More Web Proxy on the site http://driver.im/

research-article

How to communicate new input techniques

Authors:

Adrian Lanksweirt,

Niels HenzeAuthors Info & Claims

NordiCHI '18: Proceedings of the 10th Nordic Conference on Human-Computer Interaction

Pages 460 - 472

https://doi.org/10.1145/3240167.3240176

Published: 29 September 2018 Publication History

Abstract

Touchscreens are among the most ubiquitous input technologies. Commercial devices typically limit the input to 2D touch points. While a body of work enhances the interaction through finger recognition and diverse gestures, advanced input techniques have had a limited commercial impact. A major challenge is explaining new input techniques to users. In this paper, we investigate how to communicate novel input techniques for smartphones. Through interviews with 12 Ux experts, we identified three potential approaches: Depiction uses an icon to visualize the input technique, Pop-up shows a modal dialog when the input technique is available, and Tutorial explains all available input techniques in a centralized way. To understand which approach is most preferred by users we conducted a study with 36 participants that introduced novel techniques using one of the communication methods. While Depiction was preferred, we found that the approach should be selected based on the complexity of the interaction, novelty to the user, and the device size.

References

[1]

Oscar Kin-Chung Au and Chiew-Lan Tai. 2010. Multitouch Finger Registration and Its Applications. In Proceedings of the 22Nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction (OZCHI '10). ACM, New York, NY, USA, 41--48.

Digital Library

[2]

Hrvoje Benko, T. Scott Saponas, Dan Morris, and Desney Tan. 2009. Enhancing Input on and Above the Interactive Surface with Muscle Sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 93--100.

Digital Library

[3]

Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative Hci Research: Going Behind the Scenes. Morgan & Claypool Publishers. 1--115 pages.

[4]

Matthias Böhmer, Brent Hecht, Johannes Schöning, Antonio Krüger, and Gernot Bauer. 2011. Falling Asleep with Angry Birds, Facebook and Kindle: A Large Scale Study on Mobile Application Usage. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 47--56.

Digital Library

[5]

John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.

[6]

Ashley Colley and Jonna Häkkilä. 2014. Exploring Finger Specific Touch Screen Interaction for Mobile Phone User Interfaces. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (OzCHI '14). ACM, New York, NY, USA, 539--548.

Digital Library

[7]

Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies - why and how. Knowledge-Based Systems 6, 4 (1993), 258--266. Special Issue: Intelligent User Interfaces.

Digital Library

[8]

Alexander De Luca, Emanuel von Zezschwitz, Ngo Dieu Huong Nguyen, Max-Emanuel Maurer, Elisa Rubegni, Marcello Paolo Scipioni, and Marc Langheinrich. 2013. Back-of-device Authentication on Smartphones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2389--2398.

Digital Library

[9]

Philipp Ewerling, Alexander Kulik, and Bernd Froehlich. 2012. Finger and Hand Detection for Multi-touch Interfaces Based on Maximally Stable Extremal Regions. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY,USA, 173--182.

Digital Library

[10]

Emilien Ghomi, Stéphane Huot, Olivier Bau, Michel Beaudouin-Lafon, and Wendy E. Mackay. 2013. ArpèGe: Learning Multitouch Chord Gestures Vocabularies. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, New York, NY, USA, 209--218.

Digital Library

[11]

Alix Goguey, Géry Casiez, Daniel Vogel, and Carl Gutwin. 2018. Characterizing Finger Pitch and Roll Orientation During Atomic Touch Actions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 589, 12 pages.

Digital Library

[12]

Aakar Gupta, Muhammed Anwar, and Ravin Balakrishnan. 2016. Porous Interfaces for Small Screen Multitasking Using Finger Identification. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 145--156.

Digital Library

[13]

Aakar Gupta and Ravin Balakrishnan. 2016. DualKey: Miniature Screen Text Entry via Finger Identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 59--70.

Digital Library

[14]

Jefferson Y. Han. 2005. Low-cost Multi-touch Sensing Through Frustrated Total Internal Reflection. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). ACM, New York, NY, USA, 115--118.

Digital Library

[15]

Gunnar Harboe and Elaine M. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 95--104.

Digital Library

[16]

Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: Enhancing Finger Interaction on Touch Surfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 627--636.

Digital Library

[17]

Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Mensch & Computer 2003. Springer, 187--196.

[18]

Jose L. Hernandez-Rebollar, Nicholas Kyriakopoulos, and Robert W. Lindeman. 2002a. The AcceleGlove: A Whole-hand Input Device for Virtual Reality. In ACM SIGGRAPH 2002 Conference Abstracts and Applications (SIGGRAPH '02). ACM, New York, NY, USA, 259--259.

Digital Library

[19]

Jose L. Hernandez-Rebollar, Robert W. Lindeman, and Nicholas Kyriakopoulos. 2002b. A Multi-Class Pattern Recognition System for Practical Finger Spelling Translation. In Proceedings of the 4th IEEE International Conference on Multimodal Interfaces (ICMI '02). IEEE Computer Society, Washington, DC, USA, 185--.

Digital Library

[20]

David Holman, Andreas Hollatz, Amartya Banerjee, and Roel Vertegaal. 2013. Unifone: Designing for Auxiliary Finger Input in One-handed Mobile Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 177--184.

Digital Library

[21]

Min-Chieh Hsiu, Chiuan Wang, Da-Yuan Huang, Jhe-Wei Lin, Yu-Chih Lin, De-Nian Yang, Yi-ping Hung, and Mike Chen. 2016. Nail+: Sensing Fingernail Deformation to Detect Finger Force Touch Interactions on Rigid Surfaces. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 1--6.

Digital Library

[22]

Da-Yuan Huang, Ming-Chang Tsai, Ying-Chao Tung, Min-Lun Tsai, Yen-Ting Yeh, Liwei Chan, Yi-Ping Hung, and Mike Y. Chen. 2014. TouchSense: Expanding Touchscreen Input Vocabulary Using Different Areas of Users' Finger Pads. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY,USA, 189--192.

Digital Library

[23]

Sven Kratz, Patrick Chiu, and Maribeth Back. 2013. PointPose: Finger Pose Estimation for Touch Input on Mobile Devices Using a Depth Sensor. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, New York, NY, USA, 223--230.

Digital Library

[24]

Myron W. Krueger, Thomas Gionfriddo, and Katrin Hinrichsen. 1985. VIDEOPLACE - an Artificial Reality. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '85). ACM, New York, NY, USA, 35--40.

Digital Library

[25]

Huy Viet Le, Sven Mayer, and Niels Henze. 2018. InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones. In Proceedings of the 31th Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 13.

Digital Library

[26]

Pedro Lopes, Ricardo Jota, and Joaquim A. Jorge. 2011. Augmenting Touch Interaction Through Acoustic Sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, New York, NY,USA, 53--56.

Digital Library

[27]

Nicolai Marquardt, Johannes Kiemer, David Ledo, Sebastian Boring, and Saul Greenberg. 2011. Designing User-, Hand-, and Handpart-aware Tabletop Interactions with the TouchID Toolkit. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, New York, NY, USA, 21--30.

Digital Library

[28]

Damien Masson, Alix Goguey, Sylvain Malacria, and Géry Casiez. 2017. WhichFingers: Identifying Fingers on Touch Surfaces and Keyboards Using Vibration Sensors. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 41--48.

Digital Library

[29]

Sven Mayer, Perihan Gad, Katrin Wolf, Paweł W. Woźniak, and Niels Henze. 2017a. Understanding the Ergonomic Constraints in Designing for Touch Surfaces. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, Article 33, 9 pages.

Digital Library

[30]

Sven Mayer, Huy Viet Le, and Niels Henze. 2017b. Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, Brighton, United Kingdom, 220--229.

Digital Library

[31]

Sven Mayer, Huy Viet Le, and Niels Henze. 2018. Designing Finger Orientation Input for Mobile Touchscreens. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI'18). ACM, New York, NY, USA, 9.

Digital Library

[32]

Sven Mayer, Michael Mayer, and Niels Henze. 2017. Feasibility Analysis of Detecting the Finger Orientation with Depth Cameras. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI' 17). ACM, New York, NY, USA, 82:1--82:8.

Digital Library

[33]

Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 297--306.

Digital Library

[34]

Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic Books (AZ).

Digital Library

[35]

Simon Rogers, John Williamson, Craig Stewart, and Roderick Murray-Smith. 2011b. AnglePose: Robust, Precise Capacitive Touch Tracking via 3D Orientation Estimation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2575--2584.

Digital Library

[36]

Yvonne Rogers, Helen Sharp, and Jenny Preece. 2011a. Interaction design: beyond human-computer interaction. John Wiley & Sons.

Digital Library

[37]

Anne Roudaut, Eric Lecolinet, and Yves Guiard. 2009. MicroRolls: Expanding Touch-screen Input Vocabulary by Distinguishing Rolls vs. Slides of the Thumb. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 927--936.

Digital Library

[38]

Dean Rubine. 1992. Combining Gestures and Direct Manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). ACM, New York, NY, USA, 659--660.

Digital Library

[39]

Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined Motion Gestures for Mobile Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 197--206.

Digital Library

[40]

Jeff Sauro and James R Lewis. 2016. Quantifying the user experience: Practical statistics for user research. Morgan Kaufmann.

Digital Library

[41]

Ben Shneiderman, Catherine Plaisant, Maxine Cohen, Steven Jacobs, Niklas Elmqvist, and Nicholas Diakopoulos. 2016. Designing the User Interface: Strategies for Effective Human-Computer Interactio (6th ed.). Pearson.

Digital Library

[42]

Yoshiki Takeoka, Takashi Miyaki, and Jun Rekimoto. 2010. Z-touch: An Infrastructure for 3D Gesture Interaction in the Proximity of Tabletop Surfaces. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 91--94.

Digital Library

[43]

Katia Vega and Hugo Fuks. 2013. Beauty Tech Nails: Interactive Technology at Your Fingertips. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 61--64.

Digital Library

[44]

Feng Wang, Xiang Cao, Xiangshi Ren, and Pourang Irani. 2009. Detecting and Leveraging Finger Orientation for Interaction with Direct-touch Surfaces. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). ACM, New York, NY, USA, 23--32.

Digital Library

[45]

Feng Wang and Xiangshi Ren. 2009. Empirical Evaluation for Finger Input Properties in Multi-touch Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1063--1072.

Digital Library

[46]

Jingtao Wang and John Canny. 2004. FingerSense: Augmenting Expressiveness to Physical Pushing Button by Fingertip Identification. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, New York, NY, USA, 1267--1270.

Digital Library

[47]

Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 143--146.

Digital Library

[48]

Robert Xiao, Julia Schwarz, and Chris Harrison. 2015. Estimating 3D Finger Angle on Commodity Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 47--50.

Digital Library

[49]

Jingjie Zheng and Daniel Vogel. 2016. Finger-Aware Shortcuts. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4274--4285.

Digital Library

Cited By

Mackamul ECasiez GMalacria S(2024)Clarifying and differentiating discoverabilityHuman–Computer Interaction10.1080/07370024.2024.2364606(1-26)Online publication date: 13-Jun-2024
https://doi.org/10.1080/07370024.2024.2364606
Urdaneta CRodríguez-Almanza JCortés-Rico L(2023)SensorMov, biblioteca nativa para interacciones tangibles con dispositivos AndroidTecnoLógicas10.22430/22565337.244626:56(e2446)Online publication date: 14-Mar-2023
https://doi.org/10.22430/22565337.2446
Lambert VChaffangeon Caillet AGoguey AMalacria SNigay L(2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604272
Show More Cited By

Recommendations

InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Smartphones are the most successful mobile devices and offer intuitive interaction through touchscreens. Current devices treat all fingers equally and only sense touch contacts on the front of the device. In this paper, we present InfiniTouch, the first ...
Designing finger orientation input for mobile touchscreens
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

A large number of today's systems use interactive touch surfaces as the main input channel. Current devices reduce the richness of touch input to two-dimensional positions on the screen. A growing body of work develops methods that enrich touch input to ...
Investigating the feasibility of finger identification on capacitive touchscreens using deep learning
IUI '19: Proceedings of the 24th International Conference on Intelligent User Interfaces

Touchscreens enable intuitive mobile interaction. However, touch input is limited to 2D touch locations which makes it challenging to provide shortcuts and secondary actions similar to hardware keyboards and mice. Previous work presented a wide range of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '18: Proceedings of the 10th Nordic Conference on Human-Computer Interaction

September 2018

1002 pages

ISBN:9781450364379

DOI:10.1145/3240167

General Chairs:
Tone Bratteteig
University of Oslo
,
Frode Eika Sandnes
Oslo Metropolitan University
,
Publications Chair:
Gerd Berget
Oslo Metropolitan University

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 September 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

NordiCHI'18

NordiCHI'18: Nordic Conference on Human-Computer Interaction

September 29 - October 3, 2018

Oslo, Norway

Acceptance Rates

NordiCHI '18 Paper Acceptance Rate 59 of 240 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
367
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mackamul ECasiez GMalacria S(2024)Clarifying and differentiating discoverabilityHuman–Computer Interaction10.1080/07370024.2024.2364606(1-26)Online publication date: 13-Jun-2024
https://doi.org/10.1080/07370024.2024.2364606
Urdaneta CRodríguez-Almanza JCortés-Rico L(2023)SensorMov, biblioteca nativa para interacciones tangibles con dispositivos AndroidTecnoLógicas10.22430/22565337.244626:56(e2446)Online publication date: 14-Mar-2023
https://doi.org/10.22430/22565337.2446
Lambert VChaffangeon Caillet AGoguey AMalacria SNigay L(2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604272
Mackamul ECasiez GMalacria S(2023)Exploring Visual Signifier Characteristics to Improve the Perception of Affordances of In-Place Touch InputsProceedings of the ACM on Human-Computer Interaction10.1145/36042577:MHCI(1-32)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604257
Lambert V(2023)Representing microgestures interaction for wearable computingProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3609740(1-4)Online publication date: 26-Sep-2023
https://dl.acm.org/doi/10.1145/3565066.3609740
Stiegemeier DBringeland SKraus JBaumann MJi YJeon M(2022)User Experience of In-Vehicle Gesture Interaction: Exploring the Effect of Autonomy and Competence in a Mock-Up ExperimentProceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3543174.3546847(285-296)Online publication date: 17-Sep-2022
https://dl.acm.org/doi/10.1145/3543174.3546847
Mackamul E(2022)Improving the Discoverability of Interactions in Interactive SystemsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503813(1-5)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503813
Fennedy KSrivastava AMalacria SPerrault S(2022)Towards a Unified and Efficient Command Selection Mechanism for Touch-Based Devices Using Soft Keyboard HotkeysACM Transactions on Computer-Human Interaction10.1145/347651029:1(1-39)Online publication date: 7-Jan-2022
https://dl.acm.org/doi/10.1145/3476510
Vogelsang JKiss FMayer S(2021)A Design Space for User Interface Elements using Finger Orientation InputProceedings of Mensch und Computer 202110.1145/3473856.3473862(1-10)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3473862
Ikematsu KYamanaka S(2020)ScraTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34118314:3(1-19)Online publication date: 4-Sep-2020
https://dl.acm.org/doi/10.1145/3411831
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents