[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3491102.3502079acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

More Errors vs. Longer Commands: The Effects of Repetition and Reduced Expressiveness on Input Interpretation Error, Learning, and Effort

Published: 29 April 2022 Publication History

Abstract

Many interactive systems are susceptible to misinterpreting the user’s input actions or gestures. Interpretation errors are common when systems gather a series of signals from the user and then attempt to interpret the user’s intention based on those signals – e.g., gesture identification from a touchscreen, camera, or body-worn electrodes – and previous work has shown that interpretation error can cause significant problems for learning new input commands. Error-reduction strategies from telecommunications, such as repeating a command or increasing the length of the input while reducing its expressiveness, could improve these input mechanisms – but little is known about whether longer command sequences will cause problems for users (e.g., increased effort or reduced learning). We tested performance, learning, and perceived effort in a crowd-sourced study where participants learned and used input mechanisms with different error-reduction techniques. We found that error reduction techniques are feasible, can outperform error-prone ordinary input, and do not negatively affect learning or perceived effort.

Supplemental Material

MP4 File
Video Figure
MP4 File
Video Preview

References

[1]
Caroline Appert and Shumin Zhai. 2009. Using strokes as command shortcuts. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press. https://doi.org/10.1145/1518701.1519052
[2]
Gilles Bailly, Jörg Müller, and Eric Lecolinet. 2012. Design and evaluation of finger-count interaction: Combining multitouch gestures and menus. International Journal of Human-Computer Studies 70, 10 (2012), 673–689.
[3]
Victoria Bellotti, Maribeth Back, W. Keith Edwards, Rebecca E. Grinter, Austin Henderson, and Cristina Lopes. 2002. Making sense of sensing systems. In Proceedings of the SIGCHI conference on Human factors in computing systems Changing our world, changing ourselves - CHI '02. ACM Press. https://doi.org/10.1145/503376.503450
[4]
F. Bordoni and A. D'Amico. 1990. Noise in sensors. Sensors and Actuators A: Physical 21, 1-3 (Feb. 1990), 17–24. https://doi.org/10.1016/0924-4247(90)85003-m
[5]
Martin Bossert. 1999. Channel coding for telecommunications. John Wiley & Sons, Inc.
[6]
Daniel Brand, Kevin Büchele, and Alexander Meschtscherjakov. 2016. Pointing at the HUD: Gesture interaction using a leap motion. In Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 167–172.
[7]
Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1 € filter. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. ACM Press. https://doi.org/10.1145/2207676.2208639
[8]
Steven J. Castellucci and I. Scott MacKenzie. 2008. Graffiti vs. unistrokes. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press. https://doi.org/10.1145/1357054.1357106
[9]
Jared Cechanowicz, Pourang Irani, and Sriram Subramanian. 2007. Augmenting the mouse with pressure sensitive input. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1385–1394.
[10]
Jacob Cohen. 1973. Eta-Squared and Partial Eta-Squared in Fixed Factor Anova Designs. Educational and Psychological Measurement 33, 1 (April 1973), 107–112. https://doi.org/10.1177/001316447303300111
[11]
Google Corp.[n. d.]. MediaPipe Hands. https://google.github.io/mediapipe/solutions/hands.html
[12]
Damien Coyle, Jhonatan Garcia, Abdul R Satti, and T Martin McGinnity. 2011. EEG-based continuous control of a game using a 3 channel motor imagery BCI: BCI game. In 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB). IEEE. https://doi.org/10.1109/ccmb.2011.5952128
[13]
Ali Erol, George Bebis, Mircea Nicolescu, Richard D Boyle, and Xander Twombly. 2007. Vision-based hand pose estimation: A review. Computer Vision and Image Understanding 108, 1-2 (2007), 52–73.
[14]
Paul M Fitts and Michael I Posner. 1967. Human performance.Brooks/Cole Publishing Company.
[15]
R.M. Gray. 1990. Quantization noise spectra. IEEE Transactions on Information Theory 36, 6 (1990), 1220–1244. https://doi.org/10.1109/18.59924
[16]
Carl Gutwin, Andy Cockburn, Joey Scarr, Sylvain Malacria, and Scott C Olson. 2014. Faster command selection on tablets with FastTap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2617–2626.
[17]
Susumu Harada, Jacob O Wobbrock, and James A Landay. 2011. Voice games: investigation into the use of non-speech voice input for making computer games more accessible. In IFIP Conference on Human-Computer Interaction. Springer, 11–29.
[18]
Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput. In Proceedings of the 28th international conference on Human factors in computing systems - CHI '10. ACM Press. https://doi.org/10.1145/1753326.1753394
[19]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology. Elsevier, 139–183. https://doi.org/10.1016/s0166-4115(08)62386-9
[20]
Ken Hinckley, Patrick Baudisch, Gonzalo Ramos, and Francois Guimbretiere. 2005. Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '05. ACM Press. https://doi.org/10.1145/1054972.1055035
[21]
Scott E Hudson, Chris Harrison, Beverly L Harrison, and Anthony LaMarca. 2010. Whack gestures: inexact and inattentive interaction with mobile devices. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. 109–112.
[22]
Toshiki Iso and Kenichi Yamazaki. 2006. Gait analyzer based on a cell phone with a single three-axis accelerometer. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services - MobileHCI '06. ACM Press. https://doi.org/10.1145/1152215.1152244
[23]
Robert J. K. Jacob. 1996. Human-computer interaction. Comput. Surveys 28, 1 (March 1996), 177–179. https://doi.org/10.1145/234313.234387
[24]
Aniket Kittur, Ed H. Chi, and Bongwon Suh. 2008. Crowdsourcing user studies with Mechanical Turk. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press. https://doi.org/10.1145/1357054.1357127
[25]
John W Krakauer and Reza Shadmehr. 2006. Consolidation of motor memory. Trends in neurosciences 29, 1 (2006), 58–64.
[26]
Per-Ola Kristensson and Shumin Zhai. 2004. SHARK2. In Proceedings of the 17th annual ACM symposium on User interface software and technology - UIST '04. ACM Press. https://doi.org/10.1145/1029632.1029640
[27]
Gordon Kurtenbach, Abigail Sellen, and William Buxton. 1993. An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus. Human-Computer Interaction 8, 1 (March 1993), 1–23. https://doi.org/10.1207/s15327051hci0801_1
[28]
Kevin C Lam, Carl Gutwin, Madison Klarkowski, and Andy Cockburn. 2021. The Effects of System Interpretation Errors on Learning New Input Mechanisms. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
[29]
Jinyi Long, Yuanqing Li, Hongtao Wang, Tianyou Yu, Jiahui Pan, and Feng Li. 2012. A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair. IEEE Transactions on Neural Systems and Rehabilitation Engineering 20, 5 (Sept. 2012), 720–729. https://doi.org/10.1109/tnsre.2012.2197221
[30]
Wei Lu, Zheng Tong, and Jinghui Chu. 2016. Dynamic Hand Gesture Recognition With Leap Motion Controller. IEEE Signal Processing Letters 23, 9 (Sept. 2016), 1188–1192. https://doi.org/10.1109/lsp.2016.2590470
[31]
Michelle A McSweeney. 2018. The pragmatics of text messaging: making meaning in messages. Routledge.
[32]
John V. Monaco and Charles C. Tappert. 2018. The partially observable hidden Markov model and its application to keystroke dynamics. Pattern Recognition 76 (April 2018), 449–462. https://doi.org/10.1016/j.patcog.2017.11.021
[33]
Kazuya Murao, Hayami Tobise, Tsutomu Terada, Toshiki Iso, Masahiko Tsukamoto, and Tsutomu Horikoshi. 2015. Mobile phone user authentication with grip gestures using pressure sensors. International Journal of Pervasive Computing and Communications 11, 3 (Sept. 2015), 288–301. https://doi.org/10.1108/ijpcc-03-2015-0017
[34]
Brad A Myers. 2007. A user acceptance equation for intelligent assistants. In AAAI 2007 Spring Symposium on Interaction Challenges for Intelligent Assistants.
[35]
Anton Nijholt, Danny Plass-Oude Bos, and Boris Reuderink. 2009. Turning shortcomings into challenges: Brain–computer interfaces for games. Entertainment Computing 1, 2 (April 2009), 85–94. https://doi.org/10.1016/j.entcom.2009.09.007
[36]
Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.
[37]
Rupert Ortner, Brendan Z. Allison, Gerd Korisek, Herbert Gaggl, and Gert Pfurtscheller. 2011. An SSVEP BCI to Control a Hand Orthosis for Persons With Tetraplegia. IEEE Transactions on Neural Systems and Rehabilitation Engineering 19, 1 (Feb. 2011), 1–5. https://doi.org/10.1109/tnsre.2010.2076364
[38]
R C Panicker, S Puthusserypady, and Ying Sun. 2011. An Asynchronous P300 BCI With SSVEP-Based Control State Detection. IEEE Transactions on Biomedical Engineering 58, 6 (June 2011), 1781–1788. https://doi.org/10.1109/tbme.2011.2116018
[39]
G. Pfurtscheller, G.R. Muller-Putz, A. Schlogl, B. Graimann, R. Scherer, R. Leeb, C. Brunner, C. Keinrath, F. Lee, G. Townsend, C. Vidaurre, and C. Neuper. 2006. 15 years of BCI research at graz university of technology: current projects. IEEE Transactions on Neural Systems and Rehabilitation Engineering 14, 2 (June 2006), 205–210. https://doi.org/10.1109/tnsre.2006.875528
[40]
Joey Scarr, Andy Cockburn, Carl Gutwin, and Andrea Bunt. 2012. Improving command selection with CommandMaps. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 257–266.
[41]
Joey Scarr, Andy Cockburn, Carl Gutwin, and Philip Quinn. 2011. Dips and ceilings. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11. ACM Press. https://doi.org/10.1145/1978942.1979348
[42]
K. Sobottka and I. Pitas. 1996. Face localization and facial feature extraction based on shape and color information. In Proceedings of 3rd IEEE International Conference on Image Processing. IEEE. https://doi.org/10.1109/icip.1996.560536
[43]
Adam J Sporka, Sri H Kurniawan, Murni Mahmud, and Pavel Slavík. 2006. Non-speech input and speech recognition for real-time control of computer games. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility. 213–220.
[44]
Jeffrey Stylos, Brad A. Myers, and Andrew Faulring. 2004. Citrine: providing intelligent copy-and-paste. In Proceedings of the 17th annual ACM symposium on User interface software and technology - UIST '04. ACM Press. https://doi.org/10.1145/1029632.1029665
[45]
Saiwen Wang, Jie Song, Jaime Lien, Ivan Poupyrev, and Otmar Hilliges. 2016. Interacting with Soli. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/2984511.2984565
[46]
Zhengjie Wang, Yushan Hou, Kangkang Jiang, Wenwen Dou, Chengming Zhang, Zehua Huang, and Yinjing Guo. 2019. Hand Gesture Recognition Based on Active Ultrasonic Sensing of Smartphone: A Survey. IEEE Access 7(2019), 111897–111922. https://doi.org/10.1109/access.2019.2933987
[47]
Daniel Wigdor and Ravin Balakrishnan. 2003. TiltText: using tilt for text input to mobile phones. In Proceedings of the 16th annual ACM symposium on User interface software and technology. 81–90.
[48]
Wikipedia. [n. d.]. Noisy-Channel Coding Theorem. https://en.wikipedia.org/wiki/Noisy-channel_coding_theorem
[49]
Wikipedia. [n. d.]. Repetition Code. https://en.wikipedia.org/wiki/Repetition_code
[50]
Jacob O. Wobbrock, Edward Cutrell, Susumu Harada, and I. Scott MacKenzie. 2008. An error model for pointing based on Fitts' law. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press. https://doi.org/10.1145/1357054.1357306
[51]
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11. ACM Press. https://doi.org/10.1145/1978942.1978963
[52]
Thorsten O Zander and Christian Kothe. 2011. Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general. Journal of Neural Engineering 8, 2 (March 2011), 025005. https://doi.org/10.1088/1741-2560/8/2/025005
[53]
Shumin Zhai. 2012. Foundational Issues in Touch-Surface Stroke Gesture Design — An Integrative Review. Foundations and Trends® in Human–Computer Interaction 5, 2 (2012), 97–205. https://doi.org/10.1561/1100000012
[54]
Guangtao Zhang, John Paulin Hansen, Katsumi Minakata, Alexandre Alapetite, and Zhongyu Wang. 2019. Eye-Gaze-Controlled Telepresence Robots for People with Motor Disabilities. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE. https://doi.org/10.1109/hri.2019.8673093
[55]
John Zimmerman, Anthony Tomasic, Isaac Simmons, Ian Hargraves, Ken Mohnkern, Jason Cornwell, and Robert Martin McGuire. 2007. Vio: a mixed-initiative approach to learning and automating procedural update tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '07. ACM Press. https://doi.org/10.1145/1240624.1240843

Index Terms

  1. More Errors vs. Longer Commands: The Effects of Repetition and Reduced Expressiveness on Input Interpretation Error, Learning, and Effort

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
    April 2022
    10459 pages
    ISBN:9781450391573
    DOI:10.1145/3491102
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 April 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. error correction
    2. input error
    3. input expressiveness
    4. interpretation error

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    CHI '22
    Sponsor:
    CHI '22: CHI Conference on Human Factors in Computing Systems
    April 29 - May 5, 2022
    LA, New Orleans, USA

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 242
      Total Downloads
    • Downloads (Last 12 months)48
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media