More Web Proxy on the site http://driver.im/

research-article

FingerText: Exploring and Optimizing Performance for Wearable, Mobile and One-Handed Typing

Authors:

Ian OakleyAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 283, Pages 1 - 15

https://doi.org/10.1145/3411764.3445106

Published: 07 May 2021 Publication History

Abstract

Typing on wearables while situationally impaired, such as while walking, is challenging. However, while HCI research on wearable typing is diverse, existing work focuses on stationary scenarios and fine-grained input that will likely perform poorly when users are on-the-go. To address this issue we explore single-handed wearable typing using intra-hand touches between the thumb and fingers, a modality we argue will be robust to the physical disturbances inherent to input while mobile. We first examine the impact of walking on performance of these touches, noting no significant differences in accuracy or speed, then feed our study data into a multi-objective optimization process in order to design keyboard layouts (for both five and ten keys) capable of supporting rapid, accurate, comfortable, and unambiguous typing. A final study tests these layouts against QWERTY baselines and reports performance improvements of up to 10.45% WPM and 39.44% WER when users type while walking.

References

[1]

Sunggeun Ahn, Seongkook Heo, and Geehyuk Lee. 2017. Typing on a Smartwatch for Smart Glasses. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS ’17). Association for Computing Machinery, New York, NY, USA, 201–209. https://doi.org/10.1145/3132272.3134136

Digital Library

[2]

Joanna Bergstrom-Lehtovirta, Antti Oulasvirta, and Stephen Brewster. 2011. The Effects of Walking Speed on Target Acquisition on a Touchscreen Interface. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/2037373.2037396

Digital Library

[3]

Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge, and Shumin Zhai. 2012. Bimanual Gesture Keyboard. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 137–146. https://doi.org/10.1145/2380116.2380136

Digital Library

[4]

Xiaojun Bi, Barton A. Smith, and Shumin Zhai. 2010. Quasi-Qwerty Soft Keyboard Optimization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 283–286. https://doi.org/10.1145/1753326.1753367

Digital Library

[5]

Xiaojun Bi and Shumin Zhai. 2016. IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 49–58. https://doi.org/10.1145/2858036.2858421

Digital Library

[6]

J. Blank and K. Deb. 2020. Pymoo: Multi-Objective Optimization in Python. IEEE Access 8(2020), 89497–89509.

[7]

J. Blank and K. Deb. 2020. A Running Performance Metric and Termination Criterion for Evaluating Evolutionary Multi- and Many-objective Optimization Algorithms. In 2020 IEEE Congress on Evolutionary Computation (CEC). 1–8.

[8]

Roger Boldu, Alexandru Dancu, Denys J.C. Matthies, Pablo Gallego Cascón, Shanaka Ransir, and Suranga Nanayakkara. 2018. Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity. In Proceedings of the Symposium on Spatial User Interaction (Berlin, Germany) (SUI ’18). Association for Computing Machinery, New York, NY, USA, 150–157. https://doi.org/10.1145/3267782.3267796

Digital Library

[9]

Thorsten Brants and Alex Franz. 2006. Web 1T 5-gram Version 1. http://www. ldc. upenn. edu/Catalog/CatalogEntry. jsp? catalogId= LDC2006T13(2006).

[10]

Brian X Chen. 2019. Texting While Walking Is Dangerous. Here’s How to Stop.The New York Times (Nov 2019). https://www.nytimes.com/2019/11/13/technology/personaltech/distracted-walking-twalking.html

[11]

James Clawson, Thad Starner, Daniel Kohlsdorf, David P. Quigley, and Scott Gilliland. 2014. Texting While Walking: An Evaluation of Mini-Qwerty Text Input While on-the-Go. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services (Toronto, ON, Canada) (MobileHCI ’14). Association for Computing Machinery, New York, NY, USA, 339–348. https://doi.org/10.1145/2628363.2628408

Digital Library

[12]

K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 2(2002), 182–197.

Digital Library

[13]

David Dobbelstein, Gabriel Haas, and Enrico Rukzio. 2017. The Effects of Mobility, Encumbrance, and (Non-)Dominant Hand on Interaction with Smartwatches. In Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (ISWC ’17). Association for Computing Machinery, New York, NY, USA, 90–93. https://doi.org/10.1145/3123021.3123033

Digital Library

[14]

Mark Dunlop and Andrew Crossan. 2000. Predictive Text Entry Methods for Mobile Phones. Personal Technologies 4 (08 2000). https://doi.org/10.1007/BF01324120

[15]

Jacqui Fashimpaur, Kenrick Kin, and Matt Longest. 2020. PinchType: Text Entry for Virtual and Augmented Reality Using Comfortable Thumb to Fingertip Pinches. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3334480.3382888

Digital Library

[16]

Anna Maria Feit. 2018. Assignment Problems for Optimizing Text Input. Ph.D. Dissertation. Aalto University. http://urn.fi/URN:ISBN:978-952-60-8016-1

[17]

Leah Findlater and Jacob Wobbrock. 2012. Personalized Input: Improving Ten-Finger Touchscreen Typing through Automatic Adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 815–824. https://doi.org/10.1145/2207676.2208520

Digital Library

[18]

Gene V Glass, Percy D. Peckham, and James R. Sanders. 1972. Consequences of Failure to Meet Assumptions Underlying the Fixed Effects Analyses of Variance and Covariance. Review of Educational Research 42, 3 (1972), 237–288. https://doi.org/10.3102/00346543042003237 arXiv:https://doi.org/10.3102/00346543042003237

[19]

Jun Gong, Zheer Xu, Qifan Guo, Teddy Seyed, Xiang ’Anthony’ Chen, Xiaojun Bi, and Xing-Dong Yang. 2018. WrisText: One-Handed Text Entry on Smartwatch Using Wrist Gestures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173755

Digital Library

[20]

Jun Gong, Xing-Dong Yang, and Pourang Irani. 2016. WristWhirl: One-Handed Continuous Smartwatch Input Using Wrist Gestures. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 861–872. https://doi.org/10.1145/2984511.2984563

Digital Library

[21]

Tovi Grossman, Xiang Anthony Chen, and George Fitzmaurice. 2015. Typing on Glasses: Adapting Text Entry to Smart Eyewear. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services(Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 144–152. https://doi.org/10.1145/2785830.2785867

Digital Library

[22]

Aakar Gupta and Ravin Balakrishnan. 2016. DualKey: Miniature Screen Text Entry via Finger Identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 59–70. https://doi.org/10.1145/2858036.2858052

Digital Library

[23]

Aakar Gupta, Cheng Ji, Hui-Shyong Yeo, Aaron Quigley, and Daniel Vogel. 2019. RotoSwype: Word-Gesture Typing Using a Ring. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300244

Digital Library

[24]

Jibo He, Jason S. McCarley, Kirsten Crager, Murtuza Jadliwala, Lesheng Hua, and Sheng Huang. 2018. Does wearable device bring distraction closer to drivers? Comparing smartphones and Google Glass. Applied Ergonomics 70(2018), 156 – 166. https://doi.org/10.1016/j.apergo.2018.02.022

[25]

Eve Hoggan, Stephen A. Brewster, and Jody Johnston. 2008. Investigating the Effectiveness of Tactile Feedback for Mobile Touchscreens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 1573–1582. https://doi.org/10.1145/1357054.1357300

Digital Library

[26]

Joggi Hong, Seongkook Heo, Poika Isokoski, and Geehyuk Lee. 2016. Comparison of Three QWERTY Keyboards for a Smartwatch. Interacting with Computers 28, 6 (10 2016), 811–825. https://doi.org/10.1093/iwc/iww003 arXiv:https://academic.oup.com/iwc/article-pdf/28/6/811/7920055/iww003.pdf

[27]

Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1526–1537. https://doi.org/10.1145/2858036.2858483

Digital Library

[28]

Hayeon Jeong, Heepyung Kim, Rihun Kim, Uichin Lee, and Yong Jeong. 2017. Smartwatch Wearing Behavior Analysis: A Longitudinal Study. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 60 (Sept. 2017), 31 pages. https://doi.org/10.1145/3131892

Digital Library

[29]

Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, and Feng Chen. 2019. Hifinger: One-handed text entry technique for virtual environments based on touches between fingers. Sensors 19, 14 (2019), 3063.

[30]

Shaun K. Kane, Jacob O. Wobbrock, and Ian E. Smith. 2008. Getting off the Treadmill: Evaluating Walking User Interfaces for Mobile Devices in Public Spaces(MobileHCI ’08). Association for Computing Machinery, New York, NY, USA, 109–118. https://doi.org/10.1145/1409240.1409253

Digital Library

[31]

Hsin-Liu (Cindy) Kao, Artem Dementyev, Joseph A. Paradiso, and Chris Schmandt. 2015. NailO: Fingernails as an Input Surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3015–3018. https://doi.org/10.1145/2702123.2702572

Digital Library

[32]

Andreas Karrenbauer and Antti Oulasvirta. 2014. Improvements to Keyboard Optimization with Integer Programming. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 621–626. https://doi.org/10.1145/2642918.2647382

Digital Library

[33]

Keiko Katsuragawa, Ju Wang, Ziyang Shan, Ningshan Ouyang, Omid Abari, and Daniel Vogel. 2019. Tip-Tap: Battery-Free Discrete 2D Fingertip Input. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 1045–1057. https://doi.org/10.1145/3332165.3347907

Digital Library

[34]

Junhyeok Kim, William Delamare, and Pourang Irani. 2018. ThumbText: Text Entry for Wearable Devices Using a Miniature Ring. In Proceedings of Graphics Interface 2018 (Toronto, Ontario) (GI 2018). Canadian Human-Computer Communications Society / Société canadienne du dialogue humain-machine, 18 – 25. https://doi.org/10.20380/GI2018.04

Digital Library

[35]

Andreas Komninos and Mark Dunlop. 2014. Using a smart-watch as a input device for text. IEEE Pervasive Computing 13 (01 2014).

[36]

DoYoung Lee, SooHwan Lee, and Ian Oakley. 2020. Nailz: Sensing Hand Input with Touch Sensitive Nails. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376778

Digital Library

[37]

DoYoung Lee, Youryang Lee, Yonghwan Shin, and Ian Oakley. 2018. Designing Socially Acceptable Hand-to-Face Input. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 711–723. https://doi.org/10.1145/3242587.3242642

Digital Library

[38]

Lik Hang Lee, Kit Yung Lam, Tong Li, Tristan Braud, Xiang Su, and Pan Hui. 2019. Quadmetric Optimized Thumb-to-Finger Interaction for Force Assisted One-Handed Text Entry on Mobile Headsets. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 94 (Sept. 2019), 27 pages. https://doi.org/10.1145/3351252

Digital Library

[39]

Luis A. Leiva, Alireza Sahami, Alejandro Catala, Niels Henze, and Albrecht Schmidt. 2015. Text Entry on Tiny QWERTY Soft Keyboards. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 669–678. https://doi.org/10.1145/2702123.2702388

Digital Library

[40]

Gregory Lesher, Bryan Moulton, and Jeffery Higginbotham. 1999. Optimal character arrangements for ambiguous keyboards. IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society 6 (01 1999), 415–23. https://doi.org/10.1109/86.736156

[41]

Haiko Luepsen. 2017. The aligned rank transform and discrete variables: A warning. Communications in Statistics - Simulation and Computation 46, 9(2017), 6923–6936. https://doi.org/10.1080/03610918.2016.1217014 arXiv:https://doi.org/10.1080/03610918.2016.1217014

[42]

I. Scott MacKenzie. [n.d.]. 2016. A note on calculating text entry speed. (2016). https://www.yorku.ca/mack/RN-TextEntrySpeed.html

[43]

I. Scott MacKenzie and Shawn X. Zhang. 1999. The Design and Evaluation of a High-Performance Soft Keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). Association for Computing Machinery, New York, NY, USA, 25–31. https://doi.org/10.1145/302979.302983

Digital Library

[44]

Donald McMillan, Barry Brown, Airi Lampinen, Moira McGregor, Eve Hoggan, and Stefania Pizza. 2017. Situating Wearables: Smartwatch Use in Context. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3582–3594. https://doi.org/10.1145/3025453.3025993

Digital Library

[45]

Sachi Mizobuchi, Mark Chignell, and David Newton. 2005. Mobile Text Entry: Relationship between Walking Speed and Text Input Task Difficulty. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services (Salzburg, Austria) (MobileHCI ’05). Association for Computing Machinery, New York, NY, USA, 122–128. https://doi.org/10.1145/1085777.1085798

Digital Library

[46]

Aske Mottelson, Christoffer Larsen, Mikkel Lyderik, Paul Strohmeier, and Jarrod Knibbe. 2016. Invisiboard: Maximizing Display and Input Space with a Full Screen Text Entry Method for Smartwatches. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 53–59. https://doi.org/10.1145/2935334.2935360

Digital Library

[47]

Josip Musić and Roderick Murray-Smith. 2016. Nomadic Input on Mobile Devices: The Influence of Touch Input Technique and Walking Speed on Performance and Offset Modeling. Human–Computer Interaction 31, 5 (2016), 420–471. https://doi.org/10.1080/07370024.2015.1071195 arXiv:https://doi.org/10.1080/07370024.2015.1071195

Digital Library

[48]

Alexander Ng, John Williamson, and Stephen Brewster. 2015. The Effects of Encumbrance and Mobility on Touch-Based Gesture Interactions for Mobile Phones. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 536–546. https://doi.org/10.1145/2785830.2785853

Digital Library

[49]

Peter Norvig. 2009. Natural language corpus data. Beautiful data (2009), 219–242.

[50]

D. R. O’Day and R. A. Calix. 2013. Text message corpus: Applying natural language processing to mobile device forensics. In 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW). 1–6.

[51]

Stephen Oney, Chris Harrison, Amy Ogan, and Jason Wiese. 2013. ZoomBoard: A Diminutive Qwerty Soft Keyboard Using Iterative Zooming for Ultra-Small Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2799–2802. https://doi.org/10.1145/2470654.2481387

Digital Library

[52]

Antti Oulasvirta, Anna Reichel, Wenbin Li, Yan Zhang, Myroslav Bachynskyi, Keith Vertanen, and Per Ola Kristensson. 2013. Improving Two-Thumb Text Entry on Touchscreen Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2765–2774. https://doi.org/10.1145/2470654.2481383

Digital Library

[53]

Roberto Refinetti. 1996. Demonstrating the Consequences of Violations of Assumptions in between-Subjects Analysis of Variance. Teaching of Psychology 23, 1 (1996), 51–54. https://doi.org/10.1207/s15328023top2301_14

[54]

Rufat Rzayev, Paweł W. Woundefinedniak, Tilman Dingler, and Niels Henze. 2018. Reading on Smart Glasses: The Effect of Text Position, Presentation Type and Walking. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3173574.3173619

Digital Library

[55]

Tomoki Shibata, Daniel Afergan, Danielle Kong, Beste F. Yuksel, I. Scott MacKenzie, and Robert J.K. Jacob. 2016. DriftBoard: A Panning-Based Text Entry Technique for Ultra-Small Touchscreens. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 575–582. https://doi.org/10.1145/2984511.2984591

Digital Library

[56]

Miika Silfverberg, I. Scott MacKenzie, and Panu Korhonen. 2000. Predicting Text Entry Speed on Mobile Phones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands) (CHI ’00). Association for Computing Machinery, New York, NY, USA, 9–16. https://doi.org/10.1145/332040.332044

Digital Library

[57]

Gaganpreet Singh, William Delamare, and Pourang Irani. 2018. D-SWIME: A Design Space for Smartwatch Interaction Techniques Supporting Mobility and Encumbrance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174208

Digital Library

[58]

Brian A. Smith, Xiaojun Bi, and Shumin Zhai. 2015. Optimizing Touchscreen Keyboards for Gesture Typing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3365–3374. https://doi.org/10.1145/2702123.2702357

Digital Library

[59]

Mohamed Soliman, Franziska Mueller, Lena Hegemann, Joan Sol Roo, Christian Theobalt, and Jürgen Steimle. 2018. FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces(Tokyo, Japan) (ISS ’18). Association for Computing Machinery, New York, NY, USA, 177–187. https://doi.org/10.1145/3279778.3279799

Digital Library

[60]

Despina Stavrinos, Katherine W Byington, and David C Schwebel. 2011. Distracted walking: cell phones increase injury risk for college pedestrians. Journal of safety research 42, 2 (2011), 101–107.

[61]

Craig Stewart, Michael Rohs, Sven Kratz, and Georg Essl. 2010. Characteristics of Pressure-Based Input for Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 801–810. https://doi.org/10.1145/1753326.1753444

Digital Library

[62]

Colton Turner, Barbara Chaparro, and Jibo He. 2020. Typing on a Smartwatch While Mobile: A Comparison of Input Methods. Human Factors: The Journal of the Human Factors and Ergonomics Society (02 2020), 001872081989129. https://doi.org/10.1177/0018720819891291

[63]

Katia Vega and Hugo Fuks. 2014. Beauty Tech Nails: Interactive Technology at Your Fingertips. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction(Munich, Germany) (TEI ’14). Association for Computing Machinery, New York, NY, USA, 61–64. https://doi.org/10.1145/2540930.2540961

Digital Library

[64]

Keith Vertanen and Per Kristensson. 2019. Mining, analyzing, and modeling text written on mobile devices. Natural Language Engineering (10 2019), 1–33. https://doi.org/10.1017/S1351324919000548

[65]

Keith Vertanen and Per Ola Kristensson. 2011. A Versatile Dataset for Text Entry Evaluations Based on Genuine Mobile Emails. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI ’11). Association for Computing Machinery, New York, NY, USA, 295–298. https://doi.org/10.1145/2037373.2037418

Digital Library

[66]

Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y. Chen. 2015. PalmType: Using Palms as Keyboards for Smart Glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services(Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 153–160. https://doi.org/10.1145/2785830.2785886

Digital Library

[67]

Dirk Wenig, Johannes Schöning, Alex Olwal, Mathias Oben, and Rainer Malaka. 2017. WatchThru: Expanding Smartwatch Displays with Mid-Air Visuals and Wrist-Worn Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 716–721. https://doi.org/10.1145/3025453.3025852

Digital Library

[68]

Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 113 (Sept. 2017), 21 pages. https://doi.org/10.1145/3130978

Digital Library

[69]

Jacob O. Wobbrock. 2019. Situationally-Induced Impairments and Disabilities. Springer London, London, 59–92. https://doi.org/10.1007/978-1-4471-7440-0_5

[70]

Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963

Digital Library

[71]

Pui Chung Wong, Kening Zhu, and Hongbo Fu. 2018. FingerT9: Leveraging Thumb-to-Finger Interaction for Same-Side-Hand Text Entry on Smartwatches. Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3173574.3173752

Digital Library

[72]

Robert Xiao, Julia Schwarz, and Chris Harrison. 2015. Estimating 3D Finger Angle on Commodity Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). Association for Computing Machinery, New York, NY, USA, 47–50. https://doi.org/10.1145/2817721.2817737

Digital Library

[73]

Zheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo, Te-Yen Wu, Jun Gong, Sicheng Yin, Jialun Zhai, and Xing-Dong Yang. 2020. BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376306

Digital Library

[74]

Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, and Xing-Dong Yang. 2019. TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 883–899. https://doi.org/10.1145/3332165.3347865

Digital Library

[75]

Xin Yi, Chun Yu, Weijie Xu, Xiaojun Bi, and Yuanchun Shi. 2017. COMPASS: Rotational Keyboard on Non-Touch Smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 705–715. https://doi.org/10.1145/3025453.3025454

Digital Library

[76]

Xin Yi, Chun Yu, Mingrui Zhang, Sida Gao, Ke Sun, and Yuanchun Shi. 2015. ATK: Enabling Ten-Finger Freehand Typing in Air Based on 3D Hand Tracking Data. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology(Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 539–548. https://doi.org/10.1145/2807442.2807504

Digital Library

[77]

Chun Yu, Ke Sun, Mingyuan Zhong, Xincheng Li, Peijun Zhao, and Yuanchun Shi. 2016. One-Dimensional Handwriting: Inputting Letters and Words on Smart Glasses. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 71–82. https://doi.org/10.1145/2858036.2858542

Digital Library

[78]

Shumin Zhai, Michael Hunter, and Barton A. Smith. 2002. Performance Optimization of Virtual Keyboards. Human–Computer Interaction 17, 2-3 (2002), 229–269. https://doi.org/10.1080/07370024.2002.9667315 arXiv:https://www.tandfonline.com/doi/pdf/10.1080/07370024.2002.9667315

[79]

Shumin Zhai and Per Ola Kristensson. 2008. Interlaced QWERTY: Accommodating Ease of Visual Search and Input Flexibility in Shape Writing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 593–596. https://doi.org/10.1145/1357054.1357149

Digital Library

[80]

Shengdong Zhao, Pierre Dragicevic, Mark Chignell, Ravin Balakrishnan, and Patrick Baudisch. 2007. Earpod: Eyes-Free Menu Selection Using Touch Input and Reactive Audio Feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 1395–1404. https://doi.org/10.1145/1240624.1240836

Digital Library

Cited By

Chu QChen CHu HWu XHan B(2024)iHand: Hand Recognition-Based Text Input Method for Wearable DevicesComputers10.3390/computers1303008013:3(80)Online publication date: 19-Mar-2024
https://doi.org/10.3390/computers13030080
Alistar MAl-Naimi LMohammadi SDavid STung JLazaro Vasquez EKostakos VKay JHoang T(2024)Exploring the Affordances of Bio-Electronic NailsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681952(360-365)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3681952
Park YKim JOakley IKostakos VKay JHoang T(2024)The Impact of Gaze and Hand Gesture Complexity on Gaze-Pinch Interaction PerformancesCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678990(622-626)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678990
Show More Cited By

Index Terms

FingerText: Exploring and Optimizing Performance for Wearable, Mobile and One-Handed Typing
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Index terms have been assigned to the content through auto-classification.

Recommendations

The Tap Strap 2: Evaluating Performance of One-Handed Wearable Keyboard and Mouse
HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence
Abstract
This paper presents an evaluation of Tap Strap 2, a one-handed wearable keyboard that uses tap combinations to type characters. The purpose of the Tap Strap 2 is to give the user a portable keyboard that is easier to use for mobile devices than ...
Demonstration of PocketThumb: a wearable dual-sided touch interface for cursor-based control of smart-eyewear
UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers

We demonstrate PocketThumb, a wearable touch interface for smart-eyewear that is embedded into the fabrics of the front trouser pocket. The interface is reachable from outside and inside of the pocket to allow for a combined dual-sided touch input. The ...
PocketThumb: a Wearable Dual-Sided Touch Interface for Cursor-based Control of Smart-Eyewear

We present PocketThumb, a wearable touch interface for smart-eyewear that is embedded into the fabrics of the front trouser pocket. The interface is reachable from outside and inside of the pocket to allow for a combined dual-sided touch input. The user ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Research Foundation of Korea

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
1,003
Total Downloads

Downloads (Last 12 months)209
Downloads (Last 6 weeks)17

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chu QChen CHu HWu XHan B(2024)iHand: Hand Recognition-Based Text Input Method for Wearable DevicesComputers10.3390/computers1303008013:3(80)Online publication date: 19-Mar-2024
https://doi.org/10.3390/computers13030080
Alistar MAl-Naimi LMohammadi SDavid STung JLazaro Vasquez EKostakos VKay JHoang T(2024)Exploring the Affordances of Bio-Electronic NailsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681952(360-365)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3681952
Park YKim JOakley IKostakos VKay JHoang T(2024)The Impact of Gaze and Hand Gesture Complexity on Gaze-Pinch Interaction PerformancesCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678990(622-626)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678990
Zhang HLiang XLei YChen YHe ZZhang YChen LLin HHan TTian F(2024)Understanding the Effects of Restraining Finger Coactivation in Mid-Air Typing: from a Neuromechanical PerspectiveProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676441(1-18)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676441
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Liu ZLiu XWang L(2024)CrossKeys: Text Entry for Virtual Reality Using a Single Controller via Wrist RotationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2358456(1-13)Online publication date: 5-Jun-2024
https://doi.org/10.1080/10447318.2024.2358456
Komninos AStefanis VGarofalakis J(2023)A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind PersonsMultimodal Technologies and Interaction10.3390/mti70200227:2(22)Online publication date: 17-Feb-2023
https://doi.org/10.3390/mti7020022
Kounalaki MSimou IKomninos A(2023)Pseudo-haptic and Self-haptic Feedback During VR Text EntryProceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter10.1145/3609987.3610002(1-8)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3609987.3610002
Kitamura RYamamoto TSugiura Y(2023)TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective SensorsProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611371(92-97)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611371
Johns CEvangelista Belo JFeit AKlokmose CPfeuffer K(2023)Towards Flexible and Robust User Interface Adaptations With Multiple ObjectivesProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606799(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606799
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents