More Web Proxy on the site http://driver.im/

research-article

Uncertain text entry on mobile devices

Authors:

Keith Vertanen,

Per Ola KristenssonAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2307 - 2316

https://doi.org/10.1145/2556288.2557412

Published: 26 April 2014 Publication History

Abstract

Users often struggle to enter text accurately on touchscreen keyboards. To address this, we present a flexible decoder for touchscreen text entry that combines probabilistic touch models with a language model. We investigate two different touch models. The first touch model is based on a Gaussian Process regression approach and implicitly models the inherent uncertainty of the touching process. The second touch model allows users to explicitly control the uncertainty via touch pressure. Using the first model we show that the character error rate can be reduced by up to 7% over a baseline method, and by up to 1.3% over a leading commercial keyboard. Using the second model we demonstrate that providing users with control over input certainty reduces the amount of text users have to correct manually and increases the text entry rate.

Supplementary Material

MP4 File (p2307-sidebyside.mp4)

Download
212.36 MB

References

[1]

Bi, X., Li, Y., and Zhai, S. FFitts Law: Modeling Finger Touch with Fitts' Law. Proc. CHI '13. 1363--1372.

Digital Library

[2]

Bi, X. and Zhai, S. Bayesian Touch - A Statistical Criterion of Target Selection with Finger Touch. Proc. UIST '13. 51--60.

Digital Library

[3]

Brewster, S. A. and Hughes, M. Pressure-Based Text Entry for Mobile Devices. Proc. MobileHCI '09. 9:1--9:4.

Digital Library

[4]

Chen, T. and Kan, M. Y. Creating a Live, Public Short Message Service Corpus: the NUS SMS Corpus. Language Resources and Evaluation, 2012:1--37.

[5]

Clarkson, E. C., Patel, S. N., Pierce, J. S., and Abowd, G. D. Exploring Continuous Pressure Input for Mobile Phones. Tech. Rep. GIT-GVU-06-20, Georgia Tech, 2006.

[6]

de Jong, S., Kirkali, D., Schraffenberger, H., Jillissen, J., de Rooij, A., and Terpstra, A. One-Press Control: A Tactile Input Method for Pressure-Sensitive Computer Keyboards. Proc. CHI EA '10. 4261--4266.

Digital Library

[7]

Flemish, F. O., Adams, C. A., Conway, S. R., Goodrich, K. H., Palmer, M. T., and Schutte, P. C. The H-Metaphor as a Guideline for Vehicle Automation and Interaction. Tech. Rep. TM-2003-212672, NASA, 2003.

[8]

Goel, M., Findlater, L., and Wobbrock, J. WalkType: Using Accelerometer Data to Accomodate Situational Impairments in Mobile Touch Screen Text Entry. Proc. CHI '12. 2687--2696.

Digital Library

[9]

Goodman, J., Venolia, G., Steury, K., and Parker, C. Language Modeling for Soft Keyboards. Proc. AAAI 2002. 419--424.

Digital Library

[10]

Gunawardana, A., Paek, T., and Meek, C. Usability Guided Key-Target Resizing for Soft Keyboards. Proc. IUI '10. 111--118.

Digital Library

[11]

Henze, N., Rukzio, E., and Boll, S. Observational and Experimental Investigation of Typing Behaviour Using Virtual Keyboards for Mobile Devices. Proc. CHI '12. 2659--2668.

Digital Library

[12]

Heo, S. and Lee, G. Force Gestures: Augmenting Touch Screen Gestures with Normal and Tangential Forces. Proc. UIST '11. 621--626.

Digital Library

[13]

Hoffmann, A., Spelmezan, D., and Borchers, J. TypeRight: A Keyboard with Tactile Error Prevention. Proc. CHI '09. 2265--2268.

Digital Library

[14]

Holz, C. and Baudisch, P. The Generalized Perceived Input Point Model and How to Double Touch Accuracy by Extracting Fingerprints. Proc. CHI '10. 581--590.

Digital Library

[15]

Iwasaki, K., Miyaki, T., and Rekimoto, J. Expressive Typing: A New Way to Sense Typing Pressure and Its Applications. Proc. CHI EA '09. 4369--4374.

Digital Library

[16]

Kristensson, P. O. Five Challenges for Intelligent Text Entry Methods. AI Magazine, 30(4), 2009:85--94.

[17]

Kristensson, P. O. and Vertanen, K. Asynchronous Multimodal Text Entry using Speech and Gesture Keyboards. Proc. Interspeech 2011. 581--584.

[18]

Kristensson, P. O. and Vertanen, K. Performance Comparisons of Phrase Sets and Presentation Styles for Text Entry Evaluations. Proc. IUI '12. 29--32.

Digital Library

[19]

Kristensson, P. O. and Zhai, S. SHARK2: A Large Vocabulary Shorthand Writing System for Pen-Based Computers. Proc. UIST '04. 43--52.

Digital Library

[20]

Kristensson, P. O. and Zhai, S. Relaxing Stylus Typing Precision by Geometric Pattern Matching. Proc. IUI '05. 151--158.

Digital Library

[21]

Lui, M. and Baldwin, T. langid.py: An Off-the-shelf Language Identification Tool. Proceedings of the ACL 2012 System Demonstrations. 25--30.

Digital Library

[22]

MacKenzie, I. S. and Soukoreff, R. W. Phrase Sets for Evaluating Text Entry Techniques. Proc. CHI EA '03. 754--755.

Digital Library

[23]

McCallum, D. C., Mak, E., Irani, P., and Subramanian, S. PressureText: Pressure Input for Mobile Phone Text Entry. Proc. CHI EA '09. 4519--4524.

Digital Library

[24]

Oulasvirta, A., Reichel, A., Li, W., Zhang, Y., Bachynskzi, M., Vertanen, K., and Kristensson, P. O. Improving Two-Thumb Text Entry on Touchscreen Devices. Proc. CHI '13. 2765--2774.

Digital Library

[25]

Pohl, H. and Murray-Smith, R. Focused and Casual Interactions: Allowing Users to Vary Their Level of Engagement. Proc. CHI'13. 2223--2232.

Digital Library

[26]

Ramos, G., Boulos, M., and Balakrishnan, R. Pressure Widgets. Proc. CHI '04. 487--494.

Digital Library

[27]

Rasmussen, C. E. and Williams, C. K. I. Gaussian Processes for Machine Learning. The MIT Press, 2005.

Digital Library

[28]

Rogers, S., Williamson, J., Stewart, C., and Murray-Smith, R. FingerCloud: Uncertainty and Autonomy Handover in Capacitive Sensing. Proc. CHI '10. 577--580.

Digital Library

[29]

Rudchenko, D., Paek, T., and Badger, E. Text Text Revolution: A Game That Improves Text Entry on Mobile Touchscreen Keyboards. Proc. Pervasive '11. 206--213.

Digital Library

[30]

Schwarz, J., Hudson, S., Mankoff, J., and Wilson, A. D. A Framework for Robust and Flexible Handling of Inputs with Uncertainty. Proc. UIST '10. 47--56.

Digital Library

[31]

Shi, K., Irani, P., Gustafson, S., and Subramanian, S. PressureFish: A Method to Improve Control of Discrete Pressure-based Input. Proc. CHI '08. 1295--1298.

Digital Library

[32]

Siek, K. A., Rogers, Y., and Connelly, K. H. Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs. Proc. INTERACT'05. 267--280.

Digital Library

[33]

Srinivasan, M. A. and Chen, J. s. Human Performance in Controlling Normal Forces of Contact with Rigid Objects. Proc. ASME'93, vol. 49. 119--125.

[34]

Stewart, C., Rohs, M., Kratz, S., and Essl, G. Characteristics of Pressure-Based Input for Mobile Devices. Proc. CHI '10. 801--810.

Digital Library

[35]

Subramanian, S., Aliakseyeu, D., and Lucero, A. Multi-layer Interaction for Digital Tables. Proc. UIST '06. 269--272.

Digital Library

[36]

Vertanen, K. and Kristensson, P. O. A Versatile Dataset for Text Entry Evaluations Based on Genuine Mobile Emails. Proc. MobileHCI '11. 295--298.

Digital Library

[37]

Weir, D., Rogers, S., Murray-Smith, R., and Löchtefeld, M. A User-Specific Machine Learning Approach for Improving Touch Accuracy on Mobile Devices. Proc. UIST '12. 465--476.

Digital Library

[38]

Williamson, J. Continuous Uncertain Interaction. PhD thesis, University of Glasgow, 2006.

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Lertvittayakumjorn PCai SDou BHo CZhai S(2024)Can Capacitive Touch Images Enhance Mobile Keyboard Decoding?Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676420(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676420
Streli PRichardson MBotros FMa SWang RHolz C(2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676330
Show More Cited By

Index Terms

Uncertain text entry on mobile devices
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Bimanual text entry using game controllers: Relying on users' spatial familiarity with QWERTY

A strategy for entering text using two-handed game controllers with two analogue joysticks is proposed where the QWERTY keyboard layout is used as a spatial mnemonic. The technique is inspired by two-finger QWERTY typing where the fingers are ...
Investigating Tilt-based Gesture Keyboard Entry for Single-Handed Text Entry on Large Devices
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

The popularity of mobile devices with large screens is making single-handed interaction difficult. We propose and evaluate a novel design point around a tilt-based text entry technique which supports single handed usage. Our technique is based on the ...
Eyes-free text entry with error correction on touchscreen mobile devices
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

We present an eyes-free text entry method for mobile touchscreen devices. Input progresses by inking Graffiti strokes using a finger on a touchscreen. The system includes a word-level error correction algorithm. Auditory and tactile feedback guide eyes-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

64
Total Citations
View Citations
1,070
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)2

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Lertvittayakumjorn PCai SDou BHo CZhai S(2024)Can Capacitive Touch Images Enhance Mobile Keyboard Decoding?Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676420(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676420
Streli PRichardson MBotros FMa SWang RHolz C(2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676330
Zhou CYan ZRam AGu YXiang YLiu CHuang YOoi WZhao S(2024)GlassMail: Towards Personalised Wearable Assistant for On-the-Go Email Creation on Smart GlassesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660683(372-390)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660683
Ren YZhang YLiu ZXie N(2024)Eye-Hand Typing: Eye Gaze Assisted Finger Typing via Bayesian Processes in ARIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337210630:5(2496-2506)Online publication date: 19-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372106
Grubert JWitzani LOtte AGesslein TKranz MKristensson P(2024)Text Entry Performance and Situation Awareness of a Joint Optical See-Through Head-Mounted Display and Smartphone SystemIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330931630:8(5830-5846)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3309316
Lehmann FKornecki IBuschek DFeit A(2023)Typing Behavior is About More than Speed: Users' Strategies for Choosing Word Suggestions Despite Slower Typing RatesProceedings of the ACM on Human-Computer Interaction10.1145/36042767:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604276
Chu JMa YZhai SGu XBi X(2023)TouchType-GAN: Modeling Touch Typing with Generative Adversarial NetworkProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606760(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606760
Yi XLiang CChen HSong JYu CLi HShi Y(2023)From 2D to 3DProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808297:1(1-25)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580829
Li ZYu CGu YShi Y(2023)ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting FingersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581055(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581055
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents