More Web Proxy on the site http://driver.im/

research-article

Open access

Enhancing Android accessibility for users with hand tremor by reducing fine pointing and steady tapping

Authors:

Casey Burkhardt,

Jeffrey P. BighamAuthors Info & Claims

W4A '15: Proceedings of the 12th International Web for All Conference

Article No.: 29, Pages 1 - 10

https://doi.org/10.1145/2745555.2747277

Published: 18 May 2015 Publication History

Abstract

Smartphones and tablets with touchscreen have demonstrated potential to support the needs of individuals with motor impairments such as hand tremor. However, those users still face major challenges with conventional touchscreen gestures. These challenges are mostly caused by the fine precision requirement to disambiguate between targets on small screens. To reduce the difficulty caused by hand tremor in combination with small touch targets on the screen, we developed an experimental system-wide assistive service called Touch Guard. It enables enhanced area touch and a series of complementary features. This service provides the enhanced area touch feature through two possible disambiguation modes: magnification and descriptive targets list. In a laboratory study with motor-impaired users, we compared both modes to conventional tapping and tested Touch Guard with real-world applications. Targets list based disambiguation was more successful, reducing the error rate by 65% compared to conventional tapping. In addition, several challenges and design implications were discovered when presenting new touchscreen interaction techniques to users with motor impairments. As the experimental product of an intern research project at Google, Touch Guard demonstrates broad potential for solving accessibility issues for people with hand tremor using their familiar mobile devices, instead of high-cost hardware.

References

[1]

Albinsson, P. and Zhai, S. High precision touch screen interaction. CHI 2003.

Digital Library

[2]

Anthony, L. and Kim, Y. and Findlater, L. Analyzing user-generated youtube videos to understand touchscreen use by people with motor impairments. CHI 2013.

Digital Library

[3]

Baudisch, P. and Chu, G. Back-of-device interaction allows creating very small touch devices. CHI 2009.

Digital Library

[4]

Belatar, M. and Poirier, F. Text entry for mobile devices and users with severe motor impairments: handiglyph, a primitive shapes based onscreen keyboard. ASSETS '08.

Digital Library

[5]

Brooke, J. SUS-A quick and dirty usability scale. In Usability evaluation in industry 189 page 194, 1996.

[6]

Duff, S. N. and Irwin, C. B. and Skye, J. L and Sesto, M. E. and Wiegmann, D. A. The effect of disability and approach on touch screen performance during a number entry task. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2010.

[7]

Felzer, T., Nordmann, R. and Rinderknecht, S. Scanning-based human-computer interaction using intentional muscle contractions. In Universal Access in Human-Computer Interaction. Intelligent and Ubiquitous Interaction Environments, p. 509--518, 2009.

Digital Library

[8]

Findlater, L., Jansen, A., Shinohara, K., Dixon, M., Kamb, P., Rakita, J. and Wobbrock, J. O. Enhanced area cursors: reducing fine pointing demands for people with motor impairments. UIST 2010.

Digital Library

[9]

Froehlich, J. and Wobbrock, J. O and Kane, S. Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens. ASSETS 2007.

Digital Library

[10]

Guerreiro, T. and Nicolau, H. and Jorge, J. and Gonçalves, D. Towards accessible touch interfaces. ASSETS 2010.

Digital Library

[11]

Guerreiro, T. Joã o V. and Nicolau, H. and Jorge, J. and Gonçalves, D. Assessing mobile touch interfaces for tetraplegics. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services, 2010.

Digital Library

[12]

Holz, C. and Baudisch, P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. CHI 2010.

Digital Library

[13]

Hurst, A., Hudson, S. E. and Mankoff, J. Automatically identifying targets users interact with during real world tasks. IUI 2010.

Digital Library

[14]

Irwin, C. B and Sesto, M. E. Performance and touch characteristics of disabled and non-disabled participants during a reciprocal tapping task using touch screen technology. In Applied ergonomics, 43.6, pages 1038--1043, 2012.

[15]

Kane, S. K. and Jayant, C. and Wobbrock, J. O and Ladner, R. E. Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. ASSETS 2009.

Digital Library

[16]

Kurschl, W. and Augstein, M. and Stitz, H. and Heumader, P. and Pointner, C. A User Modelling Wizard for People with Motor Impairments. In Proceedings of International Conference on Advances in Mobile Computing & Multimedia, 2013.

Digital Library

[17]

Littell, R. C. SAS for mixed models. SAS institute, 2006.

Digital Library

[18]

Galaxy S5 attracts some Apple customers in Europe. http://goo.gl/56YKvw. Accessed: 06/30/2014.

[19]

Montague, K. and Hanson, V. L. and Cobley, A. Designing for individuals: usable touch-screen interaction through shared user models. ASSETS 2012.

Digital Library

[20]

Morris, M. G and Venkatesh, V. Age differences in technology adoption decisions: Implications for a changing work force. Personnel psychology, 53.2, pages 375--403, 2000.

[21]

Naftali, M. and Findlater, L. Accessibility in context: understanding the truly mobile experience of smartphone users with motor impairments. ASSETS 2014.

Digital Library

[22]

Nicolau, H. and Guerreiro, T. and Jorge, J. and Gonçalves, D. Mobile touchscreen user interfaces: bridging the gap between motor-impaired and able-bodied users. In Universal Access in the Information Society, pages 1--11, 2012.

Digital Library

[23]

Olwal, A. and Feiner, S. and Heyman, S. Rubbing and tapping for precise and rapid selection on touch-screen displays. CHI 2008.

Digital Library

[24]

Oney, S., Harrison, C., Ogan, A. and Wiese, J. ZoomBoard: a diminutive QWERTY soft keyboard using iterative zooming for ultra-small devices. CHI '13.

Digital Library

[25]

Pindat, C., Pietriga, E., Chapuis, O. and Puech, C. Jellylens: Content-aware adaptive lenses. UIST 2012.

Digital Library

[26]

Raman, T. V. and Chen, C. L. and Tim, C. Leveraging Android accessibility APIs to create an accessible experience. Google I/O 2011.

[27]

Ramos, G. and Cockburn, A. and Balakrishnan, R. and Beaudouin-Lafon, M. Pointing lenses: facilitating stylus input through visual-and motor-space magnification. CHI 2007.

Digital Library

[28]

Schuster, C. and Von Eye, A. The relationship of ANOVA models with random effects and repeated measurement designs. In Journal of Adolescent Research, 16.2, pages 205--220, 2001.

[29]

Sears, A. and Shneiderman, B. High precision touchscreens: design strategies and comparisons with a mouse. In International Journal of Man-Machine Studies, 34.4, pages 593--613, 1991.

Digital Library

[30]

Sesto, M. E. and Irwin, C. B. and Chen, K. B. and Chourasia, A. O. and Wiegmann, D. A. Effect of touch screen button size and spacing on touch characteristics of users with and without disabilities. In Human Factors: The Journal of the Human Factors and Ergonomics Society, 54.3, pages 425--436, 2012.

[31]

Smith, A. Smartphone ownership--2013 update. In Pew Research Center: Washington DC, 2013.

[32]

Trewin, S. and Keates, S. and Moffatt, K. Developing steady clicks:: a method of cursor assistance for people with motor impairments. ASSETS 2006.

Digital Library

[33]

Trewin, S., Swart, C. and Pettick, D. Physical accessibility of touchscreen smartphones. ASSETS '13.

Digital Library

[34]

Wacharamanotham, C. and Hurtmanns, J. and Mertens, A. and Kronenbuerger, M. and Schlick, C. and Borchers, J. Evaluating swabbing: a touchscreen input method for elderly users with tremor. CHI 2011.

Digital Library

[35]

Wang, F. and Cao, X. and Ren, X. and Irani, P. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. UIST 2009.

Digital Library

[36]

Wobbrock, J. O. and Myers, B. A. and Kembel, J. A. EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion. UIST 2003.

Digital Library

[37]

Worden, A. and Walker, N. and Bharat, K. and Hudson, S. Making computers easier for older adults to use: area cursors and sticky icons. CHI 1997.

Digital Library

[38]

Zhong, Y. and Raman, T. V. and Burkhardt, C. and Biadsy, F. and Bigham, J. P. JustSpeak: enabling universal voice control on Android. W4A 2014.

Digital Library

Cited By

Sun ZZhou RWang KLi Z(2024)Enhancing Mobile Interaction for Individuals With Tremors via Optical See-Through Augmented RealityIEEE Access10.1109/ACCESS.2024.344988012(123946-123955)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3449880
Bowman MRobinson JBuehler EKane S(2023)“I just thought it was me”: How Smartphones Fail Users with Mild-to-Moderate Dexterity DifferencesProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608396(1-12)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608396
Liang CIravantchi YKrolikowski TGeng RSample AGuo A(2023)BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface ActuationProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606730(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606730
Show More Cited By

Index Terms

Enhancing Android accessibility for users with hand tremor by reducing fine pointing and steady tapping
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
2. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Assistive technologies
  2. User characteristics
    1. People with disabilities

Recommendations

Enhanced area cursors: reducing fine pointing demands for people with motor impairments
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

Computer users with motor impairments face major challenges with conventional mouse pointing. These challenges are mostly due to fine pointing corrections at the final stages of target acquisition. To reduce the need for correction-phase pointing and to ...
Arabic Braille Touch Keyboard for Android Users

As smart phones appeared with their elegant, easy and exciting touch functionality, the use of touch screen devices has been spreading very fast. Beside the previous advantages, smart phones addresses some new challenges for people with disabilities. ...
From the lab to the world: lessons from extending a pointing technique for real-world use
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

We present the Pointing Magnifier as a case study for understanding the issues and challenges of deploying lab-validated pointing facilitation techniques into the real world. The Pointing Magnifier works by magnifying the contents of an area cursor to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

W4A '15: Proceedings of the 12th International Web for All Conference

May 2015

214 pages

ISBN:9781450333429

DOI:10.1145/2745555

General Chairs:
Luis Carriço
University of Lisbon, Portugal
,
Silvia Mirri
University of Bologna, Italy
,
Program Chairs:
Tiago Guerreiro
University of Lisbon, Portugal
,
Peter Thiessen
Midokura, Spain

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web
Intuit: Intuit Inc.
Google Inc.
Zakon Group
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
SIGACCESS: ACM Special Interest Group on Accessible Computing
Ability Magazine: Ability Magazine
TPG: The Paciello Group
IBM: IBM

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 May 2015

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

W4A '15

Sponsor:

SIGWEB
Intuit
SIGCHI
SIGACCESS
Ability Magazine
TPG
IBM

W4A '15: International Web for All Conference

May 18 - 20, 2015

Florence, Italy

Acceptance Rates

W4A '15 Paper Acceptance Rate 11 of 31 submissions, 35%;

Overall Acceptance Rate 171 of 371 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
944
Total Downloads

Downloads (Last 12 months)105
Downloads (Last 6 weeks)12

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun ZZhou RWang KLi Z(2024)Enhancing Mobile Interaction for Individuals With Tremors via Optical See-Through Augmented RealityIEEE Access10.1109/ACCESS.2024.344988012(123946-123955)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3449880
Bowman MRobinson JBuehler EKane S(2023)“I just thought it was me”: How Smartphones Fail Users with Mild-to-Moderate Dexterity DifferencesProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608396(1-12)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608396
Liang CIravantchi YKrolikowski TGeng RSample AGuo A(2023)BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface ActuationProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606730(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606730
Chiou PAlotaibi AHalfond W(2023)BAGEL: An Approach to Automatically Detect Navigation-Based Web Accessibility Barriers for Keyboard UsersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580749(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580749
Alotaibi AChiou PTawsif FHalfond W(2023)ScaleFix: An Automated Repair of UI Scaling Accessibility Issues in Android Applications2023 IEEE International Conference on Software Maintenance and Evolution (ICSME)10.1109/ICSME58846.2023.00025(147-159)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICSME58846.2023.00025
Vu MWyman JGrundy JMadugalla A(2023)Better Understanding Diverse End User Website Usage Challenges with Browser-Based Augmented Reality ApproachesEvaluation of Novel Approaches to Software Engineering10.1007/978-3-031-36597-3_13(269-291)Online publication date: 8-Jul-2023
https://doi.org/10.1007/978-3-031-36597-3_13
Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 15-Dec-2022
https://dl.acm.org/doi/10.1145/3543509
Lee HPark JLee U(2022)A Systematic Survey on Android API Usage for Data-driven Analytics with SmartphonesACM Computing Surveys10.1145/353081455:5(1-38)Online publication date: 3-Dec-2022
https://dl.acm.org/doi/10.1145/3530814
Fok RZhong MRoss AFogarty JWobbrock J(2022)A Large-Scale Longitudinal Analysis of Missing Label Accessibility Failures in Android AppsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502143(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502143
Di Gregorio MDi Nucci DPalomba FVitiello G(2022)The making of accessible Android applications: an empirical study on the state of the practiceEmpirical Software Engineering10.1007/s10664-022-10182-x27:6Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1007/s10664-022-10182-x
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents