[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2851581.2892382acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Exploring Haptics for Learning Bend Gestures for the Blind

Published: 07 May 2016 Publication History

Abstract

This paper explores the use of haptic stimuli as non-visual affordances to assist in learnability of bend gestures. We tested 48 haptic Tactons with simulated blind participants to understand what haptic sensation could intuitively map to bend location and direction. We identify that a short, single motor Tacton indicates reliably a bend location, while participants agreed that the combination of two motors with varying intensities could indicate bend direction. This work is the first to explore the use of Tactons to communicate bend gesture location and direction, to eventually create a tactile interaction method for blind smartphone users

References

[1]
Ahmaniemi, T.T., Kildal, J., and Haveri, M. What is a device bend gesture really good for? Proceedings of the 32nd annual ACM conference on Human factors in computing systems CHI '14, ACM Press (2014), 3503-3512.
[2]
Apple. VoiceOver. 2015. https://www.apple.com/ca/accessibility/osx/voiceover/.
[3]
Azenkot, S., Ladner, R.E., and Wobbrock, J.O. Smartphone haptic feedback for nonvisual wayfinding. The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, (2011), 281-282.
[4]
Azenkot, S. and Lee, N.B. Exploring the use of speech input by blind people on mobile devices. Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, (2013), 1-8.
[5]
Bedny, M., Pascual-Leone, A., Dodell-Feder, D., Fedorenko, E., and Saxe, R. Language processing in the occipital cortex of congenitally blind adults. Proceedings of the National Academy of Sciences of the USA of America 108, 11 (2011), 4429-4434.
[6]
Buzzi, M.C., Buzzi, M., Donini, F., Leporini, B., and Paratore, M.T. Haptic reference cues to support the exploration of touchscreen mobile devices by blind users. Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI, (2013), 1-8.
[7]
Frey, B., Southern, C., and Romero, M. BrailleTouch: Mobile texting for the visually impaired. Lecture Notes in Computer Science 6767 LNCS, PART 3 (2011), 19-25.
[8]
Gallant, D.T., Seniuk, A.G., and Vertegaal, R. Towards more paper-like input. Proceedings of the 21st annual ACM symposium on User interface software and technology - UIST '08, (2008), 283.
[9]
Girouard, A., Lo, J., Riyadh, M., Daliri, F., Eady, A.K., and Pasquero, J. One-Handed Bend Interactions with Deformable Smartphones. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, (2015), 1509-1518.
[10]
Google Inc. TalkBack. https://play.google.com/store/apps/details?id=com.google.android.marvin.talkback&hl=en.
[11]
Gougoux, F., Zatorre, R.J., Lassonde, M., Voss, P., and Lepore, F. A functional neuroimaging study of sound localization: Visual cortex activity predicts performance in early-blind individuals. PLoS Biology 3, 2 (2005), 0324-0333.
[12]
Herkenrath, G., Karrer, T., and Borchers, J. Twend: Twisting and Bending as new INteraction Gesture in Mobile Devices. Proceeding of the twenty-sixth annual CHI conference extended abstracts on Human factors in computing systems, (2008), 3819.
[13]
Holman, D., Vertegaal, R., Altosaar, M., Troje, N., and Johns, D. Paper windows: Interaction Techniques for Digital Paper. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '05, (2005), 591.
[14]
Jayant, C., Acuario, C., Johnson, W., Hollier, J., and Ladner, R. V-braille. Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility - ASSETS '10, September 2015 (2010), 295-296.
[15]
Kane, S., Wobbrock, J., and Ladner, R. Usable gestures for blind people: understanding preference and performance. Proceedings of the 2011 Conference on Human factors in computing systems CHI '11, (2011), 413-422.
[16]
Kane, S.K., Bigham, J.P., and Wobbrock, J.O. Slide rule. Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility - Assets '08, (2008), 73-81.
[17]
Karns, C.M., Dow, M.W., and Neville, H.J. Altered Cross-Modal Processing in the Primary Auditory Cortex of Congenitally Deaf Adults: A Visual Somatosensory fMRI Study with a Double-Flash Illusion. Journal of Neuroscience 32, 28 (2012), 9626-9638.
[18]
Kildal, J., Paasovaara, S., and Aaltonen, V. Kinetic device: Designing Interactions with a Deformable Mobile Interface. Proceedings of the ACM SIGCHI conference on Human Factors in Computing Systems Extended Abstracts, (2012), 1871.
[19]
Kildal, J. Interacting with Deformable User Interfaces: Effect of Material Stiffness and Type of Deformation Gesture. In Haptic and Audio Interaction Design. 2012, 71-80.
[20]
Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. Proceedings of the 2011 annual conference on Human factors in computing systems CHI '11, (2011), 1303.
[21]
Lee, S., Lim, Y., and Lee, K.-P. Exploring the effects of size on deformable user interfaces. Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion - MobileHCI '12, ACM Press (2012), 89.
[22]
Leporini, B., Buzzi, M.C., and Buzzi, M. Interacting with mobile devices via VoiceOver. Proceedings of the 24th Australian Computer-Human Interaction Conference on - OzCHI '12, (2012), 339-348.
[23]
Li, K. a., Baudisch, P., and Hinckley, K. Blindsight. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems CHI '08, (2008), 1389.
[24]
Lo, J. and Girouard, A. Fabricating Bendy: Design and Development of Deformable Prototypes. IEEE Pervasive Computing Special Issue on Fabrication and Printing 13, 3 (2014), 40-46.
[25]
MIPSoft. BlindSquare. 2015. http://blindsquare.com/.
[26]
Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., and Gonçalves, D. Human-Computer Interaction -INTERACT 2011: 13th IFIP TC 13 International Conference, Lisbon, Portugal, September 5--9, 2011, Proceedings, Part I. In P. Campos, N. Graham, J. Jorge, N. Nunes, P. Palanque and M. Winckler, eds., Springer Berlin Heidelberg, Berlin, Heidelberg, 2011, 100-107.
[27]
Qian, H., Kuber, R., and Sears, A. Towards identifying distinguishable tactons for use with mobile devices. Proceeding of the eleventh international ACM SIGACCESS conference on Computers and accessibility ASSETS 09, (2009), 257-258.
[28]
Rantala, J., Raisamo, R., Lylykangas, J., et al. Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback. IEEE Transactions on Haptics 2, 1 (2009), 28-39.
[29]
Schwesig, C., Poupyrev, I., and Mori, E. Gummi: A Bendable Computer. Proceedings of the 2004 conference on Human factors in computing systems CHI '04, (2004), 263-270.
[30]
Shaik, A.S., Hossain, G., and Yeasin, M. Design, development and performance evaluation of reconfigured mobile Android phone for people who are blind or visually impaired. Proceedings of the 28th ACM International Conference on Design of Communication SIGDOC '10, (2010), 159.
[31]
Shiri Azenkot, Jacob O. Wobbrock, Sanjana Prasain, and R.E.L. Input finger detection for nonvisual touch screen text entry in Perkinput. Proceedings of Graphics Interface (GI '12), (2012), 121-129.
[32]
Steimle, J., Jordt, A., and Maes, P. Flexpad. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, ACM Press (2013), 237.
[33]
The International Agency for the Prevention of Blindness (IAPB). Blindness and Visual Impairment: Global Facts. 2012. http://www.iapb.org/vision-2020/global-facts.
[34]
Warren, K., Lo, J., Vadgama, V., and Girouard, A. Bending the rules: Bend Gesture Classification for Flexible Displays. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, (2013), 607.
[35]
Watanabe, J., Mochizuki, A., and Horry, Y. Bookisheet: Bendable Device for Browsing Content Using the Metaphor of Leafing Through the Pages. Proceedings of the 10th international conference on Ubiquitous computing - UbiComp '08, (2008), 360.
[36]
Yatani, K. and Truong, K.N. SemFeel: A User Interface with Semantic Tactile Feedback for Mobile Touch-screen Devices. Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST '09, (2009), 111-120.
[37]
Zakai, A. speak.js. 2015, https://github.com/kripken/speak.js.
[38]
Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., and Baudisch, P. Earpod: eyes-free menu selection using touch input and reactive audio feedback. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '07, (2007), 1395.

Cited By

View all
  • (2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
  • (2024)Don’t Look Now: Audio/Haptic Guidance for 3D Scanning of LandmarksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642271(1-20)Online publication date: 11-May-2024
  • (2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
  • Show More Cited By

Index Terms

  1. Exploring Haptics for Learning Bend Gestures for the Blind

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems
    May 2016
    3954 pages
    ISBN:9781450340823
    DOI:10.1145/2851581
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 May 2016

    Check for updates

    Author Tags

    1. accessibility
    2. bend gestures
    3. deformable user interfaces
    4. haptics
    5. tactons
    6. usability
    7. visually impaired

    Qualifiers

    • Abstract

    Funding Sources

    Conference

    CHI'16
    Sponsor:
    CHI'16: CHI Conference on Human Factors in Computing Systems
    May 7 - 12, 2016
    California, San Jose, USA

    Acceptance Rates

    CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 21 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
    • (2024)Don’t Look Now: Audio/Haptic Guidance for 3D Scanning of LandmarksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642271(1-20)Online publication date: 11-May-2024
    • (2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
    • (2021)Gesture Action Mapping for Deformation-based One-handed Landscape Mode Interaction with Flexible Smartphone-sized DevicesProceedings of the 12th Indian Conference on Human-Computer Interaction10.1145/3506469.3506470(1-10)Online publication date: 19-Nov-2021
    • (2021)User-defined Bend Gesture Completion Strategies for Discrete and Continuous InputsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85613-7_14(192-202)Online publication date: 30-Aug-2021
    • (2019)Non-Rigid HCIProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322347(885-906)Online publication date: 18-Jun-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media