More Web Proxy on the site http://driver.im/

abstract

Bending Blindly: Exploring Bend Gestures for the Blind

Authors:

Audrey GirouardAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 2088 - 2096

https://doi.org/10.1145/2851581.2892303

Published: 07 May 2016 Publication History

Abstract

This paper explores the novel context of using bend gestures as a primary method of interaction for the blind. Our preliminary study assesses if this more tactile experience could enhance the usability and accessibility of technology for blind users, by comparing bend and touch interactions with simulated blind participants. Both input techniques showed similar results, indicating that bend gestures have potential in this context. We identify results that can help shape future research in this accessibility area, and potentially increase the overall interaction experience for screen reader based smartphones.

References

[1]

Ahmaniemi, T.T., Kildal, J., and Haveri, M. What is a device bend gesture really good for? Proceedings of the 32nd annual ACM conference on Human factors in computing systems CHI '14, ACM Press (2014), 3503-3512.

Digital Library

[2]

Apple. VoiceOver. 2015. https://www.apple.com/ca/accessibility/osx/voiceo ver/.

[3]

Azenkot, S., Ladner, R.E., and Wobbrock, J.O. Smartphone haptic feedback for nonvisual wayfinding. The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, (2011), 281-282.

Digital Library

[4]

Azenkot, S. and Lee, N.B. Exploring the use of speech input by blind people on mobile devices. Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, (2013), 1-8.

Digital Library

[5]

Bedny, M., Pascual-Leone, A., Dodell-Feder, D., Fedorenko, E., and Saxe, R. Language processing in the occipital cortex of congenitally blind adults. Proceedings of the National Academy of Sciences of the USA of America 108, 11 (2011), 4429-4434.

[6]

Buzzi, M.C., Buzzi, M., Donini, F., Leporini, B., and Paratore, M.T. Haptic reference cues to support the exploration of touchscreen mobile devices by blind users. Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI, (2013), 1-8.

Digital Library

[7]

Frey, B., Southern, C., and Romero, M. BrailleTouch: Mobile texting for the visually impaired. Lecture Notes in Computer Science 6767 LNCS, PART 3 (2011), 19-25.

Digital Library

[8]

Gallant, D.T., Seniuk, A.G., and Vertegaal, R. Towards more paper-like input. Proceedings of the 21st annual ACM symposium on User interface software and technology - UIST '08, (2008), 283.

Digital Library

[9]

Girouard, A., Lo, J., Riyadh, M., Daliri, F., Eady, A.K., and Pasquero, J. One-Handed Bend Interactions with Deformable Smartphones. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, (2015), 1509-1518.

Digital Library

[10]

Google Inc. TalkBack. https://play.google.com/store/apps/details?id=com.google.android.marvin.talkback&hl=en.

[11]

Gougoux, F., Zatorre, R.J., Lassonde, M., Voss, P., and Lepore, F. A functional neuroimaging study of sound localization: Visual cortex activity predicts performance in early-blind individuals. PLoS Biology 3, 2 (2005), 0324-0333.

[12]

Herkenrath, G., Karrer, T., and Borchers, J. Twend: Twisting and Bending as new INteraction Gesture in Mobile Devices. Proceeding of the twenty-sixth annual CHI conference extended abstracts on Human factors in computing systems, (2008), 3819.

Digital Library

[13]

Holman, D., Vertegaal, R., Altosaar, M., Troje, N., and Johns, D. Paper windows: Interaction Techniques for Digital Paper. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '05, (2005), 591.

Digital Library

[14]

Jayant, C., Acuario, C., Johnson, W., Hollier, J., and Ladner, R. V-braille. Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility - ASSETS '10, September 2015 (2010), 295-296.

Digital Library

[15]

Kane, S., Wobbrock, J., and Ladner, R. Usable gestures for blind people: understanding preference and performance. Proceedings of the 2011 Conference on Human factors in computing systems CHI '11, (2011), 413-422.

Digital Library

[16]

Kane, S.K., Bigham, J.P., and Wobbrock, J.O. Slide rule. Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility - Assets '08, (2008), 73-81.

Digital Library

[17]

Karns, C.M., Dow, M.W., and Neville, H.J. Altered Cross-Modal Processing in the Primary Auditory Cortex of Congenitally Deaf Adults: A Visual Somatosensory fMRI Study with a Double-Flash Illusion. Journal of Neuroscience 32, 28 (2012), 9626-9638.

[18]

Kildal, J., Paasovaara, S., and Aaltonen, V. Kinetic device: Designing Interactions with a Deformable Mobile Interface. Proceedings of the ACM SIGCHI conference on Human Factors in Computing Systems Extended Abstracts, (2012), 1871.

Digital Library

[19]

Kildal, J. Interacting with Deformable User Interfaces: Effect of Material Stiffness and Type of Deformation Gesture. In Haptic and Audio Interaction Design. 2012, 71-80.

Digital Library

[20]

Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. Proceedings of the 2011 annual conference on Human factors in computing systems CHI '11, (2011), 1303.

Digital Library

[21]

Lee, S., Lim, Y., and Lee, K.-P. Exploring the effects of size on deformable user interfaces. Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion - MobileHCI '12, ACM Press (2012), 89.

Digital Library

[22]

Leporini, B., Buzzi, M.C., and Buzzi, M. Interacting with mobile devices via VoiceOver. Proceedings of the 24th Australian Computer-Human Interaction Conference on - OzCHI '12, (2012), 339-348.

Digital Library

[23]

Li, K. a., Baudisch, P., and Hinckley, K. Blindsight. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems CHI '08, (2008), 1389.

[24]

Lo, J. and Girouard, A. Fabricating Bendy: Design and Development of Deformable Prototypes. IEEE Pervasive Computing Special Issue on Fabrication and Printing 13, 3 (2014), 40-46.

[25]

MIPSoft. BlindSquare. 2015. http://blindsquare.com/.

[26]

Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., and Gonçalves, D. Human-Computer Interaction -INTERACT 2011: 13th IFIP TC 13 International Conference, Lisbon, Portugal, September 5--9, 2011, Proceedings, Part I. In P. Campos, N. Graham, J. Jorge, N. Nunes, P. Palanque and M. Winckler, eds., Springer Berlin Heidelberg, Berlin, Heidelberg, 2011, 100-107.

Digital Library

[27]

Qian, H., Kuber, R., and Sears, A. Towards identifying distinguishable tactons for use with mobile devices. Proceeding of the eleventh international ACM SIGACCESS conference on Computers and accessibility ASSETS 09, (2009), 257-258.

Digital Library

[28]

Rantala, J., Raisamo, R., Lylykangas, J., et al. Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback. IEEE Transactions on Haptics 2, 1 (2009), 28-39.

Digital Library

[29]

Schwesig, C., Poupyrev, I., and Mori, E. Gummi: A Bendable Computer. Proceedings of the 2004 conference on Human factors in computing systems CHI '04, (2004), 263-270.

Digital Library

[30]

Shaik, A.S., Hossain, G., and Yeasin, M. Design, development and performance evaluation of reconfigured mobile Android phone for people who are blind or visually impaired. Proceedings of the 28th ACM International Conference on Design of Communication SIGDOC '10, (2010), 159.

Digital Library

[31]

Shiri Azenkot, Jacob O. Wobbrock, Sanjana Prasain, and R.E.L. Input finger detection for nonvisual touch screen text entry in Perkinput. Proceedings of Graphics Interface (GI '12), (2012), 121-129.

Digital Library

[32]

Steimle, J., Jordt, A., and Maes, P. Flexpad. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, ACM Press (2013), 237.

[33]

The International Agency for the Prevention of Blindness (IAPB). Blindness and Visual Impairment: Global Facts. 2012. http://www.iapb.org/vision-2020/global-facts.

[34]

Warren, K., Lo, J., Vadgama, V., and Girouard, A. Bending the rules: Bend Gesture Classification for Flexible Displays. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, (2013), 607.

Digital Library

[35]

Watanabe, J., Mochizuki, A., and Horry, Y. Bookisheet: Bendable Device for Browsing Content Using the Metaphor of Leafing Through the Pages. Proceedings of the 10th international conference on Ubiquitous computing - UbiComp '08, (2008), 360.

Digital Library

[36]

Yatani, K. and Truong, K.N. SemFeel: A User Interface with Semantic Tactile Feedback for Mobile Touch-screen Devices. Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST '09, (2009), 111-120.

Digital Library

[37]

Zakai, A. speak.js. 2015, https://github.com/kripken/speak.js.

[38]

Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., and Baudisch, P. Earpod: eyes-free menu selection using touch input and reactive audio feedback. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '07, (2007), 1395.

Digital Library

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062
Yin JBai SHan YZhang XDeng SWang S(2021)The Study of Bending and Twisting Input Modalities in Deformable InterfacesElectronics10.3390/electronics1023299110:23(2991)Online publication date: 1-Dec-2021
https://doi.org/10.3390/electronics10232991
Show More Cited By

Index Terms

Bending Blindly: Exploring Bend Gestures for the Blind
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Exploring Haptics for Learning Bend Gestures for the Blind
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

This paper explores the use of haptic stimuli as non-visual affordances to assist in learnability of bend gestures. We tested 48 haptic Tactons with simulated blind participants to understand what haptic sensation could intuitively map to bend location ...
Groupware Accessibility for Persons with Disabilities
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services

The accessibility issues of Groupware applications prevent visually impaired and other persons with disabilities access to these highly graphical interfaces. To address the accessibility issues persons with disabilities have with Groupware, a recent ...
Making Real-World Interfaces Accessible Through Crowdsourcing, Computer Vision, and Fabrication
W4A '17: Proceedings of the 14th International Web for All Conference

The world is full of physical interfaces that are inaccessible to blind people, from microwaves and information kiosks to thermostats and checkout terminals. Blind people cannot independently use such devices without at least first learning their layout,...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062
Yin JBai SHan YZhang XDeng SWang S(2021)The Study of Bending and Twisting Input Modalities in Deformable InterfacesElectronics10.3390/electronics1023299110:23(2991)Online publication date: 1-Dec-2021
https://doi.org/10.3390/electronics10232991
Borah PSeth JSorathia K(2021)Gesture Action Mapping for Deformation-based One-handed Landscape Mode Interaction with Flexible Smartphone-sized DevicesProceedings of the 12th Indian Conference on Human-Computer Interaction10.1145/3506469.3506470(1-10)Online publication date: 19-Nov-2021
https://dl.acm.org/doi/10.1145/3506469.3506470
Borah PSorathia KSarcar S(2021)User-defined Bend Gesture Completion Strategies for Discrete and Continuous InputsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85613-7_14(192-202)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1007/978-3-030-85613-7_14
Boem ATroiano GHarrison SBardzell SNeustaedter CTatar D(2019)Non-Rigid HCIProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322347(885-906)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322347
Borah PSorathia KKuznetsov SSaakes DWakkary RGeurts LHayes LLau M(2019)Natural and Intuitive Deformation Gestures for One-handed Landscape Mode InteractionProceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3294109.3300996(229-236)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3294109.3300996
Punchoojit LHongwarittorrn N(2017)Usability Studies on Mobile User Interface Design PatternsAdvances in Human-Computer Interaction10.1155/2017/67875042017Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1155/2017/6787504
Fellion NPietrzak TGirouard AGajos KMankoff JHarrison C(2017)FlexStylusProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126597(375-385)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126597
Ernst MSwan TCheung VGirouard A(2017)Typhlex: Exploring Deformable Input for Blind Users Controlling a Mobile Screen ReaderIEEE Pervasive Computing10.1109/MPRV.2017.397112316:4(28-35)Online publication date: Oct-2017
https://doi.org/10.1109/MPRV.2017.3971123

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents