AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone Assistant
Authors: 
Xiaoqing Jing, Chun Yu, 
Kun Yue, Liangyou Lu, 
Nan Gao, Weinan Shi, Mingshan Zhang, Ruolin Wang, Yuanchun ShiAuthors Info & Claims
Article No.: 108, Pages 1 - 31
Abstract
Spatial perception, particularly at small and medium scales, is an essential human sense but poses a significant challenge for the blind and visually impaired (BVI). Traditional learning methods for BVI individuals are often constrained by the limited availability of suitable learning environments and high associated costs. To tackle these barriers, we conducted comprehensive studies to delve into the real-world challenges faced by the BVI community. We have identified several key factors hindering their spatial perception, including the high social cost of seeking assistance, inefficient methods of information intake, cognitive and behavioral disconnects, and a lack of opportunities for hands-on exploration. As a result, we developed AngleSizer, an innovative teaching assistant that leverages smartphone technology. AngleSizer is designed to enable BVI individuals to use natural interaction gestures to try, feel, understand, and learn about sizes and angles effectively. This tool incorporates dual vibration-audio feedback, carefully crafted teaching processes, and specialized learning modules to enhance the learning experience. Extensive user experiments validated its efficacy and applicability with diverse abilities and visual conditions. Ultimately, our research not only expands the understanding of BVI behavioral patterns but also greatly improves their spatial perception capabilities, in a way that is both cost-effective and allows for independent learning.
References
[1]
Marian Adusei and DoYoung Lee. 2017. "Clicks" Appcessory for Visually Impaired Children. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 19--25. https://doi.org/10.1145/3027063.3049275
[2]
Yiannoula Andreou and Konstantinos T. Kotsis. 2005. The estimation of length, surface area, and volume by blind and sighted children. International Congress Series 1282 (2005), 780--784. https://doi.org/10.1016/j.ics.2005.05.027 Vision 2005.
[3]
Stuart Appelle. 1971. Visual and Haptic Angle Perception in the Matching Task. The American Journal of Psychology 84, 4 (1971), 487--499. http://www.jstor.org/stable/1421166
[4]
Jinqiang Bai, Shiguo Lian, Zhaoxiang Liu, Kai Wang, and Dijun Liu. 2018. Virtual-Blind-Road Following-Based Wearable Navigation Device for Blind People. IEEE Transactions on Consumer Electronics 64, 1 (Feb 2018), 136--143. https://doi.org/10.1109/TCE.2018.2812498
[5]
Rais Bastomi, Firza Putra Ariatama, Lucke Yuansyah Arif Tryas Putri, Septian Wahyu Saputra, Mohammad Rizki Maulana, Mat Syai'in, Ii Munadhif, Agus Khumaidi, Mohammad Basuki Rahmat, Annas Singgih Setiyoko, et al. 2019. Object detection and distance estimation tool for blind people using convolutional methods with stereovision. In 2019 International Symposium on Electronics and Smart Devices (ISESD).IEEE, 1--5.
[6]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77--101. https://doi.org/10.1191/1478088706qp063oa
[7]
Emeline Brulé and Gilles Bailly. 2021. " Beyond 3D printers": Understanding Long-Term Digital Fabrication Practices for the Education of Visually Impaired or Blind Youth. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--15. https://doi.org/10.1145/3411764.3445403
[8]
Cesare Cornoldi, Barbara Bertuccelli, Paola Rocchi, and Barbara Sbrana. 1993. Processing capacity limitations in pictorial and spatial representations in the totally congenitally blind. Cortex 29, 4 (1993), 675--689.
[9]
James E Cutting and Peter M Vishton. 1995. Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In Perception of space and motion. Elsevier, 69--117. https://doi.org/10.1016/B978-012240530-3/50005-5
[10]
Philip W Davidson. 1972. Haptic judgments of curvature by blind and sighted humans. Journal of experimental psychology 93, 1 (1972), 43.
[11]
Olivier Després, Domitille L. Boudard, Victor Candas, and André Dufour. 2005. Enhanced self-localization by auditory cues in blind humans. Disability and Rehabilitation 27 (2005), 753 - 759. https://api.semanticscholar.org/CorpusID:41982714
[12]
Nem Khan Dim and Xiangshi Ren. 2014. Designing motion gesture interfaces in mobile phones for blind people. Journal of Computer Science and technology 29, 5 (2014), 812--824.
[13]
Allan G Dodds and David DC Carter. 1983. Memory for movement in blind children: The role of previous visual experience. Journal of Motor Behavior 15, 4 (1983), 343--352.
[14]
Katja Fiehler, Johanna Reuschel, and Frank Rösler. 2009. Early non-visual experience influences proprioceptive-spatial discrimination acuity in adulthood. Neuropsychologia 47, 3 (2009), 897--906.
[15]
Ms. Janet F. Fletcher. 1980. Spatial Representation in Blind Children. 1: Development Compared to Sighted Children. Journal of Visual Impairment & Blindness 74, 10 (1980), 381--385. https://doi.org/10.1177/0145482X8007401004
[16]
Ms. Janet F. Fletcher. 1981. Spatial Representation in Blind Children. 3: Effects of Individual Differences. Journal of Visual Impairment & Blindness 75, 2 (1981), 46--49. https://doi.org/10.1177/0145482X8107500202
[17]
Nan Gao, Wei Shao, and Flora D Salim. 2019. Predicting personality traits from physical activity intensity. Computer 52, 7 (2019), 47--56.
[18]
Nan Gao, Zhuolei Yu, Chun Yu, Yuntao Wang, Flora D Salim, and Yuanchun Shi. 2023. Automated mobile sensing strategies generation for human behaviour understanding. arXiv preprint arXiv:2311.05457 (2023).
[19]
Karen J. Grandison. 1994. Tobin, Michael, Assessing Visually Handicapped People: an introduction to test procedures, David Fulton Publishers, 1994, 112pp, £12.99, ISBN 1 85346 295 0. British Journal of Visual Impairment 12, 2 (1994), 68--69. https://doi.org/10.1177/026461969401200215
[20]
Ralph Norman Haber and Charles A. Levin. 2001. The independence of size perception and distance perception. Perception Psychophysics 63, 7 (2001), 1140--1152. https://doi.org/10.3758/BF03194530
[21]
Mark Holllns and Elizabeth K Kelley. 1988. Spatial updating in blind and sighted people. Perception & Psychophysics 43 (1988), 380--388.
[22]
Leona Holloway, Matthew Butler, and Kim Marriott. 2022. 3D Printed Street Crossings: Supporting Orientation and Mobility Training with People Who Are Blind or Have Low Vision. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 415, 16 pages. https://doi.org/10.1145/3491102.3502072
[23]
Bill Jones. 1975. Spatial perception in the blind. British journal of psychology 66 4(1975), 461--72. https://api.semanticscholar.org/CorpusID:29616979
[24]
Sujith B Kallara, Mitu Raj, Roshan Raju, Nidhin Jacob Mathew, V R Padmaprabha, and D S Divya. 2017. Indriya --- A smart guidance system for the visually impaired. In 2017 International Conference on Inventive Computing and Informatics (ICICI). 26--29. https://doi.org/10.1109/ICICI.2017.8365359
[25]
Shaun K. Kane, Jacob O. Wobbrock, and Richard E. Ladner. 2011. Usable Gestures for Blind People: Understanding Preference and Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 413--422. https://doi.org/10.1145/1978942.1979001
[26]
A. M. Kassim, T. Yasuno, H. Suzuki, H. I. Jaafar, and M. S. M. Aras. 2016. Indoor Navigation System based on Passive RFID Transponder with Digital Compass for Visually Impaired People. International Journal of Advanced Computer Science and Applications 7, 2 (2016). https://doi.org/10.14569/IJACSA.2016.070276
[27]
Seita Kayukawa, Tatsuya Ishihara, Hironobu Takagi, Shigeo Morishima, and Chieko Asakawa. 2020. Guiding Blind Pedestrians in Public Spaces by Understanding Walking Behavior of Nearby Pedestrians. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 85 (sep 2020), 22 pages. https://doi.org/10.1145/3411825
[28]
John Miller Kennedy. 1993. Drawing & the blind: Pictures to touch. Yale University Press.
[29]
Tim Kuhlmann, Pablo Garaizar, and Ulf-Dietrich Reips. 2021. Smartphone sensor accuracy varies from device to device in mobile research: The case of spatial orientation. Behavior Research Methods 53, 1 (01 Feb 2021), 22--33. https://doi.org/10.3758/s13428-020-01404-5
[30]
Masaki Kuribayashi, Seita Kayukawa, Hironobu Takagi, Chieko Asakawa, and Shigeo Morishima. 2021. LineChaser: A Smartphone-Based Navigation System for Blind People to Stand in Lines. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 33, 13 pages. https://doi.org/10.1145/3411764.3445451
[31]
Masaki Kuribayashi, Seita Kayukawa, Jayakorn Vongkulbhisal, Chieko Asakawa, Daisuke Sato, Hironobu Takagi, and Shigeo Morishima. 2022. Corridor-Walker: Mobile Indoor Walking Assistance for Blind People to Avoid Obstacles and Recognize Intersections. Proc. ACM Hum.-Comput. Interact. 6, MHCI, Article 179 (sep 2022), 22 pages. https://doi.org/10.1145/3546714
[32]
Orly Lahav. 2006. Using virtual environment to improve spatial perception by people who are blind. Cyberpsychology & Behavior 9, 2 (2006), 174--177. https://doi.org/10.1089/cpb.2006.9.174
[33]
Orly Lahav, Hadas Gedalevitz, Steven Battersby, David Brown, Lindsay Evett, and Patrick Merritt. 2018. Virtual environment navigation with look-around mode to explore new real spaces by people who are blind. Disability and Rehabilitation 40, 9 (2018), 1072--1084. https://doi.org/10.1080/09638288.2017.1286391 28637136.
[34]
Vicky Lewis, Glyn M. Collis, Ros Shadlock, Michelle Potts, and Sarah. H. Norgate. 2002. New methods for studying blind children's understanding of familiar space. British Journal of Visual Impairment 20 (2002), 17 - 23. https://api.semanticscholar.org/CorpusID:144492013
[35]
Guanhong Liu, Tianyu Yu, Chun Yu, Haiqing Xu, Shuchang Xu, Ciyuan Yang, Feng Wang, Haipeng Mi, and Yuanchun Shi. 2021. Tactile Compass: Enabling Visually Impaired People to Follow a Path with Continuous Directional Feedback. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 28, 13 pages. https://doi.org/10.1145/3411764.3445644
[36]
Mike McLinden, Elizabeth Hodges, and Steve McCall. 2020. Learning Through Touch: Supporting Learners with Multiple Disabilities and Vision Impairment Through a Bioecological Systems Perspective (second edition ed.). Routledge.
[37]
Anca Morar, Maria Anca Băluţoiu, Alin Moldoveanu, Florica Moldoveanu, Alex Butean, and Victor Asavei. 2020. Evaluation of the ARCore Indoor Localization Technology. In 2020 19th RoEduNet Conference: Networking in Education and Research (RoEduNet). 1--5. https://doi.org/10.1109/RoEduNet51892.2020.9324849
[38]
Matthijs L Noordzij, Sander Zuidhoek, and Albert Postma. 2007. The influence of visual experience on visual and spatial imagery. Perception 36, 1 (2007), 101--112.
[39]
Rosemary O'Keeffe, Salvatore Gnecchi, Steve Buckley, Cian O'Murchu, Alan Mathewson, Suzanne Lesecq, and Julie Foucault. 2018. Long Range LiDAR Characterisation for Obstacle Detection for use by the Visually Impaired and Blind. In 2018 IEEE 68th Electronic Components and Technology Conference (ECTC). 533--538. https://doi.org/10.1109/ECTC.2018.00084
[40]
Loes Ottink, Bram van Raalte, Christian F. Doeller, Thea M. Van der Geest, and Richard J. A. Van Wezel. 2022. Cognitive map formation through tactile map navigation in visually impaired and sighted persons. Scientific Reports 12, 1 (07 Jul 2022), 11567. https://doi.org/10.1038/s41598-022-15858-4
[41]
Se-Woong Park, Tjeerd MH Dijkstra, and Dagmar Sternad. 2013. Learning to never forget---time scales and specificity of long-term memory of a motor skill. Frontiers in computational neuroscience 7 (2013), 111.
[42]
Kailas Patil, Qaidjohar Jawadwala, and Felix Che Shu. 2018. Design and Construction of Electronic Aid for Visually Impaired People. IEEE Transactions on Human-Machine Systems 48, 2 (April 2018), 172--182. https://doi.org/10.1109/THMS.2018.2799588
[43]
Roman Rener. 2017. The 3D Printing of Tactile Maps for Persons with Visual Impairment. In Universal Access in Human-Computer Interaction. Designing Novel Interactions, Margherita Antona and Constantine Stephanidis (Eds.). Springer International Publishing, Cham, 335--350.
[44]
Géza Révész. 1950. Psychology and art of the blind. (1950).
[45]
John J Rieser, Everett W Hill, Charles R Talor, Anna Bradfield, and Sandra Rosen. 1992. Visual experience, visual field size, and the development of nonvisual sensitivity to the spatial structure of outdoor neighborhoods explored by walking. Journal of Experimental Psychology: General 121, 2 (1992), 210.
[46]
John J. Rieser, Jeffrey J. Lockman, and Herbert L. Pick. 1980. The role of visual experience in knowledge of spatial layout. Perception & Psychophysics 28, 3 (01 May 1980), 185--190. https://doi.org/10.3758/BF03204374
[47]
Irvin Rock and Jack Victor. 1964. Vision and touch: An experimentally created conflict between the two senses. Science 143, 3606 (1964), 594--596.
[48]
Sophie Rouzier, Bernard Hennion, Tomás Pérez Segovia, and Denis Chêne. 2004. Touching Geometry for Blind Pupils. In Computers Helping People with Special Needs. Springer Berlin Heidelberg, Berlin, Heidelberg, 697--704.
[49]
M.F. Saaid, A.M. Mohammad, and M.S.A. Megat Ali. 2016. Smart cane with range notification for blind people. In 2016 IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS). 225--229. https://doi.org/10.1109/I2CACIS.2016.7885319
[50]
Jaime Sánchez, Matías Espinoza, Márcia de Borba Campos, and Letícia Lopes Leite. 2014. Modeling Videogames for Mental Mapping in People Who Are Blind. In Universal Access in Human-Computer Interaction. Universal Access to Information and Knowledge, Constantine Stephanidis and Margherita Antona (Eds.). Springer International Publishing, Cham, 605--616.
[51]
Jaime Sánchez, Matías Espinoza, Marcia de Borba Campos, and Lotfi B. Merabet. 2013. Enhancing Orientation and Mobility Skills in Learners Who Are Blind through Video Gaming. In Proceedings of the 9th ACM Conference on Creativity amp; Cognition (Sydney, Australia) (Camp;C '13). Association for Computing Machinery, New York, NY, USA, 353--356. https://doi.org/10.1145/2466627.2466673
[52]
Richard A Schmidt, Timothy D Lee, Carolee Winstein, Gabriele Wulf, and Howard N Zelaznik. 2018. Motor control and learning: A behavioral emphasis. Human kinetics.
[53]
Stanley Shen. 2022. A Novel Three-Dimensional Navigation Method for the Visually Impaired. arXiv preprint arXiv:2206.11136 (2022).
[54]
Peter B. Shull and Dana D. Damian. 2015. Haptic wearables as sensory replacement, sensory augmentation and trainer - a review. Journal of NeuroEngineering and Rehabilitation 12, 1 (20 Jul 2015), 59. https://doi.org/10.1186/s12984-015-0055-z
[55]
Katsunori Tai and Yasuyuki Kono. 2017. Walking Motion Recognition System by Estimating Position and Pose of Leg Mounted Camera Device Using Visual SLAM. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vienna, Austria) (MobileHCI '17). Association for Computing Machinery, New York, NY, USA, Article 49, 6 pages. https://doi.org/10.1145/3098279.3125437
[56]
M. Gail Jones;Jennifer H. Forrester;Laura E. Robertson;Grant E. Gardner;Amy R. Taylor;. 2012. Accuracy of Estimations of Measurements by Students with Visual Impairments. Journal of Visual Impairment Blindness 106, 6 (2012), 351--355. https://doi.org/10.1177/0145482X1210600604
[57]
Carolyn Ton, Abdelmalak Omar, Vitaliy Szedenko, Viet Hung Tran, Alina Aftab, Fabiana Perla, Michael J. Bernstein, and Yi Yang. 2018. LIDAR Assist Spatial Sensing for the Visually Impaired and Performance Analysis. IEEE Transactions on Neural Systems and Rehabilitation Engineering 26, 9 (Sep. 2018), 1727--1734. https://doi.org/10.1109/TNSRE.2018.2859800
[58]
Tomaso Vecchi, Maria Luisa Monticellai, and Cesare Cornoldi. 1995. Visuo-spatial working memory: Structures and variables affecting a capacity measure. Neuropsychologia 33, 11 (1995), 1549--1564.
[59]
Daniel Vera, Diego Marcillo, and Antonio Pereira. 2017. Blind Guide: Anytime, Anywhere Solution for Guiding Blind People. In Recent Advances in Information Systems and Technologies, Álvaro Rocha, Ana Maria Correia, Hojjat Adeli, Luís Paulo Reis, and Sandra Costanzo (Eds.). Springer International Publishing, Cham, 353--363.
[60]
Rob Withagen and Claire F. Michaels. 2004. Transfer of calibration in length perception by dynamic touch. Perception Psychophysics 66, 8 (2004), 1282--1292. https://doi.org/10.3758/BF03194998
[61]
Jeremy D Wong, Dinant A. Kistemaker, Alvin Chin, and Paul L. Gribble. 2012. Can proprioceptive training improve motor learning? Journal of neurophysiology 108 12 (2012), 3313--21. https://api.semanticscholar.org/CorpusID:17219279
[62]
Philip Worchel. 1951. Space Perception and Orientation by the Blind. The Psychological Monographs 65 (1951), 1--28. https://api.semanticscholar.org/CorpusID:147065481
[63]
yasumasa sato. 1974. Psychology of visually impaired children. science books. https://cir.nii.ac.jp/crid/1130000798050233216
[64]
Jingjing Zhang, Ze Dong, Xiaoliang Bai, Robert W. Lindeman, Weiping He, and Thammathip Piumsomboon. 2022. Augmented Perception Through Spatial Scale Manipulation in Virtual Reality for Enhanced Empathy in Design-Related Tasks. Frontiers in Virtual Reality 3 (2022). https://doi.org/10.3389/frvir.2022.672537
Index Terms
- AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone Assistant
Index terms have been assigned to the content through auto-classification.
Recommendations
What Makes Videos Accessible to Blind and Visually Impaired People?
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsUser-generated videos are an increasingly important source of information online, yet most online videos are inaccessible to blind and visually impaired (BVI) people. To find videos that are accessible, or understandable without additional description ...
Game accessibility for visually impaired people: a review
AbstractPlaying games is an important way to promote the integration, inclusion, and socialization of participants. This is especially the case of persons with disabilities, such as visually impaired people. Unfortunately, very few games are accessible to ...
Interactive audio-tactile maps for visually impaired people
Visually impaired people face important challenges related to orientation and mobility. Indeed, 56% of visually impaired people in France declared having problems concerning autonomous mobility [10]. These problems often mean that visually impaired ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 September 2024
Published in IMWUT Volume 8, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 369Total Downloads
- Downloads (Last 12 months)369
- Downloads (Last 6 weeks)136
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in