[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3605390.3605421acmotherconferencesArticle/Chapter ViewAbstractPublication PageschitalyConference Proceedingsconference-collections
short-paper
Open access

Exploring the User Experience of an AI-based Smartphone Navigation Assistant for People with Visual Impairments

Published: 20 September 2023 Publication History

Abstract

Advancements in artificial intelligence (AI), computer vision, and smartphone technology have spurred the development of navigation assistants aiming to improve the independent mobility experience of people with visual impairments. Still, few studies have explored whether such tools meet this intention. Therefore, this study aimed to examine the perceptions of people with visual impairments on an AI-based navigation assistant and how their perceptions may influence their use of these technologies. A study involving 13 participants was conducted with DeepNAVI, an AI-based smartphone navigation assistant for people with visual impairments in both indoor and outdoor environments. The participants reported mixed reactions towards the navigation assistant, from excitement about the promise of increased independence to a lack of trust and skepticism toward the reliability of this technology. The perceptions from the participants provide some valuable insights about AI-based smartphone navigation assistants and their practicality in real life.

References

[1]
Ali Abdolrahmani, William Easley, Michele Williams, Stacy Branham, and Amy Hurst. 2017. Embracing errors: Examining how context of use impacts blind individuals’ acceptance of navigation aid errors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4158–4169.
[2]
Ali Abdolrahmani, Maya Howes Gupta, Mei-Lian Vader, Ravi Kuber, and Stacy Branham. 2021. Towards More Transactional Voice Assistants: Investigating the Potential for a Multimodal Voice-Activated Indoor Navigation Assistant for Blind and Sighted Travelers. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–16.
[3]
Tousif Ahmed, Roberto Hoyle, Kay Connelly, David Crandall, and Apu Kapadia. 2015. Privacy concerns and behaviors of people with visual impairments. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 3523–3532.
[4]
Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: a navigational cognitive assistant for the blind. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, USA, 90–99.
[5]
Dragan Ahmetovic, Masayuki Murata, Cole Gleason, Erin Brady, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. Achieving practical and accurate indoor navigation for people with visual impairments. In Proceedings of the 14th International Web for All Conference. ACM, New York, NY, USA, 1–10.
[6]
Taslima Akter, Bryan Dosono, Tousif Ahmed, Apu Kapadia, and Bryan Semaan. 2020. “I am uncomfortable sharing what I can’t see” privacy concerns of the visually impaired with camera based assistive applications. In Proceedings of the 29th USENIX Conference on Security Symposium. 1929–1948.
[7]
Aitor Aladren, Gonzalo López-Nicolás, Luis Puig, and Josechu J Guerrero. 2014. Navigation assistance for the visually impaired using RGB-D sensor with range expansion. IEEE Systems Journal 10, 3 (2014), 922–932.
[8]
Maryam Bandukda, Aneesha Singh, Nadia Berthouze, and Catherine Holloway. 2019. Understanding experiences of blind individuals in outdoor nature. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–6.
[9]
Nikola Banovic, Rachel L Franz, Khai N Truong, Jennifer Mankoff, and Anind K Dey. 2013. Uncovering information needs for independent spatial learning for users who are visually impaired. In Proceedings of the 15th international ACM SIGACCESS conference on computers and accessibility. ACM, New York, NY, USA, 1–8.
[10]
Alexy Bhowmick and Shyamanta M Hazarika. 2017. An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends. Journal on Multimodal User Interfaces 11 (2017), 149–172.
[11]
Stacy M Branham, Ali Abdolrahmani, William Easley, Morgan Scheuerman, Erick Ronquillo, and Amy Hurst. 2017. " Is Someone There? Do They Have a Gun" How Visual Information about Others Can Improve Personal Safety Management for Blind Individuals. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, New York, NY, USA, 260–269.
[12]
Stacy M Branham and Antony Rishin Mukkath Roy. 2019. Reading between the guidelines: How commercial voice assistant guidelines hinder accessibility for blind users. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. ACM, New York, NY, USA, 446–458.
[13]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
[14]
Andrius Budrionis, Darius Plikynas, Povilas Daniušis, and Audrius Indrulionis. 2022. Smartphone-based computer vision travelling aids for blind and visually impaired individuals: A systematic review. Assistive Technology 34, 2 (2022), 178–194.
[15]
Laila Burla, Birte Knierim, Jurgen Barth, Katharina Liewald, Margreet Duetz, and Thomas Abel. 2008. From text to codings: intercoder reliability assessment in qualitative content analysis. Nursing research 57, 2 (2008), 113–117.
[16]
Babar Chaudary, Iikka Paajala, Leena Arhippainen, and Petri Pulli. 2021. Studying the navigation assistance system for the visually impaired and blind persons and ICT use by their Caretakers. In 2021 28th Conference of Open Innovations Association (FRUCT). IEEE, 55–66.
[17]
Hsuan-Eng Chen, Yi-Ying Lin, Chien-Hsing Chen, and I-Fang Wang. 2015. BlindNavi: A navigation app for the visually impaired smartphone user. In Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems. ACM, New York, NY, USA, 19–24.
[18]
Aline Darc Piculo dos Santos, Ana Lya Moya Ferrari, Fausto Orsi Medola, and Frode Eika Sandnes. 2022. Aesthetics and the perceived stigma of assistive technology for visual impairment. Disability and Rehabilitation: Assistive Technology 17, 2 (2022), 152–158.
[19]
William Easley, Michele A Williams, Ali Abdolrahmani, Caroline Galbraith, Stacy M Branham, Amy Hurst, and Shaun K Kane. 2016. Let’s get lost: Exploring social norms in predominately blind environments. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 2034–2040.
[20]
Fatma El-Zahraa El-Taher, Ayman Taha, Jane Courtney, and Susan Mckeever. 2021. A systematic review of urban navigation systems for visually impaired people. Sensors 21, 9 (2021), 3103.
[21]
Yuanyuan Feng, Abhilasha Ravichander, Yaxing Yao, Shikun Zhang, and Norman Sadeh. 2022. Exploring and Improving the Accessibility of Data Privacy-related Information for People Who Are Blind or Low-vision. arXiv preprint arXiv:2208.09959 (2022).
[22]
Nicholas A. Giudice, Benjamin A. Guenther, Toni M. Kaplan, Shane M. Anderson, Robert J. Knuesel, and Joseph F. Cioffi. 2020. Use of an Indoor Navigation System by Sighted and Blind Travelers: Performance Similarities across Visual Status and Age. ACM Trans. Access. Comput. 13, 3 (2020), 1–27.
[23]
João Guerreiro, Dragan Ahmetovic, Daisuke Sato, Kris Kitani, and Chieko Asakawa. 2019. Airport accessibility and navigation assistance for people with visual impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14.
[24]
João Guerreiro, Eshed Ohn-Bar, Dragan Ahmetovic, Kris Kitani, and Chieko Asakawa. 2018. How context and user behavior affect indoor navigation assistance for blind people. In Proceedings of the 15th International Web for All Conference. ACM, New York, NY, USA, 1–4.
[25]
Lilit Hakobyan, Jo Lumsden, Dympna O’Sullivan, and Hannah Bartlett. 2013. Mobile assistive technologies for the visually impaired. Survey of ophthalmology 58, 6 (2013), 513–528.
[26]
Andreas Hub, Joachim Diepstraten, and Thomas Ertl. 2003. Design and development of an indoor navigation and object identification system for the blind. ACM Sigaccess Accessibility and Computing 77–78, 6 (2003), 147–152.
[27]
Hernisa Kacorri, Eshed Ohn-Bar, Kris M Kitani, and Chieko Asakawa. 2018. Environmental factors in indoor navigation based on real-world trajectories of blind users. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12.
[28]
Shaun K Kane, Chandrika Jayant, Jacob O Wobbrock, and Richard E Ladner. 2009. Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility. ACM, New York, NY, USA, 115–122.
[29]
Seita Kayukawa, Tatsuya Ishihara, Hironobu Takagi, Shigeo Morishima, and Chieko Asakawa. 2020. Guiding blind pedestrians in public spaces by understanding walking behavior of nearby pedestrians. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1–22.
[30]
Akif Khan and Shah Khusro. 2021. An insight into smartphone-based assistive solutions for visually impaired and blind people: issues, challenges and opportunities. Universal Access in the Information Society 20, 2 (2021), 265–298.
[31]
Jee-Eun Kim, Masahiro Bessho, Shinsuke Kobayashi, Noboru Koshizuka, and Ken Sakamura. 2016. Navigating visually impaired travelers in a large train station using smartphone and bluetooth low energy. In Proceedings of the 31st Annual ACM Symposium on Applied Computing. ACM, New York, NY, USA, 604–611.
[32]
Bineeth Kuriakose, Raju Shrestha, and Frode Eika Sandnes. 2022. LiDAR-Based Obstacle Detection and Distance Estimation in Navigation Assistance for Visually Impaired. In Universal Access in Human-Computer Interaction. User and Context Diversity: 16th International Conference, UAHCI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26–July 1, 2022, Proceedings, Part II. Springer, 479–491.
[33]
Bineeth Kuriakose, Raju Shrestha, and Frode Eika Sandnes. 2022. Tools and technologies for blind and visually impaired navigation support: A Review. IETE Technical Review 39, 1 (2022), 3–18.
[34]
Bineeth Kuriakose, Raju Shrestha, and Frode Eika Sandnes. 2023. DeepNAVI: A deep learning-based smartphone navigation assistant for people with visual impairments. Expert Systems with Applications 212 (2023), 118720.
[35]
Masaki Kuribayashi, Seita Kayukawa, Jayakorn Vongkulbhisal, Chieko Asakawa, Daisuke Sato, Hironobu Takagi, and Shigeo Morishima. 2022. Corridor-Walker: Mobile Indoor Walking Assistance for Blind People to Avoid Obstacles and Recognize Intersections. Proceedings of the ACM on Human-Computer Interaction 6, MHCI (2022), 1–22.
[36]
Anirudh Nagraj, Ravi Kuber, Foad Hamidi, and Raghavendra SG Prasad. 2021. Investigating the Navigational Habits of People who are Blind in India. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility. ACM, New York, NY, USA, 1–10.
[37]
Vishnu Nair, Greg Olmschenk, William H Seiple, and Zhigang Zhu. 2020. ASSIST: Evaluating the usability and performance of an indoor navigation assistant for blind and visually impaired people. Assistive Technology 34, 3 (2020), 289–299.
[38]
Charis Ntakolia, George Dimas, and Dimitris K Iakovidis. 2020. User-centered system design for assisted navigation of visually impaired individuals in outdoor cultural environments. Universal Access in the Information Society 21 (2020), 249–274.
[39]
Eshed Ohn-Bar, João Guerreiro, Kris Kitani, and Chieko Asakawa. 2018. Variability in reactions to instructional guidance during smartphone-based assisted navigation of blind users. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 2, 3 (2018), 1–25.
[40]
Joyojeet Pal, Anandhi Viswanathan, Priyank Chandra, Anisha Nazareth, Vaishnav Kameswaran, Hariharan Subramonyam, Aditya Johri, Mark S. Ackerman, and Sile O’Modhrain. 2017. Agency in Assistive Technology Adoption: Visual Impairment and Smartphone Use in Bangalore. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, New York, NY, USA, 5929–5940.
[41]
Sabrina A Panëels, Adriana Olmos, Jeffrey R Blum, and Jeremy R Cooperstock. 2013. Listen to it yourself! evaluating usability of what’s around me? for the blind. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2107–2116.
[42]
Darius Plikynas, Arūnas Žvironas, Andrius Budrionis, and Marius Gudauskis. 2020. Indoor navigation systems for visually impaired persons: Mapping the features of existing technologies to user needs. Sensors 20, 3 (2020), 636.
[43]
Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K Kane. 2016. The AT effect: how disability affects the perceived social acceptability of head-mounted display use. In proceedings of the 2016 CHI conference on human factors in computing systems. ACM, New York, NY, USA, 4884–4895.
[44]
Pablo-Alejandro Quinones, Tammy Greene, Rayoung Yang, and Mark Newman. 2011. Supporting visually impaired navigation: a needs-finding study. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 1645–1650.
[45]
Xukan Ran, Haoliang Chen, Zhenming Liu, and Jiasi Chen. 2017. Delivering deep learning to mobile devices via offloading. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network. ACM, New York, NY, USA, 42–47.
[46]
Xukan Ran, Haolianz Chen, Xiaodan Zhu, Zhenming Liu, and Jiasi Chen. 2018. Deepdecision: A mobile deep learning framework for edge video analytics. In IEEE INFOCOM 2018-IEEE Conference on Computer Communications. IEEE, 1421–1429.
[47]
Sanjeev U Rao, Swaroop Ranganath, TS Ashwin, Guddeti Ram Mohana Reddy, 2021. A Google glass based real-time scene analysis for the visually impaired. IEEE Access 9 (2021), 166351–166369.
[48]
Santiago Real and Alvaro Araujo. 2019. Navigation systems for the blind and visually impaired: Past work, challenges, and open problems. Sensors 19, 15 (2019), 3404.
[49]
Manaswi Saha, Alexander J Fiannaca, Melanie Kneisel, Edward Cutrell, and Meredith Ringel Morris. 2019. Closing the gap: Designing for the last-few-meters wayfinding problem for people with visual impairments. In The 21st international ACM sigaccess conference on computers and accessibility. ACM, New York, NY, USA, 222–235.
[50]
Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. Navcog3: An evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, New York, NY, USA, 270–279.
[51]
Aaron Raymond See, Bien Grenier Sasing, and Welsey Daniel Advincula. 2022. A Smartphone-Based Mobility Assistant Using Depth Imaging for Visually Impaired and Blind. Applied Sciences 12, 6 (2022), 2802.
[52]
Kristen Shinohara. 2010. Investigating meaning in uses of assistive devices: implications of social and professional contexts. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility. ACM, New York, NY, USA, 319–320.
[53]
Kristen Shinohara and Josh Tenenberg. 2009. A blind person’s interactions with technology. Commun. ACM 52, 8 (2009), 58–66.
[54]
Kristen Shinohara and Jacob O Wobbrock. 2011. In the shadow of misperception: assistive technology use and social interactions. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, NY, USA, 705–714.
[55]
Kristen Shinohara and Jacob O Wobbrock. 2016. Self-conscious or self-confident? A diary study conceptualizing the social accessibility of assistive technology. ACM Transactions on Accessible Computing (TACCESS) 8, 2 (2016), 1–31.
[56]
Paraskevi Theodorou and Apostolos Meliones. 2022. Gaining insight for the design, development, deployment and distribution of assistive navigation systems for blind and visually impaired people through a detailed user requirements elicitation. Universal Access in the Information Society (2022), 1–27.
[57]
Paraskevi Theodorou, Kleomenis Tsiligkos, Apostolos Meliones, and Costas Filios. 2022. An Extended Usability and UX Evaluation of a Mobile Application for the Navigation of Individuals with Blindness and Visual Impairments Outdoors—An Evaluation Framework Based on Training. Sensors 22, 12 (2022), 4538.
[58]
Mohammad Moeen Valipoor and Angélica de Antonio. 2022. Recent trends in computer vision-driven scene understanding for VI/blind users: a systematic mapping. Universal Access in the Information Society (2022), 1–23.
[59]
Wenfu Wang, Yongjian Fu, Zhijie Pan, Xi Li, and Yueting Zhuang. 2020. Real-time driving scene semantic segmentation. IEEE Access 8 (2020), 36776–36788.
[60]
Michele A Williams, Caroline Galbraith, Shaun K Kane, and Amy Hurst. 2014. " just let the cane hit it" how the blind and sighted see navigation differently. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility. ACM, New York, NY, USA, 217–224.
[61]
Bichen Wu, Forrest Iandola, Peter H Jin, and Kurt Keutzer. 2017. Squeezedet: Unified, small, low power fully convolutional neural networks for real-time object detection for autonomous driving. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops. IEEE, 129–137.
[62]
Limin Zeng, Markus Simros, and Gerhard Weber. 2017. Camera-based mobile electronic travel aids support for cognitive mapping of unknown spaces. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, USA, 1–10.

Cited By

View all
  • (2024)Comprehensive Review: High-Performance Positioning Systems for Navigation and Wayfinding for Visually Impaired PeopleSensors10.3390/s2421702024:21(7020)Online publication date: 31-Oct-2024
  • (2024)User Experience and Usability of Voice User Interfaces: A Systematic Literature ReviewInformation10.3390/info1509057915:9(579)Online publication date: 19-Sep-2024
  • (2024)Dude, Where's My Luggage? An Autoethnographic Account of Airport Navigation by a Traveler with Residual VisionProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675624(1-13)Online publication date: 27-Oct-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
CHItaly '23: Proceedings of the 15th Biannual Conference of the Italian SIGCHI Chapter
September 2023
416 pages
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2023

Check for updates

Author Tags

  1. AI
  2. deep learning
  3. navigation assistant
  4. portability
  5. smartphone
  6. user evaluation
  7. visually impaired

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

CHItaly 2023

Acceptance Rates

Overall Acceptance Rate 109 of 242 submissions, 45%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)483
  • Downloads (Last 6 weeks)52
Reflects downloads up to 28 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Comprehensive Review: High-Performance Positioning Systems for Navigation and Wayfinding for Visually Impaired PeopleSensors10.3390/s2421702024:21(7020)Online publication date: 31-Oct-2024
  • (2024)User Experience and Usability of Voice User Interfaces: A Systematic Literature ReviewInformation10.3390/info1509057915:9(579)Online publication date: 19-Sep-2024
  • (2024)Dude, Where's My Luggage? An Autoethnographic Account of Airport Navigation by a Traveler with Residual VisionProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675624(1-13)Online publication date: 27-Oct-2024
  • (2024)Review of AI Technologies for Enhancing the Lives of Visually Impaired Individuals: Applications, Outcomes, and Future Directions2024 International Conference on Information and Communication Technology for Development for Africa (ICT4DA)10.1109/ICT4DA62874.2024.10777268(241-246)Online publication date: 18-Nov-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media