More Web Proxy on the site http://driver.im/

abstract

Navigation Based Application with Augmented Reality and Accessibility

Authors:

Sebastião Rocha,

Arminda LopesAuthors Info & Claims

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 9

https://doi.org/10.1145/3334480.3383004

Published: 25 April 2020 Publication History

Abstract

The implementation of adaptative applications for navigation and ubiquitous interfaces for accessibility defines a new era on spatial computing; especially on solutions that understand reacting to the environment, delivering navigation capabilities with high accuracy and utility for users. Real-time key information and awareness is presented in augmented reality (AR) by using interactive visual elements and auditive instructions. This paper describes a solution running on smartphones by using spatial computing capabilities for positional determination, tracking the user movements over the environment space. Besides the user-friendly minimalistic visual interface, the system is also able to instruct, guiding a completely blind person from a start position into a certain destination, avoiding obstacles. The communication is completely independent and uses voice recognition for accessibility capabilities.

Supplementary Material

MP4 File (lbw222pv.mp4)

Preview video

Download
7.44 MB

References

[1]

Apple, "ARKit," 2019. [Online]. Available: https://developer.apple.com/arkit/.

[2]

Google, "ARCore," 2019. [Online]. Available: https://developers.google.com/ar.

[3]

M. Miesnieks, "Dawn of the AR Cloud," 2018. [Online]. Available: https://medium.com/6dai/dawn-of-the-ar-cloud-1b31eb4b52ac.

[4]

Dent Reality, "Dent Reality," 2019. [Online]. Available: https://www.dentreality.com.

[5]

Apple, "Indoor Mapping Data Format," 2019. [Online]. Available: https://register.apple.com/resources/imdf/.

[6]

Google, "Introducing Live View, the new augmented reality feature in Google Maps," 2019. [Online]. Available: https://support.google.com/maps/thread/115542 55?hl=en.

[7]

Google, "Google Maps," 2019. [Online]. Available: https://www.google.com/maps.

[8]

ARWay, "ARWay," 2019. [Online]. Available: https://www.arway.app.

[9]

Mobidev, "How Augmented Reality-based Indoor Navigation Works," 2019. [Online]. Available: https://mobidev.biz/blog/augmented-realityindoor-navigation-app-developement-arkit#1.

[10]

Mobidev, "ARKit based AR indoor navigation in corporate campus," 2018. [Online]. Available: https://youtu.be/VmROm6nbElA.

[11]

Microsoft, "Indoor Navigation," 2016. [Online]. Available: https://youtu.be/yLTV_ZOFlWc.

[12]

Wikipedia, "Digital Twin," [Online]. Available: https://en.wikipedia.org/wiki/Digital_twin. [Accessed 2020].

[13]

J. Boyle, "First steps into an AR Cloud: Relocalization," 2018. [Online]. Available: https://medium.com/@3d_jb/first-steps-into-anar-cloud-relocalization-58d04ea93aa.

[14]

J. Boyle, "Sharing in AR, Today and Tomorrow," 2018. [Online]. Available: https://medium.com/@3d_jb/sharing-in-ar-todayand-tomorrow-da285881cd65.

[15]

A. Strange, "The Future of the AR Cloud - a Thousand Walled Gardens Bloom," 2019. [Online]. Available: https://next.reality.news/news/futurear-cloud-thousand-walled-gardens-bloom0196249/.

[16]

K. Kelly, "AR Will Spark the Next Big Tech Platform-Call It Mirrorworld," 2019. [Online]. Available: https://www.wired.com/story/mirrorworld-arnext-big-tech-platform/.

[17]

O. Inbar, "Mirrorworld v. AR Cloud or: How I Learned to Stop Worrying and Love the Spatial Future," 2019. [Online]. Available: https://medium.com/super-venturesblog/mirrorworld-v-ar-cloud-or-how-i-learned-tostop-worrying-and-love-the-spatial-future59de8fe8538f.

[18]

T. Parisi, "Building the Mirrorworld," 2019. [Online]. Available: https://medium.com/@tonyparisi/building-themirrorworld-f1f978c3eae6.

[19]

J. Boyle, "Global Relocalization: A Better GPS," 2018. [Online]. Available: https://medium.com/@3d_jb/globalrelocalization-a-better-gps-b6b98d2db20c.

[20]

O. Inbar, "AR and Blockchain: A Match Made in The AR Cloud," 2018. [Online]. Available: https://medium.com/super-ventures-blog/ar-andblockchain-a-match-made-in-the-ar-cloud7b10c52faddb.

[21]

O. Inbar, "The AR Cloud is Making it Rain!," 2018. [Online]. Available: https://medium.com/@oriinbar/the-ar-cloud-ismaking-it-rain-66c4c0f164f9.

[22]

M. Miesnieks, "Why AR Apps will struggle for engagement without the AR Cloud," 2017. [Online]. Available: https://medium.com/6dai/why-is-arkit-almost-useless-without-thearcloud-6ee1e7affc65.

[23]

Wikipedia, "Lidar," 2019. [Online]. Available: https://en.wikipedia.org/wiki/Lidar.

[24]

Wikipedia, "Time-of-flight camera," 2019. [Online]. Available: https://en.wikipedia.org/wiki/Time-offlight_camera.

[25]

Wikipedia, "Inertial measurement unit," 2019. [Online]. Available: https://en.wikipedia.org/wiki/Inertial_measureme nt_unit.

[26]

MeshLab, "MeshLab," 2019. [Online]. Available: http://www.meshlab.net.

[27]

Wikipedia, "QR code," [Online]. Available: https://en.wikipedia.org/wiki/QR_code. [Accessed 2020].

[28]

6D.ai, "AR Cloud Guide," 2019. [Online]. Available: https://developer.6d.ai/user/dashboard/?view=ar _cloud_guide.

[29]

Lifewire, "What Is a Service Set Identifier (SSID)?," 2019. [Online]. Available: https://www.lifewire.com/definition-of-serviceset-identifier-816547.

[30]

Wikipedia, "Wireless access point," [Online]. Available: https://en.wikipedia.org/wiki/Wireless_access_poi nt. [Accessed 2020].

[31]

GeeksforGeeks, *A* Search Algorithm," 2017. [Online]. Available: https://www.geeksforgeeks.org/a-searchalgorithm/.

[32]

Wikipedia, *A* search algorithm," [Online]. Available: https://en.wikipedia.org/wiki/A*_search_algorith m.

[33]

GeeksforGeeks, *A* Search Algorithm | GeeksforGeeks," 2017. [Online]. Available: https://youtu.be/vP5TkF0xJgI.

[34]

Computerphile, *A* (A Star) Search Algorithm Computerphile," 2017. [Online]. Available: https://youtu.be/ySN5Wnu88nE.

[35]

A. Patel, *A* Pathfinding," 2019. [Online]. Available: http://theory.stanford.edu/~amitp/GameProgram ming/.

[36]

Amit Patel, "Introduction to the A* Algorithm," 2019. [Online]. Available: https://www.redblobgames.com/pathfinding/astar/introduction.html.

[37]

S. Lague, *A* Pathfinding (E01: Algorithm explanation)," 2014. [Online]. Available: https://youtu.be/-L-WgKMFuhE. [Accessed 2019].

[38]

Wikipedia, "Six degrees of freedom," [Online]. Available: https://en.wikipedia.org/wiki/Six_degrees_of_free dom. [Accessed 2019].

[39]

Wikipedia, "Simultaneous localization and mapping," 2019. [Online]. Available: https://en.wikipedia.org/wiki/Simultaneous_localiz ation_and_mapping.

Cited By

Yu RLee SXie JBillah SCarroll J(2024)Human–AI Collaboration for Remote Sighted Assistance: Perspectives from the LLM EraFuture Internet10.3390/fi1607025416:7(254)Online publication date: 18-Jul-2024
https://doi.org/10.3390/fi16070254
Stefanidi H(2024)Meaningful Interaction with Digital Data in MotionAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686643(1-3)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3686643
Pathmanathan NRau TYang XCalepso AAmtsberg FMenges ASedlmair MKurzhals K(2024)Eyes on the Task: Gaze Analysis of Situated Visualization for Collaborative Tasks2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00098(785-795)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00098
Show More Cited By

Index Terms

Navigation Based Application with Augmented Reality and Accessibility
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Natural language interfaces
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Making Mobile Augmented Reality Applications Accessible
ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

Augmented Reality (AR) technology creates new immersive experiences in entertainment, games, education, retail, and social media. AR content is often primarily visual and it is challenging to enable access to it non-visually due to the mix of virtual and ...
Augmented Reality for Real-Time Navigation Assistance to Wheelchair Users with Obstacles’ Management
Computational Science – ICCS 2019
Abstract
Despite a rapid technological evolution in the field of technical assistance for people with motor disabilities, their ability to move independently in a wheelchair is still limited. New information and communication technologies (NICT) such as ...
Inclusive Immersion: a review of efforts to improve accessibility in virtual reality, augmented reality and the metaverse
Abstract
Virtual Reality (VR) and Augmented Reality (AR) afford new forms of work and leisure. While affordable and effective VR and AR headsets are now available, neither technology has achieved widespread user adoption. However, we predict continual ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

4474 pages

ISBN:9781450368193

DOI:10.1145/3334480

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2020

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
1,041
Total Downloads

Downloads (Last 12 months)200
Downloads (Last 6 weeks)21

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yu RLee SXie JBillah SCarroll J(2024)Human–AI Collaboration for Remote Sighted Assistance: Perspectives from the LLM EraFuture Internet10.3390/fi1607025416:7(254)Online publication date: 18-Jul-2024
https://doi.org/10.3390/fi16070254
Stefanidi H(2024)Meaningful Interaction with Digital Data in MotionAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686643(1-3)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3686643
Pathmanathan NRau TYang XCalepso AAmtsberg FMenges ASedlmair MKurzhals K(2024)Eyes on the Task: Gaze Analysis of Situated Visualization for Collaborative Tasks2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00098(785-795)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00098
Lynam HDascalu SFolmer E(2024)Augmented Reality Navigation: A SurveyInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2431757(1-17)Online publication date: 28-Nov-2024
https://doi.org/10.1080/10447318.2024.2431757
Cheliotis KLiarokapis FKokla MTomai EPastra KAnastopoulou NBezerianou MDarra AKavouras M(2024)UnityGeoAR: A geolocation Augmented Reality package for Unity3DSoftwareX10.1016/j.softx.2024.10177427(101774)Online publication date: Sep-2024
https://doi.org/10.1016/j.softx.2024.101774
Aswanth MAmal Alok CNagaraju SElappila M(2024)Augmented Reality based Navigation for Indoor Environment using Unity PlatformFourth Congress on Intelligent Systems10.1007/978-981-99-9043-6_17(199-207)Online publication date: 27-Mar-2024
https://doi.org/10.1007/978-981-99-9043-6_17
Macháč THořejší PŠimon M(2024)Using Markers to Refine GPS Positioning for Augmented Reality Warehouse NavigationResearch and Innovation Forum 202310.1007/978-3-031-44721-1_49(649-660)Online publication date: 1-Jan-2024
https://doi.org/10.1007/978-3-031-44721-1_49
Ryskeldiev BKobayashi MTeramoto KKusano K(2023)Towards Immersive Inclusivity for C2C: How Immersive Multimodal Interactions Can Make Online Customer-to-Customer Shopping More InclusiveProceedings of the Asian HCI Symposium 202310.1145/3604571.3604586(84-88)Online publication date: 28-Apr-2023
https://dl.acm.org/doi/10.1145/3604571.3604586
Vatavu R(2023)Leveraging Sensorimotor Realities for Assistive Technology Design Bridging Smart Environments and Virtual WorldsProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594834(247-253)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594834
Pang WXia CLeong BAhmad FPaek JGovindan RCosta XAl Hassanieh HAsadi ACox LPerino DWidmer JGiustiniano D(2023)UbiPose: Towards Ubiquitous Outdoor AR Pose Tracking using Aerial MeshesProceedings of the 29th Annual International Conference on Mobile Computing and Networking10.1145/3570361.3613263(1-16)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1145/3570361.3613263
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents