More Web Proxy on the site http://driver.im/

research-article

Simplifying orientation measurement for mobile audio augmented reality applications

Authors:

Florian Heller,

Jan BorchersAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 615 - 624

https://doi.org/10.1145/2556288.2557021

Published: 26 April 2014 Publication History

Abstract

Audio augmented reality systems overlay the physical world with a virtual audio space. Today's smartphones provide enough processing power to create the impression of virtual sound sources being located in the real world. To achieve this, information about the user's location and orientation is necessary which requires additional hardware. In a real-world installation, however, we observed that instead of turning their head to localize sounds, users tend to turn their entire body. Therefore, we suggest to simply measure orientation of the user's body - or even just the mobile device she is holding - to generate the spatial audio.

To verify this approach, we present two studies: Our first study in examines the user's head, body, and mobile device orientation when moving through an audio augmented reality system in a lab setting. Our second study analyzes the user experience in a real-world installation when using head, body, or device orientation to control the audio spatialization. We found that when navigating close to sound sources head tracking is necessary, but that it can potentially be replaced by device tracking in larger or more explorative usage scenarios. These findings help reduce the technical complexity of mobile audio augmented reality systems (MAARS), and enable their wider dissemination as mobile software-only apps.

References

[1]

Alais, D., and Burr, D. The ventriloquist effect results from near-optimal bimodal integration. Current biology 14, 3 (2004), 257--262.

[2]

Ankolekar, A., Sandholm, T., and Yu, L. Play it by ear: a case for serendipitous discovery of places with musicons. In Proc. CHI '13, ACM (2013), 2959--2968.

Digital Library

[3]

Blauert, J. Spatial Hearing: Psychophysics of Human Sound Localization, 2nd ed. MIT Press, 1996.

[4]

Brungart, D. S., Simpson, B. D., and Kordik, A. J. The detectability of headtracker latency in virtual audio displays. In Proc. ICAD '05 (2005), 37--42.

[5]

Holland, S., Morse, D. R., and Gedenryd, H. AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface. Personal and Ubiquitous computing 6, 4 (Jan. 2002).

Digital Library

[6]

Kajastila, R., and Lokki, T. Eyes-free methods for accessing large auditory menus. In Proc. ICAD '10 (2010), 223--230.

[7]

Loomis, J. M., Hebert, C., and Cicinelli, J. G. Active localization of virtual sounds. The Journal of the Acoustical Society of America 88 (1990), 1757.

[8]

Lyons, K., Gandy, M., and Starner, T. Guided by voices: An audio augmented reality system. In Proc. ICAD '00 (2000).

[9]

Mackay, W. E. Augmented reality: linking real and virtual worlds: a new paradigm for interacting with computers. In Proc. AVI '98, ACM (1998), 13--21.

Digital Library

[10]

Marentakis, G. N., and Brewster, S. A. Effects of feedback, mobility and index of difficulty on deictic spatial audio target acquisition in the horizontal plane. In Proc. CHI '06, ACM (2006), 359--368.

Digital Library

[11]

Mariette, N. Navigation performance effects of render method and head-turn latency in mobile audio augmented reality. In Proc. ICAD '09. Springer, Copenhagen, 2010, 239--265.

Digital Library

[12]

McGookin, D., Brewster, S., and Priego, P. Audio Bubbles: Employing Non-speech Audio to Support Tourist Wayfinding. In Proc. HAID '09. Springer, Dresden, Germany, 2009, 41--50.

Digital Library

[13]

Middlebrooks, J. C., and Green, D. M. Sound localization by human listeners. Annual review of psychology 42, 1 (1991), 135--159.

[14]

Reid, J., Hull, R., Cater, K., and Fleuriot, C. Magic moments in situated mediascapes. In Proc. ACE '05, ACM (2005), 290--293.

Digital Library

[15]

Sander, C., Wefers, F., and Leckschat, D. Scalable Binaural Synthesis on Mobile Devices. In AES Convention 133 (Oct. 2012).

[16]

Stahl, C. The roaring navigator: a group guide for the zoo with shared auditory landmark display. In Proc. MobileHCI '07, ACM (2007).

Digital Library

[17]

Terrenghi, L., and Zimmermann, A. Tailored audio augmented environments for museums. In Proc. IUI '04, ACM (2004).

Digital Library

[18]

Tran, T. V., Letowski, T., and Abouchacra, K. S. Evaluation of acoustic beacon characteristics for navigation tasks. Ergonomics 43, 6 (2000), 807--827.

[19]

Vazquez-Alvarez, Y., Oakley, I., and Brewster, S. Auditory display design for exploration in mobile audio-augmented reality. Personal and Ubiquitous computing 16, 8 (2012), 987--999.

Digital Library

[20]

Vorländer, M. Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality, 1st ed. Springer, 2007.

Digital Library

[21]

Wakkary, R., and Hatala, M. ec(h)o: situated play in a tangible and audio museum guide. In Proc. DIS '06, ACM (2006).

Digital Library

[22]

Walker, B. N., and Lindsay, J. Navigation Performance With a Virtual Auditory Display: Effects of Beacon Sound, Capture Radius, and Practice. Human Factors 48, 2 (2006), 265--278.

[23]

Witmer, B. G., and Singer, M. J. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoper. Virtual Environ. 7, 3 (1998), 225--240.

Digital Library

[24]

Zotkin, D. N., Duraiswami, R., and Davis, L. Rendering localized spatial audio in a virtual auditory space. IEEE Transactions on Multimedia 6, 4 (2004), 553--564.

Digital Library

Cited By

Shin SBatch AButcher PRitsos PElmqvist N(2024)The Reality of the Situation: A Survey of Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.328554630:8(5147-5164)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3285546
Heller FAdamczyk JLuyten K(2020)Attracktion: Field Evaluation of Multi-Track Audio as Unobtrusive Cues for Pedestrian Navigation22nd International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3379503.3403546(1-7)Online publication date: 5-Oct-2020
https://dl.acm.org/doi/10.1145/3379503.3403546
Kwok TKiefer PSchinazi VAdams BRaubal MBrewster SFitzpatrick GCox AKostakos V(2019)Gaze-Guided NarrativesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300721(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300721
Show More Cited By

Index Terms

Simplifying orientation measurement for mobile audio augmented reality applications
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Audio augmented reality for human-object interactions
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

In the past, augmented reality (AR) research focused mostly on visual augmentation, which requires a visual rendering device like head-mounted displays that are usually obtrusive, expensive, and socially unaccepted. In contrast, wearable audio headsets ...
Where are we?: evaluating the current rendering fidelity of mobile audio augmented reality systems
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services

Mobile audio augmented reality systems (MAARS) simulate virtual audio sources in a physical space via headphones. While 20 years ago, these required expensive sensing and rendering equipment, the necessary technology has become widely available. ...
NavigaTone: Seamlessly Embedding Navigation Cues in Mobile Music Listening
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

As humans, we have the natural capability of localizing the origin of sounds. Spatial audio rendering leverages this skill by applying special filters to recorded audio to create the impression that a sound emanates from a certain position in the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
710
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)3

Reflects downloads up to 18 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shin SBatch AButcher PRitsos PElmqvist N(2024)The Reality of the Situation: A Survey of Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.328554630:8(5147-5164)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3285546
Heller FAdamczyk JLuyten K(2020)Attracktion: Field Evaluation of Multi-Track Audio as Unobtrusive Cues for Pedestrian Navigation22nd International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3379503.3403546(1-7)Online publication date: 5-Oct-2020
https://dl.acm.org/doi/10.1145/3379503.3403546
Kwok TKiefer PSchinazi VAdams BRaubal MBrewster SFitzpatrick GCox AKostakos V(2019)Gaze-Guided NarrativesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300721(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300721
Dey ABillinghurst MLindeman RSwan J(2018)A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014Frontiers in Robotics and AI10.3389/frobt.2018.000375Online publication date: 17-Apr-2018
https://doi.org/10.3389/frobt.2018.00037
Sikora MRusso MĐerek JJurčević A(2018)Soundscape of an Archaeological Site Recreated with Audio Augmented RealityACM Transactions on Multimedia Computing, Communications, and Applications10.1145/323065214:3(1-22)Online publication date: 24-Jul-2018
https://dl.acm.org/doi/10.1145/3230652
Salo KBauters MMikkonen TShin SShin DLencastre M(2017)User generated soundscapes activating museum visitorsProceedings of the Symposium on Applied Computing10.1145/3019612.3019691(220-227)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/3019612.3019691
Heller FJevanesan JDietrich PBorchers JPaternò FVäänänen KChurch KHäkkilä JKrüger ASerrano M(2016)Where are we?Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/2935334.2935365(278-282)Online publication date: 6-Sep-2016
https://dl.acm.org/doi/10.1145/2935334.2935365
Salo KBauters MMikkonen T(2016)Mobile Soundscape Mixer – Ready for ActionMobile Web and Intelligent Information Systems10.1007/978-3-319-44215-0_2(18-30)Online publication date: 11-Aug-2016
https://doi.org/10.1007/978-3-319-44215-0_2
Salo KGiova DMikkonen T(2016)Backend Infrastructure Supporting Audio Augmented Reality and StorytellingHuman Interface and the Management of Information: Applications and Services10.1007/978-3-319-40397-7_31(325-335)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-40397-7_31
Park YKoh KPark HSeo JZhang ZCohen PBohus DHoraud RMeng H(2015)An Experiment on the Feasibility of Spatial Acquisition using a Moving Auditory Cue for Pedestrian NavigationProceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2820779(171-174)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1145/2818346.2820779
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents