[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments

Published: 22 October 2012 Publication History

Abstract

We present a study on audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments. Audio-visual rendering is provided using tracked passive visual stereoscopy and acoustic wave field synthesis (WFS). Distances are estimated using indirect blind-walking (triangulation) under each rendering condition. Experimental results show that distances perceived in the virtual environment are systematically overestimated for rendered distances closer than the position of the audio-visual rendering system and underestimated for farther distances. Interestingly, subjects perceived each virtual object at a modality-independent distance when using the audio modality, the visual modality, or the combination of both. WFS was able to synthesise perceptually meaningful sound fields. Dynamic audio-visual cues were used by subjects when estimating the distances in the virtual world. Moving may have provided subjects with a better visual distance perception of close distances than if they were static. No correlation between the feeling of presence and the visual distance underestimation has been found. To explain the observed perceptual distance compression, it is proposed that, due to conflicting distance cues, the audio-visual rendering system physically anchors the virtual world to the real world. Virtual objects are thus attracted by the physical audio-visual rendering system.

References

[1]
Alexandrova, I. V., Teneva, P. T., de la Rosa, S., Kloos, U., Bulthoff, H. H., and Mohler, B. J. 2010. Egocentric distance judgments in a large screen display immersive virtual environment. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization (APGV '10). ACM, New York, 57--60.
[2]
Andre, J. and Rogers, S. 2006. Using verbal and blind-walking distance estimates to investigate the two visual systems hypothesis. Percept. Psychophys. 68, 3, 353--361.
[3]
Armbruster, C., Wolter, M., Kuhlen, T., Spijkers, W., and Fimm, B. 2008. Depth perception in virtual reality: Distance estimations in peri- and extrapersonal space. Cyberpsychol. Behav.11, 1, 9--15.
[4]
Ashmead, D. H., Davis, D. L., and Northington, A. 1995. Contribution of listeners approaching motion to auditory distance perception. J. Experiment. Psychol.-Hum. Percept. Perform. 21, 2, 239--256.
[5]
Beall, A. C., Loomis, J. M., and Philbeck, J. W. 1994. Absolute motion parallax weakly determines visual scale. Investigative Ophthalmology Visual Sci. 35, 4, 2111--2111.
[6]
Berkhout, A. J., de Vries, D., and Vogel, P. 1993. Acoustic control by wave field synthesis. J. Acoustical Soc. Amer. 93, 5, 2764--2778.
[7]
Blauert, J. 1999. Spatial Hearing, The Psychophysics of Human Sound Localization. MIT Press, Cambridge, MA.
[8]
Bormann, K. 2005. Presence and the utility of audio spatialization. Presence-Teleoper. Virtual Environ. 14, 3, 278--297.
[9]
Bronkhorst, A. W. and Houtgast, T. 1999. Auditory distance perception in rooms. Nature 397, 6719, 517--520.
[10]
Brooks, F. P. 1999. What's real about virtual reality? IEEE Comput. Graph. Appl. 19, 6, 16--27.
[11]
Corteel, E. 2004. Caractérisation et extensions de la wave field synthesis en conditions réelles. Ph.D. dissertation, Université de Paris 6.
[12]
Corteel, E., NGuyen, K. V.,Warusfel, O., Caulkins, T., and Pellegrini, R. 2007. Objective and subjective comparison of electrodynamic and MAP loudspeakers for wave field synthesis. In Proceedings of the 30th International Conference of the Audio Engineering Society.
[13]
Creem-Regehr, S. H., Willemsen, P., Gooch, A. A., and Thompson, W. B. 2005. The influence of restricted viewing conditions on egocentric distance perception: Implications for real and virtual indoor environments. Perception 34, 2, 191--204.
[14]
Côté, N., Koehl, V., Paquier, M., and Devillers, F. 2011. Interaction between auditory and visual distance cues in virtual reality applications. In Proceedings of the Forum Acusticum.
[15]
Cutting, J. E. 1997. How the eye measures reality and virtual reality. Behav. Res. Meth. Instr. Comput. 29, 1, 27--36.
[16]
Faria, R. R. A., Zuffo, M. K., and Zuffo, J. A. 2005. Improving spatial perception through sound field simulation in VR. In Proceedings of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems. IEEE, Los Alamitos, CA, 103--108.
[17]
Fukusima, S. S., Loomis, J. M., and DaSilva, J. A. 1997. Visual perception of egocentric distance as assessed by triangulation. J. Exper. Psychol. Hum. Percept. Perform. 23, 1, 86--100.
[18]
Gerzon, M. A. 1985. Ambisonics in multichannel broadcasting and video. J. Audio Eng. Soc. 33, 11, 859--871.
[19]
Grechkin, T. Y., Nguyen, T. D., Plumert, J. M., Cremer, J. F., and Kearney, J. K. 2010. How does presentation method and measurement protocol affect distance estimation in real and virtual environments? ACM Trans. Appl. Percept. 7, 4, 26.
[20]
Hoffman, D. M., Girshick, A. R., Akeley, K., and Banks, M. S. 2008. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J. Vision 8, 3, 33.
[21]
Howarth, P. A. 2011. Potential hazards of viewing 3-D stereoscopic television, cinema and computer games: a review. Ophthalmic Physiol. Optics 31, 2, 111--122.
[22]
Interrante, V., Ries, B., Lindquist, J., Kaeding, M., and Anderson, L. 2008. Elucidating factors that can facilitate veridical spatial perception in immersive virtual environments. Presence-Teleoper. Virtual Environ.17, 2, 176--198.
[23]
Kearney, G., Gorzel, M., Rice, H., and Boland, F. 2012. Distance perception in interactive virtual acoustic environments using first and higher order ambisonic sound fields. Acta Acustica with Acustica 98, 1, 61--71.
[24]
Klein, E., Swan, J. E., Schmidt, G. S., Livingston, M. A., and Staadt, O. G. 2009. Measurement protocols for medium-field distance perception in large-screen immersive displays. In Proceedings of the IEEE Conference on Virtual Reality. IEEE, Los Alamitos, CA, 107--113.
[25]
Komiyama, S., Morita, A., Kurozumi, K., and Nakabayashi, K. 1991. Distance control system for a sound image. In Proceedings of the 9th Audio Engineering Society International Conference on Television Sound Today and Tomorrow.
[26]
Loomis, J. M., Klatzky, R. L., Philbeck, J. W., and Golledge, R. G. 1998. Assessing auditory distance perception using perceptually directed action. Percept. Psychophys. 60, 6, 966--980.
[27]
Loomis, J. M. and Knapp, J. M. 2003. Virtual and Adaptive Environments: Applications, Implications, and Human Performance t5rIssues. Lawrence Erlbaum.
[28]
Naceri, A., Chellali, R., Dionnet, F., and Toma, S. 2009. Depth perception within virtual environments: A comparative study between wide screen stereoscopic displays and head mounted devices. In Computation World. Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns, 460--466.
[29]
Nawrot, M. and Stroyan, K. 2009. The motion/pursuit law for visual depth perception from motion parallax. Vision Res. 49, 15, 1969--1978.
[30]
Plumert, J. M., Kearney, J. K., Cremer, J. F., and Recker, K. 2005. Distance perception in real and virtual environments. ACM Trans. Appl. Percept. 2, 216--233.
[31]
Porschmann, C. and Storig, C. 2009. Investigations into the velocity and distance perception of moving sound sources. Acta Acustica with Acustica 95, 4, 696--706.
[32]
Rébillat, M., Corteel, E., and Katz, B. F. 2008. SMART-I2: Spatial multi-user audio-visual real-time interactive interface. In Proceedings of the 125th Convention of the Audio Engineering Society.
[33]
Rébillat, M., Katz, B. F., and Corteel, E. 2009. SMART-I2: Spatial multi-user audio-visual real-time interactive interface. A broadcast application context. In Proceedings of the IEEE 3D-TV Conference. IEEE, Los Alamitos, CA.
[34]
Russell, M. K. and Schneider, A. L. 2006. Sound source perception in a two-dimensional setting: Comparison of action and nonaction-based response tasks. Ecological Psychol. 18, 3, 223--237.
[35]
Ryu, J., Hashimoto, N., and Sato, M. 2005. Influence of resolution degradation on distance estimation in virtual space displaying static and dynamic image. In Proceedings of the International Conference on Cyberworlds. 43--50.
[36]
Sanson, J., Corteel, E., and Warusfel, O. 2008. Objective and subjective analysis of localisation accuracy in wave field synthesis. In Proceedings of the 124th Convention of the Audio Engineering Society.
[37]
Slater, M. and Wilbur, S. 1997. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence-Teleoper. Virtual Environ. 6, 6, 603--616.
[38]
Speigle, J. M. and Loomis, J. M. 1993. Auditory distance perception by translating observers. In Proceedings of IEEE Symposium on Research Frontiers in Virtual Reality. IEEE, Los Alamitos, CA, 25--26.
[39]
Springer, J. R., Sladeczek, C., Scheffler, M., Hochstrate, J., Melchior, F., and Frohlich, B. 2006. Combining wave field synthesis and multi-viewer stereo displays. In Proceedings of the IEEE Virtual Reality Conference. IEEE, Los Alamitos, CA, 237--+.
[40]
Watt, S. J., Akeley, K., Ernst, M. O., and Banks, M. S. 2005. Focus cues affect perceived depth. J. Vision 5, 10, 834--862.
[41]
Wiest, W. M. and Bell, B. 1985. Stevens exponent for psychophysical scaling of perceived, remembered, and inferred distance. Psychol. Bull. 98, 3, 457--470.
[42]
Zahorik, P., Brungart, D. S., and Bronkhorst, A. W. 2005. Auditory distance perception in humans: A summary of past and present research. Acta Acustica with Acustica 91, 3, 409--420.

Cited By

View all
  • (2024)An Empirical Evaluation of the Calibration of Auditory Distance Perception under Different Levels of Virtual Environment Visibilities2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00089(690-700)Online publication date: 16-Mar-2024
  • (2023)Loudness constancy for noise and speech: How instructions and source information affect loudness of distant soundsAttention, Perception, & Psychophysics10.3758/s13414-023-02719-z85:8(2774-2796)Online publication date: 18-Jul-2023
  • (2023)Quantifying Egocentric Distance Perception in Virtual Reality EnvironmentInternational Journal of Human–Computer Interaction10.1080/10447318.2023.223411740:18(5431-5442)Online publication date: 19-Jul-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception
ACM Transactions on Applied Perception  Volume 9, Issue 4
October 2012
109 pages
ISSN:1544-3558
EISSN:1544-3965
DOI:10.1145/2355598
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2012
Accepted: 01 July 2012
Revised: 01 June 2012
Received: 01 August 2011
Published in TAP Volume 9, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Virtual environments
  2. distance estimation
  3. large-screen immersive displays
  4. spatial perception
  5. spatialized audio
  6. wave field synthesis

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)46
  • Downloads (Last 6 weeks)5
Reflects downloads up to 09 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)An Empirical Evaluation of the Calibration of Auditory Distance Perception under Different Levels of Virtual Environment Visibilities2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00089(690-700)Online publication date: 16-Mar-2024
  • (2023)Loudness constancy for noise and speech: How instructions and source information affect loudness of distant soundsAttention, Perception, & Psychophysics10.3758/s13414-023-02719-z85:8(2774-2796)Online publication date: 18-Jul-2023
  • (2023)Quantifying Egocentric Distance Perception in Virtual Reality EnvironmentInternational Journal of Human–Computer Interaction10.1080/10447318.2023.223411740:18(5431-5442)Online publication date: 19-Jul-2023
  • (2023)Acoustic research for telecoms: bridging the heritage to the futureActa Acustica10.1051/aacus/20230567(64)Online publication date: 8-Dec-2023
  • (2022)The Influences of Hearing and Vision on Egocentric Distance and Room Size Perception under Rich-Cue ConditionsAdvances in Fundamental and Applied Research on Spatial Audio10.5772/intechopen.102810Online publication date: 5-Oct-2022
  • (2022)Empirical Evaluation of Calibration and Long-term Carryover Effects of Reverberation on Egocentric Auditory Depth Perception in VR2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00042(232-240)Online publication date: Mar-2022
  • (2021)Measuring Presence in Virtual Environments: A SurveyACM Computing Surveys10.1145/346681754:8(1-37)Online publication date: 4-Oct-2021
  • (2021)Auditory-visual interactions in egocentric distance perception: Ventriloquism effect and aftereffectThe Journal of the Acoustical Society of America10.1121/10.0007066150:5(3593-3607)Online publication date: 15-Nov-2021
  • (2021)Sensitivity analysis of pinna morphology on head-related transfer functions simulated via a parametric pinna modelThe Journal of the Acoustical Society of America10.1121/10.0004128149:4(2559-2572)Online publication date: 12-Apr-2021
  • (2021)Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects2021 IEEE Conference on Games (CoG)10.1109/CoG52621.2021.9619046(1-4)Online publication date: 17-Aug-2021
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media