More Web Proxy on the site http://driver.im/

Work in Progress

A Quality of Experience Evaluation of an Interactive Multisensory 2.5D Virtual Reality Art Exhibit

Authors:

Conor KeighreyAuthors Info & Claims

IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences

Pages 170 - 173

https://doi.org/10.1145/3573381.3597214

Published: 29 August 2023 Publication History

Abstract

In recent years, museums have become more interactive and immersive through the adaptation of technology within large scale art exhibitions. Due to these changes, new types of cultural experiences are more appealing to a younger audience. Despite these positive changes, some museum experiences are still primarily focused on visual art experiences, which remain out of reach to those with visual impairments. Such unimodal and visual dominated experiences restrict these users who depend on sensory feedback to experience the world around them.

In this paper, the authors propose a novel VR experience which incorporates multisensory technologies. It allows individuals to engage and interact with a visual artwork museum experience presented as a fully immersive VR environment. Users can interact with virtual paintings and trigger sensory zones which deliver multisensory feedback to the user. These sensory zones are unique to each painting, presenting thematic audio and smells, custom haptic feedback to feel the artwork, and lastly air, light and thermal changes in an effort to engage those with visual impairments.

References

[1]

Jorge Iranzo Bartolomé, Dong Cho, Luis Cavazos Quero, Sunggi Jo, and Gilsang Cho. 2020. Thermal interactive for improving tactile artwork depth and colour-depth appreciation for visually impaired people. Electronics 9, 11 (2020).

[2]

R.R. Brettell. 1984. Monet’s Haystacks Reconsidered. Art Institute of Chicago Museum Studies 11, 1 (1984), 4–21.

[3]

Shaoyu Cai, Pingchuan Ke, Takuji Narumi, and Kening Zhu. 2020. ThermAirGlove: A pneumatic glove for thermal perception and material identification in virtual reality. In Virtual Reality and 3D User Interfaces (VR). IEEE, Atlanta.

[4]

Jun Dong Cho, Jaeho Jeong, Ji Hye Kim, and Hoonsuk Lee. 2020. Sound coding colour to improve artwork appreciation by people with visual impairments. Electronics 9, 11 (2020).

[5]

Empatica 2023. E4 wristband | Real-time physiological signals | Wearable PPG, EDA, Temperature, Motion sensors. Empatica. https://www.empatica.com/research/e4/.

[6]

U. Engelke, D.P. Darcy, G.H. Mulliken, S. Bosse, M.G. Martini, S. Arndt, J.-N. Antons, K.Y. Chat, N. Ramzan, and K. Brunnström. 2017. Psychophysiology-Based QoE Assessment: A Survey. IEEE Journal of Selected Topics in Signal Processing 11, 1 (2017), 6 – 21.

[7]

Fever Labs Inc 2023. "Van Gogh Exhibition: The Immersive Experience. Fever Labs Inc. https://www.vangoghexpo.com/.

[8]

R. Hajar. 2016. Monet and Cataracts. Heart Views 17, 1 (2016), 40–41.

[9]

C. Keighrey, R. Flynn, S. Murray, S. Brennan, and N. Murray. 2017. Comparing User QoE via Physiological and Interaction Measurements of Immersive AR and VR Speech and Language Therapy Applications. In Proceedings of the Thematic Workshops of ACM Multimedia. ACM, Mountain View, CA, USA.

[10]

A. Killen, M.J. Firbank, D. Collerton, M. Clarke, J.M. Jefferis, J.-P. Taylor, I.G. McKeith, and U.P. Mosimann. 2013. The assessment of cognition in visually impaired older adults. Age and Ageing 42, 1 (2013), 98–102.

[11]

M.A.N.U.S. Meta. 2023. Prime X Haptic VR. MANUS Meta. https://www.manus-meta.com/products/prime-x-haptic.

[12]

A.N. Moraes, R. Flynn, A. Hines, and N. Murray. 2021. The role of physiological responses in a VR-based sound localization task. IEEE Access 9 (2021), 122082–122091.

[13]

A. Murphy. 2021. 4D exhibition in Netherlands creates sensory experience for sight impaired visitors - MuseumNext. MuseumNext. https://www.museumnext.com/article/4d-exhibition-in-netherlands-creates-sensory-experience-for-sight-impaired-visitors/.

[14]

M.T. Paratore and B. Leporini. 2023. Exploiting the haptic and audio channels to improve orientation and mobility apps for the visually impaired. In Universal Access in the Information Society. Springer, 1 – 11, 5256.

[15]

W.P.P. plc. 2019. Geometry Prague: NeuroDigital Touching Masterpieces | WPP. WPP plc. https://www.wpp.com/en/featured/work/2019/05/geometry—touching-masterpieces.

[16]

Museo Nacional Prado. 2023. Touching the Prado - Exhibition - Museo Nacional del Prado. Museo Nacional del Prado. https://www.museodelprado.es/en/whats-on/exhibition/touching-the-prado/0d94a9bf-07d7-491a-866a-37976169f929.

[17]

Luis Cavazos Quero, Jorge Iranzo Bartolomé, and Jundong Cho. 2021. Accessible visual artworks for blind and visually impaied people: Cpmparing a multimodal approach with tactile graphics. Electronics 10, 3 (2021).

[18]

A.B. Safran, N. Sanda, and J.-A. Sahel. 2014. A neurological disorder presumably underlies painter Francis Bacon distorted world depiction. Frontiers in Human Neuroscience 8, 581 (2014), 1–3.

[19]

S.E.N.S.I.K.S.2023. Pods & Platform - SENSIKS. SENSIKS. https://www.sensiks.com/pods-platform/.

[20]

C.W. Tyler. 2019. Evidence That Leonardo da Vinci Had Strabismus. JAMA Ophthalmology 137, 1 (2019), 82–86.

[21]

Wei Wang, William Yan, Kathy Fotis, Noela M. Prasad, Charles Lansingh, Hugh R. Taylor, Robert P. Finger, Damian Facciolo, and Mingguang He. 2017. Cataract surgical rate and socioeconomics: A global study. Clinical and epidemiologic research 57, 14 (2017), 5872– 5881.

[22]

Nikoleta Yiannoutsou, Rose Johnson, and Sara Price. 2021. Non-visual virtual reality: considerations for the pedagogical design of embodied mathematical experiences for visually impaired children. Educational Teachnology & Society 24, 2 (2021), 151–163.

Cited By

Soltani SHarley D(2024)Paintings in the Age of VR Reproductions: Examining the Design of Virtual Reality GalleriesCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678815(256-262)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678815

Index Terms

A Quality of Experience Evaluation of an Interactive Multisensory 2.5D Virtual Reality Art Exhibit
1. Human-centered computing

Recommendations

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Designing a Virtual Death VR Experience
UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing

Virtual Reality (VR) exhibitions are becoming increasingly popular for creating immersive and interactive experiences. One particular use case in research is death simulations in VR, where users can experience or explore the concept of death in a ...
Captivating the Senses: Crafting a Multisensory Virtual Experience for Enhanced Realism
UbiComp/ISWC '23 Adjunct: Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing

This paper explores the challenges and opportunities in achieving a high level of realism and presence in Virtual Reality (VR) experiences. Realism and presence, which refer to the level of authenticity of the virtual environment and the user’s ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences

June 2023

465 pages

ISBN:9798400700286

DOI:10.1145/3573381

Editors:
Patrick Le Callet
Nantes Université, France
,
Matthieu Perreira Da Silva
Nantes Université, France
,
Toinon Vigier
Nantes Université, France
,
Koray Tahiroğlu
Aalto University, Finland
,
Niall Murray
Technological University of the Shannon, Ireland
,
Giuseppe Valenzise
Université Paris-Saclay, France
,
Mea Wang
University of Calgary, Canada

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 August 2023

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

IMX '23

Sponsor:

IMX '23: ACM International Conference on Interactive Media Experiences

June 12 - 15, 2023

Nantes, France

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Sponsor:
sigchi

ACM International Conference on Interactive Media Experiences

June 3 - 6, 2025

Niter?i , Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
123
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)7

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Soltani SHarley D(2024)Paintings in the Age of VR Reproductions: Examining the Design of Virtual Reality GalleriesCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678815(256-262)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678815

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents