[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content
Springer Nature Link
Log in

The Silence of Art: Investigating the Emotional Experience of a Virtual Museum by Facial Expression Analysis

  • Conference paper
  • First Online:
Extended Reality (XR Salento 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14219))

Included in the following conference series:

Abstract

Art is a fundamental part of human experience. Today the fruition of art is often mediated by new technologies such as virtual environments reproducing museums and expositions, and even more during the COVID-19 pandemic and related safety measures that confined people in their homes for long periods. Different factors can influence involvement/engagement (as a component of sense of presence) and emotions during art fruition in virtual museums. For example, while supporting information enriches real-life art fruition, some literature suggests that art should be accessed in silence. This study aimed at analyzing participants’ experience of a virtual museum with or without supporting information (audio guides), by implementing both self-report and facial expressions analysis. Results show that emotions as shown by facial expressions (specifically happiness, anger, confusion) differed between conditions, highlighting a more positive experience for the participants who explored the virtual museum without audio guides. It is possible that audio guides may generate information overload within virtual museums, and that sometimes (especially in art-focused exhibitions, where emotions and deep personal reflection are important), the opportunity to visit in silence should be guaranteed. The discussion gives indications for media design to support immersive and pleasant art fruition experience, as well as future research focused on the involvement/engagement component of sense of presence.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 55.99
Price includes VAT (United Kingdom)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 69.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Mastandrea, S., Fagioli, S., Biasi, V.: Art and psychological well-being: linking the brain to the aesthetic emotion. Front. Psychol. 10, 739 (2019)

    Article  Google Scholar 

  2. Chatterjee, H.J., Camic, P.M.: The health and well-being potential of museums and art galleries. Arts Health 7(3), 183–186 (2015)

    Article  Google Scholar 

  3. Bennington, R., Backos, A., Harrison, J., Reader, A.E., Carolan, R: Art therapy in art museums: promoting social connectedness and psychological well-being of older adults. Arts Psychother. 49, 34–43 (2016)

    Google Scholar 

  4. Sundar, S.S., Go, E., Kim, H.S., Zhang, B.: Communicating art, virtually! Psychological effects of technological affordances in a virtual museum. Int. J. Hum. Comput. Interact. 31(6), 385–401 (2015)

    Article  Google Scholar 

  5. Styliani, S., Fotis, L., Kostas, K., Petros, P.: Virtual museums, a survey and some issues for consideration. J. Cult. Herit. 10(4), 520–528 (2009)

    Article  Google Scholar 

  6. Durosini, I., Triberti, S., Savioni, L., Pravettoni, G.: In the eye of a quiet storm: a critical incident study on the quarantine experience during the coronavirus pandemic. PLoS ONE 16(2), e0247121 (2021)

    Article  Google Scholar 

  7. Brindha, D., Jayaseelan, R., Kadeswaran, S.: Covid-19 lockdown, entertainment and paid OTT video-streaming platforms: a qualitative study of audience preferences. Mass Commun. Int. J. Commun. Stud. 14(4), 12–16 (2020)

    Article  Google Scholar 

  8. Trupp, M.D., Bignardi, G., Chana, K., Specker, E., Pelowski, M.: Can a brief interaction with online, digital art improve wellbeing? A comparative study of the impact of online art and culture presentations on mood, state-anxiety, subjective wellbeing, and loneliness. Front. Psychol, 2305 (2022)

    Google Scholar 

  9. Radermecker, A.-S.: Art and culture in the COVID-19 era: for a consumer-oriented approach. SN Bus. Econ. 1(1), 1–14 (2020). https://doi.org/10.1007/s43546-020-00003-y

    Article  Google Scholar 

  10. Samaroudi, M., Echavarria, K.R., Perry, L.: Heritage in lockdown: digital provision of memory institutions in the UK and US of America during the COVID-19 pandemic. Mus. Manag. Curatorship 35(4), 337–361 (2020)

    Article  Google Scholar 

  11. Bekele, M.K., Pierdicca, R., Frontoni, E., Malinverni, E.S., Gain, J.: A survey of augmented, virtual, and mixed reality for cultural heritage. J. Comput. Cult. Herit. (JOCCH) 11(2), 1–36 (2018)

    Article  Google Scholar 

  12. Pelowski, M., Forster, M., Tinio, P.P., Scholl, M., Leder, H.: Beyond the lab: an examination of key factors influencing interaction with ‘real’ and museum-based art. Psychol. Aesthet. Creat. Arts 11(3), 245 (2017)

    Article  Google Scholar 

  13. Sylaiou, S., Kasapakis, V., Gavalas, D., Dzardanova, E.: Avatars as storytellers: affective narratives in virtual museums. Pers. Ubiquit. Comput. 24(6), 829–841 (2020)

    Article  Google Scholar 

  14. Beck, J., Rainoldi, M., Egger, R.: Virtual reality in tourism: a state-of-the-art review. Tour. Rev. 74(3), 586–612 (2019)

    Article  Google Scholar 

  15. Alelis, G., Bobrowicz, A., Ang, C.S.: Comparison of engagement and emotional responses of older and younger adults interacting with 3D cultural heritage artefacts on personal devices. Behav. Inf. Technol. 34(11), 1064–1078 (2015)

    Article  Google Scholar 

  16. Schep, M., van Boxtel, C., Noordegraaf, J.: Competent museum guides: defining competencies for use in art and history museums. Mus. Manag. Curatorship 33(1), 2–24 (2018)

    Article  Google Scholar 

  17. Best, K.: Making museum tours better: understanding what a guided tour really is and what a tour guide really does. Mus. Manag. Curatorship 27(1), 35–52 (2012)

    Article  Google Scholar 

  18. Uyen Tran, L., King, H.: The professionalization of museum educators: the case in science museums. Mus. Manag. Curatorship 22(2), 131–149 (2007)

    Article  Google Scholar 

  19. Burnham, R., Kai-Kee, E.: Teaching in the Art Museum: Interpretation as Experience. Getty Publications (2011)

    Google Scholar 

  20. Ghouaiel, N., Garbaya, S., Cieutat, J.M., Jessel, J.P.: Mobile augmented reality in museums: towards enhancing visitor’s learning experience. Int. J. Virtual Real. 17(1), 21–31 (2017)

    Article  Google Scholar 

  21. Recupero, A., Talamo, A., Triberti, S., Modesti, C.: Bridging museum mission to visitors’ experience: activity, meanings, interactions, technology. Front. Psychol. 10, 2092 (2019)

    Article  Google Scholar 

  22. Swartout, W., et al.: Ada and grace: toward realistic and engaging virtual museum guides. In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds.) IVA 2010. LNCS, vol. 6356, pp. 286–300. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15892-6_30

  23. Velentza, A.M., Heinke, D., Wyatt, J.: Museum robot guides or conventional audio guides? An experimental study. Adv. Robot. 34(24), 1571–1580 (2020)

    Google Scholar 

  24. Rzayev, R., Karaman, G., Henze, N., Schwind, V.: Fostering virtual guide in exhibitions. In: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 1–6 (2019)

    Google Scholar 

  25. Carrozzino, M., Colombo, M., Tecchia, F., Evangelista, C., Bergamasco, M.: Comparing different storytelling approaches for virtual guides in digital immersive museums. In: De Paolis, L., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10851, pp. 292–302. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95282-6_22

  26. Sljivo, S., Bosnia, S.: Audio guided virtual museums. In: Central European Seminar on Computer Graphics (2012)

    Google Scholar 

  27. Murphy, D., Pitt, I.: Spatial sound enhancing virtual story telling. In: Balet, O., Subsol, G., Torguet, P. (eds.) ICVS 2001. LNCS, vol. 2197, pp. 20–29. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45420-9_3

  28. Rizvic, S.: Story guided virtual cultural heritage applications. J. Interact. Humanit. 2(1), 2 (2014)

    Article  Google Scholar 

  29. Rzayev, R., Habler, F., Ugnivenko, P., Henze, N., Schwind, V.: It’s not always better when we’re together: effects of being accompanied in virtual reality. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–8, April 2020

    Google Scholar 

  30. Hutchinson, R., Eardley, A.F.: Inclusive museum audio guides: ‘guided looking’ through audio description enhances memorability of artworks for sighted audiences. Mus. Manag. Curatorship 36(4), 427–446 (2021)

    Article  Google Scholar 

  31. Mason, R., Sayner, J.: Bringing museal silence into focus: eight ways of thinking about silence in museums. Int. J. Herit. Stud. 25(1), 5–20 (2019)

    Article  Google Scholar 

  32. van Kessel, E.: The role of silence in the early art museum. In: von Andreas Beyer, H., Le Bon, L. (eds.) Silence. Schweigen, Deutscher Kunstverlag (2015)

    Google Scholar 

  33. Kemp, W.: Die Kunst des Schweigens. In: Koebner, T. (Hg.) Laokoon und kein Ende. Der Wettstreit der Künste, München, pp. 96–119 (1989)

    Google Scholar 

  34. Lessiter, J., Freeman, J., Keogh, E., Davidoff, J.: A cross-media presence questionnaire: the ITC-sense of presence inventory. Presence Teleoper. Virtual Environ. 10(3), 282–297 (2001)

    Google Scholar 

  35. Mauri, M., Cipresso, P., Balgera, A., Villamira, M., Riva, G.: Why is Facebook so successful? Psychophysiological measures describe a core flow state while using Facebook. Cyberpsychol. Behav. Soc. Netw. 14(12), 723–731 (2011)

    Article  Google Scholar 

  36. Mauri, M., Rancati, G., Gaggioli, A., Riva, G.: Applying implicit association test techniques and facial expression analyses in the comparative evaluation of website user experience. Front. Psychol., 4392 (2021)

    Google Scholar 

  37. Gross, J.J., Levenson, R.W.: Emotion elicitation using films. Cognit. Emot. 9(1), 87–108 (1995)

    Article  Google Scholar 

  38. Noldus, L.P.J.J.: FaceReader: Tool for Automated Analysis of Facial Expression: Version 6.0. Noldus Information, Wageningen (2014)

    Google Scholar 

  39. Loijens, L., Krips, O.: FaceReader Methodology Note. Noldus Information Technology Inc., Leesburg (2019)

    Google Scholar 

  40. Den Uyl, M.J., Van Kuilenburg, H.: The FaceReader: online facial expression recognition. In: Proceedings of Measuring Behavior, Wageningen, vol. 30, pp. 589–590 (2005)

    Google Scholar 

  41. Ekman, P.: Universal and cultural differences in facial expression of emotion. In: Nebraska Symposium on Motivation, vol. 19, University of Nebraska Press, Lincoln (1997)

    Google Scholar 

  42. Borges, N., Lindblom, L., Clarke, B., Gander, A., Lowe, R.: Classifying confusion: autodetection of communicative misunderstandings using facial action units. In: 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Cambridge, pp. 401–406. IEEE (2019)

    Google Scholar 

  43. Hirt, F., Werlen, E., Moser, I., Bergamin, P.: Measuring emotions during learning: lack of coherence between automated facial emotion recognition and emotional experience. Open Comput. Sci. 9(1), 308–317 (2019)

    Article  Google Scholar 

  44. van Kuilenburg, H., Wiering, M., den Uyl, M.: A model based method for automatic facial expression recognition. In: Gama, J., Camacho, R., Brazdil, P.B., Jorge, A.M., Torgo, L. (eds.) CML 2005. LNCS, vol. 3720, pp. 194–205. Springer, Heidelberg (2005). https://doi.org/10.1007/11564096_22

  45. Terzis, V., Moridis, C.N., Economides, A.A.: Measuring instant emotions based on facial expressions during computer-based assessment. Pers. Ubiquit. Comput. 17, 43–52 (2013)

    Article  Google Scholar 

  46. Lewinski, P., den Uyl, T.M., Butler, C.: Automated facial coding: validation of basic emotions and FACS AUs in FaceReader. J. Neurosci. Psychol. Econ. 7, 227–236 (2014)

    Article  Google Scholar 

  47. Lewinski, P., Fransen, M.L., Tan, E.S.: Predicting advertising effectiveness by facial expressions in response to amusing persuasive stimuli. J. Neurosci. Psychol. Econ. 7, 1–14 (2014)

    Article  Google Scholar 

  48. Stöckli, S., Schulte-Mecklenbeck, M., Borer, S., Samson, A.C.: Facial expression analysis with AFFDEX and FACET: a validation study. Behav. Res. Methods 50, 1446–1460 (2018)

    Article  Google Scholar 

  49. Dupré, D., Krumhuber, E.G., Küster, D., McKeown, G.J.: A performance comparison of eight commercially available automatic classifiers for facial affect recognition. PLoS ONE 15, e0231968 (2020)

    Article  Google Scholar 

  50. Farhoomand, A.F., Drury, D.H.: Managerial information overload. Commun. ACM (2002)

    Google Scholar 

  51. Näsi, M., Koivusilta, L.: Internet and everyday life: the perceived implications of internet use on memory and ability to concentrate. Cyberpsychol. Behav. Soc. Netw. 16(2), 88–93 (2013)

    Article  Google Scholar 

  52. Karr-Wisniewski, P., Lu, Y.: When more is too much: operationalizing technology overload and exploring its impact on knowledge worker productivity. Comput. Hum. Behav. 26(5), 1061–1072 (2010)

    Article  Google Scholar 

  53. Chirico, A., Gaggioli, A.: Virtual-reality music-based elicitation of awe: when silence is better than thousands sounds. In: Cipresso, P., Serino, S., Villani, D. (eds.) MindCare 2019. LNICST, vol. 288, pp. 1–11. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25872-6_1

  54. Stasi, A., et al.: Neuromarketing empirical approaches and food choice: a systematic review. Food Res. Int. 108, 650–664 (2018)

    Article  Google Scholar 

  55. Triberti, S., Kelders, S.M., Gaggioli, A.: User engagement. In: Kip, H., Kelders, S.M., Sanderman, R., van Gemert-Pijen, L. (eds.) eHealth Research, Theory and Development, pp. 271–289. Routledge (2018)

    Google Scholar 

  56. Triberti, S., Chirico, A., La Rocca, G., Riva, G.: Developing emotional design: emotions as cognitive processes and their role in the design of interactive technologies. Front. Psychol. 8, 1773 (2017)

    Article  Google Scholar 

  57. Glenn, C.R., Blumenthal, T.D., Klonsky, E.D., Hajcak, G.: Emotional reactivity in nonsuicidal self-injury: divergence between self-report and startle measures. Int. J. Psychophysiol. 80(2), 166–170 (2011)

    Article  Google Scholar 

  58. Diminich, E.D., Bonanno, G.A.: Faces, feelings, words: divergence across channels of emotional responding in complicated grief. J. Abnorm. Psychol. 123(2), 350 (2014)

    Article  Google Scholar 

  59. Vrana, S.R.: The psychophysiology of disgust: differentiating negative emotional contexts with facial EMG. Psychophysiology 30(3), 279–286 (1993)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy

    Maurizio Mauri & Daniela Villani

  2. Department of Human Sciences, Università Telematica Pegaso, Naples, Italy

    Stefano Triberti

Authors
  1. Maurizio Mauri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefano Triberti
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniela Villani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefano Triberti .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Naples Federico II, Naples, Italy

    Pasquale Arpaia

  3. CNR-STIIMA, Lecco, Italy

    Marco Sacco

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mauri, M., Triberti, S., Villani, D. (2023). The Silence of Art: Investigating the Emotional Experience of a Virtual Museum by Facial Expression Analysis. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2023. Lecture Notes in Computer Science, vol 14219. Springer, Cham. https://doi.org/10.1007/978-3-031-43404-4_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43404-4_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43403-7

  • Online ISBN: 978-3-031-43404-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation