Abstract
Although emotions can influence our living, experiences, and performance in different contexts, current immersive services in physical environments are failing to read, interpret and respond to our emotions. This study aims to provide understanding of how to enhance physical spaces with emotionally aware, intelligent, and integrated services meeting the expectations of the users. It focuses on three different environments (office, public space and transport) and defines the high-level requirements for the technologies needed for the implementation of emotionally intelligent services, as well as identifies the stakeholders involved in service creation and data processing. Service concepts were generated in collaboration with experts from academia and industry using co-creation methods. The industrial partners of this study see that the novel sensing capabilities and artificial emotional intelligence-based solutions for behaviour analysis and situational awareness have the potential to enable new services, for both the space operators and the users. For such services, the pipeline from data to information and actions must be streamlined and modular, which requires research on technologies, analytics methods, service, and business model design. Ultimately, such services will enable businesses to provide experiences that understand and respond to human behaviour and emotional responses in everyday life, while interacting with technology.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Tzirakis et al. (2021).
- 2.
Hernandez et al. (2021).
- 3.
- 4.
Fernandes et al. (2022).
- 5.
Anderson and Ostrom (2015).
- 6.
Luomala et al. (2023).
- 7.
- 8.
Tirachini and Cats (2020).
- 9.
- 10.
Camplani et al. (2016).
- 11.
Iguernaissi et al. (2019).
- 12.
Fu et al. (2020).
- 13.
Cabanac (2002).
- 14.
Canal et al. (2022).
- 15.
Ben et al. (2022).
- 16.
Russell and Mehrabian (1974).
- 17.
Kreibig (2010).
- 18.
- 19.
Kiuru et al. (2016).
- 20.
Jardak et al. (2019).
- 21.
David and Samraj (2020).
- 22.
Zhang et al. (2022).
- 23.
Ibid.
- 24.
MyData (2024).
References
Anderson L, Ostrom AL (2015) Transformative service research: advancing our knowledge about service and well-being. J Serv Res 18(3):243–249. https://doi.org/10.1177/1094670515591316
Ben X, Ren Y, Zhang J, Wang S-J, Kpalma K, Meng W, Liu Y-J (2022) Video-based facial micro-expression analysis: a survey of datasets, features, and algorithms. IEEE Transact Pattern Anal Mach Intell 44(9):5826–5846. https://doi.org/10.1109/TPAMI.2021.3067464
Booth BM, Mundnich K, Feng T, Nadarajan A, Falk TH, Villatte JL, Ferrara E, Narayanan S (2019) Multimodal human and environmental sensing for longitudinal behavioral studies in naturalistic settings: framework for sensor selection, deployment, and management. J Med Inter Res 21(8):e12832. https://doi.org/10.2196/12832
Cabanac M (2002) What is emotion? Behav Process 60(2):69–83
Camplani M, Paiement A, Mirmehdi M, Damen D, Hannuna S, Burghardt T, Tao L (2016) Multiple human tracking in RGB-depth data: a survey. IET Computer Vision. https://doi.org/10.1049/iet-cvi.2016.0178
Canal FZ, Rossi Müller T, Matias JC, Scotton GG, de Sa R, Junior A, Pozzebon E, Sobieranski AC (2022) A survey on facial emotion recognition techniques: a state-of-the-art literature review. Inf Sci 582:593–617. https://doi.org/10.1016/j.ins.2021.10.005
Casado CÁ, Räsänen P, Nguyen L, Lämsä A, Peltola J, Bordallo López M (2024) A distributed framework for remote multimodal biosignal acquisition and analysis. In: Särestöniemi, M et al (eds) Digital Health and Wireless Solutions. NCDHWS 2024. Communications in Computer and Information Science, vol 2084. Springer, Cham. https://doi.org/10.1007/978-3-031-59091-7_9
David DS, Samraj M (2020) A comprehensive survey of emotion recognition system in facial expression. Artech J Effect Res Eng Technol 1:76–81
Fernandes JM, Silva JS, Rodrigues A, Boavida F (2022) A survey of approaches to unobtrusive sensing of humans. ACM Comput Surv (CSUR) 55(2):1–28. https://doi.org/10.1145/3491208
Fu B, Damer N, Kirchbuchner F, Kuijper A (2020) Sensing technology for human activity recognition: a comprehensive survey. IEEE Access 8:83791–83820. https://doi.org/10.1109/ACCESS.2020.2991891
Hernandez J, Lovejoy J, McDuff D et al (2021) Guidelines for assessing and minimizing risks of emotion recognition applications. In: 2021 9th International conference on affective computing and intelligent interaction (ACII). IEEE, pp 1–8. https://doi.org/10.1109/ACII52823.2021.9597452
Iguernaissi R, Merad D, Aziz K et al (2019) People tracking in multi-camera systems: a review. Multimedia Tools Appl 78:10773–10793. https://doi.org/10.1007/s11042-018-6638-5
Jardak S, Alouini M, Kiuru T, Metso M, Ahmed S (2019) Compact mmWave FMCW radar: implementation and performance analysis. IEEE Aerosp Electr Syst Magaz 34(2):36–44. https://doi.org/10.1109/MAES.2019.180130
Kallio J, Vildjiounaite E, Koivusaari J, Räsänen P, Similä, H, Kyllönen V, Muuraiskangas S, Ronkainen J, Rehu J, Vehmas K (2020) Assessment of perceived indoor environmental quality, stress and productivity based on environmental sensor data and personality categorization. Build Environ 175:Article 106787. https://doi.org/10.1016/j.buildenv.2020.106787
Kiuru T, Metso M, Jardak S, Pursula P, Hakli J, Hirvonen M, Sepponen R (2016) Movement and respiration detection using statistical properties of the FMCW radar signal. In: Proceedings of 2016 Global Symposium on Millimeter Waves (GSMM) & ESA Workshop on Millimetre-Wave Technology and Applications, Espoo, Finland, pp 1–4. https://doi.org/10.1109/GSMM.2016.7500331
Kreibig SD (2010) Autonomic nervous system activity in emotion: a review. Biol Psychol 84(3):394–421
Lin K, Xia F, Wang W, Tian D, Song J (2016) System design for big data application in emotion-aware healthcare. IEEE Access 4:6901–6909
Luomala HT, Järvinen S, Peltola J, Pennanen K, Sihvonen J (2023) Priming shoppers’ well-being goal in grocery stores: moving toward healthier food choices? Food Q Pref 108:104882. https://doi.org/10.1016/j.foodqual.2023.104882
MyData (2024). https://github.com/mydataglobal/declaration/raw/master/1.0/EN/MyData_Declaration_v1.0_EN.pdf. Accessed 16 Feb 2024
Russell JA, Mehrabian A (1974) Distinguishing anger and anxiety in terms of emotional response factors. J Consult Clin Psychol 42(1):79–83. https://doi.org/10.1037/h0035915
Tirachini A, Cats O (2020) COVID-19 and public transportation: current assessment, prospects, and research needs. J Public Transp 22(1). https://doi.org/10.5038/2375-0901.22.1.1
Tzirakis P, Chen J, Zafeiriou S, Schuller B (2021) End-to-end multimodal affect recognition in real-world environments. Inform Fusion 68:46–53. https://doi.org/10.1016/j.inffus.2020.10.011
Vildjiounaite E, Mäkelä S-M, Keränen T, Kyllönen V, Huotari V, Järvinen S, Gimelfarb G (2017) Unsupervised illness recognition via in-home monitoring by depth cameras. Pervasive Mobile Comput 38(Part 1):166–187. https://doi.org/10.1016/j.pmcj.2016.07.004
Vildjiounaite E, Huotari V, Kallio J, Kyllönen V, Mäkelä SM, Gimel'farb G (2019) Unobtrusive assessment of stress of office workers via analysis of their motion trajectories. Pervasive Mobile Comput 58:Article 101028. doi:https://doi.org/10.1016/j.pmcj.2019.05.009
Wang W, den Brinker AC, Stuijk S, de Haan G (2017) Algorithmic principles of remote PPG. IEEE Transact Biomed Eng 64(7):1479–1491
Zhang X, Zheng P, Peng T, He Q, Lee C, Tang R (2022) Promoting employee health in smart office: a survey. Adv Eng Inform 51:101518. https://doi.org/10.1016/j.aei.2021.101518
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Järvinen, S., Kallio, J. (2025). Adding Emotional Intelligence to Physical Spaces: Data-Driven Solutions for Measuring, Analysing, and Responding to User Needs and Expectations. In: Ballardini, R., van den Hoven van Genderen, R., Järvinen, S. (eds) Emotional Data Applications and Regulation of Artificial Intelligence in Society. Law, Governance and Technology Series, vol 69. Springer, Cham. https://doi.org/10.1007/978-3-031-80111-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-80111-2_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-80110-5
Online ISBN: 978-3-031-80111-2
eBook Packages: Law and CriminologyLaw and Criminology (R0)