More Web Proxy on the site http://driver.im/

abstract

3rd Workshop on Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild

Authors:

Dennis Küster,

Pascal E. Fortin,

Nerea Urrestilla,

Tanja SchultzAuthors Info & Claims

ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

Pages 860 - 861

https://doi.org/10.1145/3462244.3480978

Published: 18 October 2021 Publication History

Abstract

Modeling with multimodal data in the wild poses similar challenges in human-computer and human-robot interaction (HCI, HRI). This workshop series thus blends HCI and HRI to jointly address a broad range of current topics in multimodal modeling aimed at designing intelligent systems in the wild. From addressing data scarcity in multimodal user state recognition to emotion prediction from EEG while listening to music, our third workshop in this series aims to further stimulate this important multidisciplinary exchange.

References

[1]

Patrícia Alves-Oliveira, Dennis Küster, Arvid Kappas, and Ana Paiva. 2016. Psychological science in hri: Striving for a more integrated field of research. In 2016 AAAI Fall Symposium Series.

[2]

Tony Belpaeme. 2020. The Wizard is Dead, Long Live Data: Towards Autonomous Social Behaviour Using Data-Driven Methods. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 411. https://doi.org/10.1145/3395035.3425204

[3]

John T Cacioppo and Louis G Tassinary. 1990. Principles of psychophysiology: Physical, social, and inferential elements.Cambridge University Press.

[4]

Sromona Chatterjee, Kevin Scheck, Dennis Küster, Felix Putze, Harish Moturu, Johannes Schering, Jorge Marx Gómez, and Tanja Schultz. 2020. SmartHelm: Towards Multimodal Detection of Attention in an Outdoor Augmented Reality Biking Scenario. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 426–432. https://doi.org/10.1145/3395035.3425207

Digital Library

[5]

Andreas Foltyn and Jessica Deuschel. 2021. Towards Reliable Multimodal Stress Detection under Distribution Shift. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.

Digital Library

[6]

Elif Gümüslü, Duygun Erol Barkana, and Hatice Köse. 2020. Emotion Recognition Using EEG and Physiological Data for Robot-Assisted Rehabilitation Systems. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 379–387. https://doi.org/10.1145/3395035.3425199

[7]

Dennis Küster, Felix Putze, Patrícia Alves-Oliveira, Maike Paetzel, and Tanja Schultz. 2020. Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild. In Proceedings of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20). Association for Computing Machinery, New York, NY, USA, 883–885. https://doi.org/10.1145/3382507.3420053

Digital Library

[8]

Dennis Küster and Arvid Kappas. 2014. What Could a Body Tell a Social Robot that It Does Not Know?. In Proceedings of the International Conference on Physiological Computing Systems (Lisbon, Portugal). SCITEPRESS - Science and and Technology Publications, 358–367. https://doi.org/10.5220/0004892503580367

[9]

Aurelien Lechappe, Mathieu Chollet, Jérôme Rigaud, and Caroline G.L. Cao. 2020. Assessment of Situation Awareness during Robotic Surgery Using Multimodal Data. In Companion Publication of the 2020 International Conference on Multimodal Interaction(Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 412–416. https://doi.org/10.1145/3395035.3425205

Digital Library

[10]

Kana Miyamoto, Hiroki Tanaka, and Satoshi Nakamura. 2021. Meta-Learning for Emotion Prediction from EEG while Listening to Music. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.

Digital Library

[11]

Tempestt Neal, Khadija Zanna, and Shaun Canavan. 2021. Clustering of Physiological Signals by Emotional State, Race, and Sex. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.

[12]

Srinivas Parthasarathy and Shiva Sundaram. 2020. Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognition. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 400–404. https://doi.org/10.1145/3395035.3425202

Digital Library

[13]

Felix Putze, Merlin Burri, Lisa-Marie Vortmann, and Tanja Schultz. 2020. Model-Based Prediction of Exogeneous and Endogeneous Attention Shifts During an Everyday Activity. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 417–425. https://doi.org/10.1145/3395035.3425206

Digital Library

[14]

Felix Putze, Jutta Hild, Akane Sano, Enkelejda Kasneci, Erin Solovey, and Tanja Schultz. 2018. Modeling Cognitive Processes from Multimodal Signals. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (Boulder, CO, USA) (ICMI ’18). Association for Computing Machinery, New York, NY, USA, 663. https://doi.org/10.1145/3242969.3265861

Digital Library

[15]

David St-Onge, Marcel Kaufmann, Jacopo Panerati, Benjamin Ramtoula, Yanjun Cao, Emily B.J. Coffey, and Giovanni Beltrame. 2020. Planetary Exploration With Robot Teams: Implementing Higher Autonomy With Swarm Intelligence. IEEE Robotics Automation Magazine 27, 2 (2020), 159–168. https://doi.org/10.1109/MRA.2019.2940413

[16]

Nerea Urrestilla and David St-Onge. 2020. Measuring Cognitive Load: Heart-Rate Variability and Pupillometry Assessment. In Companion Publication of the 2020 International Conference on Multimodal Interaction(Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 405–410. https://doi.org/10.1145/3395035.3425203

[17]

Hendric Voss, Heiko Wersing, and Stefan Kopp. 2021. Addressing Data Scarcity in Multimodal User State Recognition by Combining Semi-Supervised and Supervised Learning. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.

Cited By

Dudzik BHrkalovic TKüster DSt-Onge DPutze FDevillers L(2023)The 5th Workshop on Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild (MSECP-Wild)Proceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616883(828-829)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3616883
Salous MKuster DScheck KDikfidan ANeumann TPutze FSchultz T(2022)SmartHelm: User Studies from Lab to Field for Attention Modeling2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53654.2022.9945155(1012-1019)Online publication date: 9-Oct-2022
https://doi.org/10.1109/SMC53654.2022.9945155

Recommendations

Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild
ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

Detecting, modeling, and making sense of multimodal data from human users in the wild still poses numerous challenges. Starting from aspects of data quality and reliability of our measurement instruments, the multidisciplinary endeavor of developing ...
The 5th Workshop on Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild (MSECP-Wild)
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

The ability to automatically infer relevant aspects of human users’ thoughts and feelings is crucial for technologies to intelligently adapt their behaviors in complex interactions. Research on multimodal analysis has demonstrated the potential of ...
Attention and Engagement Aware Multimodal Conversational Systems
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Despite their ability to complete certain tasks, dialog systems still suffer from poor adaptation to users' engagement and attention. We observe human behaviors in different conversational settings to understand human communication dynamics and then ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

October 2021

876 pages

ISBN:9781450384810

DOI:10.1145/3462244

Editors:
Zakia Hammal
Carnegie Mellon University
,
Carlos Busso
University of Texas at Dallas
,
Catherine Pelachaud
CNRS - ISIR, Sorbonne University
,
Sharon Oviatt
Monash University
,
Albert Ali Salah
Utrecht University and Boğaziçi University
,
Guoying Zhao
University of Oulu

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 October 2021

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Conference

ICMI '21

Sponsor:

SIGCHI

ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 18 - 22, 2021

QC, Montréal, Canada

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
90
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dudzik BHrkalovic TKüster DSt-Onge DPutze FDevillers L(2023)The 5th Workshop on Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild (MSECP-Wild)Proceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616883(828-829)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3616883
Salous MKuster DScheck KDikfidan ANeumann TPutze FSchultz T(2022)SmartHelm: User Studies from Lab to Field for Attention Modeling2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53654.2022.9945155(1012-1019)Online publication date: 9-Oct-2022
https://doi.org/10.1109/SMC53654.2022.9945155

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents