MuSe '24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor
Authors: 
Lukas Christ, Shahin Amiriparian, Andreas König, Simone Eulitz, 
Erik Cambria, Björn W. SchullerAuthors Info & Claims
Pages 10 - 11
Abstract
The 5th Multimodal Sentiment Analysis Challenge (MuSe), a workshop in conjunction with ACM Multimedia '24, is focused on Multimodal Machine Learning in the domain of Affective Computing. Two different sub-challenges are proposed: Social Perception Sub-Challenge(MuSe-Perception) is a regression task on 16 different perceived characteristics including arrogance, sincerity and likability. For this, the novel LMU-ELP dataset is introduced, consisting of short audiovisual recordings of 177 subjects annotated by MTurk workers. Cross-Cultural Humour Detection Sub-Challenge(MuSe-Humor) poses the problem of cross-cultural humor recognition. An extension of the Passau Spontaneous Football Coach Humour (Passau-SFCH) dataset featuring football coach press conference recordings is utilized in this task. The training set consists of German data, while the test data comprises English recordings only. In both sub-challenges, audiovisual recordings, transcripts, pre-computed features, and baseline models are made available. In this summary, we detail the challenge's motives, organization, participation statistics, and results.
References
[1]
Shahin Amiriparian, Lukas Christ, Alexander Kathan, Maurice Gerczuk, Niklas Müller, Steffen Klug, Lukas Stappen, Andreas König, Erik Cambria, Björn W. Schuller, and Simone Eulitz. 2024. The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor Recognition. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[2]
Bagus Tris Atmaja. 2024. Feature-wise Optimization and Performance-weighted Multimodal Fusion for Social Perception Recognition. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[3]
Mehedi Hasan Bijoy, Dejan Porjazovski, Nhan Phan, Guangpu Huang Huang, Tamas Grosz, and Mikko Kurimo. 2024. Multimodal Humor Detection and Social Perception Prediction. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[4]
Shun Chen, Hailiang Yao, Mingyu Xu, Zhuofan Wen, Haiyang Sun, Licai Sun, Zheng Lian, Bin Liu, Fengyu Zhang, Siyuan Zhang, and Jianhua Tao. 2024. DPP: A Dual-Phase Processing Method for Cross-Cultural Humor Detection. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[5]
Lukas Christ, Shahin Amiriparian, Alice Baird, Alexander Kathan, Niklas Müller, Steffen Klug, Chris Gagne, Panagiotis Tzirakis, Lukas Stappen, Eva-Maria Meßner, Andreas König, Alan Cowen, Erik Cambria, and Björn W. Schuller. 2023. The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation (MuSe '23). Association for Computing Machinery, New York, NY, USA, 1--10. https://doi.org/10.1145/3606039.3613114
[6]
Lukas Christ, Shahin Amiriparian, Alice Baird, Panagiotis Tzirakis, Alexander Kathan, Niklas Müller, Lukas Stappen, Eva-Maria Meßner, Andreas König, Alan Cowen, Erik Cambria, and Björn W. Schuller. 2022. The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stress. In Proc. of the 3rd Multimodal Sentiment Analysis Challenge. ACM, Lisbon, Portugal. Workshop held at ACM Multimedia 2022, to appear.
[7]
Lukas Christ, Shahin Amiriparian, Alexander Kathan, Niklas Müller, Andreas König, and Björn W Schuller. 2023. Towards Multimodal Prediction of Spontaneous Humour: A Novel Dataset and First Results. arXiv preprint arXiv:2209.14272 (2023).
[8]
Sergio Esteban-Romero, Iván Martín-Fernández, Manuel Gil-Martín, David Griol-Barres, Zoraida Callejas-Carrión, and Fernando Fernández-Martínez. 2024. LLM-Driven Multimodal Fusion for Human Perception Analysis. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[9]
Eunchae Lim, Hyeon-Ji Yang, Hyung-Jeong Yang, Soo-Hyung Kim, Seung-Won Kim, Ji-Eun Shin, and Aera Kim. 2024. Modality Weights based Fusion Model for Social Perception Prediction in Video, Audio, and Text. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[10]
Iván Martín-Fernández, Sergio Esteban-Romero, Jaime Bellver, Fernando Fernández-Martínez, and Manuel Gil-Martín. 2024. Larger Encoders, Smaller Regressors: Exploring Label Dimensionality Reduction and Multimodal Large Language Models as Feature Extractors for Predicting Social Perception. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[11]
Ankit Kumar Singh, Jaeheon Kim, Ho-min Park, Ganghyun Kim Kim, Bong Jun Choi, and Wesley De Neve. 2024. Exploring Multimodal Approaches and Fusion Methods for CEO Social Attribute Prediction in 2024 MuSe-Perception. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[12]
Zhuofan Wen, Hailiang Yao, Shun Chen, Haiyang Sun, Mingyu Xu, Licai Sun, Zheng Lian, Bin Liu, Fengyu Zhang, Siyuan Zhang, and Jianhua Tao. 2024. Social Perception Prediction for MuSe 2024: Joint Learning of Multiple Perceptions. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
[13]
Yangyang Xu, Peng Zou, Rui Wang, Qi Li, Chengpeng Xu, Zhuoer Zhao, Xun Yang, Dan Guo, Xiao Sun, and Meng Wang. 2024. AMTN: Attention-Enhanced Multimodal Temporal Network for Humor Detection. In Proc. of MuSe '24. ACM, Melbourne, Australia. To appear.
Index Terms
- MuSe '24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor
Recommendations
The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor Recognition
MuSe'24: Proceedings of the 5th on Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and HumorThe Multimodal Sentiment Analysis Challenge (MuSe) 2024 addresses two contemporary multimodal affect and sentiment analysis problems: In the Social Perception Sub-Challenge (MuSe-Perception), participants will predict 16 different social attributes of ...
MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress
MM '22: Proceedings of the 30th ACM International Conference on MultimediaThe 3rd Multimodal Sentiment Analysis Challenge (MuSe) focuses on multimodal affective computing. The workshop is held in conjunction with ACM Multimedia'22. Three datasets are provided as part of the challenge: (i) the Passau Spontaneous Football Coach ...
MuSe 2023 Challenge: Multimodal Prediction of Mimicked Emotions, Cross-Cultural Humour, and Personalised Recognition of Affects
MM '23: Proceedings of the 31st ACM International Conference on MultimediaThe 4th Multimodal Sentiment Analysis Challenge (MuSe) focuses on Multimodal Prediction of Mimicked Emotions, Cross-Cultural Humour, and Personalised Recognition of Affects. The workshop takes place in conjunction with ACM Multimedia'23. We provide three ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
76 pages
ISBN:9798400711992
DOI:10.1145/3689062
- General Chair:
- Shahin Amiriparian,
- Program Chairs:
- Lukas Christ,
- Simone Eulitz,
- Andreas König,
- Erik Cambria,
- Björn W. Schuller
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 October 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
MM '24
Sponsor:
MM '24: The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne VIC, Australia
Acceptance Rates
Overall Acceptance Rate 14 of 17 submissions, 82%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 69Total Downloads
- Downloads (Last 12 months)69
- Downloads (Last 6 weeks)69
Reflects downloads up to 11 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in