Cited By
View all- Booth BBosch ND’Mello S(2023)Engagement Detection and Its Applications in Learning: A Tutorial and Selective ReviewProceedings of the IEEE10.1109/JPROC.2023.3309560111:10(1398-1422)Online publication date: Oct-2023
Getting Really Wild: Challenges and Opportunities of Real-World Multimodal Affect Detection
Page 1
Abstract
Affect detection in the "real" wild - where people go about their daily routines in their homes and workplaces - is arguably a different problem than affect detection in the lab or in the "quasi" wild (e.g., YouTube videos). How will our affect detection systems hold up when put to the test in the real wild? Some in the Affective Computing community had an opportunity to address this question as part of the MOSAIC (Multimodal Objective Sensing to Assess Individuals with Context [1]) program which ran from 2017 to 2020. Results were sobering, but informative. I'll discuss those efforts with an emphasis on performance achieved, insights gleaned, challenges faced, and lessons learned.
Reference
[1]
https://www.iarpa.gov/index.php/research-programs/mosaic
Index Terms
- Getting Really Wild: Challenges and Opportunities of Real-World Multimodal Affect Detection
Recommendations
Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features
We developed and evaluated a multimodal affect detector that combines conversational cues, gross body language, and facial features. The multimodal affect detector uses feature-level fusion to combine the sensory channels and linear discriminant ...
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
This survey describes recent progress in the field of Affective Computing (AC), with a focus on affect detection. Although many AC researchers have traditionally attempted to remain agnostic to the different emotion theories proposed by psychologists, ...
Affect detection from multichannel physiology during learning sessions with AutoTutor
AIED'11: Proceedings of the 15th international conference on Artificial intelligence in educationIt is widely acknowledged that learners experience a variety of emotions while interacting with Intelligent Tutoring Systems (ITS), hence, detecting and responding to emotions might improve learning outcomes. This study uses machine learning techniques ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2021
88 pages
ISBN:9781450386784
DOI:10.1145/3475957
- General Chairs:
- Björn W. Schuller,
- Lukas Stappen,
- Eva-Maria Meßner,
- Erik Cambria,
- Guoying Zhao
Copyright © 2021 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 October 2021
Check for updates
Author Tags
Qualifiers
- Keynote
Conference
MM '21
Sponsor:
Acceptance Rates
Overall Acceptance Rate 14 of 17 submissions, 82%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 100Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025
Other Metrics
Citations
Cited By
View all- Booth BBosch ND’Mello S(2023)Engagement Detection and Its Applications in Learning: A Tutorial and Selective ReviewProceedings of the IEEE10.1109/JPROC.2023.3309560111:10(1398-1422)Online publication date: Oct-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in