research-article

Predicting remote versus collocated group interactions using nonverbal cues

Authors:

Daniel Gatica-PerezAuthors Info & Claims

ICMI-MLMI '09: Proceedings of the ICMI-MLMI '09 Workshop on Multimodal Sensor-Based Systems and Mobile Phones for Social Computing

Article No.: 3, Pages 1 - 4

https://doi.org/10.1145/1641389.1641392

Published: 06 November 2009 Publication History

Get Access

Abstract

This paper addresses two problems: Firstly, the problem of classifying remote and collocated small-group working meetings, and secondly, the problem of identifying the remote participant, using in both cases nonverbal behavioral cues. Such classifiers can be used to improve the design of remote collaboration technologies to make remote interactions as effective as possible to collocated interactions. We hypothesize that the difference in the dynamics between collocated and remote meetings is significant and measurable using speech activity based nonverbal cues. Our results on a publicly available dataset - the Augmented Multi-Party Interaction with Distance Access (AMIDA) corpus - show that such an approach is promising, although more controlled settings and more data are needed to explore the addressed problems further.

References

[1]

C. M. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.

Digital Library

Google Scholar

[2]

D. Jayagopi et al. Characterizing conversational group dynamics using nonverbal behavior. In Proc. ICME, New York, June 2009.

Digital Library

Google Scholar

[3]

J. Hall et al. Nonverbal behavior and the vertical dimension of social relations: A meta-analysis. Psychological bulletin, 131(6):898--924, 2005.

Crossref

Google Scholar

[4]

J. M. DiMicco et al. Influencing group participation with a shared display. In Proc. CSCW '04, pages 614--623, New York, NY, USA, 2004. ACM.

Digital Library

Google Scholar

[5]

K. Otsuka et al. A realtime multimodal system for analyzing group meetings by combining face pose tracking and speaker diarization. In Proc. ICMI'08, Chania, October 2008. ACM.

Digital Library

Google Scholar

[6]

M. Lincoln et al. The amida data recording environment. In Proc. Workshop MLMI, 2007.

Google Scholar

[7]

M. Poel et al. Meeting behavior detection in smart environments: Nonverbal cues that help to obtain natural interaction. In Proc. FG 2008, pages 1--6. IEEE Computer Society Press, September 2008.

Google Scholar

[8]

O'Conaill et al. Conversations over video conferences: an evaluation of the spoken aspects of video-mediated communication. Human-Computer Interaction, 8(4):389--428, 1993.

Digital Library

Google Scholar

[9]

P. J. Hinds et al. Out of sight, out of sync: Understanding conflict in distributed teams. Organization Science, 14(6):615--632, Nov -- Dec 1982.

Digital Library

Google Scholar

[10]

D. Gatica-Perez. Automatic nonverbal analysis of social interaction in small groups: a review. Image and Vision Computing, Special Issue on Human Behavior, 1(12), December 2009.

Digital Library

Google Scholar

[11]

T. Kim, A. Chang, L. Holland, and A. Pentland. Meeting mediator: enhancing group collaboration with sociometric feedback. In Proc. ACM '08: Conference on CSCW, pages 457--466, 2008.

Digital Library

Google Scholar

[12]

T. Kim and A. Pentland. Understanding effects of feedback on group collaboration. Association for the Advancement of Artificial Intelligence, pages 25--30, 2009.

Google Scholar

[13]

H. J. A. op den Akker et al. Supporting engagement and floor control in hybrid meetings. In A. Esposito and R. Vich, editors, Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions, Prague, July 2009.

Digital Library

Google Scholar

Cited By

View all

Beyan CCapozzi FBecchio CMurino V(2018)Prediction of the Leadership Style of an Emergent Leader Using Audio and Visual Nonverbal FeaturesIEEE Transactions on Multimedia10.1109/TMM.2017.274006220:2(441-456)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1109/TMM.2017.2740062
Rasipuram SB. PJayagopi DNakano YAndré ENishida TMorency LBusso CPelachaud C(2016)Asynchronous video interviews vs. face-to-face interviews for communication skill measurement: a systematic studyProceedings of the 18th ACM International Conference on Multimodal Interaction10.1145/2993148.2993183(370-377)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2993148.2993183
Jayagopi DGatica-Perez D(2010)Mining Group Nonverbal Conversational Patterns Using Probabilistic Topic ModelsIEEE Transactions on Multimedia10.1109/TMM.2010.206521812:8(790-802)Online publication date: 1-Dec-2010
https://dl.acm.org/doi/10.1109/TMM.2010.2065218
Show More Cited By

Index Terms

Predicting remote versus collocated group interactions using nonverbal cues
1. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

Videoconference and Embodied VR: Communication Patterns Across Task and Medium
CSCW2

Videoconference has become the dominant technology for remote meetings. Embodied Virtual Reality is a potential alternative that employs motion tracking in order to place people in a shared virtual environment as avatars. This paper describes a 210 ...
FluidMeet: Enabling Frictionless Transitions Between In-Group, Between-Group, and Private Conversations During Virtual Breakout Meetings
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

People often form small conversation groups during physical gatherings to have ad-hoc and informal conversations. As these groups are loosely defined, others can often overhear and join the conversation. However, current video-conferencing tools only ...
Recognizing conversational context in group interaction using privacy-sensitive mobile sensors
MUM '10: Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia

The availability of mobile sociometric sensors allows Computer-Supported Cooperative Work (CSCW) designers the possibility to enhance online meeting support through automatic recognition of conversational context. This paper addresses the task of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICMI-MLMI '09: Proceedings of the ICMI-MLMI '09 Workshop on Multimodal Sensor-Based Systems and Mobile Phones for Social Computing

November 2009

27 pages

ISBN:9781605586946

DOI:10.1145/1641389

General Chairs:
James Crowley
INRIA
,
Yuri Ivanov
MERL
,
Christopher Wren
Google
,
Program Chairs:
Daniel Gatica-Perez
Idiap Research Institute
,
Michael Johnston
AT&T Research
,
Rainer Stiefelhagen
University of Karlsruhe

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI-MLMI '09

Sponsor:

SIGCHI

ICMI-MLMI '09: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES/WORKSHOP ON MACHINE LEARNING FOR MULTIMODAL INTERFACES

November 6, 2009

Massachusetts, Cambridge

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
159
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Beyan CCapozzi FBecchio CMurino V(2018)Prediction of the Leadership Style of an Emergent Leader Using Audio and Visual Nonverbal FeaturesIEEE Transactions on Multimedia10.1109/TMM.2017.274006220:2(441-456)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1109/TMM.2017.2740062
Rasipuram SB. PJayagopi DNakano YAndré ENishida TMorency LBusso CPelachaud C(2016)Asynchronous video interviews vs. face-to-face interviews for communication skill measurement: a systematic studyProceedings of the 18th ACM International Conference on Multimodal Interaction10.1145/2993148.2993183(370-377)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2993148.2993183
Jayagopi DGatica-Perez D(2010)Mining Group Nonverbal Conversational Patterns Using Probabilistic Topic ModelsIEEE Transactions on Multimedia10.1109/TMM.2010.206521812:8(790-802)Online publication date: 1-Dec-2010
https://dl.acm.org/doi/10.1109/TMM.2010.2065218
Berkenbrock CSilva AHirata CFernandes CPichiliani M(2010)Investigating Users Anonymity in a Collocated Mobile Groupware EnvironmentProceedings of the 2010 Brazilian Symposium on Collaborative Systems - Simpósio Brasileiro de Sistemas Colaborativos10.1109/SBSC.2010.15(47-54)Online publication date: 5-Oct-2010
https://dl.acm.org/doi/10.1109/SBSC.2010.15

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Videoconference and Embodied VR: Communication Patterns Across Task and Medium

FluidMeet: Enabling Frictionless Transitions Between In-Group, Between-Group, and Private Conversations During Virtual Breakout Meetings

Recognizing conversational context in group interaction using privacy-sensitive mobile sensors