[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3395035.3425964acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
short-paper

Group Performance Prediction with Limited Context

Published: 27 December 2020 Publication History

Abstract

Automated prediction of group task performance normally proceeds by extracting linguistic, acoustic, or multimodal features from an entire conversation in order to predict an objective task measure. In this work, we investigate whether we can maintain robust prediction performance when using only limited context from the beginning of the meeting. Graph-based conversation features as well as more traditional linguistic features are extracted from the first minute of the meeting and from the entire meeting. We find that models trained only on the first minute are competitive with models trained on the full conversation. In particular, deriving features from graph-based models of conversational interaction in the first minute of discussion is particularly effective for predicting group performance, and outperforms models using more traditional linguistic features. This work also uses a much larger amount of data than previous work, by combining three similar survival task datasets.

References

[1]
Nalini Ambady and Robert Rosenthal. 1992. Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological bulletin, Vol. 111, 2 (1992), 256.
[2]
U. Avci and O. Aran. 2016. Predicting the performance in decision-making tasks: From individual cues to group interaction. IEEE Transactions on Multimedia, Vol. 18, 4 (2016), 643--658.
[3]
Umut Avci and Oya Aran. 2019. Analyzing group performance in small group interaction: Linking personality traits and group performance through the verbal content. In 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019). IEEE, 1--7.
[4]
Indrani Bhattacharya, Michael Foley, Christine Ku, Ni Zhang, Tongtao Zhang, Cameron Mine, Manling Li, Heng Ji, Christoph Riedl, Brooke Foucault Welles, et al. 2019. The unobtrusive group interaction (UGI) corpus. In Proceedings of the 10th ACM Multimedia Systems Conference, Nice, France. 249--254.
[5]
McKenzie Braley and Gabriel Murray. 2018. The Group Affect and Performance (GAP) Corpus. In Proceedings of the Group Interaction Frontiers in Technology. ACM, 2.
[6]
Dinesh Babu Jayagopi, Sileye Ba, Jean-Marc Odobez, and Daniel Gatica-Perez. 2008. Predicting two facets of social verticality in meetings from five-minute time slices and nonverbal cues. In Proceedings of the 10th international conference on Multimodal interfaces. 45--52.
[7]
Christina Sauper Sean J. Taylor Justine Zhang, Cristian Danescu-Niculescu-Mizil. 2018. Characterizing Online Public Discussions through Patterns of Participant Interactions. In Proceedings of CSCW .
[8]
Uliyana Kubasova, Gabriel Murray, and McKenzie Braley. 2019. Analyzing Verbal and Nonverbal Features for Predicting Group Performance. In Proceedings of Interspeech 2019, Graz, Austria .
[9]
Yun-Shao Lin and Chi-Chun Lee. 2020. Predicting Performance Outcome with a Conversational Graph Convolutional Network for Small Group Interactions. In ICASSP 2020--2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 8044--8048.
[10]
Gabriel Murray. 2019. Information Processing and Overload in Group Conversation: A Graph-Based Prediction Model. Multimodal Technologies and Interaction, Vol. 3, 3 (2019), 46.
[11]
Gabriel Murray and Catharine Oertel. 2018. Predicting Group Performance in Task-Based Interaction. In Proceedings of ICMI 2018, Boulder, USA. 14--20.
[12]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, Vol. 12 (2011), 2825--2830.
[13]
Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Empirical Methods in Natural Language Processing (EMNLP). 1532--1543. http://www.aclweb.org/anthology/D14--1162
[14]
S Zahra Razavi, Benjamin Kane, and Lenhart K Schubert. 2019. Investigating Linguistic and Semantic Features for Turn-Taking Prediction in Open-Domain Human-Computer Conversation. Proc. of Interspeech 2019, Graz, Austria (2019), 4140--4144.
[15]
Dairazalia Sanchez-Cortes, Oya Aran, Marianne Schmid Mast, and Daniel Gatica-Perez. 2012. A nonverbal behavior approach to identify emergent leaders in small groups. IEEE Transactions on Multimedia, Vol. 14, 3 (2012), 816--832.
[16]
Maite Taboada, Julian Brooke, Milan Tofiloski, Kimberly Voll, and Manfred Stede. 2011. Lexicon-based methods for sentiment analysis. Computational linguistics, Vol. 37, 2 (2011), 267--307.
[17]
Alessandro Vinciarelli. 2007. Speakers role recognition in multiparty audio recordings using social network analysis and duration distribution modeling. IEEE Transactions on Multimedia, Vol. 9, 6 (2007), 1215--1226.

Cited By

View all
  • (2022)An Interaction-process-guided Framework for Small-group Performance PredictionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/355876819:2(1-25)Online publication date: 26-Aug-2022

Index Terms

  1. Group Performance Prediction with Limited Context
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal Interaction
      October 2020
      548 pages
      ISBN:9781450380027
      DOI:10.1145/3395035
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 27 December 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. graph models
      2. group interaction
      3. meetings
      4. multimodal interaction
      5. social network analysis
      6. social signal processing
      7. task performance

      Qualifiers

      • Short-paper

      Funding Sources

      • NSERC

      Conference

      ICMI '20
      Sponsor:
      ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
      October 25 - 29, 2020
      Virtual Event, Netherlands

      Acceptance Rates

      Overall Acceptance Rate 453 of 1,080 submissions, 42%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)22
      • Downloads (Last 6 weeks)4
      Reflects downloads up to 10 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2022)An Interaction-process-guided Framework for Small-group Performance PredictionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/355876819:2(1-25)Online publication date: 26-Aug-2022

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media