poster

Using linguistic and vocal expressiveness in social role recognition

Authors:

Theresa Wilson,

Gregor HoferAuthors Info & Claims

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

Pages 419 - 422

https://doi.org/10.1145/1943403.1943480

Published: 13 February 2011 Publication History

Get Access

Abstract

In this paper, we investigate two types of expressiveness, linguistic and vocal, and whether they are useful for recognising the social roles of participants in meetings. Our experiments show that combining expressiveness features with speech activity does improve social role recognition over speech activity features alone.

References

[1]

R. F. Bales. Task roles and social roles in problem-solving groups. In T. M. Newcomb and E. L. Hartley, editors, Readings in Social Psychology, pages 437--447. Hold, Rinhart and Winston, 1958.

Google Scholar

[2]

S. Banerjee and A. I. Rudnicky. Using simple speech-based features to detect the state of a meeting and the roles of the meeting participants. In Proc. of Interspeech-ICSLP, 2004.

Google Scholar

[3]

K. D. Benne and P. Sheats. Functional roles of group members. Journal of Social Issues, 4:41--49, 1948.

Crossref

Google Scholar

[4]

J. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, V. Karaiskos, W. Kraaij, M. Kronenthal, G. Lathoud, M. Lincoln, A. Lisowska, I. McCowan, W. Post, D. Reidsma, and P. Wellner. The AMI meeting corpus. In Proc. of the Measuring Behavior Symposium on 'Annotating and Measuring Meeting Behavior', 2005.

Google Scholar

[5]

W. Dong, B. Lepri, A. Cappelletti, A. S. Pentland, F. Pianesi, and M. Zancanaro. Using the influence model to recognize functional roles in meetings. In Proc. of ICMI, 2007.

Digital Library

Google Scholar

[6]

S. Favre, H. Salamin, J. Dines, and A. Vinciarelli. Role recognition in multiparty recordings using social affiliation networks and discrete distributions. In Proc. of ICMI, 2008.

Digital Library

Google Scholar

[7]

T. Hain, L. Burget, J. Dines, G. Garau, M. Karafiat, M. Lincoln, J. Vepa, and V. Wan. The AMI system for the transcripton of meetings. In Proc. of ICASSP, 2007.

Google Scholar

[8]

G. Hofer and H. Shimodaira. Automatic head motion prediction from speech data. In Proc. Interspeech 2007, Antwerp, Belgium, Aug. 2007.

Google Scholar

[9]

J. Lafferty, A. McCallum, and F. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. of ICML, 2001.

Digital Library

Google Scholar

[10]

F. Pianesi, M. Zancanaro, B. Lepri, and A. Cappelletti. A multimodal annotated corpus of consensus decision making meetings. Language, Resources and Evaluation, 41:409--429, 2007.

Crossref

Google Scholar

[11]

F. Pianesi, M. Zancanaro, E. Not, C. Leonardi, V. Falcon, and B. Lepri. Multimodal support to group dynamics. Personal and Ubiquitous Computing, 12:181--195, 2008.

Digital Library

Google Scholar

[12]

S. Raaijmakers, K. Truong, and T. Wilson. Multimodal subjectivity analysis of multiparty conversation. In Proc. of EMNLP, 2008.

Digital Library

Google Scholar

[13]

R. E. Schapire and Y. Singer. BoosTexter: A boosting-based system for text categorization. Machine Learning, 39(2/3):135--168, 2000.

Digital Library

Google Scholar

[14]

T. Wilson. Annotating subjective content in meetings. In Proc. of LREC, 2008.

Google Scholar

Cited By

View all

Priya KKrishnaveni R. Krishnamurthy M. Bairavel S. (2022)Analyzing Social Emotions in Social Network Using Graph Based Co-Ranking AlgorithmResearch Anthology on Implementing Sentiment Analysis Across Multiple Disciplines10.4018/978-1-6684-6303-1.ch018(329-341)Online publication date: 10-Jun-2022
https://doi.org/10.4018/978-1-6684-6303-1.ch018
Shiota THonda KShimada KSaitoh T(2021)Development and Application of Leader Identification Model Using Multimodal Information in Multi-Party ConversationsInternational Journal of Asian Language Processing10.1142/S271755452050019830:04(2050019)Online publication date: 8-May-2021
https://doi.org/10.1142/S2717554520500198
Priya KKrishnaveni R. Krishnamurthy M. Bairavel S. (2020)Analyzing Social Emotions in Social Network Using Graph Based Co-Ranking AlgorithmInternational Journal of Technology and Human Interaction10.4018/IJTHI.202004010316:2(23-33)Online publication date: 1-Apr-2020
https://doi.org/10.4018/IJTHI.2020040103
Show More Cited By

Index Terms

Using linguistic and vocal expressiveness in social role recognition
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing

Recommendations

Characterizing and detecting spontaneous speech: Application to speaker role recognition

Processing spontaneous speech is one of the many challenges that automatic speech recognition systems have to deal with. The main characteristics of this kind of speech are disfluencies (filled pause, repetition, false start, etc.) and many studies have ...
Speaker recognition using complementary information from vocal source and vocal tract
Automatic role recognition based on conversational and prosodic behaviour
MM '10: Proceedings of the 18th ACM international conference on Multimedia

This paper proposes an approach for the automatic recognition of roles in settings like news and talk-shows, where roles correspond to specific functions like Anchorman, Guest or Interview Participant. The approach is based on purely nonverbal vocal ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

February 2011

504 pages

ISBN:9781450304191

DOI:10.1145/1943403

General Chairs:
Pearl Pu
EPFL, Switzerland
,
Michael Pazzani
Rutgers University, USA
,
Program Chairs:
Elisabeth André
Augsburg University, Germany
,
Doug Riecken
CCLS Columbia University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 February 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

IUI '11

Sponsor:

IUI '11: 16th International Conference on Intelligent User Interfaces

February 13 - 16, 2011

CA, Palo Alto, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
133
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Priya KKrishnaveni R. Krishnamurthy M. Bairavel S. (2022)Analyzing Social Emotions in Social Network Using Graph Based Co-Ranking AlgorithmResearch Anthology on Implementing Sentiment Analysis Across Multiple Disciplines10.4018/978-1-6684-6303-1.ch018(329-341)Online publication date: 10-Jun-2022
https://doi.org/10.4018/978-1-6684-6303-1.ch018
Shiota THonda KShimada KSaitoh T(2021)Development and Application of Leader Identification Model Using Multimodal Information in Multi-Party ConversationsInternational Journal of Asian Language Processing10.1142/S271755452050019830:04(2050019)Online publication date: 8-May-2021
https://doi.org/10.1142/S2717554520500198
Priya KKrishnaveni R. Krishnamurthy M. Bairavel S. (2020)Analyzing Social Emotions in Social Network Using Graph Based Co-Ranking AlgorithmInternational Journal of Technology and Human Interaction10.4018/IJTHI.202004010316:2(23-33)Online publication date: 1-Apr-2020
https://doi.org/10.4018/IJTHI.2020040103
Shiota THonda KShimada KSaitoh T(2020)Leader Identification Using Multimodal Information in Multi-party Conversations2020 International Conference on Asian Language Processing (IALP)10.1109/IALP51396.2020.9310465(7-12)Online publication date: 4-Dec-2020
https://doi.org/10.1109/IALP51396.2020.9310465
Trilla AAlias F(2018)Sentence-Based Sentiment Analysis for Expressive Text-to-SpeechIEEE Transactions on Audio, Speech, and Language Processing10.1109/TASL.2012.221712921:2(223-233)Online publication date: 20-Dec-2018
https://dl.acm.org/doi/10.1109/TASL.2012.2217129
Gatica-Perez DAran OJayagopi D(2017)Analysis of Small GroupsSocial Signal Processing10.1017/9781316676202.025(349-367)Online publication date: 13-Jul-2017
https://doi.org/10.1017/9781316676202.025
Sapru ABourlard H(2015)Automatic Recognition of Emergent Social Roles in Small Group InteractionsIEEE Transactions on Multimedia10.1109/TMM.2015.240843717:5(746-760)Online publication date: May-2015
https://doi.org/10.1109/TMM.2015.2408437
Dong WLepri BPianesi FPentland A(2013)Modeling Functional Roles Dynamics in Small Group InteractionsIEEE Transactions on Multimedia10.1109/TMM.2012.222503915:1(83-95)Online publication date: Jan-2013
https://doi.org/10.1109/TMM.2012.2225039
Sapru ABourlard H(2013)Investigating the Impact of Language Style and Vocal Expression on Social Roles of Participants in Professional MeetingsProceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction10.1109/ACII.2013.60(324-329)Online publication date: 2-Sep-2013
https://dl.acm.org/doi/10.1109/ACII.2013.60
Sapru AValente F(2012)Automatic speaker role labeling in AMI meetings: Recognition of formal and social roles2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2012.6289057(5057-5060)Online publication date: Mar-2012
https://doi.org/10.1109/ICASSP.2012.6289057

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Characterizing and detecting spontaneous speech: Application to speaker role recognition

Speaker recognition using complementary information from vocal source and vocal tract

Automatic role recognition based on conversational and prosodic behaviour