More Web Proxy on the site http://driver.im/

poster

Automatic detection of deceit in verbal communication

Authors:

Verónica Pérez-Rosas,

Mihai BurzoAuthors Info & Claims

ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction

Pages 131 - 134

https://doi.org/10.1145/2522848.2522888

Published: 09 December 2013 Publication History

Abstract

This paper presents experiments in building a classifier for the automatic detection of deceit. Using a dataset of deceptive videos, we run several comparative evaluations focusing on the verbal component of these videos, with the goal of understanding the difference in deceit detection when using manual versus automatic transcriptions, as well as the difference between spoken and written lies. We show that using only the linguistic component of the deceptive videos, we can detect deception with accuracies in the range of 52-73%.

References

[1]

J. F. Cohn and K. L. Schmidt. The timing of facial motion in posed and spontaneous smiles. International Journal of Wavelets, Multiresolution and Information Processing, 2, 2004.

[2]

B. DePaulo, J. Lindsay, B. Malone, L. Muhlenbruck, K. Charlton, and H. Cooper. Cues to deception. Psychological Bulletin, 129(1):74--118, 2003.

[3]

P. Ekman. Detecting deception from the body or face. Journal of Personality and Social Psychology, 29(3), 1974.

[4]

S. Ezzat, N. Gayar, and M. Ghanem. Investigating analysis of speech content through text classification. In Soft Computing and Pattern Recognition (SoCPaR), 2010 International Conference of, pages 105--110, dec. 2010.

[5]

M. Frank, J. Movellan, M. Bartlett, and G. Littleworth. RU-FACS-1 database, Machine Perception Laboratory, U.C. San Diego, 2012.

[6]

J. Hirschberg, S. Benus, J. Brenier, F. Enos, S. Friedman, S. Gilman, C. Girand, M. Graciarena, A. Kathol, L. Michaelis, B. Pellom, E. Shriberg, and A. Stolcke. Distinguishing deceptive from non-deceptive speech. In Proceedings of INTERSPEECH-2005, Lisbon, Portugal, 2005.

[7]

G. Littlewort, M. Bartlett, and K. Lee. Faces of pain: automated measurement of spontaneous all facial expressions of genuine and posed pain. In Proceedings of the International Conference on Multimodal Interaction, 2007.

Digital Library

[8]

F. Metze, T. Polzehl, and M. Wagner. Fusion of acoustic and linguistic features for emotion detection. In Semantic Computing, 2009. ICSC '09. IEEE International Conference on, pages 153 --160, sept. 2009.

Digital Library

[9]

R. Mihalcea and C. Strapparava. The lie detector: Explorations in the automatic recognition of deceptive language. In Proceedings of the Association for Computational Linguistics (ACL 2009), Singapore, 2009.

Digital Library

[10]

A. Mohammadian, V. Abootalebi, M. H. Moradi, and M. A. Khalilzadeh. Multimodal detection of deception using fusion of reaction time and p300 component. In Biomedical Engineering Conference, 2008.

[11]

M. Newman, J. Pennebaker, D. Berry, and J. Richards. Lying words: Predicting deception from linguistic styles. Personality and Social Psychology Bulletin, 29:665--675, 2003.

[12]

M. Ott, Y. Choi, C. Cardie, and J. Hancock. Finding deceptive opinion spam by any stretch of the imagination. In Association for Computational Linguistics (ACL), 2011.

Digital Library

[13]

T. Qin, J. K. Burgoon, J. P. Blair, and J. F. Nunamaker. Modality effects in deception detection and applications in automatic deception-detection. In Proceedings of the 38th Hawaii International Conference on System Sciences, 2005.

Digital Library

[14]

J. F. Torres, E. Moore, and E. Bryant. A study of Glottal waveform features for deceptive speech classification. In International Conference on Acoustics, Speech, and Signal Processing, 2008.

[15]

P. Tsiamyrtzis, J. Dowdall, D. Shastri, I. Pavlidis, M. Frank, and P. Ekman. Imaging facial physiology for the detection of deceit. International Journal of Computer Vision, 71(2), 2006.

Digital Library

[16]

M. Valstar, H. Gunes, and M. Pantic. How to distinguish posed from spontaneous smiles using geometric features. In Proceedings of the ACM International Conference on Multimodal Interfaces, 2007.

Digital Library

[17]

M. Valstar, M. Pantic, Z. Ambadar, and J. Cohn. Spontaneous vs. posed facial behavior: automatic analysis of brow actions. In Proceedings of the ACM International Conference on Multimodal Interfaces, 2006.

Digital Library

[18]

Z. Zhang, V. Singh, T. E. Slowe, S. Tulyakov, and V. Govindaraju. Real-time automatic deceit detection from involuntary facial expressions. In Conference on Computer Vision and Pattern Recognition, 2007.

[19]

L. Zhou, J. Burgoon, J. Nunamaker, and D. Twitchell. Automating linguistics-based cues for detecting deception in text-based asynchronous computer-mediated communication. Group Decision and Negotiation, 13:81--106, 2004.

[20]

Z. Zhu, P. Tsiamyrtzis, and I. Pavlidis. Forehead thermal signature extraction in lie detection. In Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, France, 2007.

Cited By

Constâncio ATsunoda DSilva HSilveira JCarvalho D(2023)Deception detection with machine learning: A systematic review and statistical analysisPLOS ONE10.1371/journal.pone.028132318:2(e0281323)Online publication date: 9-Feb-2023
https://doi.org/10.1371/journal.pone.0281323
Avola DCinque LForesti GPannone DConci NShan CMarcenaro LHan J(2019)Automatic Deception Detection in RGB videos using Facial Action UnitsProceedings of the 13th International Conference on Distributed Smart Cameras10.1145/3349801.3349806(1-6)Online publication date: 9-Sep-2019
https://dl.acm.org/doi/10.1145/3349801.3349806
Bak PBak P(2019)Was sind Emotionen?Lernen, Motivation und Emotion10.1007/978-3-662-59691-3_11(145-163)Online publication date: 22-Nov-2019
https://doi.org/10.1007/978-3-662-59691-3_11
Show More Cited By

Index Terms

Automatic detection of deceit in verbal communication
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Speech recognition

Recommendations

Deception detection using a multimodal approach
ICMI '14: Proceedings of the 16th International Conference on Multimodal Interaction

In this paper we address the automatic identification of deceit by using a multimodal approach. We collect deceptive and truthful responses using a multimodal setting where we acquire data using a microphone, a thermal camera, as well as physiological ...
Cross-Cultural Production and Detection of Deception from Speech
WMDD '15: Proceedings of the 2015 ACM on Workshop on Multimodal Deception Detection

Detecting deception from different dimensions of human behavior has been a major goal of research in psychology and computational linguistics for some years and is currently of considerable interest to military and law enforcement agencies. However, ...
Deception detection methods incorporating discourse network metrics in synchronous computer-mediated communication

The prevalence of deception in computer-mediated communication and the risk of misjudgement based on deceptive information call for effective detection methods of deception. Extant models for online deception detection rely mainly on verbal behaviours of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction

December 2013

630 pages

ISBN:9781450321297

DOI:10.1145/2522848

General Chairs:
Julien Epps
The University of New South Wales, Australia
,
Fang Chen
National ICT Australia, Australia
,
Sharon Oviatt
Incaa Designs, USA
,
Kenji Mase
Nagoya University, Japan
,
Program Chairs:
Andrew Sears
Rochester Institute of Technology, USA
,
Kristiina Jokinen
University of Helsinki, Finland
,
Björn Schuller
Technische Universität München, Germany

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 December 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI '13

Sponsor:

SIGCHI

ICMI '13: 2013 International Conference on Multimodal Interaction

December 9 - 13, 2013

Sydney, Australia

Acceptance Rates

ICMI '13 Paper Acceptance Rate 49 of 133 submissions, 37%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
221
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Constâncio ATsunoda DSilva HSilveira JCarvalho D(2023)Deception detection with machine learning: A systematic review and statistical analysisPLOS ONE10.1371/journal.pone.028132318:2(e0281323)Online publication date: 9-Feb-2023
https://doi.org/10.1371/journal.pone.0281323
Avola DCinque LForesti GPannone DConci NShan CMarcenaro LHan J(2019)Automatic Deception Detection in RGB videos using Facial Action UnitsProceedings of the 13th International Conference on Distributed Smart Cameras10.1145/3349801.3349806(1-6)Online publication date: 9-Sep-2019
https://dl.acm.org/doi/10.1145/3349801.3349806
Bak PBak P(2019)Was sind Emotionen?Lernen, Motivation und Emotion10.1007/978-3-662-59691-3_11(145-163)Online publication date: 22-Nov-2019
https://doi.org/10.1007/978-3-662-59691-3_11
Rosso PCagnina L(2017)Deception Detection and Opinion SpamA Practical Guide to Sentiment Analysis10.1007/978-3-319-55394-8_8(155-171)Online publication date: 12-Apr-2017
https://doi.org/10.1007/978-3-319-55394-8_8
Demyanov SBailey JRamamohanarao KLeckie CZhang ZCohen PBohus DHoraud RMeng H(2015)Detection of Deception in the Mafia Party GameProceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2820745(335-342)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1145/2818346.2820745

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents