More Web Proxy on the site http://driver.im/

Article

Free access

Face to interface: facial affect in (hu)man and machine

Authors:

Diane J. Schiano,

Sheryl M. Ehrlich,

Krisnawan Rahardja,

Kyle SheridanAuthors Info & Claims

CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

Pages 193 - 200

https://doi.org/10.1145/332040.332430

Published: 01 April 2000 Publication History

Abstract

Facial expression of emotion (or “facial affect”) is rapidly becoming an area of intense interest in the computer science and interaction design communities. Ironically, this interest comes at a time when the classic findings on perception of human facial affect are being challenged in the psychological research literature, largely on methodological grounds. This paper presents two studies on perception of facial affect. Experiment 1 provides new data on the recognition of human facial expressions, using experimental methods and analyses designed to systematically address the criticisms and help resolve this controversy. Experiment 2 is a user study on affect in a prototype robot face; the results are compared to the human data of Experiment 1. Together they provide a demonstration of how basic and more applied research can mutually contribute to this rapidly developing field.

References

[1]

Bartlett, M.S., Hager, J.C., Ekman, P. & Sejnowski, T.J. Psychophysiology, 36 (1999), 253-263.

[2]

Darwin, C. The Expression of Emotion in Man and Animals. Univ. of Chicago Press: Chicago, IL, 1965 (originally 1872).

[3]

Ehrlich, S., Schiano, D.J., Sheridan, K., Beck, D. & Pinto, J. Facing the issues: Methods matter Psychonomic Society (Dallas, TX, May 1998).

[4]

Ekman, P. and Friesen,W.V. The Facial Action Coding System. Consulting Psychologists Press: Palo Alto, CA, 1978.

[5]

Ekman, P., Friesen, W.V. & Ellsworth, P. Emotion in the Human Face. Pergamon, New York, 1972.

[6]

Hamm, J. Cartooning the Head and Figure. Perigree, New York, 1982.

[7]

Kurlander, D., Skelly, T. & Salesin, D. "Comic chat," Computer Graphics Proceedings, (1996), ACM Press, 225- 236.

Digital Library

[8]

Levenson, R. W., Ekman, P., Friesen, W. V. Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology, 27 (1990), 363-384.

[9]

Lisetti, C.L. & Schiano, D.J. Automatic facial expression interpretation: Where Human-Computer Interaction, Artificial Intelligence and Cognitive Science intersect. Pragmatics and Cognition (Special issue on Facial Information Processing, a Multidisciplinary Perspective). 1999, in press.

[10]

Nass, C.I., Steuer, J.S. & Tauber, E. "Computers are social actors", in Proceedings of CHI'94 (Boston MA, April 1994), 72-78.

Digital Library

[11]

Picard, R. Affective Computing. MIT Press: Cambridge, MA, 1997.

Digital Library

[12]

Reeves, B. & Nass, C.I. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press: New York, 1996.

Digital Library

[13]

Russell, J.A. A circumplex model of affect. Journal of Personality and Social Psychology, 39(6) (1980), 1161- 1178.

[14]

Russell, J.A. Is there universal recognition of emotion from facial expression? Psychological Bulletin, 95 (1994), 102-141.

[15]

Russell, J.A and Fernandez-Dols, J.M. The Psychology of Facial Expression. Cambridge University Press: New York, 1997.

[16]

Schlosberg, H. Three dimensions of emotion. Psychological Review, 69 (1954), 81-88.

[17]

Tow, R. "Affect-based Robot Communication Methods and Systems" - U.S. Patent No 5,832,189, November, 1998.

[18]

Walker, J.H., Sproull, L., Subramani, R. (1994). Using a human face in an interface, in Companion of CHI'94 Conference on Human Factors in Computing Systems (Boston MA, April 1994), 205.

Digital Library

[19]

Yamada, H., Matsuda, T., Watari, C. & Suenaga, T. Dimensions of visual information for categorizing facial expressions of emotion. Japanese Psychological Research, 35(1993), 172-181.

Cited By

Penčić MČavić MOros DVrgović PBabković KOrošnjak MČavić D(2022)Anthropomorphic Robotic Eyes: Structural Design and Non-Verbal Communication EffectivenessSensors10.3390/s2208306022:8(3060)Online publication date: 15-Apr-2022
https://doi.org/10.3390/s22083060
Gervasi RBarravecchia FMastrogiacomo LFranceschini F(2022)Applications of affective computing in human-robot interaction: State-of-art and challenges for manufacturingProceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture10.1177/09544054221121888237:6-7(815-832)Online publication date: 9-Sep-2022
https://doi.org/10.1177/09544054221121888
Wairagkar MLima MBazo DCraig RWeissbart HEtoundi AReichenbach TIyengar PVaswani SJames CBarnaghi PMelhuish CVaidyanathan R(2022)Emotive Response to a Hybrid-Face Robot and Translation to Consumer Social RobotsIEEE Internet of Things Journal10.1109/JIOT.2021.30975929:5(3174-3188)Online publication date: 1-Mar-2022
https://doi.org/10.1109/JIOT.2021.3097592
Show More Cited By

Index Terms

Face to interface: facial affect in (hu)man and machine

Recommendations

Categorical imperative NOT: facial affect is perceived continuously
CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Facial affect (or emotion) recognition is a central issue for many VMC and naturalistic computing applications. Most computational models assume "categorical perception" of facial affect, in which a benign illusion promotes robust recognition of ...
The communicative role of non-face emojis

Emojis have evolved from imitations of facial expressions meant to communicate affect into pictures of objects, food, and places that are not directly linked to affect. While emojis that resemble facial expressions are well-researched, emojis that ...
Affective guidance of intelligent agents: How emotion controls cognition

How do emotions and moods color cognition? In this article, we examine how such reactions influence both judgments and cognitive performance. We argue that many affective influences are due, not to affective reactions themselves, but to the information ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

April 2000

587 pages

ISBN:1581132166

DOI:10.1145/332040

Chairmen:
Thea Turner
Motorola Labs
,
Gerd Szwillus
Univ. of Paderborn, Paderborn, Germany

Copyright © 2000 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI00

Sponsor:

SIGCHI

CHI00: Human Factors in Computing Systems

April 1 - 6, 2000

The Hague, The Netherlands

Acceptance Rates

CHI '00 Paper Acceptance Rate 72 of 336 submissions, 21%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,729
Total Downloads

Downloads (Last 12 months)105
Downloads (Last 6 weeks)16

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Penčić MČavić MOros DVrgović PBabković KOrošnjak MČavić D(2022)Anthropomorphic Robotic Eyes: Structural Design and Non-Verbal Communication EffectivenessSensors10.3390/s2208306022:8(3060)Online publication date: 15-Apr-2022
https://doi.org/10.3390/s22083060
Gervasi RBarravecchia FMastrogiacomo LFranceschini F(2022)Applications of affective computing in human-robot interaction: State-of-art and challenges for manufacturingProceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture10.1177/09544054221121888237:6-7(815-832)Online publication date: 9-Sep-2022
https://doi.org/10.1177/09544054221121888
Wairagkar MLima MBazo DCraig RWeissbart HEtoundi AReichenbach TIyengar PVaswani SJames CBarnaghi PMelhuish CVaidyanathan R(2022)Emotive Response to a Hybrid-Face Robot and Translation to Consumer Social RobotsIEEE Internet of Things Journal10.1109/JIOT.2021.30975929:5(3174-3188)Online publication date: 1-Mar-2022
https://doi.org/10.1109/JIOT.2021.3097592
Chin HYi M(2021)Voices that Care Differently: Understanding the Effectiveness of a Conversational Agent with an Alternative Empathy Orientation and Emotional Expressivity in Mitigating Verbal AbuseInternational Journal of Human–Computer Interaction10.1080/10447318.2021.198768038:12(1153-1167)Online publication date: 10-Nov-2021
https://doi.org/10.1080/10447318.2021.1987680
Mccoll DHong AHatakeyama NNejat GBenhabib B(2016)A Survey of Autonomous Human Affect Detection Methods for Social Robots Engaged in Natural HRIJournal of Intelligent and Robotic Systems10.1007/s10846-015-0259-282:1(101-133)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1007/s10846-015-0259-2
Supratak AWu CDong HSun KGuo Y(2016)Survey on Feature Extraction and Applications of BiosignalsMachine Learning for Health Informatics10.1007/978-3-319-50478-0_8(161-182)Online publication date: 10-Dec-2016
https://doi.org/10.1007/978-3-319-50478-0_8
Fitter NKuchenbecker K(2016)Designing and Assessing Expressive Open-Source Faces for the Baxter RobotSocial Robotics10.1007/978-3-319-47437-3_33(340-350)Online publication date: 7-Oct-2016
https://doi.org/10.1007/978-3-319-47437-3_33
Bennett CSabanovic SFraune MShaw K(2014)Context congruency and robotic facial expressions: Do effects on human perceptions vary across culture?The 23rd IEEE International Symposium on Robot and Human Interactive Communication10.1109/ROMAN.2014.6926296(465-470)Online publication date: Aug-2014
https://doi.org/10.1109/ROMAN.2014.6926296
Mäkäräinen MKätsyri JTakala T(2014)Exaggerating Facial Expressions: A Way to Intensify Emotion or a Way to the Uncanny Valley?Cognitive Computation10.1007/s12559-014-9273-06:4(708-721)Online publication date: 10-May-2014
https://doi.org/10.1007/s12559-014-9273-0
Lawrence LAbdel Nabi D(2013)The Compilation and Validation of a Collection of Emotional Expression Images Communicated by Synthetic and Human FacesInternational Journal of Synthetic Emotions10.4018/ijse.20130701044:2(34-62)Online publication date: 1-Jul-2013
https://dl.acm.org/doi/10.4018/ijse.2013070104
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents