More Web Proxy on the site http://driver.im/

research-article

FaceShare: Mirroring with Pseudo-Smile Enriches Video Chat Communications

Authors:

Masanori Yokoyama,

Shigeo Yoshida,

Takayoshi Mochizuki,

Tomohiro Yamada,

Tomohiro Tanikawa,

Michitaka HiroseAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 5313 - 5317

https://doi.org/10.1145/3025453.3025574

Published: 02 May 2017 Publication History

Abstract

"Mirroring" refers to the unconscious mimicry of another person's behaviors, such as their facial expressions. Mirroring has many positive effects, such as enhancing closeness and improving the flow of a conversation, which enriches the quality of communication. Our study set out to devise a means of evoking these positive effects in a video chat without any conscious effort of participants. We constructed a videophone system, called FaceShare, which can deform the user's face into a smile in response to their partner's smiling. That is, our system generates mirroring by producing a pseudo-smile through image processing. We conducted an experiment in which pairs of participants had brief conversations via FaceShare. The results implied that mirroring using the pseudo-smile lets the mimicker, whose face is deformed according to the expressions of their partner, feel a closeness, and improves the flow of the conversation for both the mimicker and the mimickee, who sees the mimicker's deformed face.

Supplementary Material

suppl.mov (pn1579-file3.mp4)

Supplemental video

Download
53.06 MB

suppl.mov (pn1579p.mp4)

Supplemental video

Download
16.32 MB

References

[1]

Tanya L. Chartrand and John A. Bargh. 1999. The chameleon effect: The perception-behavior link and social interaction. Journal of personality and social psychology 76, 6 (1999), 893.

[2]

Ulf Dimberg and Sven Söderkvist. 2011. The voluntary facial action technique: A method to test the facial feedback hypothesis. Journal of nonverbal behavior 35, 1 (2011), 17--33.

[3]

Ulf Dimberg and Monika Thunberg. 1998. Rapid facial reactions to emotional facial expressions. Scandinavian journal of psychology 39, 1 (1998), 39--45.

[4]

Ulf Dimberg, Monika Thunberg, and Kurt Elmehed. 2000. Unconscious facial reactions to emotional facial expressions. Psychological science 11, 1 (2000), 86-- 89.

[5]

Paul Ekman and Wallace V. Friesen. 2003. Unmasking the face: A guide to recognizing emotions from facial clues. Ishk.

[6]

Hiroko Ichikawa and Junshiro Makino. 2007. Function of congruent facial responses to smiling and frowning. Perceptual and motor skills 105, 3 (2007), 838--851.

[7]

James M. Kilner, Yves Paulignan, and Sarah-Jayne Blakemore. 2003. An interference effect of observed biological movement on action. Current Biology 13, 6 (2003), 522--525.

[8]

Yuki Kinoshita, Masanori Yokoyama, Keita Suzuki, Takayoshi Mochizuki, Tomohiro Yamada, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2016. Transcendent Telepresence: Tele-Communication Better Than Face to Face Interaction. In International Conference on Distributed, Ambient, and Pervasive Interactions. Springer, 429--438.

[9]

Jessica L. Lakin, Valerie E. Jefferis, Clara Michelle Cheng, and Tanya L. Chartrand. 2003. The chameleon effect as social glue: Evidence for the evolutionary significance of nonconscious mimicry. Journal of nonverbal behavior 27, 3 (2003), 145--162.

[10]

Naoto Nakazato, Shigeo Yoshida, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Smart Face: enhancing creativity during video conferences using real-time facial deformation. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 75--83.

Digital Library

[11]

Wataru Sato and Sakiko Yoshikawa. 2007. Spontaneous facial mimicry in response to dynamic facial expressions. Cognition 104, 1 (2007), 1--18.

[12]

Mariëlle Stel and Roos Vonk. 2010. Mimicry in social interaction: Benefits for mimickers, mimickees, and their interaction. British Journal of Psychology 101, 2 (2010), 311--323.

[13]

Keita Suzuki, Masanori Yokoyama, Yuki Kinoshita, Takayoshi Mochizuki, Tomohiro Yamada, and Sho Sakurai. 2016. Enhancing Effect of Mediated Social Touch between Same Gender by Changing Gender Impression. In Proceedings of the 7th Augmented Human International Conference 2016. ACM, 17.

Digital Library

[14]

Rick B. Van Baaren, Rob W. Holland, Kerry Kawakami, and Ad Van Knippenberg. 2004. Mimicry and prosocial behavior. Psychological science 15, 1 (2004), 71--74.

[15]

Yuanchen Zhu and Steven J. Gortler. 2007. 3D deformation using moving least squares. Harvard Univ.: TR10-07, Tech. Rep (2007).

Cited By

Diao CArevalo Arboleda SRaake A(2024)Nonverbal Dynamics in Dyadic Videoconferencing Interaction: The Role of Video Resolution and Conversational QualityProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685733(387-396)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685733
Armstrong MYang CSkiers KLim MGunasekaran TWang ZNarumi TMinamizawa KPai Y(2024)SealMates: Improving Communication in Video Conferencing using a Collective Behavior-Driven AvatarProceedings of the ACM on Human-Computer Interaction10.1145/36373958:CSCW1(1-23)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637395
Yoneyama JFujimoto YOkazaki KSawabe TKanbara MKato H(2024)Augmented conversations: AR face filters for facilitating comfortable in-person interactionsJournal on Multimodal User Interfaces10.1007/s12193-024-00446-9Online publication date: 5-Dec-2024
https://doi.org/10.1007/s12193-024-00446-9
Show More Cited By

Index Terms

FaceShare: Mirroring with Pseudo-Smile Enriches Video Chat Communications
1. Applied computing
  1. Document management and text processing
    1. Document preparation
      1. Multi / mixed media creation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Hypertext / hypermedia

Recommendations

Papetto: Crafting Embodied Co-Presence in Video Chat
HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

In this paper, we describe Papetto, a lightweight robotic arm that moves according to face detection techniques in order to mirror facial movements such as head shaking, leaning and tilting. Using this system we examine the role of the "frame" in video ...
Communicative facial displays as a new conversational modality
CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems

The human face is an independent communication channel that conveys emotional and conversational signals encoded as facial displays. Facial displays can be viewed as communicative signals that help coordinate conversation. We are attempting to introduce ...
Photo-realistic conversation agent
Integrated image and graphics technologies

Image-based facial animation (IBFA) techniques allow us to build photorealistic talking heads. In this chapter, we address two important issues in creating a conversation agent using IBFA. First, we show how to make a conversation agent appear to be ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
788
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)7

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Diao CArevalo Arboleda SRaake A(2024)Nonverbal Dynamics in Dyadic Videoconferencing Interaction: The Role of Video Resolution and Conversational QualityProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685733(387-396)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685733
Armstrong MYang CSkiers KLim MGunasekaran TWang ZNarumi TMinamizawa KPai Y(2024)SealMates: Improving Communication in Video Conferencing using a Collective Behavior-Driven AvatarProceedings of the ACM on Human-Computer Interaction10.1145/36373958:CSCW1(1-23)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637395
Yoneyama JFujimoto YOkazaki KSawabe TKanbara MKato H(2024)Augmented conversations: AR face filters for facilitating comfortable in-person interactionsJournal on Multimodal User Interfaces10.1007/s12193-024-00446-9Online publication date: 5-Dec-2024
https://doi.org/10.1007/s12193-024-00446-9
Horigome TYoshida STanikawa TMimura MKishimoto T(2023)Modification of the therapist’s facial expressions using virtual reality technology during the treatment of social anxiety disorder: a case seriesFrontiers in Psychology10.3389/fpsyg.2023.103005014Online publication date: 15-May-2023
https://doi.org/10.3389/fpsyg.2023.1030050
Kawata MNitada YMeneses AYoshikawa YIshiguro H(2023)Improvement the sense of being listened to by using a video conferencing system to visualize focal words of user’s speaking in a thought bubble2023 62nd Annual Conference of the Society of Instrument and Control Engineers (SICE)10.23919/SICE59929.2023.10354197(1122-1126)Online publication date: 6-Sep-2023
https://doi.org/10.23919/SICE59929.2023.10354197
Niwa MMasai KYoshida SSugimoto MWard JMcGill MMarky K(2023)Investigating Effects of Facial Self-Similarity Levels on the Impression of Virtual Agents in Serious/Non-Serious ContextsProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582721(221-230)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582721
Shimizu KNaruse SNishida JKasahara S(2023)Morphing Identity: Exploring Self-Other Identity Continuum through Interpersonal Facial Morphing ExperienceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580853(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580853
Futami KYanase SMurao KTerada T(2022)Unconscious Other’s Impression Changer: A Method to Manipulate Cognitive Biases That Subtly Change Others’ Impressions Positively/Negatively by Making AI Bias in Emotion Estimation AISensors10.3390/s2224996122:24(9961)Online publication date: 17-Dec-2022
https://doi.org/10.3390/s22249961
Shirai KFutami KMurao K(2022)Exploring Tactile Stimuli from a Wrist-Worn Device to Manipulate Subjective Time Based on the Filled-Duration IllusionSensors10.3390/s2219719422:19(7194)Online publication date: 22-Sep-2022
https://doi.org/10.3390/s22197194
Futami KKawahigashi DMurao K(2022)Mindless Memorization Booster: A Method to Influence Memorization Power Using Attention Induction Phenomena Caused by Visual Interface Modulation and Its Application to Memorization Support for English Vocabulary LearningElectronics10.3390/electronics1114227611:14(2276)Online publication date: 21-Jul-2022
https://doi.org/10.3390/electronics11142276
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents