research-article

Physiological Expression of Robots Enhancing Users' Emotion in Direct and Indirect Communication

Authors:

Naoto Yoshida,

Tomoko YonezawaAuthors Info & Claims

HAI '17: Proceedings of the 5th International Conference on Human Agent Interaction

Pages 505 - 509

https://doi.org/10.1145/3125739.3132609

Published: 27 October 2017 Publication History

Get Access

Abstract

One of the important factors in medical and nursing care recently has been arousing the emotions of patients. Many types of communication robots and pet robots have been developed as communication partners for patients. The user's emotions are stimulated during direct communication with the robot, although there is less chance that the robot will approach the user in other situations such as watching TV and listening to music without disturbing him or her.The user feels that the robot is troublesome during the user's other tasks. The purpose of this research is to elevate the user's emotional experience through emotional expression by physiological expressions of a partner robot in the user's daily life. Ambient but emotional expressions of physiological phenomena are perceived by touch, even when the user is concentrating on other tasks. First, we focused on breathing, heartbeat and body temperature as the physiological phenomena. From the results of the evaluations of the robot's heartbeat and body temperature, along with our previous results for the breathing, each expression has arousal and pleasure axes of the robot's situation. In this paper, we focus on The joint attention of the robot and user to an emotional photograph, and we verified whether the strength of the user's own emotional response to the content was changed by the physiological expressions of the robot while they looked at photographs together. The results suggest that the physiological expression of the robot would make the common emotional experience of users the user's own emotion in the experience more excited and more relaxed.

References

[1]

Hideyuki Ando, Junji Watanabe, and Masahiko Sato. 2012. Empathetic heartbeat. In Proceedings of the 20th ACM international conference on Multimedia. ACM, 1489--1490.

Digital Library

Google Scholar

[2]

David M Berger. 1987. Clinical empathy. Jason Aronson.

Google Scholar

[3]

Iolanda Leite, Ginevra Castellano, André Pereira, Carlos Martinho, and Ana Paiva. 2012. Modelling empathic behaviour in a robotic game companion for children:an ethnographic study in real-world settings. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. ACM, 367--374.

Digital Library

Google Scholar

[4]

Takahiro Matsumoto, Shunichi Seko, Ryousuke Aoki, Akihiro Miyata, Tomoki Watanabe, and Tomohiro Yamada. 2014. Affective Agents for Enhancing Emotional Experience. In Proceedings of the Second International Conference on Human-agent Interaction (HAI '14). ACM, New York, NY, USA, 169--172.

Digital Library

Google Scholar

[5]

T. Matsumoto, S. Seko, R. Aoki, A. Miyata, T. Watanabe, and T. Yamada. 2015. Towards enhancing human experience by affective robots:Experiment and discussion. In 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). 271--276.

Crossref

Google Scholar

[6]

Stewart W Mercer and William J Reynolds. 2002. Empathy and quality of care. British Journal of General Practice 52, Suppl (2002), S9--12. http://bjgp.org/content/52/supplement/S9

Google Scholar

[7]

T. Mitsui, T. Shibata, K. Wada, A. Touda, and K. Tanie. 2001. Psychophysiological effects by interaction with mental commit robot. In Intelligent Robots and Systems, 2001. Proceedings. 2001 IEEE/RSJ International Conference on, Vol. 2. 1189--1194 vol.2.

Crossref

Google Scholar

[8]

Narihiro Nishimura, Asuka Ishi, Michi Sato, Shogo Fukushima, and Hiroyuki Kajimoto. 2012. Facilitation of affection by tactile feedback of false heratbeat. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. ACM, 2321--2326.

Digital Library

Google Scholar

[9]

Yasaman Sefidgar, Karon MacLean, Steve Yohanan, HF Machiel Van der Loos, Elizabeth Croft, and others. 2015. Design and Evaluation of a Touch-Centered Calming Interaction with a Social Robot. IEEE Transactions on Affective Computing 1 (2015), 1--1.

Google Scholar

[10]

Walter Dan Stiehl, Jeff Lieberman, Cynthia Breazeal, Louis Basel, Levi Lalla, and Michael Wolf. 2005. Design of a therapeutic robotic companion for relational, affective touch. In Robot and Human Interactive Communication, 2005. ROMAN 2005. IEEE International Workshop on. IEEE, 408--415.

Crossref

Google Scholar

[11]

Myrthe Tielman, Mark Neerincx, John-Jules Meyer, and Rosemarijn Looije. 2014. Adaptive emotional expression in robot-child interaction. In Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction. ACM, 407--414.

Digital Library

Google Scholar

[12]

Stuart Valins. 1966. Cognitive effects of false heart-rate feedback. Journal of personality and social psychology 4, 4 (1966), 400.

Crossref

Google Scholar

[13]

Steve Yohanan and Karon E MacLean. 2008. The haptic creature project:Social human-robot interaction through affective touch. In Proceedings of the AISB 2008 Symposium on the Reign of Catz & Dogs:The Second AISB Symposium on the Role of Virtual Creatures in a Computerised Society, Vol. 1. Citeseer, 7--11.

Google Scholar

[14]

Naoto Yoshida and Tomoko Yonezawa. 2016. Investigating Breathing Expression of a Stuffed-Toy Robot Based on Body-Emotion Model. In Proceedings of the Fourth International Conference on Human Agent Interaction (HAI '16). ACM, New York, NY, USA, 139--144.

Digital Library

Google Scholar

Cited By

View all

YOSHIDA NYONEZAWA T(2022)The Effect of the Robot’s Physiological Approach on the Impression of the Arousal of the Content and the Familiarity of the Robotユーザに対するロボットの生理的働きかけによるコンテンツ覚醒度の増幅と親密感への影響Journal of Japan Society for Fuzzy Theory and Intelligent Informatics10.3156/jsoft.34.3_57934:3(579-591)Online publication date: 15-Aug-2022
https://doi.org/10.3156/jsoft.34.3_579
Saunderson SNejat G(2019)How Robots Influence Humans: A Survey of Nonverbal Communication in Social Human–Robot InteractionInternational Journal of Social Robotics10.1007/s12369-019-00523-0Online publication date: 29-Jan-2019
https://doi.org/10.1007/s12369-019-00523-0
Yoshida NYonezawa TImai MNorman TSklar EKomatsu T(2018)Arousal and Valence in Robot's Emotional Expression of Breathing and HeartbeatProceedings of the 6th International Conference on Human-Agent Interaction10.1145/3284432.3287176(330-332)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3284432.3287176

Index Terms

Physiological Expression of Robots Enhancing Users' Emotion in Direct and Indirect Communication

Recommendations

Investigating Breathing Expression of a Stuffed-Toy Robot Based on Body-Emotion Model
HAI '16: Proceedings of the Fourth International Conference on Human Agent Interaction

In this research, we focus on physiological phenomena expression of robots, propose the Body-Emotion Model (BEM), which concerns the relationship between the internal states of robots and their involuntary physical reactions. We expect that the robot ...
Arousal and Valence in Robot's Emotional Expression of Breathing and Heartbeat
HAI '18: Proceedings of the 6th International Conference on Human-Agent Interaction

In our past study, we have aimed at emotional expressions of a robot using artificial physiological phenomena, such as breathing and heartbeat, and we demonstrated that both the robot's respiratory rate and heart rate could express the arousal. On the ...
Is happy better than sad even if they are both non-adaptive? Effects of emotional expressions of talking-head interface agents

Hedonic preference and contextual appropriateness are two general principles governing humans' emotional expressions. People in general prefer perceiving and expressing positive emotions to negative ones, but also modulate their emotional expressions to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HAI '17: Proceedings of the 5th International Conference on Human Agent Interaction

October 2017

550 pages

ISBN:9781450351133

DOI:10.1145/3125739

General Chairs:
Britta Wrede
Bielefeld University, Germany
,
Yukie Nagai
Osaka University, Japan
,
Program Chairs:
Takanori Komatsu
Meiji University, Japan
,
Marc Hanheide
University of Lincoln, UK
,
Lorenzo Natale
Italian Institute of Technology, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Japan Society for the Promotion of Science

Conference

HAI '17

Sponsor:

SIGCHI

HAI '17: The Fifth International Conference on Human-Agent Interaction

October 17 - 20, 2017

Bielefeld, Germany

Acceptance Rates

Overall Acceptance Rate 121 of 404 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
187
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

YOSHIDA NYONEZAWA T(2022)The Effect of the Robot’s Physiological Approach on the Impression of the Arousal of the Content and the Familiarity of the Robotユーザに対するロボットの生理的働きかけによるコンテンツ覚醒度の増幅と親密感への影響Journal of Japan Society for Fuzzy Theory and Intelligent Informatics10.3156/jsoft.34.3_57934:3(579-591)Online publication date: 15-Aug-2022
https://doi.org/10.3156/jsoft.34.3_579
Saunderson SNejat G(2019)How Robots Influence Humans: A Survey of Nonverbal Communication in Social Human–Robot InteractionInternational Journal of Social Robotics10.1007/s12369-019-00523-0Online publication date: 29-Jan-2019
https://doi.org/10.1007/s12369-019-00523-0
Yoshida NYonezawa TImai MNorman TSklar EKomatsu T(2018)Arousal and Valence in Robot's Emotional Expression of Breathing and HeartbeatProceedings of the 6th International Conference on Human-Agent Interaction10.1145/3284432.3287176(330-332)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3284432.3287176

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Investigating Breathing Expression of a Stuffed-Toy Robot Based on Body-Emotion Model

Arousal and Valence in Robot's Emotional Expression of Breathing and Heartbeat

Is happy better than sad even if they are both non-adaptive? Effects of emotional expressions of talking-head interface agents