More Web Proxy on the site http://driver.im/

research-article

Designing Social Interactions with a Humorous Robot Photographer

Authors:

Timothy Adamson,

C. Burton Lyng-Olsen,

Kendrick Umstattd,

Marynel VázquezAuthors Info & Claims

HRI '20: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

Pages 233 - 241

https://doi.org/10.1145/3319502.3374809

Published: 09 March 2020 Publication History

Abstract

This paper describes our efforts to explore the design space of social interactions for a robot portrait photographer. Our human-centered design process involved professional and amateur photographers to better understand the social dimensions of subject-photographer interactions. This exploration then guided our design of a robot photographer, which employs humor to elicit spontaneous smiles during photography events. In a laboratory evaluation of our robot prototype, we found that the majority of the subjects considered the robot's humor to be comical and appreciated it. More spontaneous smiles were elicited by the robot when it delivered humorous content to its subjects than when it was not humorous. Our findings provide insights for the design of future social robot photographers.

Supplementary Material

ZIP File (fp1232aux.zip)

The supplemental material consists of one PDF file. The PDF explains the software architecture of our system as well as the exact wording of the questions as they appeared on the surveys that we used.

Download
418.73 KB

SBV File (fp1232vfc.sbv)

Video figure captions

Download
2.19 KB

MP4 File (fp1232vf.mp4)

Supplemental video

Download
20.69 MB

MP4 File (p233-adamson.mp4)

Download
35.04 MB

References

[1]

Hyunsang Ahn, Dohyung Kim, Jaeyeon Lee, Suyoung Chi, Kyekyung Kim, Jinsul Kim, Minsoo Hahn, and Hyunseok Kim. 2006. A robot photographer with user interactivity. In 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 5637--5643.

[2]

Marlène Aillaud and Annie Piolat. 2012. Influence of gender on judgment of dark and nondark humor. Individual Differences Research, Vol. 10, 4 (2012), 211--222.

[3]

Anne E Beall. 2007. Can a new smile make you look more intelligent and successful? Dental Clinics of North America, Vol. 51, 2 (2007), 289--297.

[4]

Deborah R Billings, Kristin E Schaefer, Jessie YC Chen, and Peter A Hancock. 2012. Human-robot interaction: developing trust in robots. In Proceedings of the seventh annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, 109--110.

Digital Library

[5]

Rogerio Bonatti, Yanfu Zhang, Sanjiban Choudhury, Wenshan Wang, and Sebastian Scherer. 2018. Autonomous drone cinematographer: Using artistic principles to create smooth, safe, occlusion-free trajectories for aerial filming. arXiv preprint arXiv:1808.09563 (2018).

[6]

Zachary Byers, Michael Dixon, Kevin Goodier, Cindy M Grimm, and William D Smart. 2003. An autonomous robot photographer. In Proc. 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vol. 3. IEEE, 2636--2641.

[7]

Zachary Byers, Michael Dixon, William D Smart, and Cindy M Grimm. 2004. Say cheese! Experiences with a robot photographer. AI magazine, Vol. 25, 3 (2004), 37--37.

[8]

Manuel G Calvo, Andrés Fernández-Mart'in, and Lauri Nummenmaa. 2012. Perceptual, categorical, and affective processing of ambiguous smiling facial expressions. Cognition, Vol. 125, 3 (2012), 373--393.

[9]

Munjal Desai, Poornima Kaniarasu, Mikhail Medvedev, Aaron Steinfeld, and Holly Yanco. 2013. Impact of robot failures and feedback on real-time trust. In Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction. IEEE Press, 251--258.

Digital Library

[10]

Hamdi Dibeklioug lu, Albert Ali Salah, and Theo Gevers. 2015. Recognition of genuine smiles. IEEE Transactions on Multimedia, Vol. 17, 3 (2015), 279--294.

Digital Library

[11]

Dennis J Dunleavy. 2004. In the age of the instant: The influence of the digital camera on the photojournalistic routines of productivity, empowerment and social interaction between subject and photographer . Ph.D. Dissertation.

[12]

Paul Ekman, Richard J Davidson, and Wallace V Friesen. 1990. The Duchenne smile: Emotional expression and brain physiology: II. Journal of Personality and Social Psychology, Vol. 58, 2 (1990), 342.

[13]

Edward Twitchell Hall. 1910. The Hidden Dimension . Vol. 609. Garden City, NY: Doubleday.

[14]

Peter A Hancock, Deborah R Billings, Kristin E Schaefer, Jessie YC Chen, Ewart J De Visser, and Raja Parasuraman. 2011. A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction. Human Factors, Vol. 53, 5 (2011), 517--527.

[15]

Shanee Honig and Tal Oron-Gilad. 2018. Understanding and resolving failures in human-robot interaction: Literature review and model development. Frontiers in Psychology, Vol. 9 (2018), 861.

[16]

Bill Hurter. 2004. Portrait Photographer's Handbook .Amherst Media, Inc.

[17]

Bill Hurter. 2008. The Best of Portrait Photography: Techniques and Images from the Pros .Amherst Media.

[18]

L. Jacobs. 2010. The Art of Posing: Techniques for Digital Portrait Photographers .Amherst Media.

[19]

Tonglin Jiang, Hao Li, and Yubo Hou. 2019. Cultural Differences in Humor Perception, Usage, and Implications. Frontiers in Psychology, Vol. 10 (2019), 123. https://doi.org/10.3389/fpsyg.2019.00123

[20]

Myung-Jin Kim, Tae-Hoon Song, Seung-Hun Jin, Soon-Mook Jung, Gi-Hoon Go, Key-Ho Kwon, and Jae-Wook Jeon. 2010. Automatically available photographer robot for controlling composition and taking pictures. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 6010--6015.

[21]

GA Rajesh Kumar, Ravi Kant Kumar, and Goutam Sanyal. 2017. Discriminating real from fake smile using convolution neural network. In 2017 International Conference on Computational Intelligence in Data Science (ICCIDS). IEEE, 1--6.

[22]

Joseph C. Kush. 1997. Relationship Between Humor Appreciation and Counselor Self-Perceptions. Counseling and Values, Vol. 42, 1 (1997), 22--29. https://onlinelibrary.wiley.com/doi/abs/10.1002/j.2161-007X.1997.tb00950.x

[23]

CNN Maisy Mok. 2019. This robot photographer will take your profile pic for you. https://www.cnn.com/travel/article/worlds-first-robotic-photographer-intl-hnk-scli

[24]

Andrew Mendelson. 2015. The construction of photographic meaning. Handbook of Research on Teaching Literacy Through the Communicative and Visual Arts, Volume II: A Project of the International Reading Association (2015), 27.

[25]

Nicole Mirnig, Susanne Stadler, Gerald Stollnberger, Manuel Giuliani, and Manfred Tscheligi. 2016. Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability. In 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 166--171.

[26]

Tobias N"ageli, Lukas Meier, Alexander Domahidi, Javier Alonso-Mora, and Otmar Hilliges. 2017. Real-time planning for automated multi-view drone cinematography. ACM Transactions on Graphics (TOG), Vol. 36, 4 (2017), 132.

[27]

Monica Perusquia-Hernández, Saho Ayabe-Kanamura, Kenji Suzuki, and Shiro Kumano. 2019. The Invisible Potential of Facial Electromyography: A Comparison of EMG and Computer Vision when Distinguishing Posed from Spontaneous Smiles. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 149.

Digital Library

[28]

Paul Robinette, Ayanna M Howard, and Alan R Wagner. 2017. Effect of Robot Performance on Human-Robot Trust in Time-Critical Situations. IEEE Transactions on Human-Machine Systems, Vol. 47, 4 (2017), 425--436.

[29]

Maha Salem, Gabriella Lakatos, Farshid Amirabdollahian, and Kerstin Dautenhahn. 2015. Would you trust a (faulty) robot?: Effects of error, task type and personality on human-robot cooperation and trust. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, 141--148.

Digital Library

[30]

Tracy Sanders, Kristin E Oleson, Deborah R Billings, Jessie YC Chen, and Peter A Hancock. 2011. A model of human-robot trust: Theoretical model development. In Proceedings of The Human Factors and Ergonomics Society Annual Meeting, Vol. 55. SAGE Publications Sage CA: Los Angeles, CA, 1432--1436.

[31]

Tracy L Sanders, Tarita Wixon, K Elizabeth Schafer, Jessie YC Chen, and PA Hancock. 2014. The influence of modality and transparency on trust in human-robot interaction. In 2014 IEEE International Inter-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA). IEEE, 156--159.

[32]

Anne E Scanlon and Danielle C Polage. 2011. The Strength of a Smile: Duchenne Smiles Improve Advertisement and Product Evaluations. Pacific Northwest Journal of Undergraduate Research and Creative Activities, Vol. 2, 1 (2011), 3.

[33]

SLR Lounge Sean Lewis. [n.d.]. Eva The Robot Photographer-For-Hire Now Photographs Weddings. https://www.slrlounge.com/eva-the-robot-photographer-for-hire-now-photographs-weddings

[34]

William Smart and Cindy Grimm. 2003. (Not) Interacting with a Robotic Photographer. In AAAI Spring Symposium. 181--186. Interaction observations with Lewis the robot photographer.

[35]

Sarah Strohkorb Sebo, Margaret Traeger, Malte Jung, and Brian Scassellati. 2018. The ripple effects of vulnerability: The effects of a robot's vulnerable behavior on trust in human-robot teams. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 178--186.

Digital Library

[36]

Leila Takayama and Caroline Pantofaru. 2009. Influences on proxemic behaviors in human-robot interaction. In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 5495--5502.

[37]

TJ Thomson and Keith Greenwood. 2017. Beyond Framing: Influences of subject--photographer interactions on visual journalism. Journalism Practice, Vol. 11, 5 (2017), 625--644.

[38]

Hitomi Tsujita and Jun Rekimoto. 2011. HappinessCounter: Smile-encouraging Appliance to Increase Positive Mood. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, New York, NY, USA, 117--126. https://doi.org/10.1145/1979742.1979608

Digital Library

[39]

Marynel Vázquez, Elizabeth J Carter, Braden McDorman, Jodi Forlizzi, Aaron Steinfeld, and Scott E Hudson. 2017. Towards robot autonomy in group conversations: Understanding the effects of body orientation and gaze. In Proc. of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 42--52.

Digital Library

[40]

Michael L Walters, Kerstin Dautenhahn, Kheng Lee Koay, Christina Kaouri, R te Boekhorst, Chrystopher Nehaniv, Iain Werry, and David Lee. 2005. Close encounters: Spatial distances between people and a robot of mechanistic appearance. In 5th IEEE-RAS International Conference on Humanoid Robots. IEEE, 450--455.

[41]

Cornelia S Wendt and Guy Berg. 2009. Nonverbal humor as a new dimension of HRI. In RO-MAN 2009-The 18th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 183--188.

[42]

Paul Wilkinson and Sarah Plater. 2015. Mastering Portrait Photography .Ammonite Press.

[43]

Manfredas Zabarauskas and Stephen Cameron. 2014. Luke: An autonomous robot photographer. In 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 1809--1815.

Cited By

Wysokińska AStrömel KWoźniak P(2024)Zooming In: A Review of Designing for Photo Taking in Human-Computer Interaction and Future ProspectsProceedings of the ACM on Human-Computer Interaction10.1145/36981508:ISS(597-623)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698150
Candon KGeorgiou NZhou HRichardson SZhang QScassellati BVázquez MGrollman DBroadbent EJu WSoh HWilliams T(2024)REACT: Two Datasets for Analyzing Both Human Reactions and Evaluative Feedback to Robots Over TimeProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3637480(885-889)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3637480
Susena PSoeharno A(2023)Peran Fotografer dalam Mendukung Kegiatan Konser Musik Jember Unifest 2023Jurnal Bisnis dan Komunikasi Digital10.47134/jbkd.v1i2.19181:2(12)Online publication date: 29-Nov-2023
https://doi.org/10.47134/jbkd.v1i2.1918
Show More Cited By

Index Terms

Designing Social Interactions with a Humorous Robot Photographer
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing devices

Recommendations

My Humorous Robot: Effects of a Robot Telling Jokes on Perceived Intelligence and Liking
HRI '18: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

Research suggests, interpersonal competences such as having a sense of humor can help establish sociality in human-robot interaction. This study tested the effect of different types of jokes told by either a human or a robot (NAO) on the perceived ...
Designing Non-Verbal Humorous Gestures for a Non-Humanoid Robot
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Humor has various positive implications for our daily lives, and it has shown to improve human-robot interaction as well. To date, humor has been applied to robots that mimic human behavior thus missing out on improving interactions with the non-...
Humorous Robotic Behavior as a New Approach to Mitigating Social Awkwardness
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Social awkwardness is a frequent challenge to healthy social interactions and can dramatically impact how people feel, communicate and behave. It is known that humor can invoke positive feelings and enable people to modify perspective of a situation. We ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '20: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

March 2020

690 pages

ISBN:9781450367462

DOI:10.1145/3319502

General Chairs:
Tony Belpaeme
Ghent University, Belgium
,
James Young
University of Manitoba, Canada
,
Program Chairs:
Hatice Gunes
University of Cambridge, UK
,
Laurel Riek
UC San Diego, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
IEEE-RAS: Robotics and Automation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI '20

Sponsor:

SIGAI
SIGCHI
IEEE-RAS

HRI '20: ACM/IEEE International Conference on Human-Robot Interaction

March 23 - 26, 2020

Cambridge, United Kingdom

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
494
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)12

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wysokińska AStrömel KWoźniak P(2024)Zooming In: A Review of Designing for Photo Taking in Human-Computer Interaction and Future ProspectsProceedings of the ACM on Human-Computer Interaction10.1145/36981508:ISS(597-623)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698150
Candon KGeorgiou NZhou HRichardson SZhang QScassellati BVázquez MGrollman DBroadbent EJu WSoh HWilliams T(2024)REACT: Two Datasets for Analyzing Both Human Reactions and Evaluative Feedback to Robots Over TimeProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3637480(885-889)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3637480
Susena PSoeharno A(2023)Peran Fotografer dalam Mendukung Kegiatan Konser Musik Jember Unifest 2023Jurnal Bisnis dan Komunikasi Digital10.47134/jbkd.v1i2.19181:2(12)Online publication date: 29-Nov-2023
https://doi.org/10.47134/jbkd.v1i2.1918
Zhang QNarcomey ACandon KVázquez MCastellano GRiek LCakmak MLeite I(2023)Self-Annotation Methods for Aligning Implicit and Explicit Human Feedback in Human-Robot InteractionProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576986(398-407)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576986
Green HIslam MAli SIqbal TSakamoto DWeiss AHiatt LShiomi M(2022)Who's Laughing NAO?Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523804(313-322)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523804
Green HIslam MAli SIqbal T(2022)Who's Laughing NAO? Examining Perceptions of Failure in a Humorous Robot Partner2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889353(313-322)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889353
Mahdi HAkgun SSaleh SDautenhahn K(2022)A survey on the design and evolution of social robots — Past, present and futureRobotics and Autonomous Systems10.1016/j.robot.2022.104193156:COnline publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1016/j.robot.2022.104193

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents