Abstract
The advantages of using a tele-operated robot to facilitate otherwise difficult verbal disclosure of thoughts and concerns was examined. In a field study, individuals with autism spectrum disorder, who often face obstacles in social interaction, were provided daily-life-guidance by a robot tele-operated by their caregiver. In cases in which the robot was operated remotely or from the same room, subjects were able to disclose concerns to the robot that they had not previously disclosed to their caregiver. Furthermore, under the latter case the improved communicability was maintained through subsequent conversation with the operator. In a separate laboratory experiment involving participants not judged to be on the autism spectrum, it was observed that the participants were silent longer during conversation via a robot than in face-to-face conversation. The enhanced length of silence in the first setting can be considered to be an index for good counseling of a subject. Furthermore, the enhanced length of silence was maintained in subsequent face-to-face conversation with a robot operator in the same room, which appears to be consistent with the results of the field experiment. The findings encourage future applications in therapeutic conversation approaches such as counseling for providing clients with environments that facilitate the disclosure of concerns.
Similar content being viewed by others
References
Carpenter Laura (2013) American Psychiatric Association. Diagnostic and statistical manual of mental disorders fifth edition (dsm-5)
Baio J, Eds, (2010) National Center on Birth Defects and Developmental Disabilities, and CDC. Prevalence of autism spectrum disorder among children aged 8 years autism and developmental disabilities monitoring network, 11 sites, united states
Green VA, Pituch KA, Itchon J, Choi A, OReilly M, Sigafoos J (2006) Internet survey of treatments used by parents of children with autism. Res Dev Disabil 27(1):70–84
Kim JA, Szatmari P, Bryson SE, Streiner DL, Wilson FJ (2000) The prevalence of anxiety and mood problems among children with autism and asperger syndrome. Autism 4(2):117–132
Carter S (2009) Bullying of students with asperger syndrome. Issues Compr Pediatric Nurs 32(3):145–154
Allen D, Evans C, Hider A, Hawkins S, Peckett H, Morgan H (2008) Offending behaviour in adults with asperger syndrome. J Autism Dev Disord 38(4):748–758
Paul R, Orlovski SM, Marcinko HC, Volkmar F (2009) Conversational behaviors in youth with high-functioning asd and asperger syndrome. J Autism Dev Disord 39(1):115–125
Choi JJ, Kwak SS (2016) Can you feel me?: How embodiment levels of telepresence systems affect presence. In: 2016 25th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 606–611
Tanaka K, Nakanishi H, Ishiguro H (2014) Robot conferencing: physically embodied motions enhance social telepresence. In: Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems. ACM, pp 1591–1596
Stollnberger G, Giuliani M, Mirnig N, Tscheligi M, Arent K, Kreczmer B, Grzeszczak F, Szczesniak-Stanczyk D, Zarczuk R, Wysokinski A (2016) Designing user interfaces for different user groups: a three-way teleconference system for doctors, patients and assistants using a remote medical robot. In: 2016 25th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 612–617
Uchida T, Takahashi H, Ban M, Yoshikawa Y, Ishiguro H (2017) A robot counseling system -what kinds of topics do we prefer to disclose to robots? In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 207–212
Kuwamura K, Nishio S, Sato S (2016) Can we talk through a robot as if face-to-face? long-term fieldwork using teleoperated robot for seniors with Alzheimer’s disease. Front Psychol 7
Sproull L, Kiesler S (1986) Reducing social context cues: electronic mail in organizational communication. Manag Sci 32(11):1492–1512
Joinson AN (2001) Self-disclosure in computer-mediated communication: the role of self-awareness and visual anonymity. Eur J Soc Psychol 31(2):177–192
DeVault D, Artstein R, Benn G, Dey T, Fast E, Gainer A, Georgila K, Gratch J, Hartholt A, Lhommet M et al (2014) Simsensei kiosk: a virtual human interviewer for healthcare decision support. In: Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, pp 1061–1068
Yokotani K, Takagi G, Wakashima K (2018) Advantages of virtual agents over clinical psychologists during comprehensive mental health interviews using a mixed methods design. In: Computers in human behavior
Geiskkovitch DY, Cormier D, Seo SH, Young JE (2015) Please continue, we need more data: an exploration of obedience to robots. J Hum Robot Interact 5(1):82–99
Wood LJ, Dautenhahn K, Rainer A, Robins B, Lehmann H, Syrdal DS (2013) Robot-mediated interviews-how effective is a humanoid robot as a tool for interviewing young children? PloS ONE 8(3):e59448
Bethel CL, Henkel Z, Stives K, May DC, Eakin DK, Pilkinton M, Jones A, Stubbs-Richardson M (2016) Using robots to interview children about bullying: lessons learned from an exploratory study. In: 2016 25th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 712–717
Weir S, Emanuel R (1976) Using LOGO to catalyse communication in an autistic child. University of Edinburgh, Edinburgh
Salter T, Davey N, Michaud F (2014) Designing & developing queball, a robotic device for autism therapy. In: 2014 RO-MAN: the 23rd IEEE international symposium on robot and human interactive communication. IEEE, pp 574–579
Hideki K, Michalowski MP, Nakagawa C (2009) Keepon. Int J Soc Robot 1(1):3–18
Kim ES, Berkovits LD, Bernier EP, Leyzberg D, Shic F, Paul R, Scassellati B (2013) Social robots as embedded reinforcers of social behavior in children with autism. J Autism Dev Disord 43(5):1038–1049
Robins B, Amirabdollahian F, Ji Z, Dautenhahn K (2010) Tactile interaction with a humanoid robot for children with autism: a case study analysis involving user requirements and results of an initial implementation. In: RO-MAN, 2010 IEEE. IEEE, pp 704–711
Robins B, Dautenhahn K, Dickerson P (2009) From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In: Second international conferences on advances in computer-human interactions, 2009. ACHI’09. IEEE, pp 205–211
Shamsuddin S, Yussof H, Ismail LI, Mohamed S, Hanapiah FA, Zahari NI (2012) Initial response in HRI-a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot nao. Procedia Eng 41:1448–1455
Yoshikawa Y, Matsumoto Y, Kumazaki H, Wakita Y, Nemoto S, Ishiguro H, Mimura M, Miyao M (2015) Positive bias of gaze-following to android robot in adolescents with autism spectrum disorders. In: JSAI international symposium on artificial intelligence. Springer, pp 447–453
Gendlin ET (1982) Focusing. Bantam, New York
Nagaoka C, Kuwabara T, Yoshikawa S, Watabe M, Komori M, Oyama Y, Hatanaka C (2013) Implication of silence in a Japanese psychotherapy context: a preliminary study using quantitative analysis of silence and utterance of a therapist and a client. Asia Pacific J Couns Psychother 4(2):147–152
Wechsler D (1991) WISC-III: wechsler intelligence scale for children: manual. Psychological Corporation, Agra
Wechsler D (2003) WISC-IV wechsler intelligence scale for children: technical and interpretative: manual. Pearson, London
Sumioka H, Nakae A, Kanai R, Ishiguro H (2013) Huggable communication medium decreases cortisol levels. Sci Rep 3:3034
Bartneck C, Bleeker T, Bun J, Fens P, Riet L (2010) The influence of robot anthropomorphism on the feelings of embarrassment when interacting with robots. Paladyn J Behav Robot 1(2):109–115
Yoshikawa Y, Shinozawa K, Ishiguro H, Hagita N, Miyamoto T (2006)The effects of responsive eye movement and blinking behavior in a communication robot. In: 2006 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 4564–4569
Shimaya J, Yoshikawa Y, Matsumoto Y, Kumazaki H, Ishiguro H, Mimura M, Miyao M (2016) Advantages of indirect conversation via a desktop humanoid robot: case study on daily life guidance for adolescents with autism spectrum disorders. In: 2016 25th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 831–836
Wada K, Shibata T, Saito T, Tanie K (2004) Effects of robot-assisted activity for elderly people and nurses at a day service center. Proc IEEE 92(11):1780–1788
Modigliani A (1971) Embarrassment, facework, and eye contact: testing a theory of embarrassment. J Pers Soc Psychol 17(1):15
Adams RB, Gordon HL, Baird AA, Ambady N, Kleck RE (2003) Effects of gaze on amygdala sensitivity to anger and fear faces. Science 300(5625):1536–1536
Bartneck C, Nomura T, Kanda T, Suzuki T, Kato K (2005) Cultural differences in attitudes towards robots. In: Proceedings of symposium on robot companions (SSAISB 2005 convention), pp 1–4
Nishimura S, Nevgi A, Tella S (2008) Communication style and cultural features in high/low context communication cultures: a case study of Finland, Japan and India. Teoksessa A. Kallioniemi (toim.), Uudistuva ja kehittyvä ainedidaktiikka. Ainedidaktinen symposiumi 8 (2008): 783–796
Acknowledgements
We are deeply grateful to the participants and their guardians for their kind cooperation. We also appreciate the beneficial support and feedback provided by the schoolteachers. This work was supported by the Japan Science and Technology Agency (JST), the Exploratory Research for Advanced Technology (ERATO) the ISHIGURO symbiotic human–robot interaction project, and Japan Society for the Promotion of Science (JSPS) KAKENHI Grant Numbers 25220004, 24680022, and 15K12117.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Y. Yoshikawa and H. Ishiguro serve as consultants of Vstone Co. Ltd.
Ethical Statement
In this study, ethical approval was received from Graduate School of Engineering Science, Osaka University and Research Center for Child Mental Development, Kanazawa University.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Shimaya, J., Yoshikawa, Y., Kumazaki, H. et al. Communication Support via a Tele-Operated Robot for Easier Talking: Case/Laboratory Study of Individuals with/Without Autism Spectrum Disorder. Int J of Soc Robotics 11, 171–184 (2019). https://doi.org/10.1007/s12369-018-0497-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-018-0497-0