[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Robot and virtual reality-based intervention in autism: a comprehensive review

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

Autism Spectrum Disorder is a neurological and developmental disorder. Children diagnosed with this disorder have persistent deficits in their social-emotional reciprocity skills, nonverbal communication, and developing, maintaining, and understanding relationships. Besides, autistic children usually have motor deficits that influence their imitation and gesture production ability. The present study aims to review and analyze the current research findings in using robot-based and virtual reality-based intervention to support the therapy of improving the social, communication, emotional, and academic deficits of children with autism. Experimental data from the surveyed works are analyzed regarding the target behaviors and how each technology, robot, or virtual reality, was used during therapy sessions to improve the targeted behaviors. Furthermore, this study explores the different therapeutic roles that robots and virtual reality were observed to play. Finally, this study shares perspectives on the affordances and challenges of applying these technologies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Melo FS, Sardinha A et al (2019) Project INSIDE: towards autonomous semi-unstructured human–robot social interaction in autism therapy. Artif Intell Med 96:198–216

    Google Scholar 

  2. Yousif JH, Kazem HA, Chaichan MT (2019) Evaluation implementation of humanoid robot for autistic children: a review. Int J Comput Appl Sci 6(1):412–420

    Google Scholar 

  3. Srinivasan S, Eigsti I, Neelly L, Bhat A (2016) The effects of embodied rhythm and robotic interventions on the spontaneous and responsive social attention patterns of children with autism spectrum disorder (ASD): a pilot randomized controlled trial. Res Autism Spectr Disord 27:54–72

    Google Scholar 

  4. Dautenhahn K (2000) Design issues on interactive environments for children with autism. In: Proceedings of 3rd international conference on disability, virtual reality and associated technologies, pp. 1–8. http://web.mit.edu/16.459/www/Dautenhahn.pdf. Accessed 2020

  5. Wood Z (2018) Synthesizing and restructuring the conversation around the use of robots in the education and therapy of individuals with Autism Spectrum Disorders, master thesis, Columbia University

  6. Chen A (2015). The Ever-Growing Ed-Tech Market. The Atlantic. www.theatlantic.com/education/archive/2015/11/quantifying-classroom-tech-market/414244/. Accessed Sep 2020

  7. Advanced social robots. http://www.robokindrobots.com. Accessed Sep 2020

  8. Your child's rights: autism and school. https://www.autismspeaks.org/what-autism/your-childs-rights. Accessed 22 Sep 2020

  9. Kelley J (1984) An iterative design methodology for user-friendly natural language office information applications. ACM Trans Inf Syst 2(1):26–41

    Google Scholar 

  10. Costescu CA, Vanderborght B, David DO (2015) Reversal learning task in children with autism spectrum disorder: a robot-based approach. J Autism Dev Discord 45(11):3715–3725

    Google Scholar 

  11. Kim ES, Berkovits LD, Bernier EP, Leyzberg D, Shic F, Paul R, Scassellati B (2013) Social robots as embedded reinforcers of social behavior in children with autism. J Autism Dev Disord 43(5):1038–1049

    Google Scholar 

  12. Robins B, Dautenhahn K, Dickerson P (2009) From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In: 2009 second international conferences on advances in computer-human interactions, pp. 205–211

  13. Esteban P, Baxter P, Belpaeme P, Billing E, Cai H, Cao H et al (2017) How to build a supervised autonomous system for robot-enhanced therapy for children with autism spectrum disorder. J Behav Robot 8(1):18–38

    Google Scholar 

  14. Feil-Seifer D, Mataric M (2009) Toward socially assistive robotics for augmenting interventions for children with autism spectrum disorders. In: Proceedings of 11th international symposium on experimental robotics, vol 54, pp 201–210

  15. Michaud F, Théberge-Turmel C (2002) Mobile robotic toys and autism: observations of interaction. Kluwer Academic Publishers, London

    Google Scholar 

  16. Greczek J, Kaszubski E, et al (2014) Graded cueing feedback in robot-mediated imitation practice for children with autism spectrum disorders. In: Proceedings of 23rd IEEE international symposium on robot and human interactive communication, pp. 561–566

  17. Kozima H, Nakagawa C, Kawai N, Kosugi D, Yano Y (2004) A humanoid in company with children. In: Proceedings of 4th IEEE/RAS international conference on humanoid robots, pp. 470–477

  18. Yun SS, Kim H, Choi J, Park S (2015) A robot-assisted behavioural intervention system for children with autism spectrum disorders. Robot Auton Syst 76:58–67

    Google Scholar 

  19. Begum M, Serna RW, Yanco HA (2016) Are robots ready to deliver autism interventions? A comprehensive review. Int J Soc Robot 8(2):157–181

    Google Scholar 

  20. Dickstein-Fischer L, Fischer GS (2014) Combining psychological and engineering approaches to utilizing social robots with children with autism. In: Engineering in medicine and biology society, pp. 792–795

  21. Anzalone SM, Xavier J et al (2019) Quantifying patterns of joint attention during human-robot interactions: an application for autism spectrum disorder assessment. Pattern Recogn Lett 118:42–50

    Google Scholar 

  22. Bernardo B, Alves-Oliveira P, Santos MG, Melo FS, Paiva A (2016) An interactive tangram game for children with auism. Lecture notes in computer. Springer, New York

    Google Scholar 

  23. Ting Z (2013) Application in the intervention program of autism based on NAO robot. Syst Simul Technol 9:327–331

    Google Scholar 

  24. Miskam MA, Masnina NF et al (2014) Encouraging children with autism to improve social and communication skills through the game-based approach. Proc Comput Sci 42:93–98

    Google Scholar 

  25. Miranda LS, Mary ET, Amy PA (2017) Using Children's picture books about autism as resources in inclusive classrooms

  26. Yang X, Shyu ML et al (2019) Integrating image and textual information in human-robot interactions for children with autism spectrum disorder (ASD). IEEE Trans Multimed 21(3):746–759

    Google Scholar 

  27. So W, Wong MK et al (2019) Who is a better teacher for children with autism? comparison of learning outcomes between robot-based and human-based interventions in gestural production and recognition. Res Dev Disabil 86:62–75

    Google Scholar 

  28. Romero-García R et al (2021) Q-CHAT-NAO: a robotic approach to autism screening in toddlers. J Biomed Inform 118:103797–103797

    Google Scholar 

  29. Petric F, Miklic D, Kovacic Z (2017) Robot-assisted autism spectrum disorder diagnostics using POMDPs. In: ACM/IEEE international conference on human-robot interaction, pp 369–370

  30. Salleh MHK, Miskam MA, Yussof H, Omar AR (2017) HRI assessment of ask NAO intervention framework via typically developed child. Proc Comput Sci 105:333–339

    Google Scholar 

  31. Palestra G, Carolis BD, Esposito F (2017) Artificial Intelligence for robot-assisted treatment of autism. In: Workshop on artificial intelligence with application in health, pp 1–8

  32. Tapus A, Peca A, Aly A, Pop C et al (2012) Children with autism social engagement in interaction with nao, an imitative robot—a series of single case experiments. Interact Stud 13(3):315–334

    Google Scholar 

  33. Dickstein-Fischer LA, Pereira RH, Gandomi KY, Fathima AT, Fischer GS (2017) Interactive tracking for robot-assisted autism therapy. In: ACM/IEEE international conference on human-robot interaction, pp. 107–108

  34. Bharatharaj J, Huang L, Krägeloh C, Elara MR, Al-Jumaily A (2018) Social engagement of children with autism spectrum disorder in interaction with a parrot-inspired therapeutic robot. Proc Comput Sci 133:368–376

    Google Scholar 

  35. Ricks DJ, Colton MB (2010) Trends and considerations in robot-assisted autism therapy. In: 2010 IEEE international conference on robotics and automation, pp 4354–4359

  36. Costa S, Lehmann H, Dautenhahn K, Robins B, Soares F (2015) Using a humanoid robot to elicit body awareness and appropriate physical interaction in children with autism. Int J Soc Robot 7(2):265–278

    Google Scholar 

  37. Huijnen CAGJ, Lexis MAS et al (2017) How to implement robots in interventions for children with autism? A co-creation study involving people with autism, parents and professionals. J Autism Dev Disord 47:3079–3096

    Google Scholar 

  38. Hanson D, Baurmann S, Riccio T, Margolin R, Dockins T, Tavares M, Carpenter K (2009) Zeno: a cognitive character. In: AI Magazine, and special Proceedings Of AAAI national conference, Chicago, pp 9–11

  39. Peca A, Simut R, Cao HL, Vanderborght B (2016) Do infants perceive the social robot Keepon as a communicative partner? Infant Behav Dev 42:157–167

    Google Scholar 

  40. Chalmers C (2018) Robotics and computational thinking in primary school. Int J Child-Comput Interact 17:93–100

    Google Scholar 

  41. Richard M (2018) Parent perspective: the greatest investment any school can make. Robots4autism. https://robots4autism.com/author/richard/. Accessed 22 Sep 2020

  42. IESD case study: children with asd make gains with robots4autism in a Dallas, Texas Charter School (2017), pp 1–4

  43. IESD case study: children on the autism spectrum show improvement with robot4autism in Spartanburg, South Carolina (2016), pp 1–4

  44. Kamps HJ (2016) The autism solutions bot helps autistic kids. https://techcrunch.com/2016/09/11/autism-solutions/. Accessed 22 Sep 2020

  45. Lee J, Takehashi H et al (2012) Which robot features can stimulate better responses from children with autism in robot-assisted therapy? Int J Adv Robot Syst 9(72):1–5

    Google Scholar 

  46. Stanton CM, Kahn PH, Severson RL, Ruckert JH, Gill BT (2014) Robotic animals might aid in the social development of children with autism. In: Proceedings of the 3rd ACM/IEEE international conference on Human-robot interaction, pp 271–278

  47. Duquette A, Michaud F, Mercier H (2008) Exploring the use of a mobile robot as an imitation agent with children with low-functioning autism. Auton Robot 24(2):147–157

    Google Scholar 

  48. Albo-Canals J, Yanez C, Barco A, Angulo Bahón C, Heerink M (2016) Modelling social skills and problem solving strategies used by children with ASD through cloud connected social robots as data loggers: first modelling approach. In: Conference proceedings New Friends 2015: the 1st international conference on social robots in therapy and education, Netherlands, pp 1–2

  49. Mesa-Gresa P, Gil-Gomez H, Lozano-Quilis JA et al (2018) Effectiveness of virtual reality for children and adolescents with autism spectrum disorder: an evidence-based systematic review. Sensors (Basel) 18(8):1–15

    Google Scholar 

  50. Areces D, Rodríguez C et al (2018) Efficacy of a continuous performance test based on virtual reality in the diagnosis of ADHD and its clinical presentations. J Atten Disord 22(11):1081–1091

    Google Scholar 

  51. Albiol-Perez S, Gil-Gomez JA et al (2017) The effect of balance training on postural control in patients with Parkinson’s disease using a virtual rehabilitation system. Methods Inf Med 56(2):138–144

    Google Scholar 

  52. Pulijala Y, Ma M, Pears M, Peebles D, Ayoub A (2018) Effectiveness of immersive virtual reality in surgical training—a randomized control trial. J Oral Maxillofac Surg 76(5):1065–1072

    Google Scholar 

  53. Bekels K, Calnan D et al (2017) Effect of an immersive preoperative virtual reality experience on patient reported outcomes: a randomized controlled trial. Ann Surg 265(6):1068–1073

    Google Scholar 

  54. Mesa-Gresa P, Lozano JA, Llórens R, Alcañiz M, Navarro MD, Noé E (2011) Clinical validation of a virtual environment test for safe street crossing in the assessment of acquired brain injury patients with and without neglect. Lect. Notes Comput. Sci. Springer, Berlin, pp 44–51

    Google Scholar 

  55. Ip HHS, Wong SWL, Chan DFY et al (2018) Enhance emotional and social adaptation skills for children with autism spectrum disorder: a virtual reality enabled approach. Comput Educ 117:1–15

    Google Scholar 

  56. Thomas M, Padmavathi S, Tamilselvi D (2018) Rehabilitation Therapy for autism spectrum disorder using virtual reality. Smart secure systems—IoT and analytics perspective, 1st edn. Springer, Singapore

    Google Scholar 

  57. Bekele E, Wade J, et al (2016) Multimodal adaptive social interaction in virtual environment (MASI-VR) for children with Autism spectrum disorders (ASD). In: 2016 IEEE virtual reality, pp. 121–130

  58. Didehbani N, Allen T, Kandalaft M, Krawczyk D, Chapman S (2016) Virtual reality social cognition training for children with high functioning autism. Comput Hum Behav 62:703–711

    Google Scholar 

  59. Ip HH, Wong SW, et al (2016) Virtual reality enabled training for social adaptation in inclusive education settings for school-aged children with autism spectrum disorder (ASD). In: Proceedings of the international conference on blending learning, pp 94–102

  60. Ke F, Lee S (2015) Virtual reality based collaborative design by children with high-functioning autism: design-based flexibility, identity, and norm construction. Interact Learn Environ 24:1511–1533

    Google Scholar 

  61. Cheng Y, Huang CL, Yang CS (2015) Using a 3D immersive virtual environment system to enhance social understanding and social skills for children with autism spectrum disorders. Focus Autism Other Dev Disabl 30(4):222–236

    Google Scholar 

  62. Parsons S (2015) Learning to work together: designing a multi-user virtual reality game for social collaboration and perspective-taking for children with autism. Int J Child-Comput Interact 6:28–38

    Google Scholar 

  63. Bekele E, Crittendon J et al (2014) Assessing the utility of a virtual environment for enhancing facial affect recognition in adolescents with autism. J Autism Dev Disord 44(7):1641–1650

    Google Scholar 

  64. Stichter JP, Laffey J et al (2014) iSocial: delivering the social competence intervention for adolescents (sci-a) in a 3d virtual learning environment for youth with high functioning autism. J Autism Dev Disord 44(2):417–430

    Google Scholar 

  65. Saadatzi MN, Pennington RC et al (2018) Small-Group technology-assisted instruction: virtual teacher and robot peer for individuals with autism spectrum disorder. J Autism Dev Disord 48(11):3816–3830

    Google Scholar 

  66. Rogers S (2019) How virtual reality can help those with autism. https://www.forbes.com/sites/solrogers/2019/04/03/how-virtual-reality-can-help-those-with-autism/#409bf5fc198e. Accessed 1 Oct 2019

  67. Alcorn A, Pain H, Rajendran G, Smith T et al (2011) Social communication between virtual characters and children with autism. Artificial intelligence in education. Lecture Notes in Computer Science 6738. Springer, Berlin, pp 7–14

    Google Scholar 

  68. Milne M, Luerssen MH, et al (2010) Development of a virtual agent based social tutor for children with autism spectrum disorders. In: Proceedings of the 2010 international joint conference on neural networks (IJCNN), pp 1–9

  69. Chen CH, Lee IJ, Lin LY (2016) Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Comput Hum Behav 55:477–485

    Google Scholar 

  70. Lorenzo G, Lledó A, Pomares J, Roig R (2016) Design and application of an immersive virtual reality system to enhance emotional skills for children with autism spectrum disorders. Comput Educ 98:192–205

    Google Scholar 

  71. Lamash L, Klinger E, Josman N (2017) Using a virtual supermarket to promote independent functioning among adolescents with Autism Spectrum Disorder. In: 2017 international conference on virtual rehabilitation, pp 1–7

  72. Wade J, Zhang L, Bian D, Fan J et al (2016) A Gaze-Contingent adaptive virtual reality driving environment for intervention in individuals with autism spectrum disorders. ACM Trans Interact Intell Syst 6:1–23

    Google Scholar 

  73. Taryadi BR, Kurniawan I (2017) The improvement of autism spectrum disorders on children communication ability with PECS method Multimedia Augmented Reality-Based. J Phys Conf Ser 947:1–7

    Google Scholar 

  74. Finkelstein S, Barnes T, Wartell Z, Suma AA (2013) Evaluation of the exertion and motivation factors of a virtual reality exercise game for children with autism. IEEE Virtual Real. https://doi.org/10.1109/VAAT.2013.6786186

    Article  Google Scholar 

  75. Maskey M, Lowry J, Rodgers J, McConachie H, Parr JR (2014) Reducing specific phobia/fear in young people with autism spectrum disorders (ASDs) through a virtual reality environment intervention. PLoS ONE 9(7):e100374. https://doi.org/10.1371/journal.pone.0100374

    Article  Google Scholar 

  76. Adjorlu A, Høeg E, et al (2017) Daily living skills training in virtual reality to help children with autism spectrum disorder in a real shopping scenario. In:16th IEEE international symposium on mixed and augmented reality, pp 294–302

  77. Forbes PAG, Pan X, Hamilton AFC (2016) Reduced mimicry to virtual reality avatars in autism spectrum disorder. J Autism Dev Disord 46(12):3788–3797

    Google Scholar 

  78. Halabi O, El-Seoud S et al (2017) Design of immersive virtual reality system to improve communication skills in individuals with autism. Int J Emerg Technol Learn (IJET) 12:50–64

    Google Scholar 

  79. Ramachandiran CR, Jomhari N, Thiyagaraja S, Maria M (2015) Virtual reality based behavioural learning for autistic children. Electron J e-Learn 13(5):357–365

    Google Scholar 

  80. Rosenfield NS, Lamkin K, Re J, Day K, Boyd L, Linstead E (2019) A virtual reality system for practicing conversation skills for children with autism. Multimodal Technol Interact 3(2):28

    Google Scholar 

  81. Loomes R, Hull L, Mandy WPL (2017) What Is the male-to-female ratio in autism spectrum disorder? A systematic review and meta-analysis. J Am Acad Child Adolesc Psychiatry 56(6):466–474

    Google Scholar 

  82. Syahputra MF, Arisandi D et al (2017) Augmented reality social story for autism spectrum disorder. J Phys Conf Ser. https://doi.org/10.1088/1742-6596/978/1/012040

    Article  Google Scholar 

  83. Zhao H, Swanson AR et al (2018) Hand-in-hand: a communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Trans Hum Mach Syst 48(2):136–148

    Google Scholar 

  84. Efstratiou R et al (2021) Teaching daily life skills in autism spectrum disorder (ASD) interventions using the social robot pepper. Robotics in education. Advances in intelligent systems and computing, vol 1316. Springer, Cham

    Google Scholar 

  85. Brivio A, Rogacheva K, Lucchelli M, Bonarini A (2021) A soft, mobile, autonomous robot to develop skills through play in autistic children. Paladyn, J Behav Robot 12(1):187–198

    Google Scholar 

  86. Niderla K, Maciejewsk M (2021) Construction of a zoomorphical robot for rehabilitation of autistic children. J Phys Conf Ser 1782:012024. https://doi.org/10.1088/1742-6596/1782/1/012024

    Article  Google Scholar 

Download references

Funding

The authors would like to acknowledge Higher Colleges of Technology for their financial support to this research grant.

Author information

Authors and Affiliations

  1. Computer and Information Sciences Department, Higher Colleges of Technology, P.O. Box: 25026, Abu Dhabi, UAE

    Fadi Abu-Amara, Ameur Bensefia, Heba Mohammad & Hatem Tamimi

Authors
  1. Fadi Abu-Amara
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ameur Bensefia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Heba Mohammad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hatem Tamimi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fadi Abu-Amara.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abu-Amara, F., Bensefia, A., Mohammad, H. et al. Robot and virtual reality-based intervention in autism: a comprehensive review. Int. j. inf. tecnol. 13, 1879–1891 (2021). https://doi.org/10.1007/s41870-021-00740-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-021-00740-9

Keywords

Search

Navigation