EMooly: Supporting Autistic Children in Collaborative Social-Emotional Learning with Caregiver Participation through Interactive AI-infused and AR Activities
Authors: 
Yue Lyu, Di Liu, 
Pengcheng An, Xin Tong, Huan Zhang, Keiko Katsuragawa, 
Jian ZhaoAuthors Info & Claims
Article No.: 203, Pages 1 - 36
Abstract
Children with autism spectrum disorder (ASD) have social-emotional deficits that lead to difficulties in recognizing emotions as well as understanding and responding to social interactions. This study presents EMooly, a tablet game that actively involves caregivers and leverages augmented reality (AR) and generative AI (GenAI) to enhance social-emotional learning for autistic children. Through a year of collaborative effort with five domain experts, we developed EMooly that engages children through personalized social stories, interactive and fun activities, and enhanced caregiver participation, focusing on emotion understanding and facial expression recognition. Compared with a baseline, a controlled study with 24 autistic children and their caregivers showed EMooly significantly improved children's emotion recognition skills and its novel features were preferred and appreciated. EMooly demonstrates the potential of AI and AR in enhancing social-emotional development for autistic children via prompt personalizing and engagement, and highlights the importance of caregiver involvement for optimal learning outcomes.
Supplemental Material
MP4 File - Video demo of EMooly
Video demonstration of EMooly, a tablet game that actively involves caregivers and leverages augmented reality (AR) and generative AI (GenAI) to enhance social-emotional learning for autistic children.
- Download
- 18.68 MB
References
[1]
Aaishah Alli, Shabnam Abdoola, and Anniah Mupawose. 2015. Parents' journey into the world of autism. South African Journal of Child Health 9, 3 (2015), 81--84.
[2]
Nuria Aresti-Bartolome and Begonya Garcia-Zapirain. 2014. Technologies as Support Tools for Persons with Autistic Spectrum Disorder: A Systematic Review. International Journal of Environmental Research and Public Health 11, 8 (Aug. 2014), 7767--7802. https://doi.org/10.3390/ijerph110807767
[3]
Beatrice Aruanno, Franca Garzotto, Emanuele Torelli, and Francesco Vona. 2018. HoloLearn: Wearable Mixed Reality for People with Neurodevelopmental Disorders (NDD). In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS '18). Association for Computing Machinery, New York, NY, USA, 40--51. https://doi.org/10.1145/3234695.3236351
[4]
American Psychiatric Association. 2013. Diagnostic and statistical manual of mental disorders DSM-IV-TR (5 ed.). American Psychiatric Publishing, Inc., US. https://doi.org/10.1176/appi.books.9780890425596
[5]
Rachel Bader. 2006. Using social stories to increase emotion recognition and labeling in school-age children with autism. Alliant International University, San Diego.
[6]
Jon Baio, Lisa Wiggins, Deborah L Christensen, Matthew J Maenner, Julie Daniels, Zachary Warren, Margaret Kurzius-Spencer, Walter Zahorodny, Cordelia Robinson Rosenberg, Tiffany White, et al. 2018. Prevalence of autism spectrum disorder among children aged 8 years---autism and developmental disabilities monitoring network, 11 sites, United States, 2014. MMWR Surveillance Summaries 67, 6 (2018), 1.
[7]
Simon Baron-Cohen, Sally Wheelwright, Jacqueline Hill, Yogini Raste, and Ian Plumb. 2001. The "Reading the Mind in the Eyes" Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. The Journal of Child Psychology and Psychiatry and Allied Disciplines 42, 2 (2001), 241--251.
[8]
Laura Bartoli, Franca Garzotto, Mirko Gelsomini, Luigi Oliveto, and Matteo Valoriani. 2014. Designing and evaluating touchless playful interaction for ASD children. In Proceedings of the 2014 Conference on Interaction Design and Children (Aarhus, Denmark) (IDC '14). Association for Computing Machinery, New York, NY, USA, 17--26. https://doi.org/10.1145/2593968.2593976
[9]
Nirit Bauminger. 2002. The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes. Journal of autism and developmental disorders 32 (2002), 283--298.
[10]
Audrée Jeanne Beaudoin, Guillaume Sébire, and Mélanie Couture. 2019. Parent-mediated intervention tends to improve parent-child engagement, and behavioral outcomes of toddlers with ASD-positive screening: A randomized crossover trial. Research in Autism Spectrum Disorders 66 (Oct. 2019), 101416. https://doi.org/10.1016/j.rasd.2019.101416
[11]
Yarlagadda Bhargavi, D Bini, and Shajin Prince. 2023. AI-based Emotion Therapy Bot for Children with Autism Spectrum Disorder (ASD). In 2023 9th International Conference on Advanced Computing and Communication Systems (ICACCS), Vol. 1. IEEE, IEEE, Coimbatore, India, 1895--1899.
[12]
Sofiane Boucenna, Antonio Narzisi, Elodie Tilmont, Filippo Muratori, Giovanni Pioggia, David Cohen, and Mohamed Chetouani. 2014. Interactive technologies for autistic children: A review. Cognitive Computation 6 (2014), 722--740.
[13]
LouAnne E. Boyd, Saumya Gupta, Sagar B. Vikmani, Carlos M. Gutierrez, Junxiang Yang, Erik Linstead, and Gillian R. Hayes. 2018. vrSocial: Toward Immersive Therapeutic VR Systems for Children with Autism. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3173574.3173778
[14]
Louanne E Boyd, Kathryn E Ringland, Oliver L Haimson, Helen Fernandez, Maria Bistarkey, and Gillian R Hayes. 2015. Evaluating a collaborative iPad game's impact on social relationships for children with autism spectrum disorder. ACM Transactions on Accessible Computing (TACCESS) 7, 1 (2015), 1--18.
[15]
Maria Claudia Buzzi, Gabriella Paolini, Caterina Senette, Marina Buzzi, and Maria Teresa Paratore. 2019. Designing an accessible web app to teach piano to students with autism. In Proceedings of the 13th Biannual Conference of the Italian SIGCHI Chapter: Designing the next Interaction (Padova, Italy) (CHItaly '19). Association for Computing Machinery, New York, NY, USA, Article 4, 12 pages. https://doi.org/10.1145/3351995.3352037
[16]
Stéphanie Carlier, Sara Van der Paelt, Femke Ongenae, Femke De Backere, and Filip De Turck. 2019. Using a Serious Game to Reduce Stress and Anxiety in Children with Autism Spectrum Disorder. In Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare (Trento, Italy) (PervasiveHealth'19). Association for Computing Machinery, New York, NY, USA, 452--461. https://doi.org/10.1145/3329189.3329237
[17]
Elena Núñez Castellar, Jan Van Looy, Arnaud Szmalec, and Lieven De Marez. 2014. Improving arithmetic skills through gameplay: Assessment of the effectiveness of an educational game in terms of cognitive and affective learning outcomes. Information sciences 264 (2014), 19--31.
[18]
Irene Chaidi and Athanasios Drigas. 2020. Parents' Involvement in the Education of their Children with Autism: Related Research and its Results. International Journal of Emerging Technologies in Learning (iJET) 15, 14 (Jul. 2020), pp. 194--203. https://doi.org/10.3991/ijet.v15i14.12509
[19]
Chien-Hsu Chen, I-Jui Lee, and Ling-Yi Lin. 2016. Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior 55 (Feb. 2016), 477--485. https://doi.org/10.1016/j.chb.2015.09.033
[20]
Dasom Choi, Sung-In Kim, Sunok Lee, Hyunseung Lim, Hee Jeong Yoo, and Hwajung Hong. 2023. Love on the Spectrum: Toward Inclusive Online Dating Experience of Autistic Individuals. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 53, 15 pages. https://doi.org/10.1145/3544548.3581341
[21]
Dominique H Como, Margaret Goodfellow, Delaney Hudak, and Sharon A Cermak. 2023. A Scoping Review: Social Stories Supporting Behavior Change for Individuals with Autism. Journal of Occupational Therapy, Schools, & Early Intervention (01 2023), 1--22. https://doi.org/10.1080/19411243.2023.2168824
[22]
Pietro Crovari, Mattia Gianotti, Fabiano Riccardi, and Franca Garzotto. 2019. Designing a smart toy: guidelines from the experience with smart dolphin "SAM". In Proceedings of the 13th Biannual Conference of the Italian SIGCHI Chapter: Designing the next Interaction (Padova, Italy) (CHItaly '19). Association for Computing Machinery, New York, NY, USA, Article 8,10 pages. https://doi.org/10.1145/3351995.3352041
[23]
Ana Paula de Carvalho, Camila S Braz, Sibele M dos Santos, Renato AC Ferreira, and Raquel O Prates. 2023. Serious games for children with autism spectrum disorder: A systematic literature review. International Journal of Human-Computer Interaction (2023), 1--28.
[24]
David Deriso, Joshua Susskind, Lauren Krieger, and Marian Bartlett. 2012. Emotion Mirror: A Novel Intervention for Autism Based on Real-Time Expression Recognition. Springer Berlin Heidelberg, Berlin, Heidelberg, 671--674. https://doi.org/10.1007/978-3-642-33885-4_79
[25]
Michele D Dickey. 2006. Game design narrative for learning: Appropriating adventure game design narrative devices and techniques for the design of interactive learning environments. Educational technology research and development 54 (2006), 245--263.
[26]
Ilan Dinstein, Shirley Solomon, Michael Zats, Ronit Shusel, Raphael Lottner, Bella Ben Gershon, Gal Meiri, Idan Menashe, and Dorit Shmueli. 2023. Two-fold increase in the prevalence of autism in Israel between 2017 and 2021. medRxiv (2023), 2023--04.
[27]
Xuejun Du, Pengcheng An, Justin Leung, April Li, Linda E. Chapman, and Jian Zhao. 2024. DeepThInk: Designing and probing human-AI co-creation in digital art therapy. International Journal of Human-Computer Studies 181 (2024), 103139. https://doi.org/10.1016/j.ijhcs.2023.103139
[28]
Rita Dunn, Jonah Elgart, Lisa Lokshina, Alexander Faisman, Maria Waslick, Yuriy Gankin, and Andrey Vyshedskiy. 2017. Tablet-Based Cognitive exercises as an early parent-administered intervention Tool for Toddlers with Autism---Evidence from a field study. Clinical Psychiatry 3, 1 (2017), 1--8.
[29]
Paul Ekman and Wallace V. Friesen. 1978. Facial Action Coding System. https://doi.org/10.1037/t27734-000
[30]
Neil Frude and Steve Killick. 2011. Family storytelling and the attachment relationship. Psychodynamic Practice 17, 4 (Nov. 2011), 441--455. https://doi.org/10.1080/14753634.2011.609025
[31]
Jose Maria Garcia-Garcia, Victor M. R. Penichet, Maria D. Lozano, and Anil Fernando. 2022. Using emotion recognition technologies to teach children with autism spectrum disorder how to identify and express emotions. Universal Access in the Information Society 21, 4 (Nov. 2022), 809--825. https://doi.org/10.1007/s10209-021-00818-y
[32]
Mirko Gelsomini. 2016. An Affordable Virtual Reality Learning Framework for Children with Neuro-Developmental Disorder. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (Reno, Nevada, USA) (ASSETS '16). Association for Computing Machinery, New York, NY, USA, 343--344. https://doi.org/10.1145/2982142.2982143
[33]
Grace W Gengoux, Salena Schapp, Sarah Burton, Christina M Ardel, Robin A Libove, Gina Baldi, Kari L Berquist, Jennifer M Phillips, and Antonio Y Hardan. 2019. Effects of a parent-implemented developmental reciprocity treatment program for children with autism spectrum disorder. Autism 23, 3 (2019), 713--725.
[34]
Parisa Ghanouni, Tal Jarus, Jill G Zwicker, Joseph Lucyshyn, Kristin Mow, and Alyssa Ledingham. 2019. Social stories for children with autism spectrum disorder: Validating the content of a virtual reality program. Journal of autism and developmental disorders 49 (2019), 660--668.
[35]
Ofer Golan, Emma Ashwin, Yael Granader, Suzy McClintock, Kate Day, Victoria Leggett, and Simon Baron-Cohen. 2010. Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces. Journal of autism and developmental disorders 40 (2010), 269--279.
[36]
Ofer Golan, Simon Baron-Cohen, Jacqueline Hill, and Yael Golan. 2006. The "Reading the Mind in Films" Task: Complex emotion recognition in adults with and without autism spectrum conditions. Social Neuroscience 1, 2 (6 2006), 111--123. https://doi.org/10.1080/17470910600980986
[37]
Fatemeh Golzari, Ghorban Hemati Alamdarloo, and Shahram Moradi. 2015. The Effect of a Social Stories Intervention on the Social Skills of Male Students With Autism Spectrum Disorder. SAGE Open 5 (1 10 2015), 4.
[38]
Carol A. Gray and Joy D. Garand. 1993. Social Stories: Improving Responses of Students with Autism with Accurate Social Information. Focus on Autistic Behavior 8, 1 (April 1993), 1--10. https://doi.org/10.1177/108835769300800101
[39]
Joshua Hailpern. 2007. Encouraging speech and vocalization in children with autistic spectrum disorder. SIGACCESS Access. Comput. 89 (sep 2007), 47--52. https://doi.org/10.1145/1328567.1328576
[40]
Ariel Han and Zhenyao Cai. 2023. Design implications of generative AI systems for visual storytelling for young learners. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference. 470--474.
[41]
Eugenia Hernandez-Ruiz. 2021. Parent-mediated music interventions with children with ASD: A systematic review. Review Journal of Autism and Developmental Disorders 8, 4 (2021), 403--420.
[42]
Yuxuan Huang, Yihe Wang, Tongxin Xiao, Rongqi Bei, Yuhang Zhao, Zhicong Lu, and Xin Tong. 2022. StarRescue: Transforming A Pong Game to Visually Convey the Concept of Turn-taking to Children with Autism. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (Bremen, Germany) (CHI PLAY '22). Association for Computing Machinery, New York, NY, USA, 246--252. https://doi.org/10.1145/3505270.3558320
[43]
S.Jain, B. Tamersoy, Y. Zhang, J. K. Aggarwal, and V. Orvalho. 2012. An interactive game for teaching facial expressions to children with Autism Spectrum Disorders. In 2012 5th International Symposium on Communications, Control and Signal Processing. IEEE, Rome, Italy, 1--4. https://doi.org/10.1109/ISCCSP.2012.6217849
[44]
Chen Ji and Katherine Isbister. 2022. AR fidget: augmented reality experiences that support emotion regulation through fidgeting. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1--4.
[45]
Amie M King, Melissa Thomeczek, Grayce Voreis, and Victoria Scott. 2014. iPad® use in children and young adults with Autism Spectrum Disorder: An observational study. Child Language Teaching and Therapy 30, 2 (2014), 159--173.
[46]
Robert L Koegel, Lynn Kern Koegel, and Lauren I Brookman. 2003. Empirically supported pivotal response interventions for children with autism. Evidence-based psychotherapies for children and adolescents 341357 (2003), 341--357.
[47]
Robert L. Koegel, Mary C. O'Dell, and Lynn Kern Koegel. 1987. A natural language teaching paradigm for nonverbal autistic children. Journal of Autism and Developmental Disorders 17, 2 (June 1987), 187--200. https://doi.org/10.1007/BF01495055
[48]
Anastasia Kokina and Lee Kern. 2010. Social Story™ interventions for students with autism spectrum disorders: A meta-analysis. Journal of autism and developmental disorders 40 (2010), 812--826.
[49]
Patricia J Krantz, Stanley Zalenski, Laura J Hall, Edward C Fenske, and Lynn E McClannahan. 1981. Teaching complex language to autistic children. Analysis and Intervention in Developmental Disabilities 1, 3--4 (1981), 259--297.
[50]
Zhen Li, Lejin Yang, Hui Chen, Yuan Fang, Tongchao Zhang, Xiaolin Yin, Jinyu Man, Xiaorong Yang, and Ming Lu. 2022. Global, regional and national burden of autism spectrum disorder from 1990 to 2019: results from the Global Burden of Disease Study 2019. Epidemiology and Psychiatric Sciences 31 (2022), e33.
[51]
Di Liu, Hanqing Zhou, and Pengcheng An. 2024. "When He Feels Cold, He Goes to the Seahorse"-Blending Generative AI into Multimaterial Storymaking for Family Expressive Arts Therapy. arXiv preprint arXiv:2402.06472 (2024).
[52]
Tommaso Loiacono, Marco Trabucchi, Nicolò Messina, Vito Matarazzo, Franca Garzotto, and Eleonora Aida Beccaluva. 2018. Social MatchUP -: Memory-like Virtual Reality Game for the Enhancement of Social Skills in Children with Neurodevelopmental Disorders. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/3170427.3188525
[53]
Yue Lyu, Pengcheng An, Yage Xiao, Zibo Zhang, Huan Zhang, Keiko Katsuragawa, and Jian Zhao. 2023. Eggly: Designing Mobile Augmented Reality Neurofeedback Training Games for Children with Autism Spectrum Disorder. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 2 (2023), 1--29.
[54]
Gabriela Marcu, Anind K. Dey, and Sara Kiesler. 2012. Parent-driven use of wearable cameras for autism support: a field study with families. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (Pittsburgh, Pennsylvania) (UbiComp '12). Association for Computing Machinery, New York, NY, USA, 401--410. https://doi.org/10.1145/2370216.2370277
[55]
Jose Mercado, Ismael Espinosa-Curiel, Lizbeth Escobedo, and Monica Tentori. 2019. Developing and evaluating a BCI video game for neurofeedback training: the case of autism. Multimedia Tools and Applications 78 (2019), 13675--13712.
[56]
Eve Müller, Adriana Schuler, and Gregory B Yates. 2008. Social challenges and supports from the perspective of individuals with Asperger syndrome and other autism spectrum disabilities. Autism 12, 2 (2008), 173--190.
[57]
Antonio Narzisi. 2020. Handle the autism spectrum condition during Coronavirus (COVID-19) stay at home period: Ten tips for helping parents and caregivers of young children. 207 pages.
[58]
Ahmadreza Nazari, Ali Shahidi, Kate M Kaufman, Julia E Bondi, Lorans Alabood, Vikram K Jaswal, Diwakar Krishnamurthy, and Mea Wang. 2023. Interactive ar applications for nonspeaking autistic people?-a usability study. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1--15.
[59]
Heather J Nuske, PhD Heather J Nuske, Amanda V Young, BSN Amanda V Young, Farzana Khan, MPH Farzana Khan, Emma H Palermo, BA Emma H Palermo, Bukola Ajanaku Bukola Ajanaku, PhD Melanie Pellecchia NCSP, et al. 2023. Systematic review: emotion dysregulation and challenging behavior interventions for children andadolescents with autism with graded key evidence-based strategy recommendations. (2023).
[60]
World Health Organization. 2023. Autism. https://www.who.int/news-room/fact-sheets/detail/autism-spectrum-disorders
[61]
Ji Hyun Park, Bretagne Abirached, and Yan Zhang. 2012. A framework for designing assistive technologies for teaching children with ASDs emotions. In CHI '12 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2423--2428. https://doi.org/10.1145/2212776.2223813
[62]
K. Pelphrey, N. Sasson, J. Reznick, Gregory Paul, B. Goldman, and J. Piven. 2002. Visual Scanning of Faces in Autism. Journal of Autism and Developmental Disorders 32 (2002), 249--261. https://doi.org/10.1023/A:1016374617369
[63]
Robert C Pennington. 2010. Computer-assisted instruction for teaching academic skills to students with autism spectrum disorders: A review of literature. Focus on Autism and Other Developmental Disabilities 25, 4 (2010), 239--248.
[64]
Kaśka Porayska-Pomsta, Alyssa M Alcorn, Katerina Avramides, Sandra Beale, Sara Bernardini, Mary Ellen Foster, Christopher Frauenberger, Judith Good, Karen Guldberg, Wendy Keay-Bright, et al. 2018. Blending human and artificial intelligence to support autistic children's social communication skills. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 6 (2018), 1--35.
[65]
Cathy H Qi, Erin E Barton, Margo Collier, Yi-Ling Lin, and Charisse Montoya. 2018. A systematic review of effects of social stories interventions for individuals with autism spectrum disorder. Focus on Autism and Other Developmental Disabilities 33, 1 (2018), 25--34.
[66]
Elizabeth P Quintero. 2010. Something to say: Children learning through story. Early Education and Development 21, 3 (2010), 372--391.
[67]
Sathiyaprakash Ramdoss, Wendy Machalicek, Mandy Rispoli, Austin Mulloy, Russell Lang, and Mark O'Reilly. 2012. Computer-based interventions to improve social and emotional skills in individuals with autism spectrum disorders: A systematic review. Developmental neurorehabilitation 15, 2 (2012), 119--135.
[68]
Brian Reichow and Fred R Volkmar. 2010. Social skills interventions for individuals with autism: Evaluation for evidence-based practices within a best evidence synthesis framework. Journal of autism and developmental disorders 40 (2010), 149--166.
[69]
Georgina Reynhout and Mark Carter. 2006. Social Stories™ for Children with Disabilities. Journal of Autism and Developmental Disorders 36, 4 (May 2006), 445--469. https://doi.org/10.1007/s10803-006-0086-1
[70]
Daniel J. Ricks and Mark B. Colton. 2010. Trends and considerations in robot-assisted autism therapy. In 2010 IEEE International Conference on Robotics and Automation. IEEE, Anchorage, AK, USA, 4354--4359. https://doi.org/10.1109/ROBOT.2010.5509327
[71]
P. Camila Rios and Sara M. Scharoun Benson. 2020. Exploring Caregiver Perspectives of Social and Motor Skills in Children With Autism Spectrum Disorder and the Impact on Participation. Frontiers in Psychology 11 (2020). https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2020.01260
[72]
Ute Ritterfeld, Michael Cody, and Peter Vorderer. 2009. Serious games: Mechanisms and effects. Routledge, Oxfordshire, England, UK.
[73]
Nicky Rogge and Juliette Janssen. 2019. The Economic Costs of Autism Spectrum Disorder: A Literature Review. Journal of Autism and Developmental Disorders 49, 7 (July 2019), 2873--2900. https://doi.org/10.1007/s10803-019-04014-z
[74]
Delphine B Rosset, Cecilie Rondan, David Da Fonseca, Andreia Santos, Brigitte Assouline, and Christine Deruelle. 2008. Typical emotion processing for cartoon but not for real faces in children with autistic spectrum disorders. Journal of autism and developmental disorders 38 (2008), 919--925.
[75]
Amirreza Rouhi, Micol Spitale, Fabio Catania, Giulia Cosentino, Mirko Gelsomini, and Franca Garzotto. 2019. Emotify: emotional game for children with autism spectrum disorder based-on machine learning. In Companion Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19 Companion). Association for Computing Machinery, New York, NY, USA, 31--32. https://doi.org/10.1145/3308557.3308688
[76]
Fereshteh Sabzevari, Omid Amelirad, Zohre Moradi, and Mostafa Habibi. 2023. Artificial intelligence evaluation of COVID-19 restrictions and speech therapy effects on the autistic children's behavior. Scientific Reports 13, 1 (2023), 4312.
[77]
Saeid Sadeghi, Hamid Reza Pouretemad, Reza Khosrowabadi, Jalil Fathabadi, and Sedighe Nikbakht. 2021. Parent-child interaction effects on autism symptoms and EEG relative power in young children with excessive screen-time. Early Child Development and Care 191, 6 (2021), 827--836.
[78]
Hannah H. Schertz, Samuel L. Odom, Kathleen M. Baggett, and John H. Sideris. 2018. Mediating Parent Learning to Promote Social Communication for Toddlers with Autism: Effects from a Randomized Controlled Trial. Journal of Autism and Developmental Disorders 48, 3 (March 2018), 853--867. https://doi.org/10.1007/s10803-017-3386-8
[79]
Howard C Shane and Patti Ducoff Albert. 2008. Electronic screen media for persons with autism spectrum disorders: Results of a survey. Journal of autism and developmental disorders 38 (2008), 1499--1508.
[80]
Michael Siller and Marian Sigman. 2002. The behaviors of parents of children with autism predict the subsequent development of their children's communication. Journal of autism and developmental disorders 32 (2002), 77--89.
[81]
Petr Slovák and Geraldine Fitzpatrick. 2015. Teaching and developing social and emotional skills with technology. ACM Transactions on Computer-Human Interaction (TOCHI) 22, 4 (2015), 1--34.
[82]
Petr Slovák, Kael Rowan, Christopher Frauenberger, Ran Gilad-Bachrach, Mia Doces, Brian Smith, Rachel Kamb, and Geraldine Fitzpatrick. 2016. Scaffolding the scaffolding: Supporting children's social-emotional learning at home. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (San Francisco, California, USA) (CSCW '16). Association for Computing Machinery, New York, NY, USA, 1751--1765. https://doi.org/10.1145/2818048.2820007
[83]
Deborah Sturm, Michael Kholodovsky, Rayan Arab, David Shane Smith, Pavel Asanov, and Kristen Gillespie-Lynch. 2019. Participatory design of a hybrid kinect game to promote collaboration between autistic players and their peers. International Journal of Human-Computer Interaction 35, 8 (2019), 706--723.
[84]
Tarja Susi, Mikael Johannesson, and Per Backlund. 2007. Serious games: An overview. (2007).
[85]
James W Tanaka, Julie M Wolf, Cheryl Klaiman, Kathleen Koenig, Jeffrey Cockburn, Lauren Herlihy, Carla Brown, Sherin Stahl, Martha D Kaiser, and Robert T Schultz. 2010. Using computerized games to teach face recognition skills to children with autism spectrum disorder: the Let's Face It! program. Journal of Child Psychology and Psychiatry 51, 8 (2010), 944--952.
[86]
Andrea Tartaro, Justine Cassell, Corina Ratz, Jennifer Lira, and Valeria Nanclares-Nogués. 2014. Accessing peer social interaction: Using authorable virtual peer technology as a component of a group social skills intervention program. ACM Transactions on Accessible Computing (TACCESS) 6, 1 (2014), 1--29.
[87]
Nikki Theofanopoulou and Petr Slovak. 2022. Exploring Technology-Mediated Parental Socialisation of Emotion: Leveraging an Embodied, In-situ Intervention for Child Emotion Regulation. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 217, 16 pages. https://doi.org/10.1145/3491102.3502130
[88]
Giovanni Valeri, Laura Casula, Deny Menghini, Filomena Alessandra Amendola, Eleonora Napoli, Patrizio Pasqualetti, and Stefano Vicari. 2020. Cooperative parent-mediated therapy for Italian preschool children with autism spectrum disorder: a randomized controlled trial. European Child & Adolescent Psychiatry 29, 7 (July 2020), 935--946. https://doi.org/10.1007/s00787-019-01395-5
[89]
Asimina Vasalou, Sara Kalantari, Natalia Kucirkova, and Yvonne Vezzoli. 2020. Designing for oral storytelling practices at home: A parental perspective. International Journal of Child-Computer Interaction 26 (Dec. 2020), 100214. https://doi.org/10.1016/j.ijcci.2020.100214
[90]
Svetha Venkatesh, Dinh Phung, Thi Duong, Stewart Greenhill, and Brett Adams. 2013. TOBY: early intervention in autism through technology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 3187--3196. https://doi.org/10.1145/2470654.2466437
[91]
Chuan-Po Wang. 2023. Training children with autism spectrum disorder, and children in general with AI robots related to the automatic organization of sentence menus and interaction design evaluation. Expert Systems with Applications 229 (2023), 120527.
[92]
Peter Washington, Catalin Voss, Aaron Kline, Nick Haber, Jena Daniels, Azar Fazel, Titas De, Carl Feinstein, Terry Winograd, and Dennis Wall. 2017. SuperpowerGlass: A Wearable Aid for the At-Home Therapy of Children with Autism. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (Sept. 2017), 1--22.
[93]
Elisabeth M Whyte, Joshua M Smyth, and K Suzanne Scherf. 2015. Designing serious game interventions for individuals with autism. Journal of Autism and Developmental Disorders 45, 12 (Dec. 2015), 3820--3831.
[94]
M. Jeanne Wilcox and Juliann Woods. 2011. Participation as a basis for developing early intervention outcomes. Language, speech, and hearing services in schools 42 3 (2011), 365--78. https://doi.org/10.1044/0161-1461(2011/10-0014)
[95]
Beth T Williams, Kylie M Gray, and Bruce J Tonge. 2012. Teaching emotion recognition skills to young children with autism: a randomised controlled trial of an emotion training programme. Journal of Child Psychology and Psychiatry 53, 12 (2012), 1268--1276.
[96]
B. Wong. 1979. Increasing Retention of Main Ideas through Questioning Strategies. Learning Disability Quarterly 2 (1979), 42 - 47. https://doi.org/10.2307/1510643
[97]
Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, Rui Zheng, Xiaoran Fan, Xiao Wang, Limao Xiong, Yuhao Zhou, Weiran Wang, Changhao Jiang, Yicheng Zou, Xiangyang Liu, Zhangyue Yin, Shihan Dou, Rongxiang Weng, Wensen Cheng, Qi Zhang, Wenjuan Qin, Yongyan Zheng, Xipeng Qiu, Xuanjing Huang, and Tao Gui. 2023. The Rise and Potential of Large Language Model Based Agents: A Survey. arXiv:2309.07864 [cs.AI]
[98]
A. Zaman and M. Bhuiyan. 2014. Usabilty evaluation of the MumIES (Multimodal Interface based Education and Support) system for the children with special needs in Bangladesh. In 2014 International Conference on Informatics, Electronics & Vision (ICIEV). IEEE Computer Society, Los Alamitos, CA, USA, 1--4. https://doi.org/10.1109/ICIEV.2014.6850841
Index Terms
- EMooly: Supporting Autistic Children in Collaborative Social-Emotional Learning with Caregiver Participation through Interactive AI-infused and AR Activities
Recommendations
AEDLE: Designing Drama Therapy Interface for Improving Pragmatic Language Skills of Children with Autism Spectrum Disorder Using AR
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsThis research proposes AEDLE, a new interface combining AR with drama therapy — an approved method of improving pragmatic language skills — to offer effective, universal, and accessible language therapy for children with Autism Spectrum Disorder (ASD). ...
Audio-augmented paper for therapy and educational intervention for children with autistic spectrum disorder
Autism affects children@?s learning and social development. Commonly used rehabilitative treatments are aimed at stimulating the social skills of children with autism. In this article, we present a prototype and a pilot study on an audio-augmented paper ...
Are autistic children more vulnerable online? Relating autism to online safety, child wellbeing and parental risk management
NordiCHI '20: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping SocietyMany autistic children are active online users. Research suggests that they are subject to distress and poor wellbeing following online safety threats. However, it is unclear if autistic children are more likely to experience online safety risks ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2024 ACM.
Publication rights licensed to ACM. ACM acknowledges that this contribution was co-authored by an affiliate of the Canadian National Government. As such, the Crown in Right of Canada retains an equal interest in the copyright. Reprint requests should be forwarded to ACM, and reprints must include clear attribution to ACM and National Research Council Canada -NRC.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 21 November 2024
Published in IMWUT Volume 8, Issue 4
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Funding Sources
- Waterloo AI Institute
- NSSFC
- Natural Sciences and Engineering Research Council of Canada (NSERC)
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 73Total Downloads
- Downloads (Last 12 months)73
- Downloads (Last 6 weeks)73
Reflects downloads up to 11 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in