Can You Dance? A Study of Child–Robot Interaction and Emotional Response Using the NAO Robot
<p>Finger grabbing is a very popular application where the robot responds to touch by opening or closing its palms. The picture was taken during a visit to a kindergarten and anonymized in order to protect identities.</p> "> Figure 2
<p>Drawings of the NAO robot before (<b>a</b>,<b>c</b>) and after (<b>b</b>,<b>d</b>) the session, which included a theatrical performance, dance, pantomime, finger grabbing, and physical contact with the robot. Figures (<b>a</b>,<b>b</b>) were drawn by a 3-year-old child while figures (<b>c</b>,<b>d</b>) were drawn by a 5-year-old child.</p> ">
Abstract
:1. Introduction
2. Developed Applications for the NAO Robot
2.1. Motor Development Activities and Games
2.1.1. Aerobics
2.1.2. Finger Grabbing
2.1.3. Dance
2.2. Children’s Games
2.2.1. Pantomime
2.2.2. The Day and Night Game
2.2.3. Football
2.3. Theatrical Performances
2.3.1. Mr. Cheerful
2.3.2. Robonocchio
2.3.3. “O barvici, ki je hotela plesati”
2.4. Artificial Intelligence Applications
2.4.1. Facenao
2.4.2. LiveChat
2.5. Data Harvesting Applications
2.5.1. Face Detection
2.5.2. WhimBot
3. Discussion
4. Conclusions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
STEM | science, technology, engineering, mathematics |
HRI | human–robot interaction |
CRI | child–robot interaction |
AI | artificial intelligence |
LED | light-emitting diode |
DOF | degree of freedom |
API | application programming interface |
ASD | autistic spectrum disorder |
ADHD | attention deficit hyperactivity disorder |
SAR | socially assistive robotics |
References
- Goodrich, M.; Schultz, A. Human-Robot Interaction: A Survey. Found. Trends Hum.-Comput. Interact. 2007, 1, 203–275. [Google Scholar] [CrossRef]
- Soegaard, M.; Dam, R.F. (Eds.) The Encyclopedia of Human-Computer Interaction, 2nd ed.; The Interaction Design Foundation: Aarhus, Denmark, 2012. [Google Scholar]
- Belpaeme, T.; Baxter, P.; de Greeff, J.; Kennedy, J.; Read, R.; Looije, R.; Neerincx, M.; Baroni, I.; Zelati, M.C. Child-Robot Interaction: Perspectives and Challenges. In Proceedings of the Social Robotics, Bristol, UK, 27–29 October 2013; Herrmann, G., Pearson, M.J., Lenz, A., Bremner, P., Spiers, A., Leonards, U., Eds.; Springer: Cham, Switzerland, 2013; pp. 452–459. [Google Scholar]
- Amirova, A.; Rakhymbayeva, N.; Yadollahi, E.; Sandygulova, A.; Johal, W. 10 Years of Human-NAO Interaction Research: A Scoping Review. Front. Robot. AI 2021, 8, 744526. [Google Scholar] [CrossRef] [PubMed]
- Feil-Seifer, D.; Mataric, M. Defining socially assistive robotics. In Proceedings of the 9th International Conference on Rehabilitation Robotics (ICORR), Chicago, IL, USA, 28 June–1 July 2005; pp. 465–468. [Google Scholar]
- Matić, D.; Kovačić, Z. NAO Robot as Demonstrator of Rehabilitation Exercises after Fractures of Hands. In Proceedings of the 2019 International Conference on Software, Telecommunications and Computer Networks (SoftCOM), Split, Croatia, 19–21 September 2019; pp. 1–6. [Google Scholar]
- Assad-Uz-Zaman, M.; Islam, M.R.; Miah, M.S.; Rahman, M. NAO robot for cooperative rehabilitation training. J. Rehabil. Assist. Technol. Eng. 2019, 6, 2055668319862151. [Google Scholar] [CrossRef] [PubMed]
- Miglino, O.; Lund, H.H.; Cardaci, M. Robotics as an educational tool. J. Interact. Learn. Res. 1999, 10, 25–47. [Google Scholar]
- Lytridis, C.; Bazinas, C.; Papakostas, G.A.; Kaburlasos, V. On Measuring Engagement Level During Child-Robot Interaction in Education. In Proceedings of the Robotics in Education, Vienna, Austria, 10–12 April 2019; Merdan, M., Lepuschitz, W., Koppensteiner, G., Balogh, R., Obdržálek, D., Eds.; Springer: Cham, Switzerland, 2020; pp. 3–13. [Google Scholar]
- Alimardani, M.; van den Braak, S.; Jouen, A.L.; Matsunaka, R.; Hiraki, K. Assessment of Engagement and Learning During Child-Robot Interaction Using EEG Signals. In Proceedings of the Social Robotics: 13th International Conference, ICSR 2021, Singapore, 10–13 November 2021; Proceedings. Springer: Berlin/Heidelberg, Germany, 2021; pp. 671–682. [Google Scholar]
- Valagkouti, I.A.; Troussas, C.; Krouska, A.; Feidakis, M.; Sgouropoulou, C. Emotion Recognition in Human & Robot Interaction Using the NAO Robot. Computers 2022, 11, 72. [Google Scholar]
- Filippini, C.; Perpetuini, D.; Cardone, D.; Merla, A. Improving Human–Robot Interaction by Enhancing NAO Robot Awareness of Human Facial Expression. Sensors 2021, 21, 6438. [Google Scholar] [CrossRef] [PubMed]
- Papakostas, G.A.; Sidiropoulos, G.K.; Papadopoulou, C.I.; Vrochidou, E.; Kaburlasos, V.G.; Papadopoulou, M.T.; Holeva, V.; Nikopoulou, V.A.; Dalivigkas, N. Social Robots in Special Education: A Systematic Review. Electronics 2021, 10, 1398. [Google Scholar] [CrossRef]
- Virnes, M. Robotics in Special Needs Education. In Proceedings of the 7th International Conference on Interaction Design and Children, New York, NY, USA, 11–13 June 2008; IDC ’08. pp. 29–32. [Google Scholar]
- Syriopoulou-Delli, C.; Gkiolnta, E. Robotics and inclusion of students with disabilities in special education. Res. Soc. Dev. 2021, 10, e36210918238. [Google Scholar] [CrossRef]
- Freitas, H.; Costa, P.; Silva, V.; Silva Pereira, A.; Soares, F.; Esteves, J.S. Using a humanoid robot as the promoter of the interaction with children in the context of educational games. Int. J. Mechatronics Appl. Mech. 2017. [Google Scholar] [CrossRef]
- Rakhymbayeva, N.; Amirova, A.; Sandygulova, A. A Long-Term Engagement with a Social Robot for Autism Therapy. Front. Robot. AI 2021, 8, 669972. [Google Scholar] [CrossRef]
- Dignum, V.; Penagos, M.; Pigmans, K.; Vosloo, S. Policy guidance on AI for children. In Report, UNICEF, Office of Global Insight & Policy, United Nations Children’s Fund; United Nations Plaza: New York, NY, USA, 2021; p. 10017. [Google Scholar]
- Charisi, V.; Chaudron, S.; Di Gioia, R.; Vuorikari, R.; Planas, M.E. Artificial Intelligence and the Rights of the Child: Towards an Integrated Agenda for Research and Policy. In Scientific Analysis or Review KJ-NA-31048-EN-N (Online); Publications Office of the European Union: Luxembourg, 2022. [Google Scholar]
- Yang, W. Artificial Intelligence education for young children: Why, what, and how in curriculum design and implementation. Comput. Educ. Artif. Intell. 2022, 3, 100061. [Google Scholar] [CrossRef]
- Kewalramani, S.; Kidman, G.; Palaiologou, I. Using Artificial Intelligence (AI)-interfaced robotic toys in early childhood settings: A case for children’s inquiry literacy. Eur. Early Child. Educ. Res. J. 2021, 29, 652–668. [Google Scholar] [CrossRef]
- Parsons, S.; Sklar, E. Teaching AI using LEGO Mindstorms. In Proceedings of the 2004 AAAI Spring Symposium: Accessible Hands-on AI and Robotics Education, Palo Alto, CA, USA, 22–24 March 2004. [Google Scholar]
- Williams, R.; Park, H.W.; Oh, L.; Breazeal, C. PopBots: Designing an Artificial Intelligence Curriculum for Early Childhood Education. In Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA, 27 January–1 February 2019; Volume 33, pp. 9729–9736. [Google Scholar]
- Williams, R.; Park, H.W.; Breazeal, C. A is for Artificial Intelligence: The Impact of Artificial Intelligence Activities on Young Children’s Perceptions of Robots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, Scotland, UK, 4–9 May 2019; pp. 1–11. [Google Scholar]
- Bertel, L.; Hannibal, G. The NAO robot as a Persuasive Educational and Entertainment Robot (PEER)—A case study on children’s articulation, categorization and interaction with a social robot for learning. Tidsskr. LæRing Medier (LOM) 2015, 8. [Google Scholar] [CrossRef]
- Macedonia, M. Embodied Learning: Why at School the Mind Needs the Body. Front. Psychol. 2019, 10. [Google Scholar] [CrossRef]
- Baumann, A.E.; Goldman, E.J.; Meltzer, A.; Poulin-Dubois, D. People Do Not Always Know Best: Preschoolers’ Trust in Social Robots. J. Cogn. Dev. 2023, 24, 532–562. [Google Scholar] [CrossRef]
- Lindsay, S.; Hounsell, K.G. Adapting a robotics program to enhance participation and interest in STEM among children with disabilities: A pilot study. Disabil. Rehabil. Assist. Technol. 2017, 12, 694–704. [Google Scholar] [CrossRef] [PubMed]
- Jolley, R.P. Children and Pictures: Drawing and Understanding; Understanding Children’s Worlds; Wiley: Hoboken, NJ, USA, 2009. [Google Scholar]
- Serjouie, A. Children’s Understanding of Pictures and Expression of Emotion in their Drawings. Ph.D. Thesis, Art Education Faculty University of Erfurt, Erfurt, Germany, 2012. [Google Scholar]
- Weinberg, J.B.; Pettibone, J.C.; Thomas, S.; Stephen, M.L.; Stein, C. The Impact of Robot Projects on Girl’s Attitudes Toward Science and Engineering. In Proceedings of the 2007 RSS Robotics in Education Workshop, Atlanta, GA, USA, 27–30 June 2007. [Google Scholar]
- Pedersen, B.K.M.K.; Weigelin, B.C.; Larsen, J.C.; Nielsen, J. Using educational robotics to foster girls’ interest in STEM: A systematic review. In Proceedings of the 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), Vancouver, BC, Canada, 8–12 August 2021; pp. 865–872. [Google Scholar]
- Torpegaard, J.; Knudsen, L.S.; Linnet, M.P.; Skov, M.B.; Merritt, T. Preschool children’s social and playful interactions with a play-facilitating cardboard robot. Int. J. Child-Comput. Interact. 2022, 31, 100435. [Google Scholar] [CrossRef]
- Metatla, O.; Bardot, S.; Cullen, C.; Serrano, M.; Jouffrais, C. Robots for Inclusive Play: Co-Designing an Educational Game with Visually Impaired and Sighted Children. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; pp. 1–13. [Google Scholar]
- LePage, L. Performing Robots: Some Reflections. In Proceedings of the TaPRA Interim Event: Performing Robots, Arena Theatre, Wolverhampton, 2 March 2017. [Google Scholar]
- Lin, C.Y.; Tseng, C.K.; Teng, W.C.; Lee, W.C.; Kuo, C.H.; Gu, H.Y.; Chung, K.L.; Fahn, C.S. The realization of robot theater: Humanoid robots and theatric performance. In Proceedings of the 2009 International Conference on Advanced Robotics, Munich, Germany, 22–26 June 2009; pp. 1–6. [Google Scholar]
- Hargreaves, R. Mr.Cheerful; Egmont Books Ltd.: London, UK, 2014. [Google Scholar]
- Collodi, C. The Adventures of Pinocchio (Oxford World’s Classics); Oxford University Press: New York, NY, USA, 2009. [Google Scholar]
- Arriaga, O.; Valdenegro-Toro, M.; Muthuraja, M.; Devaramani, S.; Kirchner, F. Perception for Autonomous Systems (PAZ). 2020. Available online: http://xxx.lanl.gov/abs/2010.14541 (accessed on 19 July 2023).
- Arriaga, O.; Valdenegro-Toro, M.; Plöger, P.G. Real-time Convolutional Neural Networks for emotion and gender classification. In Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2019), Bruges, Belgium, 24–26 April 2019. [Google Scholar]
- Mellouk, W.; Handouzi, W. Facial emotion recognition using deep learning: Review and insights. Procedia Comput. Sci. 2020, 175, 689–694. [Google Scholar] [CrossRef]
- Editorial. What’s the next word in large language models? Nat. Mach. Intell. 2023, 5, 331–332. [CrossRef]
- Endrawis, S.; Leibovich, G.; Jacob, G.; Novik, G.; Tamar, A. Efficient Self-Supervised Data Collection for Offline Robot Learning. 2021. Available online: http://xxx.lanl.gov/abs/2105.04607 (accessed on 19 July 2023).
- Ravichandar, H.; Polydoros, A.S.; Chernova, S.; Billard, A. Recent Advances in Robot Learning from Demonstration. Annu. Rev. Control Robot. Auton. Syst. 2020, 3, 297–330. [Google Scholar] [CrossRef]
- Dunbabin, M.; Marques, L. Robots for Environmental Monitoring: Significant Advancements and Applications. IEEE Robot. Autom. Mag. 2012, 19, 24–39. [Google Scholar] [CrossRef]
- Tekdas, O.; Isler, V.; Lim, J.H.; Terzis, A. Using mobile robots to harvest data from sensor fields. IEEE Wirel. Commun. 2009, 16, 22–28. [Google Scholar] [CrossRef]
- Han, Z.; Williams, T. Towards Formalizing HRI Data Collection Processes. In Proceedings of the 4th Annual Workshop on Novel and Emerging Test Methods & Metrics for Effective HRI, online, 11 March 2022. [Google Scholar]
- Ismail, L.; Shamsuddin, S.; Yussof, H.; Hashim, H.; Bahari, S.; Jaafar, A.; Zahari, I. Face detection technique of Humanoid Robot NAO for application in robotic assistive therapy. In Proceedings of the 2011 IEEE International Conference on Control System, Computing and Engineering, Penang, Malaysia, 25–27 November 2011; pp. 517–521. [Google Scholar]
- Mori, M. Bukimi no tani. Energy 1970, 7, 33–35. [Google Scholar]
- Destephe, M.; Zecca, M.; Hashimoto, K.; Takanishi, A. Uncanny valley, robot and autism: Perception of the uncanniness in an emotional gait. In Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014), Bali, Indonesia, 5–10 December 2014; pp. 1152–1157. [Google Scholar]
- Brink, K.A.; Gray, K.; Wellman, H.M. Creepiness Creeps In: Uncanny Valley Feelings Are Acquired in Childhood. Child Dev. 2019, 90, 1202–1214. [Google Scholar] [CrossRef]
- Pandey, A.K.; Gelin, R. A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind. IEEE Robot. Autom. Mag. 2018, 25, 40–48. [Google Scholar] [CrossRef]
- Mathur, M.B.; Reichling, D.B. Navigating a social world with robot partners: A quantitative cartography of the Uncanny Valley. Cognition 2016, 146, 22–32. [Google Scholar] [CrossRef]
- von der Pütten, A.M.R.; Krämer, N.C. How design characteristics of robots determine evaluation and uncanny valley related responses. Comput. Hum. Behav. 2014, 36, 422–439. [Google Scholar] [CrossRef]
- Kozima, H.; Nakagawa, C. Interactive Robots as Facilitators of Childrens Social Development. In Mobile Robots: Towards New Applications; Lazinica, A., Ed.; IntechOpen: Rijeka, Croatia, 2006; Chapter 14. [Google Scholar]
- Gaertner, B.M.; Spinrad, T.L.; Eisenberg, N. Focused Attention in Toddlers: Measurement, Stability, and Relations to Negative Emotion and Parenting. Infant Child Dev. 2008, 17, 339–363. [Google Scholar] [CrossRef]
- Pinto-Bernal, M.J.; Sierra, S.D.M.; Munera, M.; Casas, D.; Villa-Moreno, A.; Frizera-Neto, A.; Stoelen, M.F.; Belpaeme, T.; Cifuentes, C.A. Do different robot appearances change emotion recognition in children with ASD? Front. Neurorobot. 2023, 17, 11. [Google Scholar] [CrossRef]
- Andreasson, R.; Alenljung, B.; Billing, E.; Lowe, R. Affective Touch in Human–Robot Interaction: Conveying Emotion to the Nao Robot. Int. J. Soc. Robot. 2018, 10, 473–491. [Google Scholar] [CrossRef]
- Winston, A.S.; Kenyon, B.; Stewardson, J.; Lepine, T. Children’s Sensitivity to Expression of Emotion in Drawings. Vis. Arts Res. 1995, 21, 1–14. [Google Scholar]
- Konrad, A. Inflection AI, Startup from Ex-DeepMind Leaders, Launches Pi—A Chattier Chatbot. Forbes 2023. [Google Scholar]
- Admoni, H. Nonverbal Communication in Socially Assistive Human-Robot Interaction. AI Matters 2016, 2, 9–10. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Podpečan, V. Can You Dance? A Study of Child–Robot Interaction and Emotional Response Using the NAO Robot. Multimodal Technol. Interact. 2023, 7, 85. https://doi.org/10.3390/mti7090085
Podpečan V. Can You Dance? A Study of Child–Robot Interaction and Emotional Response Using the NAO Robot. Multimodal Technologies and Interaction. 2023; 7(9):85. https://doi.org/10.3390/mti7090085
Chicago/Turabian StylePodpečan, Vid. 2023. "Can You Dance? A Study of Child–Robot Interaction and Emotional Response Using the NAO Robot" Multimodal Technologies and Interaction 7, no. 9: 85. https://doi.org/10.3390/mti7090085
APA StylePodpečan, V. (2023). Can You Dance? A Study of Child–Robot Interaction and Emotional Response Using the NAO Robot. Multimodal Technologies and Interaction, 7(9), 85. https://doi.org/10.3390/mti7090085