Let's Play: Early Explorations of Child-Caregiver Embodied Interactions
Authors: 
Giacomo Lepri, Nicola Corbellini, Silvia Ferrando, Gualtiero Volpe, Antonio CamurriAuthors Info & Claims
Pages 913 - 918
Abstract
We report on the initial design steps of an audio-visual installation to be set up in a hospital guest house for children and their caregivers. The goal of the project is twofold: on one hand we aim to design a playful experience which can support children physical activity and their communication skills. On the other, we intend to develop an automated tool to assess a few basic qualities of child-caregiver interaction by interpreting users’ upper-body motion. We focus on the early stages of the project, situating it in the context of a collaboration between two institutions: an HCI lab and a paediatric hospital. We describe our efforts for the identification of a suitable dyadic activity to be first analysed using motion capture techniques and later augmented with audio-visual feedback. We also outline the strategies identified for the evaluation of the automated measurements of embodied child-caregiver interactions. Finally, we present two basic prototypes developed to stimulate a hands-on debate within our research team on the project’s design challenges and outcomes.
References
[1]
Kristina Andersen and Ron Wakkary. 2019. The Magic Machine Workshops: Making Personal Design Knowledge(CHI ’19). Association for Computing Machinery.
[2]
Janette B Benson. 2020. Encyclopedia of infant and early childhood development. Elsevier.
[3]
VJ Bernstein, SL Hans, and C Percansky. 1992. Parent–Infant Observation Guide for program planning around feeding and other daily routines. Unpublished manual, Department of Psychiatry, University of Chicago, Chicago, IL (1992).
[4]
Zeynep Biringen. 2008. Emotional Availability Scales (4th ed.). Emotionalavailability.com.
[5]
Mark A Blythe, Kees Overbeeke, Andrew F Monk, and Peter C Wright. 2004. Funology: from usability to enjoyment. Springer.
[6]
Gregory S Braswell. 2001. Collaborative drawing during early mother-child interactions. Visual Arts Research (2001), 27–39.
[7]
Antonio Camurri, Shuji Hashimoto, Matteo Ricchetti, Andrea Ricci, Kenji Suzuki, Riccardo Trocca, and Gualtiero Volpe. 2000. Eyesweb: Toward gesture and affect recognition in interactive dance and music systems. Computer Music Journal 24, 1 (2000), 57–69.
[8]
Antonio Camurri, Gualtiero Volpe, Stefano Piana, Maurizio Mancini, Radoslaw Niewiadomski, Nicola Ferrari, and Corrado Canepa. 2016. The dancer in the eye: towards a multi-layered computational framework of qualities in movement. In Proceedings of the 3rd International Symposium on Movement and Computing. 1–7.
[9]
Theresa Casey. 2005. Inclusive play: Practical strategies for working with children aged 3 to 8. Sage.
[10]
Franceli L. Cibrian, Oscar Peña, Deysi Ortega, and Monica Tentori. 2017. BendableSound: An elastic multisensory surface using touch-based interactions to assist children with severe autism during music therapy. International Journal of Human-Computer Studies 107 (2017), 22–37. https://doi.org/10.1016/j.ijhcs.2017.05.003 Multisensory Human-Computer Interaction.
[11]
M Cathrene Connery, V John-Steiner, and A Marjanovic-Shane. 2010. Dancing with the muses. Vygotsky and creativity: A cultural-historical approach to play, meaning making and the arts, New York: Peter Lang Publishing (2010), 3–17.
[12]
Harry Daniels. 2002. Vygotsky and pedagogy. Routledge.
[13]
Emilie Delaherche, Mohamed Chetouani, Ammar Mahdhaoui, Catherine Saint-Georges, Sylvie Viaux, and David Cohen. 2012. Interpersonal synchrony: A survey of evaluation methods across disciplines. IEEE Transactions on Affective Computing 3, 3 (2012), 349–365.
[14]
Stacey C Dusing, Emily C Marcinowski, Nelci ACF Rocha, Tanya Tripathi, and Shaaron E Brown. 2019. Assessment of parent-child interaction is important with infants in rehabilitation and can use high-tech or low-tech methods. Physical therapy 99, 6 (2019), 658–665.
[15]
Ida Egmose, Giovanna Varni, Katharina Cordes, Johanne Smith-Nielsen, Mette S Væver, David Cohen, and Mohamed Chetouani. 2017. Relations between automatically extracted motion features and the quality of mother-infant interactions at 4 and 13 months. Frontiers in Psychology 8 (2017), 305709.
[16]
Ruth Feldman. 1998. Coding interactive behavior manual. Unpublished manual (1998).
[17]
Ruth Feldman. 2012. Parenting behavior as the environment where children grow. (2012).
[18]
Alan Fogel, Ilse DeKoeyer, Cory Secrist, Andrew Sipherd, Tina Hafen, and Michael Fricke. 2003. The Revised Relational Coding System. https://doi.org/10.13140/RG.2.2.27439.46245
[19]
Alexandra Frischen and Steven Tipper. 2004. Orienting Attention Via Observed Gaze Shift Evokes Longer Term Inhibitory Effects: Implications for Social Interactions, Attention, and Memory. Journal of experimental psychology. General 133 (12 2004), 516–33. https://doi.org/10.1037/0096-3445.133.4.516
[20]
Doris Pronin Fromberg and Doris Bergen. 2012. Play from birth to twelve: Contexts, perspectives, and meanings. Routledge.
[21]
William W Gaver, John Bowers, Andrew Boucher, Hans Gellerson, Sarah Pennington, Albrecht Schmidt, Anthony Steed, Nicholas Villars, and Brendan Walker. 2004. The drift table: designing for ludic engagement. In CHI’04 extended abstracts on Human factors in computing systems. 885–900.
[22]
Jacqueline Hammack, Mini Sharma, Lindsey Riera-Gomez, Hila Z Gvirts, and Teresa Wilcox. 2023. When I move, you move: Associations between automatic and person-coded measures of infant-mother synchrony during free-play using virtual in-home data collection. Infant Behavior and Development 72 (2023), 101869.
[23]
Kristina Hook. 2018. Designing with the body: Somaesthetic interaction design. MIt Press.
[24]
Pradthana Jarusriboonchai, Janis Lena Meissner, Teresa Almeida, and Madeline Balaam. 2019. Understanding Children’s Free Play in Primary Schools. In Proceedings of the 9th International Conference on Communities & Technologies - Transforming Communities (Vienna, Austria) (C&T ’19). Association for Computing Machinery, New York, NY, USA, 178–188. https://doi.org/10.1145/3328320.3328384
[25]
Elvin Karana, Bahareh Barati, Valentina Rognoli, Van Der Laan, Anouk Zeeuw, 2015. Material driven design (MDD): A method to design for material experiences. (2015).
[26]
Chloë Leclère, Marie Avril, S Viaux-Savelon, N Bodeau, Catherine Achard, Sylvain Missonnier, Miri Keren, R Feldman, M Chetouani, and David Cohen. 2016. Interaction and behaviour imaging: a novel method to measure mother–infant interaction using video 3D reconstruction. Translational Psychiatry 6, 5 (2016), e816–e816.
[27]
Annett Lotzin, Xiaoxing Lu, Levente Kriston, Julia Schiborr, Teresa Musal, Georg Romer, and Brigitte Ramsauer. 2015. Observational tools for measuring parent–infant interaction: A systematic review. Clinical child and family psychology review 18 (2015), 99–132.
[28]
Temitayo Olugbade, Marta Bieńkiewicz, Giulia Barbareschi, Vincenzo D’amato, Luca Oneto, Antonio Camurri, Catherine Holloway, Mårten Björkman, Peter Keller, Martin Clayton, 2022. Human movement datasets: An interdisciplinary scoping review. Comput. Surveys 55, 6 (2022), 1–29.
[29]
Jessica Phillips-Silver and Peter E Keller. 2012. Searching for roots of entrainment and joint action in early musical interactions. Frontiers in human neuroscience 6 (2012), 26.
[30]
Iana Podkosova, Francesco De Pace, and Hugo Brument. 2023. Joint Action in Collaborative Mixed Reality: Effects of Immersion Type and Physical Location. In Proceedings of the 2023 ACM Symposium on Spatial User Interaction (, Sydney, NSW, Australia,) (SUI ’23). Association for Computing Machinery, New York, NY, USA, Article 16, 12 pages. https://doi.org/10.1145/3607822.3614541
[31]
Janet Read and Tilde Bekker. 2011. The Nature of Child Computer Interaction. Proceedings of HCI 2011 - 25th BCS Conference on Human Computer Interaction, 163–170. https://doi.org/10.14236/ewic/HCI2011.43
[32]
Casey Reas and Ben Fry. 2006. Processing: programming for the media arts. Ai & Society 20 (2006), 526–538.
[33]
Joan Santer, Carol Griffiths, and Deborah Lynne Goodall. 2007. Free Play in Early Childhood: A literature review. https://api.semanticscholar.org/CorpusID:70367487
[34]
Sarah Schwab-Farrell, Nicole Carver, Maia Forman, Drew Abney, Tehran Davis, Michael Riley, Alexandra Paxton, and Paula Silva. 2022. Child-Caregiver Interactions During a Collaborative Motor Task in Children with Cerebral Palsy: A Descriptive Exploratory Study. Journal of Developmental and Physical Disabilities 34 (04 2022). https://doi.org/10.1007/s10882-021-09798-6
[35]
Natalie Sebanz, Harold Bekkering, and Günther Knoblich. 2006. Joint action: bodies and minds moving together. Trends in Cognitive Sciences 10, 2 (2006), 70–76. https://doi.org/10.1016/j.tics.2005.12.009
[36]
Joan Soler-Adillon and Narcis Parés. 2009. Interactive slide: an interactive playground to promote physical activity and socialization of children. In CHI ’09 Extended Abstracts on Human Factors in Computing Systems (, Boston, MA, USA,) (CHI EA ’09). Association for Computing Machinery, New York, NY, USA, 2407–2416. https://doi.org/10.1145/1520340.1520343
[37]
Deborah Tollefsen. 2005. Let’s Pretend!: Children and Joint Action. Philosophy of the Social Sciences 35, 1 (2005), 75–97. https://doi.org/10.1177/0048393104271925
[38]
Giovanna Varni, Antonio Camurri, Paolo Coletta, and Gualtiero Volpe. 2009. Toward a real-time automated measure of empathy and dominance. In 2009 International Conference on Computational Science and Engineering, Vol. 4. IEEE, 843–848.
[39]
Giovanna Varni, Gualtiero Volpe, and Antonio Camurri. 2010. A system for real-time multimodal analysis of nonverbal affective social interaction in user-centric media. IEEE Transactions on Multimedia 12, 6 (2010), 576–590.
[40]
Lev S Vygotsky. 1967. Play and its role in the mental development of the child. Soviet psychology 5, 3 (1967), 6–18.
[41]
Ron Wakkary, William Odom, Sabrina Hauser, Garnet Hertz, and Henry Lin. 2015. Material speculation: actual artifacts for critical inquiry. In Proceedings of The Fifth Decennial Aarhus Conference on Critical Alternatives. Aarhus University Press, 97–108.
[42]
Theodore Zamenopoulos and Katerina Alexiou. 2018. Co-design as collaborative research. Bristol University/AHRC Connected Communities Programme.
Index Terms
- Let's Play: Early Explorations of Child-Caregiver Embodied Interactions
Recommendations
Let's Play!: Digital and Analog Play between Preschoolers and Parents
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsPlay is an enjoyable and developmentally useful part of early childhood, and parent-child play is a highly productive mechanism by which children learn to participate in the world. We conducted an observational lab study to examine how 15 parent-child ...
"Let's play 'puters": expressive language use at the computer center
The researchers investigated 25 preschool children's expressive language while they were engaged at a classroom computer center and during their free play at traditional early childhood learning centers. The participants were enrolled in an inclusive ...
Smile and Laugh Dynamics in Naturalistic Dyadic Interactions: Intensity Levels, Sequences and Roles
ICMI '19: 2019 International Conference on Multimodal InteractionSmiles and laughs have been the subject of many studies over the past decades, due to their frequent occurrence in interactions, as well as their social and emotional functions in dyadic conversations. In this paper we push forward previous work by ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2024
1049 pages
ISBN:9798400704420
DOI:10.1145/3628516
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 June 2024
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Conference
IDC '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 172 of 578 submissions, 30%
Upcoming Conference
IDC '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 60Total Downloads
- Downloads (Last 12 months)60
- Downloads (Last 6 weeks)7
Reflects downloads up to 20 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format