More Web Proxy on the site http://driver.im/

research-article

Open access

Small CCI – Exploring App Evaluation with Preschoolers

Authors:

Matthew Horton,

Rhona Anne Dick,

Emanuela Mazzone,

Rachel ForbesAuthors Info & Claims

IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference

Pages 94 - 99

https://doi.org/10.1145/3585088.3589362

Published: 19 June 2023 Publication History

All formats PDF

Abstract

Child-Computer Interaction (CCI) is predominantly studied with school aged children. Working with preschool children, generally unable to read or write, involves addressing many challenges around planning, recruitment, and interpretation of findings. There are few examples in the literature of the challenges faced when conducting evaluations of technology with preschool children and very few evaluations conducted for commercial software companies. Our case study paper describes a six-week, twelve session, evaluation study of a commercial app (Lingokids) with children aged three and four in two nursery (preschool / kindergarten) schools. We describe challenges we met and describe how we adapted our plans to fit the context. We show how we were able to explore engagement and learning without gathering any personal data. With our practical tips and reflections, we hope our work will encourage others to work with young children in ways that respect their limited ability to understand assent and participation.

References

[1]

Alissa N Antle, Christopher Frauenberger, Monica Landoni, Jerry Alan Fails, Marina Jirotka, Helena Webb and Nalin Tutiyaphuengprasert. 2020. Emergent, situated and prospective ethics for child-computer interaction research. In Proceedings of the 2020 ACM Interaction Design and Children Conference: Extended Abstracts. (2020), 54-61.

Digital Library

[2]

Alissa N Antle, Elgin-Skye McLaren, Holly Fiedler and Naomi Johnson. 2019. Evaluating the impact of a mobile neurofeedback app for young children at school and home. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. (2019), 1-13.

Digital Library

[3]

Ceylan Beşevli, Elif Salman, Tilbe Goksun, Hakan Urey and Oğuzhan Özcan. 2019. MaR-T: Designing a projection-based mixed reality system for nonsymbolic math development of preschoolers: Guided by theories of cognition and learning. In Proceedings of the 18th ACM International Conference on Interaction Design and Children. (2019), 280-292.

Digital Library

[4]

Kristen Pilner Blair, Jay Pfaffman, Maria Cutumisu, Nicole Hallinen and Daniel Schwartz. 2015. Testing the effectiveness of iPad math game: lessons learned from running a multi-classroom Study. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. (2015), 727-734.

Digital Library

[5]

Yu-Chen Chang, Jin-Ling Lo, Chao-Ju Huang, Nan-Yi Hsu, Hao-Hua Chu, Hsin-Yen Wang, Pei-Yu Chi and Ya-Lin Hsieh. 2008. Playful toothbrush: ubicomp technology for teaching tooth brushing to kindergarten children. In Proceedings of the SIGCHI conference on human factors in computing systems. (2008), 363-372.

Digital Library

[6]

Sue Dockett and Bob Perry. 2011. Researching with young children: Seeking assent. Child Indicators Research, 4, 2 (2011), 231-247.

[7]

Thomas Dylan, Abigail Durrant, Sena Çerçi, Shaun Lawson and John Vines 2021. Lanterns: Configuring a Digital Resource to Inspire Preschool Children's Free Play Outdoors. Association for Computing Machinery, Article 635.

Digital Library

[8]

Saria Eltalhi, Huda Kutrani, Reem Imsallim and Mikal Elrfadi. 2021. The Usability of BenKids Mobile Learning App in Vocabulary Teaching for Preschool. iJIM, 15, 24 (2021), 5.

[9]

Bettina Grünzweil and Michael Haller. 2009. Analyzing interaction techniques using mouse and keyboard for preschool children. In Symposium of the Austrian HCI and Usability Engineering Group. (2009), Springer, 448-456.

Digital Library

[10]

L Hanna, K Risden and K Alexander, J. 1997. Guidelines for usability testing with children. Interactions, 1997, 5 (1997), 9-14.

Digital Library

[11]

J Höysniemi, P Hämäläinen and L Turkki. 2003. Using Peer Tutoring in Evaluating the Usability of a Physically Interactive Computer Game. Interacting with Computers, 15, 2 (2003), 203 - 225.

[12]

Madeleine Heins Israelson. 2015. The app map: A tool for systematic evaluation of apps for early literacy learning. The Reading Teacher, 69, 3 (2015), 339-349.

[13]

Steven Joffe. 2003. Rethink" affirmative agreement," but abandon" assent" (2003).

[14]

Ana Vitoria Joly, Lyn Pemberton and Richard Griffiths. 2009. Card sorting activities with preschool children. People and Computers XXIII Celebrating People and Technology (2009), 204-213.

[15]

Peter H Kahn Jr, Batya Friedman, Deanne R Perez-Granados and Nathan G Freier. 2004. Robotic pets in the lives of preschool children. In CHI'04 extended abstracts on Human factors in computing systems. (2004), 1449-1452.

Digital Library

[16]

Junko Kanero, Vasfiye Geçkin, Cansu Oranç, Ezgi Mamus, Aylin C Küntay and Tilbe Göksun. 2018. Social robots for early language learning: Current evidence and future directions. Child Development Perspectives, 12, 3 (2018), 146-151.

[17]

Stuart MacFarlane, Janet Read, Johanna Höysniemi and Panos Markopoulos. 2003. Half-day tutorial: evaluating interactive products for and with children. In Interact. (2003), 1027-1028.

[18]

Javier Marco, Sandra Baldassarri, Eva Cerezo, Diana Yifan Xu and Janet C Read. 2010. LIFELONG INTERACTIONS Let the experts talk: an experience of tangible game design with children. Interactions, 17, 1 (2010), 58-61.

Digital Library

[19]

Yusrita Mohd Yusoff, Ian Ruthven and Monica Landoni. 2013. Measuring emotion: A new evaluation tool for very young children (2013).

[20]

Peter Moss. 2016. Early years PISA testing. Early Years Educator, 18, 6 (2016), 14-16.

[21]

Junya Nakanishi, Hidenobu Sumioka and Hiroshi Ishiguro. 2016. Can Children Anthropomorphize Human-shaped Communication Media? A Pilot Study on Co-sleeping with a Huggable Communication Medium. In Proceedings of the Fourth International Conference on Human Agent Interaction. (2016), 103-106.

Digital Library

[22]

Stamatios Papadakis. 2020. Tools for evaluating educational apps for young children: a systematic review of the literature. Interactive Technology and Smart Education (2020).

[23]

Stamatios Papadakis, Julie Vaiopoulou, Michail Kalogiannakis and Dimitrios Stamovlasis. 2020. Developing and exploring an evaluation tool for educational apps (ETEA) targeting kindergarten children. Sustainability, 12, 10 (2020), 4201.

[24]

J. C Read. 2007. Validating the Fun Toolkit: an instrument for measuring children's opinions of technology. Cognition Technology and Work (2007).

[25]

Janet Read and Matthew Horton. 2022. Respecting and Facilitating Children's Contributions to Research, Design and Evaluation in HCI: Course Submission. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. (2022), 1-3.

[26]

Gwyneth Storey. 1992. The educational value of computers in nursery schools. Education 3-13, 20, 1 (1992), 43-47.

[27]

Anuj Tewari and John Canny. 2014. What did spot hide? a question-answering game for preschool children. In Proceedings of the SIGCHI conference on human factors in computing systems. (2014), 1807-1816.

Digital Library

[28]

Neha Tuli and Archana Mantri. 2021. Evaluating usability of mobile-based augmented reality learning environments for early childhood. International Journal of Human–Computer Interaction, 37, 9 (2021), 815-827.

[29]

Jorick Vissers, Lode De Bot and Bieke Zaman. 2013. MemoLine: evaluating long-term UX with children. In Proceedings of the 12th International Conference on Interaction Design and Children. (2013), ACM, 285-288.

Digital Library

[30]

Monica Ward. 2014. HCI requirements for young primary school CALL learners. In International Conference on Learning and Collaboration Technologies. (2014), Springer, 339-348.

[31]

B Zaman. 2009. Introducing a Pairwise Comparison Scale for UX Evaluations with Preschoolers. In Interact 2009. (2009), IFIP, 634 - 637.

Cited By

Varatharaj ARead JHorton MLochrie MBrehm L(2024)Children As Evaluators: Understanding Emotion Language AcquisitionProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659413(892-896)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659413
Baxter MHorton MRead JAllen JDick R(2024)Pots and Pans, Books and Stories, Apps and Tablets - The Power of Digital in Young Children's Pre-school SettingsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659379(706-709)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659379
Read JHorton MFitton DKing JSim GAllen JDoumanis IGraham TXu DTierney MLochrie MMacKenzie S(2024)Inclusive Child Engagement in HCI: Exploring Ocean Health with SchoolchildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655750(83-92)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655750
Show More Cited By

Index Terms

Small CCI – Exploring App Evaluation with Preschoolers
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies

Recommendations

Pots and Pans, Books and Stories, Apps and Tablets - The Power of Digital in Young Children's Pre-school Settings
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference

This work in progress builds on the work on ‘Small CCI’ working with children below the age of 5. The purpose of this study was to compare children's engagement and experience with three classroom activities over a three-week period. Eight children aged ...
Exploring Parent Use of Early STEM Media to Inform Design for Children
IDC '19: Proceedings of the 18th ACM International Conference on Interaction Design and Children

This paper explores how parents identify and use science and math media to engage their preschool children in informal science and math learning. Through an interview study, we examine parental beliefs about media's role in their preschool-aged children'...
An effort to understand parents’ media mediation roles and early childhood children's digital game addiction tendency: A descriptive correlational survey study
Abstract
This study aims to determine whether parents' media mediation roles are related to their early childhood children's digital game addiction tendencies. In addition, it examines whether these variables are related to the child's and parent's digital ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference

June 2023

824 pages

ISBN:9798400701313

DOI:10.1145/3585088

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Check for updates

Badges

Honorable Mention Short Paper

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

IDC '23

Sponsor:

SIGCHI

IDC '23: Interaction Design and Children

June 19 - 23, 2023

IL, Chicago, USA

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
358
Total Downloads

Downloads (Last 12 months)220
Downloads (Last 6 weeks)15

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Varatharaj ARead JHorton MLochrie MBrehm L(2024)Children As Evaluators: Understanding Emotion Language AcquisitionProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659413(892-896)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659413
Baxter MHorton MRead JAllen JDick R(2024)Pots and Pans, Books and Stories, Apps and Tablets - The Power of Digital in Young Children's Pre-school SettingsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659379(706-709)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659379
Read JHorton MFitton DKing JSim GAllen JDoumanis IGraham TXu DTierney MLochrie MMacKenzie S(2024)Inclusive Child Engagement in HCI: Exploring Ocean Health with SchoolchildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655750(83-92)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655750
Read JChisik YYadollahi EHorton M(2024)Children and Emerging Technologies: Ethical and Practical Research and DesignExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636275(1-4)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636275

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents