More Web Proxy on the site http://driver.im/

research-article

Investigating children's opinions of games: Fun Toolkit vs. This or That

Authors:

Matthew HortonAuthors Info & Claims

IDC '12: Proceedings of the 11th International Conference on Interaction Design and Children

Pages 70 - 77

https://doi.org/10.1145/2307096.2307105

Published: 12 June 2012 Publication History

Abstract

Over the past decade many new evaluation methods have emerged for evaluating user experience with children, but the results of these studies have tended to be reported in isolation of other techniques. This paper reports on a comparative analysis of 2 user experience evaluations methods with children. A within-subject design was adopted using 20 children aged between 7 and 8. The children played 2 different games on a tablet PCs and their experiences of each were captured using 2 evaluation methods which have been validated with children: the Fun Toolkit and This or That. The results showed that the Fun Toolkit and This or That method yielded similar results and were able to establish a preference for one game over the other. However, there were some inconsistencies between the results of individual tools within the Fun toolkit and some of the constructs being measured in the This or That method. Further research will try to identify any ordering effects within each method and redundancies within the questions.

References

[1]

Korhonen, H. and Koivisto, E. M. 2006. Playability Heuristics for Mobile Games, in MobileHCI. Helsinki: ACM.

Digital Library

[2]

Olsen, A., Smolentzov, L. and Strandvall, T. 2010. Comparing different eye tracking cues when using the retrospective think aloud method in usability testing, in 24th British HCI Conference - Play is serious business, ACM: Abertay.

Digital Library

[3]

Hanna, N. R. 2002. Effective Use of a Range of Authentic Assessments in a Web Assisted Pharmacology Course. Educational Technology & Society, 5(3): p. 123--137.

[4]

Druin, A. 1999. Cooperative inquiry: develping new technologies for children with children, in SIGCHI Conference on Human Factors in Computer Systems: The CHI is the Limit. Pittsburgh: ACM.

Digital Library

[5]

Druin, A. and Solomon, C. 1996, Designing Multimedia Environments for Children: Computers, Creatvity, and Kids. Wiley Computer Publishing.

Digital Library

[6]

Read, J. C., MacFarlane, S. J. and Casey, C. 2001. Measuring the Usability of Text Input Methods for Children. in HCI2001. Lille, France: Springer Verlag.

[7]

Hoysniemi, J., Hamalainen, P. and Turkki, L. 2003. Using peer tutoring in evaluating the usability of a physically interactive computer game with children. Interacting with Computers, 15(2): p. 203--225.

[8]

Sim, G., MacFarlane, S. and Read, J. C. 2006. All Work and No Play: Measuring Fun, Usability and Learning in Software for Children. Computers and Education, 46(3): p. 235--248.

Digital Library

[9]

Baauw, E. and Markopoulos, P. 2004. A comparison of think-aloud and post-task interview for usability testing with children., in IDC 2004, ACM Press: Maryland.

Digital Library

[10]

Xu, Y., Read, J. C., Sim, G. and Qualter, P. 2009. Children and Smart Technologies: Can Chldren's Experiences be Interpreted and Coded, in HCI 2009 People and Computers, British Computer Society: Cambridge, p. 224--231.

Digital Library

[11]

Law, E. L.-C., Roto, V., Vermeeren, A. P. O. S., Kort, J. and Hassenzahl, M. 2008. Towards a Shared Definition of User Experience, in CHI 2008 ACM Press: Florence, p. 2395--2398.

Digital Library

[12]

ISO. 2010. Ergonomics of human system interaction - Prt 210: Human-centred design for interactive system. International Standards Organisation: Switserland.

[13]

Kaye, J. 2007. Evaluating experienced-focused HCI, in CHI 2007, ACM Press: San Jose. p. 1661--1664.

Digital Library

[14]

Carroll, J. M. 2004. Beyond Fun. Interactions, 11(5): p. 38--40.

Digital Library

[15]

Inkpen, K. 1997. Three Important Research Agendas for Educational Multimedia: Learning, Children and Gender. in Educationl MultiMedia 97. Calgary.

[16]

Malone, T. W. 1980. What makes things fun to learn? Heuristics for designing instructional computer games, in 3rd ACM SIGSMALL symposium and the first SIGPC symposium on Small systems. Palo Alto: ACM.

Digital Library

[17]

Barendregt, W., Bekker, M. and Baauw, E. 2008. Development and evaluation of the problem identification picture cards method. Cognition, Technology and Work, 10(2): p. 95--105.

Digital Library

[18]

Read, J., MacFarlane, S. and Casey, C. 2002. Endurability, Engagement and Expectations: Measuring Children's Fun. in Interaction Design and Children. Eindhoven.

[19]

Zaman, B. and Abeele. V. V. 2010. Laddering with Young Children in User Experence Evaluations: Theoretical Groundings and a Practical Case. in IDC. Barcelona: ACM.

Digital Library

[20]

Zaman, B. 2009. Introduction and validation of a pairwise comparison scale for UX evaluations and benchmarking with preschoolers, in Interact. Uppsala: Springer.

Digital Library

[21]

Horton, M. and Read, J. C. 2008. Interactive Whiteboards in the Living Room? - Asking Children about their Technologies, in 22nd British HCI Conference. Liverpool.

Digital Library

[22]

Borgers, N., Leeuw, E. D. and Hox, J. 2000. Children as Respondents in Survey Research: Cognitive Development and Response Quality. Buletin de Methodologie Sociologique, 66: p. 60--75.

[23]

Read, J. C. and Fine, K. 2005. Using Survey Methods for Design and Evaluation in Child Computer Interaction. in Interact 2005, Rome.

[24]

Barendregt, W., Bekker, M., Bouwhuis, D. G. and Baauw, E. 2006. Identifying usability and fun problems in a computer game during first use and some practice. International Journal Human Computer Interaction, 64: p. 830--846.

Digital Library

[25]

Metaxas, G., Metin, B., Schneider, J., Shapiro, G. Zhou, W. and Markopoulos, P. 2005. SCORPIODROME: an exploration in mixed reality social gaming for children, in International Conference on Advances in computer entertainment technology. Valencia: ACM.

Digital Library

[26]

Read, J. C., 2008. Validating the Fun Toolkit: an instrument for measuring children's opinion of technology. Cognition, Technology and Work, 10(2): p. 119--128.

Digital Library

[27]

Dhar, R. and Simonson, I. 2003. The effects of Forced Choice on Choice. Journal of Marketing Research, 40(2): p. 146--160.

[28]

Miller, N. E. 1944. Experimental Studies of Conflict, in Personality and Behavior Disorder, J. M. Hunt, Editor Ronald Press: New York.

[29]

Jams, I. L. and Mann, L. 1977. Decision Making, New York: Free Press.

Cited By

Koolwijk Pde Jonge EMombarg RRemmers TVan Kann Dvan Aart ISavelsbergh Gde Vries S(2024)Characteristics of Children with an Undesirable Motor Competence Development During the Transition from Early to Middle Childhood: Results of a 2-Year Longitudinal StudyInternational Journal of Environmental Research and Public Health10.3390/ijerph2111146021:11(1460)Online publication date: 31-Oct-2024
https://doi.org/10.3390/ijerph21111460
MacKenzie JKlarkowski MHorton ETheobald MDanby SKervin LBarrie LAmery PAndradi MSmith SMandryk RJohnson D(2024)Using Psychophysiological Data to Facilitate Reflective Conversations with Children about their Player ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/36771128:CHI PLAY(1-33)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677112
Wöbbekind LMandl T(2024)Exploring the Understanding of Semantic Differentials to Measure User Experience with Children and Adolescents - First Findings and Recommendations for UX TestingProceedings of Mensch und Computer 202410.1145/3670653.3677503(660-664)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3677503
Show More Cited By

Index Terms

Investigating children's opinions of games: Fun Toolkit vs. This or That
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Laddering with young children in User eXperience evaluations: theoretical groundings and a practical case
IDC '10: Proceedings of the 9th International Conference on Interaction Design and Children

In this paper, we investigate the usefulness and feasibility of Laddering with young children in User eXperience evaluations. We start with a revision of theoretical literature and guidelines. Developmental literature suggests that children aged two to ...
Evaluating artefacts with children: age and technology effects in the reporting of expected and experienced fun
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

In interaction design, there are several metrics used to gather user experience data. A common approach is to use surveys with the usual method being to ask users after they have experienced a product as to their opinion and satisfaction. This paper ...
Evaluating game preference using the fun toolkit across cultures
BCS-HCI '12: Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers

Over the past decade many new evaluation methods have emerged for evaluating user experience with children, but the results of these studies have tended to be reported in isolation and cultural implications have been largely ignored. This paper reports ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IDC '12: Proceedings of the 11th International Conference on Interaction Design and Children

June 2012

399 pages

ISBN:9781450310079

DOI:10.1145/2307096

Conference Chair:
Heidi Schelhowe
University of Bremen, Germany

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

didactalab: didactalab
IMIS: Institut für Multimediale und Interaktive Systeme

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IDC '12

Sponsor:

didactalab
IMIS

IDC '12: The 11th International Conference on Interaction Design and Children

June 12 - 15, 2012

Bremen, Germany

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
690
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)4

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Koolwijk Pde Jonge EMombarg RRemmers TVan Kann Dvan Aart ISavelsbergh Gde Vries S(2024)Characteristics of Children with an Undesirable Motor Competence Development During the Transition from Early to Middle Childhood: Results of a 2-Year Longitudinal StudyInternational Journal of Environmental Research and Public Health10.3390/ijerph2111146021:11(1460)Online publication date: 31-Oct-2024
https://doi.org/10.3390/ijerph21111460
MacKenzie JKlarkowski MHorton ETheobald MDanby SKervin LBarrie LAmery PAndradi MSmith SMandryk RJohnson D(2024)Using Psychophysiological Data to Facilitate Reflective Conversations with Children about their Player ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/36771128:CHI PLAY(1-33)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677112
Wöbbekind LMandl T(2024)Exploring the Understanding of Semantic Differentials to Measure User Experience with Children and Adolescents - First Findings and Recommendations for UX TestingProceedings of Mensch und Computer 202410.1145/3670653.3677503(660-664)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3677503
Petrevska MWright FKhan AMunce SFehlings DBiddiss E(2024)Evaluating the impact of movement tracking feedback on engagement with home exercise programmes of children with cerebral palsy using a new therapy app: a protocol for a mixed-methods single-case experimental design with alternating treatmentsBMJ Open10.1136/bmjopen-2023-08276114:3(e082761)Online publication date: 18-Mar-2024
https://doi.org/10.1136/bmjopen-2023-082761
Sim GRead J(2024)Using Eye-Tracking to Demonstrate Children’s Attention to Detail When Evaluating Low-Fidelity PrototypesInteracting with Computers10.1093/iwc/iwad052Online publication date: 10-Jan-2024
https://doi.org/10.1093/iwc/iwad052
Rapti SSapounidis TTselegkaridis S(2024)Investigating Educators’ and Students’ Perspectives on Virtual Reality Enhanced Teaching in PreschoolEarly Childhood Education Journal10.1007/s10643-024-01659-zOnline publication date: 5-Apr-2024
https://doi.org/10.1007/s10643-024-01659-z
Abd El-Sattar H(2024)Future metaverse-based education to promote daily living activities in learners with autism using immersive technologiesEducation and Information Technologies10.1007/s10639-024-12844-3Online publication date: 9-Aug-2024
https://doi.org/10.1007/s10639-024-12844-3
Rapti SSapounidis TTselegkaridis S(2023)Enriching a Traditional Learning Activity in Preschool through Augmented Reality: Children’s and Teachers’ ViewsInformation10.3390/info1410053014:10(530)Online publication date: 28-Sep-2023
https://doi.org/10.3390/info14100530
Dujić Rodić LStančić IČoko DPerković TGranić A(2023)Towards a Machine Learning Smart Toy Design for Early Childhood Geometry Education: Usability and PerformanceElectronics10.3390/electronics1208195112:8(1951)Online publication date: 21-Apr-2023
https://doi.org/10.3390/electronics12081951
Smakman MVanegas DSmit KLeewis SOkkerse YObbes JUffing TSoliman Mvan der Krogt TTönjes L(2022)A Trustworthy Robot Buddy for Primary School ChildrenMultimodal Technologies and Interaction10.3390/mti60400296:4(29)Online publication date: 14-Apr-2022
https://doi.org/10.3390/mti6040029
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents