Experimental Analysis of First-Grade Students' Block-Based Programming Problem Solving Processes
Authors: 
Gabriele Pozzan, Costanza Padova, Chiara Montuori, Barbara Arfé, 
Tullio VardanegaAuthors Info & Claims
Abstract
This work presents an experimental analysis of first-grade students' block-based programming trajectories. These trajectories consist of edit-level program snapshots that capture learners' problem-solving processes in a navigational microworld. Our results highlight the potential of this fine-grained data capture. Snapshot frequencies in trajectories collected before and after a coding intervention showcase the collective progress of the learners. Graph visualizations, in which nodes represent snapshots and directed edges code edits, highlight strategies, pitfalls and debugging procedures. Individual programming trajectories shed light on details of learners' problem-solving processes that less granular analysis would conceal. Various works in the field of Learning Analytics research show the usefulness of collecting fine-grained process data that proceed from programming activities. However, how to analyze this data is still an open question and research on the subject is in an experimental phase. We contribute to this experimentation by analyzing and discussing results collected from 30 first-grade students in a pretest-posttest study.
References
[1]
Barbara Arfé, Tullio Vardanega, Chiara Montuori, and Marta Lavanga. 2019. Coding in primary grades boosts children's executive functions. Frontiers in psychology, Vol. 10 (2019), 2713.
[2]
Barbara Arfé, Tullio Vardanega, and Lucia Ronconi. 2020. The effects of coding on children's planning and inhibition skills. Computers & Education, Vol. 148 (2020), 103807.
[3]
David Bau, Jeff Gray, Caitlin Kelleher, Josh Sheldon, and Franklyn Turbak. 2017. Learnable programming: blocks and beyond. Commun. ACM, Vol. 60, 6 (2017), 72--80.
[4]
Miles Berry. 2013. Computing in the national curriculum: A guide for primary teachers. (2013).
[5]
Isabella Corradini, Michael Lodi, and Enrico Nardelli. 2017. Computational Thinking in Italian Schools: Quantitative Data and Teachers' Sentiment Analysis after Two Years of "Programma il Futuro". In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education (Bologna, Italy) (ITiCSE '17). Association for Computing Machinery, New York, NY, USA, 224--229. https://doi.org/10.1145/3059009.3059040
[6]
Peter J Denning and Paul S Rosenbloom. 2009. the profession of it Computing: the Fourth great domain of science. Commun. ACM, Vol. 52, 9 (2009), 27--29.
[7]
Tomávs Effenberger and Radek Pelánek. 2019. Measuring Students' Performance on Programming Tasks. In Proceedings of the Sixth (2019) ACM Conference on Learning @ Scale (Chicago, IL, USA) (L@S '19). Association for Computing Machinery, New York, NY, USA, Article 26, bibinfonumpages4 pages. https://doi.org/10.1145/3330430.3333639
[8]
Daniel Amo Filvà, Marc Alier Forment, Francisco José Garc'ia-Pe nalvo, David Fonseca Escudero, and Mar'ia José Casa n. 2019. Clickstream for learning analytics to assess students' behavior with Scratch. Future Generation Computer Systems, Vol. 93 (2019), 673--686.
[9]
Barry Gribbons and Joan Herman. 1996. True and quasi-experimental designs. Practical assessment, research, and evaluation, Vol. 5, 1 (1996), 14.
[10]
Ting-Chia Hsu, Shao-Chen Chang, and Yu-Ting Hung. 2018. How to learn and how to teach computational thinking: Suggestions based on a review of the literature. Computers & Education, Vol. 126 (2018), 296--310.
[11]
Bo Jiang, Wei Zhao, Nuan Zhang, and Feiyue Qiu. 2022. Programming trajectories analytics in block-based programming language learning. Interactive Learning Environments, Vol. 30, 1 (2022), 113--126.
[12]
Ioanna Kanellopoulou, Pablo Garaizar, and Mariluz Guenaga. 2021. First steps towards automatically defining the difficulty of maze-based programming challenges. IEEE Access, Vol. 9 (2021), 64211--64223.
[13]
Max Kesselbacher and Andreas Bollin. 2019. Discriminating Programming Strategies in Scratch: Making the Difference between Novice and Experienced Programmers. In Proceedings of the 14th Workshop in Primary and Secondary Computing Education (Glasgow, Scotland, Uk) (WiPSCE '19). Association for Computing Machinery, New York, NY, USA, Article 20, bibinfonumpages10 pages. https://doi.org/10.1145/3361721.3361727
[14]
Seymour Papert. 1980. Mindstorms: Computers, children, and powerful ideas. NY: Basic Books, Vol. 255 (1980).
[15]
Radek Pelánek and Tomávs Effenberger. 2022. Design and analysis of microworlds and puzzles for block-based programming. Computer Science Education, Vol. 32, 1 (2022), 66--104.
[16]
Radek Pelánek and Tomávs Effenberger. 2023. The landscape of computational thinking problems for practice and assessment. ACM Transactions on Computing Education, Vol. 23, 2 (2023), 1--29.
[17]
Chris Piech, Mehran Sahami, Jonathan Huang, and Leonidas Guibas. 2015. Autonomously Generating Hints by Inferring Problem Solving Policies. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale (Vancouver, BC, Canada) (L@S '15). Association for Computing Machinery, New York, NY, USA, 195--204. https://doi.org/10.1145/2724660.2724668
[18]
Mitchel Resnick, John Maloney, Andrés Monroy-Hernández, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner, Eric Rosenbaum, Jay Silver, Brian Silverman, et al. 2009. Scratch: programming for all. Commun. ACM, Vol. 52, 11 (2009), 60--67.
[19]
Judy Robertson, Stuart Gray, Martin Toye, and Josephine Booth. 2020. The relationship between executive functions and computational thinking. International Journal of Computer Science Education in Schools, Vol. 3, 4 (2020), 35--49.
[20]
Robert Rosenthal, Harris Cooper, Larry Hedges, et al. 1994. Parametric measures of effect size. The handbook of research synthesis, Vol. 621, 2 (1994), 231--244.
[21]
Valerie J Shute, Chen Sun, and Jodi Asbell-Clarke. 2017. Demystifying computational thinking. Educational research review, Vol. 22 (2017), 142--158.
[22]
Xiaodan Tang, Yue Yin, Qiao Lin, Roxana Hadad, and Xiaoming Zhai. 2020. Assessing computational thinking: A systematic review of empirical studies. Computers & Education, Vol. 148 (2020), 103798.
[23]
Sean Tsung, Huan Wei, Haotian Li, Yong Wang, Meng Xia, and Huamin Qu. 2022. BlockLens: Visual Analytics of Student Coding Behaviors in Block-Based Programming Environments. In Proceedings of the Ninth ACM Conference on Learning @ Scale (New York City, NY, USA) (L@S '22). Association for Computing Machinery, New York, NY, USA, 299--303. https://doi.org/10.1145/3491140.3528298
[24]
Jeroen JG Van Merrienboer. 2013. Perspectives on problem solving and instruction. Computers & Education, Vol. 64 (2013), 153--160.
[25]
Kaizhong Zhang and Dennis Shasha. 1989. Simple fast algorithms for the editing distance between trees and related problems. SIAM journal on computing, Vol. 18, 6 (1989), 1245--1262.
[26]
Yingbin Zhang, Luc Paquette, Juan D Pinto, Qianhui Liu, and Aysa Xuemo Fan. 2023. Combining latent profile analysis and programming traces to understand novices' differences in debugging. Education and Information Technologies, Vol. 28, 4 (2023), 4673--4701.
Index Terms
- Experimental Analysis of First-Grade Students' Block-Based Programming Problem Solving Processes
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2024
776 pages
ISBN:9798400706004
DOI:10.1145/3649217
- General Chairs:
- Mattia Monga,
- Violetta Lonati,
- Erik Barendsen,
- Program Chairs:
- Judithe Sheard,
- James Paterson
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ITiCSE 2024
Sponsor:
Acceptance Rates
Overall Acceptance Rate 552 of 1,613 submissions, 34%
Upcoming Conference
ITiCSE '25
- Sponsor:
- sigcse
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 183Total Downloads
- Downloads (Last 12 months)183
- Downloads (Last 6 weeks)38
Reflects downloads up to 14 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in