Cited By
View all- Erdoğdu FGökoğlu S(2025)Mapping the Anatomy of Novice-Generated Mistakes in Learning ProgrammingEffective Computer Science Education in K-12 Classrooms10.4018/979-8-3693-4542-9.ch007(171-192)Online publication date: 24-Jan-2025
Syntax error based quantification of the learning progress of the novice programmer
Pages 10 - 14
Abstract
Recent data-driven research has produced metrics for quantifying a novice programmer's error profile, such as Jadud's error quotient. However, these metrics tend to be context dependent and contain free parameters. This paper reviews the caveats of such metrics and proposes a more general approach to developing a metric. The online implementation of the proposed metric is publicly available at http://online-analysis-demo.herokuapp.com/.
References
[1]
Alireza Ahadi, Arto Hellas, and Raymond Lister. 2017. A contingency table derived method for analyzing course data. ACM Transactions on Computing Education (TOCE) 17, 3 (2017), 13.
[2]
Alireza Ahadi, Raymond Lister, Heikki Haapala, and Arto Vihavainen. 2015. Exploring Machine Learning Methods to Automatically Identify Students in Need of Assistance. In Proceedings of the Eleventh Annual International Conference on International Computing Education Research (ICER ’15). ACM, New York, NY, USA, 121–130.
[3]
Alireza Ahadi, Raymond Lister, and Arto Vihavainen. 2016. On the Number of Attempts Students Made on Some Online Programming Exercises During Semester and their Subsequent Performance on Final Exam Questions. In Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education. ACM, 218–223.
[4]
Brett A Becker. 2016. A new metric to quantify repeated compiler errors for novice programmers. In Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education. ACM, 296–301.
[5]
Adam S. Carter, Christopher D. Hundhausen, and Olusola Adesope. 2015. The Normalized Programming State Model: Predicting Student Performance in Computing Courses Based on Programming Behavior. In Proceedings of the Eleventh Annual International Conference on International Computing Education Research (ICER ’15). ACM, New York, NY, USA, 141–150.
[6]
2787710
[7]
Ronald K Hambleton and Win J van der Linden. 1997. Handbook of modern item response theory.
[8]
Matthew Jadud. 2006. An Exploration of Novice Compilation Behaviour in BlueJ. Ph.D. Dissertation.
[9]
Matthew C Jadud. 2006. Methods and tools for exploring novice compilation behaviour. In Proceedings of the second international workshop on Computing education research. ACM, 73–84.
[10]
Manu Kapur. 2014. Productive failure in learning math. Cognitive Science 38, 5 (2014), 1008–1022.
[11]
Andrew Petersen, Jaime Spacco, and Arto Vihavainen. 2015. An exploration of error quotient in multiple contexts. In Proceedings of the 15th Koli Calling Conference on Computing Education Research. ACM, 77–86.
[12]
Leo Porter, Daniel Zingaro, and Raymond Lister. 2014. Predicting student success using fine grain clicker data. In Proceedings of the tenth annual conference on International computing education research. ACM, 51–58.
[13]
Maria Mercedes T Rodrigo, Emily Tabanao, Ma Beatriz E Lahoz, and Matthew C Jadud. 2009. Analyzing online protocols to characterize novice Java programmers. Philippine Journal of Science 138, 2 (2009), 177–190.
[14]
Kurt VanLehn, Stephanie Siler, Charles Murray, Takashi Yamauchi, and William B Baggett. 2003. Why do only some events cause learning during human tutoring? Cognition and Instruction 21, 3 (2003), 209–249.
[15]
Christopher Watson, Frederick WB Li, and Jamie L Godwin. 2013. Predicting Performance in an Introductory Programming Course by Logging and Analyzing Student Programming Behavior. In Advanced Learning Technologies (ICALT), 2013 IEEE 13th International Conference on. IEEE, 319–323.
[16]
Michael Yudelson, Roya Hosseini, Arto Vihavainen, and Peter Brusilovsky. 2014. Investigating Automated Student Modeling in a Java MOOC. In Proceedings of The Seventh International Conference on Educational Data Mining 2014.
[17]
Abstract 1 Introduction 2 Background 3 Metric Design 3.1 Metric Characteristics 3.2 Conceptual Framework 3.3 Design 3.4 Metric Evaluation 4 discussion 5 conclusion References
Index Terms
- Syntax error based quantification of the learning progress of the novice programmer
Recommendations
The Effects of Compilation Mechanisms and Error Message Presentation on Novice Programmer Behavior
SIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science EducationIt is generally accepted that learning to program could be easier for many students. One of the most important components of this experience is the programming environment. Novices learn in a variety of environments, from basic command-line interfaces ...
A New Look at Novice Programmer Errors
Special Section on ML Education and Regular ArticlesThe types of programming errors that novice programmers make and struggle to resolve have long been of interest to researchers. Various past studies have analyzed the frequency of compiler diagnostic messages. This information, however, does not have a ...
Learning programming, syntax errors and institution-specific factors
ACE '18: Proceedings of the 20th Australasian Computing Education ConferenceLearning programming is a road that is paved with mistakes. Initially, novices are bound to write code with syntactic mistakes, but after a while semantic mistakes take a larger role in the novice programmers' lives.
Researchers who wish to understand ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2018
394 pages
ISBN:9781450357074
DOI:10.1145/3197091
- General Chairs:
- Irene Polycarpou,
- Janet C. Read,
- Program Chairs:
- Panayiotis Andreou,
- Michal Armoni
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 July 2018
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ITiCSE '18
Sponsor:
ITiCSE '18: 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education
July 2 - 4, 2018
Larnaca, Cyprus
Acceptance Rates
Overall Acceptance Rate 552 of 1,613 submissions, 34%
Upcoming Conference
ITiCSE '25
- Sponsor:
- sigcse
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 202Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)1
Reflects downloads up to 02 Mar 2025
Other Metrics
Citations
Cited By
View all- Erdoğdu FGökoğlu S(2025)Mapping the Anatomy of Novice-Generated Mistakes in Learning ProgrammingEffective Computer Science Education in K-12 Classrooms10.4018/979-8-3693-4542-9.ch007(171-192)Online publication date: 24-Jan-2025
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in