[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1456659.1456686acmotherconferencesArticle/Chapter ViewAbstractPublication PageshtConference Proceedingsconference-collections
research-article

Automatic marking with Sakai

Published: 06 October 2008 Publication History

Abstract

Large student numbers often drive teaching staff to consider greater degrees of automation of assessment activities. In introductory Computer Science classes - where submitted programs need to repeatedly be compiled, executed and tested -automation is an obvious route to investigate. This paper reports on an experimental automation system for assessing programming assignments, and its integration with the open source Sakai learning management system. While the system has been an administrative success, feedback from students has identified numerous areas for improvement at the interface of the student and the automatic marker. Furthermore, the use of automation has highlighted the need for teaching software development methodology from an early stage.

References

[1]
Douce, C., Livingstone, D., and Orwell, J. 2005. Automatic test-based assessment of programming: A review. J. Educ. Resour. Comput. 5, 3 (Sep. 2005), 4. DOI=http://doi.acm.org/10.1145/1163405.1163409
[2]
Malmi, L., Korhonen, A., and Saikkonen, R. 2002. Experiences in automatic assessment on mass courses and issues for designing virtual courses. SIGCSE Bull. 34, 3 (Sep. 2002), 55--59. DOI=http://doi.acm.org/10.1145/637610.544433
[3]
Edwards, S. H. 2003. Rethinking computer science education from a test-first perspective. In Companion of the 18th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (Anaheim, CA, USA, October 26 -- 30, 2003). OOPSLA '03. ACM, New York, NY, 148--155. DOI=http://doi.acm.org/10.1145/949344.949390
[4]
Sakai Project. 2008. http://www.sakaiproject.org/
[5]
Blackboard. 2008. http://www.blackboard.com/
[6]
IMS Global Learning Consortium. 2008. http://www.imsglobal.org/
[7]
Dougiamas, M. and Taylor, P. C. 2003. Moodle: Using Learning Communities to Create an Open Source Course Management System. In Proceedings of the EDMEDIA 2003 Conference, Honolulu, Hawaii.
[8]
Sakai. 2008. Linktool. https://source.sakaiproject.org/svn/linktool/trunk/linktool.txt
[9]
Facebook. 2008. Developers Documentation. http://developers.facebook.com/documentation.php
[10]
Apache HTTP Server Documentation Project. 2008. Apache suEXEC Support. http://httpd.apache.org/docs/1.3/suexec.html
[11]
Parkinson, J. 2005. Essays marked by computer program. BBC News. http://news.bbc.co.uk/2/hi/uk_news/education/4425423.stm
[12]
Thomas, P., Waugh, K., and Smith, N. 2005. Experiments in the automatic marking of ER-diagrams. SIGCSE Bull. 37, 3 (Sep. 2005), 158--162. DOI=http://doi.acm.org/10.1145/1151954.1067490
[13]
Waugh, K., Thomas, P. and Smith, N. 2007. In Proceedings of the 24th British National Conference on Databases. BNCOD'07. IEEE Computer Society.
[14]
Foubister, F. P., Michaelson, G. J., and Tomes, N. 1997. Automatic assessment of elementary Standard ML programs using Ceilidh. J. Computer Assisted Learning 13 (2).
[15]
Jackson, D. and Usher, M. 1997. Grading student programs using ASSYST. In Proceedings of the Twenty-Eighth SIGCSE Technical Symposium on Computer Science Education (San Jose, California, United States, February 27 -March 01, 1997). J. E. Miller, Ed. SIGCSE '97. ACM, New York, NY, 335--339. DOI=http://doi.acm.org/10.1145/268084.268210
[16]
Truong, N., Roe, P., and Bancroft, P. 2004. Static analysis of students' Java programs. In Proceedings of the Sixth Conference on Australasian Computing Education - Volume 30 (Dunedin, New Zealand). R. Lister and A. Young, Eds. ACM International Conference Proceeding Series, vol. 57. Australian Computer Society, Darlinghurst, Australia, 317--325.
[17]
Saikkonen, R., Malmi, L., and Korhonen, A. 2001. Fully automatic assessment of programming exercises. SIGCSE Bull. 33, 3 (Sep. 2001), 133--136. DOI=http://doi.acm.org/10.1145/507758.377666
[18]
Tremblay, G., Guérin, F., Pons, A., and Salah, A. 2008. Oto, a generic and extensible tool for marking programming assignments. Software: Practice and Experience, 28 (3), John Wiley & Sons.
[19]
Blumenstein, M. M., Green, S., Nguyen, A. T., and Muthukkumarasamy, V. 2004. GAME: A Generic Automated Marking Environment for Programming Assessment. In Proceedings ITCC 2004 International Conference on Information Technology: Coding and Computing. http://hdl.handle.net/10072/2110

Cited By

View all
  • (2024)ProgEdu4Web: An automated assessment tool for motivating the learning of web programming courseComputer Applications in Engineering Education10.1002/cae.2277032:5Online publication date: 28-May-2024
  • (2023)Design of an Online Programming Platform and a Study on Learners’ Testing AbilityElectronics10.3390/electronics1222459612:22(4596)Online publication date: 10-Nov-2023
  • (2023)General Characteristics of the Assisted E-Learning System in Computer SciencesEducation, Research and Business Technologies10.1007/978-981-19-6755-9_10(117-125)Online publication date: 1-Jan-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
SAICSIT '08: Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology
October 2008
304 pages
ISBN:9781605582863
DOI:10.1145/1456659
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Microsoft: Microsoft

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Sakai
  2. assessment
  3. automation
  4. interoperability

Qualifiers

  • Research-article

Conference

SAICSIT '08
Sponsor:
  • Microsoft

Acceptance Rates

Overall Acceptance Rate 187 of 439 submissions, 43%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)2
Reflects downloads up to 23 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)ProgEdu4Web: An automated assessment tool for motivating the learning of web programming courseComputer Applications in Engineering Education10.1002/cae.2277032:5Online publication date: 28-May-2024
  • (2023)Design of an Online Programming Platform and a Study on Learners’ Testing AbilityElectronics10.3390/electronics1222459612:22(4596)Online publication date: 10-Nov-2023
  • (2023)General Characteristics of the Assisted E-Learning System in Computer SciencesEducation, Research and Business Technologies10.1007/978-981-19-6755-9_10(117-125)Online publication date: 1-Jan-2023
  • (2022)Review of Programming Assignments Automated Assessment Systems2022 2nd International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC)10.1109/MIUCC55081.2022.9781736(230-237)Online publication date: 8-May-2022
  • (2022)Automated Programming Assignment Marking Tool2022 IEEE 7th International conference for Convergence in Technology (I2CT)10.1109/I2CT54291.2022.9824339(1-8)Online publication date: 7-Apr-2022
  • (2022)An automated system with a versatile test oracle for assessing student programsComputer Applications in Engineering Education10.1002/cae.2257731:1(176-199)Online publication date: 11-Oct-2022
  • (2021)Using a distributed systems laboratory to facilitate students' cognitive, metacognitive and critical thinking strategy useJournal of Computer Assisted Learning10.1111/jcal.1260538:1(209-222)Online publication date: 23-Aug-2021
  • (2021)Using a Notification, Recommendation and Monitoring System to Improve Interaction in an Automated Assessment Tool: An Analysis of Students’ PerceptionsInternational Journal of Human–Computer Interaction10.1080/10447318.2021.1938400(1-20)Online publication date: 17-Jun-2021
  • (2020)Tools and Techniques for Teaching Computer Programming: A ReviewJournal of Educational Technology Systems10.1177/004723952092697149:2(170-198)Online publication date: 27-May-2020
  • (2020) EduZinc : a tool for the creation and assessment of student learning activities in complex open, online, and flexible learning environments Distance Education10.1080/01587919.2020.172476941:1(86-105)Online publication date: 1-Mar-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media