More Web Proxy on the site http://driver.im/

short-paper

Open access

Examinator v3.0: Cheating Detection in Online Take-Home Exams

Authors:

Christopher Cui,

Saurabh Chatterjee,

Rocko Graziano,

Thad StarnerAuthors Info & Claims

L@S '23: Proceedings of the Tenth ACM Conference on Learning @ Scale

Pages 401 - 405

https://doi.org/10.1145/3573051.3596196

Published: 20 July 2023 Publication History

Abstract

Examinator v3.0 detects cheating in online take-home exams by comparing answers and the timestamps they were entered. A web interface enables efficient manual inspection. Use of the tool reveals that certain question types substantially enhance cheating detection, demonstrating the potential of automated algorithmic detection at scale. Examinator v3.0 has analyzed 915,831 pairs of exam submissions across three courses over two semesters at a top U.S. institution, identifying 46 instances of cheating.

References

[1]

Keith L Adkins and David A Joyner. 2022. Scaling anti-plagiarism efforts to meet the needs of large online computer science classes: Challenges, solutions, and recommendations. Journal of Computer Assisted Learning, Vol. 38, 6 (2022), 1603--1619.

[2]

Abdullah M Almutawa and Sai Sruthi. 2022. Students' perspective towards online proctoring in exams during COVID-19. Journal of Engineering Research, Vol. 10, 4A (2022).

[3]

Raghav Apoorv, Akshay Dahiya, Uma Sreeram, Bharat Rahuldhev Patil, India Irish, Rocko Graziano, and Thad Starner. 2020. Examinator: A Plagiarism Detection Tool for Take-Home Exams. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 261--264.

Digital Library

[4]

Lars Bengtsson. 2019. Take-home exams in higher education: A systematic review. Education Sciences, Vol. 9, 4 (2019), 267.

[5]

Canvas. n.d. How do I create a quiz using New Quizzes? https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-create-a-quiz-using-New-Quizzes/ta-p/1173 Retrieved April 7, 2023 from

[6]

Martin Dick, Judy Sheard, Cathy Bareiss, Janet Carter, Donald Joyce, Trevor Harding, and Cary Laxer. 2002. Addressing student cheating: definitions and solutions. ACM SigCSE Bulletin, Vol. 35, 2 (2002), 172--184.

Digital Library

[7]

Jiameng Du, Yifan Song, Mingxiao An, Marshall An, Christopher Bogart, and Majd Sakr. 2022. Cheating Detection in Online Assessments via Timeline Analysis. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1. 98--104.

Digital Library

[8]

David Goldberg. 2021. Programming in a pandemic: Attaining academic integrity in online coding courses. Communications of the Association for Information Systems, Vol. 48, 1 (2021), 6.

[9]

David N Harpp and James J Hogan. 1993. Crime in the classroom: Detection and prevention of cheating on multiple-choice exams. Journal of Chemical Education, Vol. 70, 4 (1993), 306.

[10]

Phil Hill. 2023. State of higher ed LMS market for US and Canada: Year-end 2022 edition. Dostupno na: https://philonedtech.com/state-of-higher-ed-lms-market-for-us-and-canada-year-end-2022-edition/[Pristupljeno: 31.01.2023.] (2023).

[11]

Chun-Hua Hsiao. 2015. Impact of ethical and affective variables on cheating: comparison of undergraduate students with and without jobs. Higher Education, Vol. 69, 1 (2015), 55--77.

[12]

Fakhroddin Noorbehbahani, Azadeh Mohammadi, and Mohammad Aminazadeh. 2022. A systematic review of research on cheating in online exams from 2010 to 2021. Education and Information Technologies, Vol. 27, 6 (2022), 8413--8460.

Digital Library

[13]

Jochen Ranger, Nico Schmidt, and Anett Wolgast. 2020. The detection of cheating on E-exams in higher education-the performance of several old and some new indicators. Frontiers in Psychology, Vol. 11 (2020), 568825.

[14]

Peter Salhofer. 2017. Analysing student behavior in CS courses: A case-study on detecting and preventing cheating. In 2017 IEEE Global Engineering Education Conference (EDUCON). IEEE, 1426--1431.

[15]

Talia Waltzer and Audun Dahl. 2022. Why do students cheat? Perceptions, evaluations, and motivations. Ethics & Behavior (2022), 1--21.

[16]

Krist Wongsuphasawat and Ben Shneiderman. 2009. Finding comparable temporal categorical records: A similarity measure with an interactive visualization. In 2009 IEEE Symposium on Visual Analytics Science and Technology. 27--34. https://doi.org/10.1109/VAST.2009.5332595

Cited By

Cui CHung JSharma PChatterjee SStarner TJoyner DKim MWang XXia M(2024)Answer Watermarking: Using Answer Generation Assistance Tools to Find Evidence of CheatingProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664712(519-523)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664712
Duncan ATang THuang YLuu JThakkar NJoyner DJoyner DKim MWang XXia M(2024)Forums, Feedback, and Two Kinds of AI: A Selective History of Learning @ ScaleProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664667(376-382)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664667
Cui CHung JMalhotra VGoel HApoorv RStarner TJoyner DKim MWang XXia M(2024)Examinator v4.0 : Cheating Detection in Online Take-Home ExamsProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664659(330-334)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664659
Show More Cited By

Index Terms

Examinator v3.0: Cheating Detection in Online Take-Home Exams
1. Applied computing
  1. Education

Recommendations

Examinator v4.0 : Cheating Detection in Online Take-Home Exams
L@S '24: Proceedings of the Eleventh ACM Conference on Learning @ Scale

Cheating detection in large classes with online, take-home exams is an extremely difficult problem. As class size increases, the process of detection and evidence building becomes a significant investment of time. To identify cheating without invasive ...
Answer Watermarking: Using Answer Generation Assistance Tools to Find Evidence of Cheating
L@S '24: Proceedings of the Eleventh ACM Conference on Learning @ Scale

Cheating detection in large classes with online, take-home exams is an extremely difficult problem. While some cheating can be identified through statistical analysis of all student responses, this analysis can easily be fooled by "smart cheaters'' ...
Comments on Harn---Lin's cheating detection scheme

Detection of cheating and identification of cheaters in threshold schemes has been well studied, and several solid solutions have been provided in the literature. This paper analyses Harn and Lin's recent work on cheating detection and identification of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

L@S '23: Proceedings of the Tenth ACM Conference on Learning @ Scale

July 2023

445 pages

ISBN:9798400700255

DOI:10.1145/3573051

General Chair:
Daniel Spikol
University of Copenhagen, Denmark
,
Program Chairs:
Olga Viberg
KTH Royal Institute of Technology, Sweden
,
Alejandra Martínez-Monés
Universidad de Valladolid, Spain
,
Philip Guo
UC San Diego, USA

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2023

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

L@S '23

L@S '23: Tenth ACM Conference on Learning @ Scale

July 20 - 22, 2023

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 117 of 440 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
998
Total Downloads

Downloads (Last 12 months)815
Downloads (Last 6 weeks)36

Reflects downloads up to 24 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cui CHung JSharma PChatterjee SStarner TJoyner DKim MWang XXia M(2024)Answer Watermarking: Using Answer Generation Assistance Tools to Find Evidence of CheatingProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664712(519-523)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664712
Duncan ATang THuang YLuu JThakkar NJoyner DJoyner DKim MWang XXia M(2024)Forums, Feedback, and Two Kinds of AI: A Selective History of Learning @ ScaleProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664667(376-382)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664667
Cui CHung JMalhotra VGoel HApoorv RStarner TJoyner DKim MWang XXia M(2024)Examinator v4.0 : Cheating Detection in Online Take-Home ExamsProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664659(330-334)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664659
Cui CDeshpande GMason CStarner TJoyner DKim MWang XXia M(2024)Scaling Classrooms: A Forum for Practitioners Seeking, Developing and Adapting their Own ToolsProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664641(563-564)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664641
Lintang QDwi Wahyu Cahyani NArief Nugroho M(2024)Log Analyzer for English Proficiency Test Cheating Detection2024 12th International Conference on Information and Communication Technology (ICoICT)10.1109/ICoICT61617.2024.10698253(115-122)Online publication date: 7-Aug-2024
https://doi.org/10.1109/ICoICT61617.2024.10698253

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten