research-article

Coverage of course topics in a student generated MCQ repository

Authors:

Paul Denny,

Andrew Luxton-Reilly,

John Hamer,

Helen PurchaseAuthors Info & Claims

ACM SIGCSE Bulletin, Volume 41, Issue 3

Pages 11 - 15

https://doi.org/10.1145/1595496.1562888

Published: 06 July 2009 Publication History

Get Access

Abstract

A recent approach to engaging students in deep learning involves an online tool, PeerWise, through which students contribute multiple-choice questions to a shared question bank. Earlier work demonstrated a strong correlation between the use of PeerWise and student performance. In this study we investigate the quality of the MCQ repository created by students in an introductory programming course by analysing the range of topics on which students chose to write questions (i.e.~the repository coverage) without guidance from an instructor. We assess the repository coverage by comparing it with a common list of typical introductory programming topics, and by looking at its extent. We find that, despite having freedom to choose any topic, students created a repository that covered all the major topics in the curriculum.

References

[1]

M. Birenbaum and R. A. Feldman. Relationships between learning patterns and attitudes towards two assessment formats. Educational Research, 40(1):90--97, 1998.

Crossref

Google Scholar

[2]

P. Denny, J. Hamer, A. Luxton-Reilly, and H. Purchase. PeerWise: Students sharing their multiple choice questions. In ICER '08: Proceedings of the 2008 international workshop on Computing education research, pages 51--58, Sydney, Australia, 2008. ACM.

Digital Library

Google Scholar

[3]

P. Denny, A. Luxton-Reilly, and J. Hamer. The PeerWise system of student contributed assessment questions. In Simon and M. Hamilton, editors, Tenth Australasian Computing Education Conference (ACE 2008), volume 78 of CRPIT, pages 69--74, Wollongong, NSW, Australia, 2008. ACS.

Digital Library

Google Scholar

[4]

P. Denny, A. Luxton-Reilly, and J. Hamer. Student use of the PeerWise system. In ITICSE '08: Proceedings of the 13th annual SIGCSE conference on Innovation and technology in computer science education, pages 73--77, Madrid, Spain, 2008. ACM.

Digital Library

Google Scholar

[5]

P. Denny, A. Luxton-Reilly, and B. Simon. Quality of student contributed questions using PeerWise. In M. Hamilton and T. Clear, editors, Eleventh Australasian Computing Education Conference (ACE 2009), volume 95 of CRPIT, Wellington, New Zealand, 2009. ACS.

Digital Library

Google Scholar

[6]

J. Hamer, Q. Cutts, J. Jackova, A. Luxton-Reilly, R. McCartney, H. Purchase, C. Riedesel, M. Saeli, K. Sanders, and J. Sheard. Contributing student pedagogy. SIGCSE Bull., 40(4):194--212, 2008.

Digital Library

Google Scholar

[7]

D. Nicol. E-assessment by design: using multiple-choice tests to good effect. Journal of Further and Higher Education, 31(1):53--64, 2007.

Crossref

Google Scholar

[8]

C. Schulte and J. Bennedsen. What do teachers teach in introductory programming? In ICER '06: Proceedings of the 2006 international workshop on Computing education research, pages 17--28, New York, NY, USA, 2006. ACM.

Digital Library

Google Scholar

[9]

K. Scouller. The influence of assessment method on students' learning approaches: multiple choice question examination versus assignment essay. Higher Education, 35:453--472, 1998.

Crossref

Google Scholar

Cited By

View all

Pirttinen NDenny PHellas ALeinonen J(2023)Lessons Learned From Four Computing Education Crowdsourcing SystemsIEEE Access10.1109/ACCESS.2023.325364211(22982-22992)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3253642
Rhind SMacKay JBrown AMosley CRyan JHughes KBoyd S(2021)Developing Miller’s Pyramid to Support Students’ Assessment LiteracyJournal of Veterinary Medical Education10.3138/jvme.2019-005848:2(158-162)Online publication date: Apr-2021
https://doi.org/10.3138/jvme.2019-0058
Wint SFunabiki N(2021)A proposal of recommendation function for element fill-in-Blank problems in java programming learning assistant systemInternational Journal of Web Information Systems10.1108/IJWIS-11-2020-007017:2(140-152)Online publication date: 5-Apr-2021
https://doi.org/10.1108/IJWIS-11-2020-0070
Show More Cited By

Index Terms

Coverage of course topics in a student generated MCQ repository
1. Applied computing
  1. Education

Recommendations

PeerWise
Koli '08: Proceedings of the 8th International Conference on Computing Education Research

PeerWise is a web-based system that allows multiple-choice question banks to be built solely from student input. The system provides a number of intrinsic reward structures that encourage students to contribute high-quality questions in the complete ...
Student use of the PeerWise system
ITiCSE '08: Proceedings of the 13th annual conference on Innovation and technology in computer science education

PeerWise is a web-based system that supports the creation of student-generated test banks of multiple choice questions. Students contribute question stems and answers, provide explanations, answer questions contributed by other students, rate questions ...
Coverage of course topics in a student generated MCQ repository
ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education

A recent approach to engaging students in deep learning involves an online tool, PeerWise, through which students contribute multiple-choice questions to a shared question bank. Earlier work demonstrated a strong correlation between the use of PeerWise ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACM SIGCSE Bulletin Volume 41, Issue 3

ITiCSE '09

September 2009

403 pages

ISSN:0097-8418

DOI:10.1145/1595496

Issue’s Table of Contents

ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education
July 2009
428 pages
ISBN:9781605583815
DOI:10.1145/1562877
General Chair:
Patrick Brézillon
UPMC, France
,
Program Chairs:
Ingrid Russell
University of Hartford, USA
,
Jean-Marc Labat
UPMC, France

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 July 2009

Published in SIGCSE Volume 41, Issue 3

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
362
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pirttinen NDenny PHellas ALeinonen J(2023)Lessons Learned From Four Computing Education Crowdsourcing SystemsIEEE Access10.1109/ACCESS.2023.325364211(22982-22992)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3253642
Rhind SMacKay JBrown AMosley CRyan JHughes KBoyd S(2021)Developing Miller’s Pyramid to Support Students’ Assessment LiteracyJournal of Veterinary Medical Education10.3138/jvme.2019-005848:2(158-162)Online publication date: Apr-2021
https://doi.org/10.3138/jvme.2019-0058
Wint SFunabiki N(2021)A proposal of recommendation function for element fill-in-Blank problems in java programming learning assistant systemInternational Journal of Web Information Systems10.1108/IJWIS-11-2020-007017:2(140-152)Online publication date: 5-Apr-2021
https://doi.org/10.1108/IJWIS-11-2020-0070
Kay AHardy JGalloway R(2019)Student use of PeerWise: A multi‐institutional, multidisciplinary evaluationBritish Journal of Educational Technology10.1111/bjet.1275451:1(23-35)Online publication date: 27-Feb-2019
https://doi.org/10.1111/bjet.12754
Snow SWilde ADenny Pschraefel m(2018)A discursive question: Supporting student‐authored multiple choice questions through peer‐learning software in non‐STEMM disciplinesBritish Journal of Educational Technology10.1111/bjet.1268650:4(1815-1830)Online publication date: 16-Sep-2018
https://doi.org/10.1111/bjet.12686
Luxton-Reilly ADenny P(2010)Constructive evaluation: a pedagogy of student-contributed assessmentComputer Science Education10.1080/08993408.2010.48627520:2(145-167)Online publication date: Jun-2010
https://doi.org/10.1080/08993408.2010.486275
Pirttinen NHellas ALeinonen J(2023)Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?Proceedings of the 25th Australasian Computing Education Conference10.1145/3576123.3576137(123-131)Online publication date: 30-Jan-2023
https://dl.acm.org/doi/10.1145/3576123.3576137
Thomas A(2023)A Consolidated Catalogue of Question Types for Programming CoursesICT Education10.1007/978-3-031-48536-7_9(119-133)Online publication date: 29-Nov-2023
https://doi.org/10.1007/978-3-031-48536-7_9
Pirttinen NLeinonen JBecker BQuille KLaakso MBarendsen ESimon (2022)Can Students Review Their Peers?Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 110.1145/3502718.3524762(12-18)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3502718.3524762
DAI YYOSHIKAWA MASANO Y(2020)Estimating Knowledge Category Coverage by Courses Based on Centrality in TaxonomyIEICE Transactions on Information and Systems10.1587/transinf.2019DAP0002E103.D:5(928-938)Online publication date: 1-May-2020
https://doi.org/10.1587/transinf.2019DAP0002
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

PeerWise

Student use of the PeerWise system

Coverage of course topics in a student generated MCQ repository