[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3491140.3528286acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesl-at-sConference Proceedingsconference-collections
short-paper
Open access

Learnersourcing: Student-generated Content @ Scale

Published: 01 June 2022 Publication History

Abstract

The first annual workshop on Learnersourcing: Student-generated Content @ Scale is taking place at Learning @ Scale 2022. This hybrid workshop will expose attendees to the ample opportunities in the learnersourcing space, including instructors, researchers, learning engineers, and many other roles. We believe participants from a wide range of backgrounds and prior knowledge on learnersourcing can both benefit and contribute to this workshop, as learnersourcing draws on work from education, crowdsourcing, learning analytics, data mining, ML/NLP, and many more fields. Additionally, as the learnersourcing process involves many stakeholders (students, instructors, researchers, instructional designers, etc.), multiple viewpoints can help to inform what future student-generated content might be useful, new and better ways to assess the quality of the content and spark potential collaboration efforts between attendees. We ultimately want to show how everyone can make use of learnersourcing and have participants gain hands-on experience using existing tools, create their own learnersourcing activities using them or their own platforms, and take part in discussing the next challenges and opportunities in the learnersourcing space. Our hope is to attract attendees interested in scaling the generation of instructional and assessment content and those interested in the use of online learning platforms.

Supplementary Material

MP4 File (learning_at_scale_learnersourcing_workshop_video.mp4)
The workshop focus will be on examining the tools, processes, and content that is both used and generated through learnersourcing. After introduction, two presentations and demos will then be run to highlight different learnersourcing tools, with an emphasis on how the student-generated content can be used by instructors and researchers. We will then have participant presentations, where accepted submissions will be presented. From there, we will then demonstrate how participants can add learnersourcing activities of their own to any piece of educational technology. Participants will then engage in a discussion around the challenges, opportunities, and future of learnersourcing, including how we can assess and incentivize quality student-generated content, while also empowering the instructors and learners with actionable insights. The workshop will conclude with a summary of the day's events, core challenges and opportunities we addressed in the discussions, and a strong emphasis on future collaborations.

References

[1]
Khosravi, H., Demartini, G., Sadiq, S., & Gasevic, D. (2021, April). Charting the design and analytics agenda of learnersourcing systems. In LAK21: 11th International Learning Analytics and Knowledge Conference (pp. 32--42).
[2]
Kim, J. (2015, May). Learnersourcing: improving learning with collective learner activity. PhD Dissertation. Massachusetts Institute of Technology
[3]
Nathan, M. J., Koedinger, K. R., & Alibali, M. W. (2001, April). Expert blind spot: When content knowledge eclipses pedagogical content knowledge. In Proceedings of the third international conference on cognitive science (Vol. 644648).
[4]
Williams, J. J., Kim, J., Rafferty, A., Maldonado, S., Gajos, K. Z., Lasecki, W. S., & Heffernan, N. (2016, April). Axis: Generating explanations at scale with learnersourcing and machine learning. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale (pp. 379--388).
[5]
Denny, P., Hamer, J., Luxton-Reilly, A., & Purchase, H. (2008, September). PeerWise: students sharing their multiple-choice questions. In Proceedings of the fourth international workshop on computing education research (pp. 51--58).
[6]
Khosravi, H., Kitto, K., & Williams, J. J. (2019). RiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities. Journal of Learning Analytics, 6(3), 91--105.
[7]
Duret, D., Christley, R., Denny, P., & Senior, A. (2018). Collaborative learning with PeerWise. Research in Learning Technology, 26, 1--13.
[8]
Abdi, S., Khosravi, H., Sadiq, S., & Demartini, G. (2021). Evaluating the quality of learning resources: A learnersourcing approach. IEEE Transactions on Learning Technologies, 14(1), 81--92.
[9]
Dale Hancock, Nicole Hare, Paul Denny and Gareth Denyer. 2018. Improving large class performance and engagement through student-generated question banks. Biochemistry and Molecular Biology Education, 46(4), pages 306--317.
[10]
Bier, N., Moore, S., & Van Velsen, M. (2019). Instrumenting courseware and leveraging data with the Open Learning Initiative (OLI). In Companion Proceedings 9th International Learning Analytics & Knowledge Conference, Tempe, AZ.
[11]
Moore, S., Nguyen, H. A., & Stamper, J. (2021, June). Examining the Effects of Student Participation and Performance on the Quality of Learnersourcing Multiple-Choice Questions. In Proceedings of the Eighth ACM Conference on Learning@ Scale (pp. 209--220).
[12]
Singh, A., Brooks, C., Lin, Y., & Li, W. (2021, June). What's In It for the Learners? Evidence from a Randomized Field Experiment on Learnersourcing Questions in a MOOC. In Proceedings of the Eighth ACM Conference on Learning@ Scale (pp. 221--233).
[13]
Wang, Z., Lamb, A., Saveliev, E., Cameron, P., Zaykov, J., Hernandez-Lobato, J. M., ... & Zhang, C. (2021, August). Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challenge. In NeurIPS 2020 Competition and Demonstration Track (pp. 191--205). PMLR.
[14]
Denny, P., McDonald, F., Empson, R., Kelly, P., & Petersen, A. (2018, April). Empirical support for a causal relationship between gamification and learning outcomes. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1--13).
[15]
Denny, P. (2015, February). Generating practice questions as a preparation strategy for introductory programming exams. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (pp. 278--283).
[16]
Abdi, S., Khosravi, H., & Sadiq, S. (2020, July). Modelling learners in crowdsourcing educational systems. In International Conference on Artificial Intelligence in Education (pp. 3--9). Springer, Cham.
[17]
Huang, A., Hancock, D., Clemson, M., Yeo, G., Harney, D., Denny, P., & Denyer, G. (2021). Selecting student-authored questions for summative assessments. Research in Learning Technology, 29.
[18]
Lahza, H., Khosravi, H., Demartini, G., & Gasevic, D. (2022, March). Effects of Technological Interventions for Self-regulation: A Control Experiment in Learnersourcing. In LAK22: 12th International Learning Analytics and Knowledge Conference (pp. 542--548).
[19]
Moore, S., Nguyen, H. A., & Stamper, J. (2020, July). Evaluating Crowdsourcing and Topic Modeling in Generating Knowledge Components from Explanations. In International Conference on Artificial Intelligence in Education (pp. 398--410). Springer, Cham.
[20]
Moore, S., Nguyen, H., & Stamper, J. (2020). Evaluating Crowdsourcing and Topic Modeling in Generating Knowledge Components from Explanations. Artificial Intelligence in Education, 12163, 398 - 410.
[21]
Darvishi A, Khosravi K, Abdi S, Sadiq S, and Gasevic D. (2022) Incorporating Training, Self-monitoring and AI-Assistance to Improve Peer Feedback Quality. In Proceedings of the Ninth ACM Conference on Learning @ Scale
[22]
Darvishi, A., Khosravi, H., & Sadiq, S. (2021, June). Employing peer review to evaluate the quality of student generated content at scale: A trust propagation approach. In Proceedings of the Eighth ACM Conference on Learning@ Scale (pp. 139--150).
[23]
Ni, L., Bao, Q., Li, X., Qi, Q., Denny, P., Warren, J., Witbrock, M., Liu, J. (2022). DeepQR: Neural-based Quality Ratings for Learnersourced Multiple-Choice Questions. The 12th Symposium on Educational Advances in Artificial Intelligence (pp. 1--9).
[24]
Gyamfi, G., Hanna, B., & Khosravi, H. (2021). Supporting peer evaluation of student-generated content: a study of three approaches. Assessment & Evaluation in Higher Education, 1--19.
[25]
Denny, P., Hamer, J., Luxton-Reilly, A., & Purchase, H. (2008, September). PeerWise: students sharing their multiple choice questions. In Proceedings of the fourth international workshop on computing education research (pp. 51--58).
[26]
Denny, P., Luxton-Reilly, A., & Hamer, J. (2008, January). The PeerWise system of student contributed assessment questions. In Proceedings of the tenth conference on Australasian computing education-Volume 78 (pp. 69--74).

Cited By

View all
  • (2024)Learnersourcing: Student-generated Content @ Scale: 2nd Annual WorkshopProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664643(559-562)Online publication date: 9-Jul-2024
  • (2024)Evaluating the quality of student-generated content in learnersourcing: A large language model based approachEducation and Information Technologies10.1007/s10639-024-12851-4Online publication date: 17-Jul-2024
  • (2023)Crowdsourcing the Evaluation of Multiple-Choice Questions Using Item-Writing Flaws and Bloom's TaxonomyProceedings of the Tenth ACM Conference on Learning @ Scale10.1145/3573051.3593396(25-34)Online publication date: 20-Jul-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
L@S '22: Proceedings of the Ninth ACM Conference on Learning @ Scale
June 2022
491 pages
ISBN:9781450391580
DOI:10.1145/3491140
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. assessment
  2. learnersourcing
  3. multiple-choice question
  4. question creation
  5. student learning
  6. student-generated content

Qualifiers

  • Short-paper

Conference

L@S '22
L@S '22: Ninth (2022) ACM Conference on Learning @ Scale
June 1 - 3, 2022
NY, New York City, USA

Acceptance Rates

Overall Acceptance Rate 117 of 440 submissions, 27%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)187
  • Downloads (Last 6 weeks)24
Reflects downloads up to 15 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Learnersourcing: Student-generated Content @ Scale: 2nd Annual WorkshopProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664643(559-562)Online publication date: 9-Jul-2024
  • (2024)Evaluating the quality of student-generated content in learnersourcing: A large language model based approachEducation and Information Technologies10.1007/s10639-024-12851-4Online publication date: 17-Jul-2024
  • (2023)Crowdsourcing the Evaluation of Multiple-Choice Questions Using Item-Writing Flaws and Bloom's TaxonomyProceedings of the Tenth ACM Conference on Learning @ Scale10.1145/3573051.3593396(25-34)Online publication date: 20-Jul-2023
  • (2023)Empowering Education with LLMs - The Next-Gen Interface and Content GenerationArtificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky10.1007/978-3-031-36336-8_4(32-37)Online publication date: 30-Jun-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media