[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3583780.3614822acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article
Public Access

Continuous Personalized Knowledge Tracing: Modeling Long-Term Learning in Online Environments

Published: 21 October 2023 Publication History

Abstract

With the advance of online education systems, accessibility to learning materials has increased. In these systems, students can practice independently and learn from different learning materials over long periods of time. As a result, it is essential to trace students' knowledge states over long learning sequences while maintaining a personalized model of each individual student's progress. However, the existing deep learning-based knowledge tracing models are either not personalized or not tailored for handling long sequences. Handling long sequences are especially essential in the online education environments, in where models are preferred to be updated with the newly collected user data in a timely manner as students could acquire knowledge on each learning activity. In this paper, we propose a knowledge tracing model, Continuous Personalized Knowledge Tracing (CPKT), that can mimic the real-world long-term continuous learning scenario by incorporating a novel online model training paradigm that is suitable for the knowledge tracing problem. To achieve personalized knowledge tracing, we propose two model components: 1) personalized memory slots to maintain learner's knowledge in a lifelong manner, and 2) personalized user embeddings that help to accurately predict the individual responses, correctly detect the personalized knowledge acquisition and forgetting patterns, and better interpret and analyze the learner's progress. Additionally, we propose transition-aware stochastic shared embedding according to the learning transition matrix to regularize the online model training. Extensive experiments on four real-world datasets showcase the effectiveness and superiority of CPKT, especially for students with longer sequences.

References

[1]
Mahdi Abavisani, Liwei Wu, Shengli Hu, Joel Tetreault, and Alejandro Jaimes. 2020. Multimodal Categorization of Crisis Events in Social Media. In Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 14679--14689.
[2]
Juan Miguel L Andres, Ryan S Baker, George Siemens, Dragan Gavs ević, and Catherine A Spann. 2016. Replicating 21 Findings on Student Success in Online Learning. Technology, Instruction, Cognition, and Learning, Vol. 10, 4 (2016), 313--333.
[3]
Hao Cen, Kenneth Koedinger, and Brian Junker. 2006. Learning Factors Analysis--a General Method for Cognitive Model Evaluation and Improvement. In Proceedings of the 8th International Conference on Intelligent Tutoring Systems. Springer, 164--175.
[4]
Min Chi, Kenneth R Koedinger, Geoffrey J Gordon, Pamela W Jordan, and Kurt VanLehn. 2011. Instructional Factors Analysis: A Cognitive Model For Multiple Instructional Interventions. Proceedings of the 12th International Conference on Educational Data Mining, Vol. 2011 (2011), 61--70.
[5]
Beno^it Choffin, Fabrice Popineau, Yolaine Bourda, and Jill-Jênn Vie. 2019. DAS3H: Modeling Student Learning and Forgetting for Optimally Scheduling Distributed Practice of Skills. arXiv preprint arXiv:1905.06873 (2019).
[6]
Youngduck Choi, Youngnam Lee, Junghyun Cho, Jineon Baek, Byungsoo Kim, Yeongmin Cha, Dongmin Shin, Chan Bae, and Jaewe Heo. 2020. Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracing. In Proceedings of the 7th ACM Conference on Learning@ Scale. 341--344.
[7]
Albert T Corbett and John R Anderson. 1994. Knowledge Tracing: Modeling the Acquisition of Procedural Knowledge. User Modeling and User-Adapted Interaction, Vol. 4, 4 (1994), 253--278.
[8]
Theophile Gervet, Ken Koedinger, Jeff Schneider, Tom Mitchell, et al. 2020. When is Deep Learning the Best Approach to Knowledge Tracing? Journal of Educational Data Mining, Vol. 12, 3 (2020), 31--54.
[9]
Aritra Ghosh, Neil Heffernan, and Andrew S Lan. 2020. Context-Aware Attentive Knowledge Tracing. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2330--2339.
[10]
Wang-Cheng Kang and Julian McAuley. 2018. Self-Attentive Sequential Recommendation. In Proceedings of 2018 IEEE International Conference on Data Mining. IEEE, 197--206.
[11]
Mohammad M Khajah, Yun Huang, José P González-Brenes, Michael C Mozer, and Peter Brusilovsky. 2014. Integrating Knowledge Tracing and Item Response Theory: A Tale of Two Frameworks. In CEUR Workshop proceedings, Vol. 1181. University of Pittsburgh, 7--15.
[12]
Andrew S Lan, Andrew E Waters, Christoph Studer, and Richard G Baraniuk. 2013. Sparse Factor Analysis for Learning and Content Analytics. arXiv preprint arXiv:1303.5685 (2013).
[13]
Jung In Lee and Emma Brunskill. 2012. The Impact on Individualizing Student Models on Necessary Practice Opportunities. International Educational Data Mining Society (2012).
[14]
Robert V Lindsey, Jeffery D Shroyer, Harold Pashler, and Michael C Mozer. 2014. Improving Students' Long-Term Knowledge Retention Through Personalized Review. Psychological Science, Vol. 25, 3 (2014), 639--647.
[15]
Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, and Guoping Hu. 2019. EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction. IEEE Transactions on Knowledge and Data Engineering, Vol. 33, 1 (2019), 100--115.
[16]
Ting Long, Yunfei Liu, Jian Shen, Weinan Zhang, and Yong Yu. 2021. Tracing Knowledge State with Individual Cognition and Acquisition Estimation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 173--182.
[17]
Frederic M Lord. 2012. Applications of Item Response Theory to Practical Testing Problems. Routledge.
[18]
Shalini Pandey and George Karypis. 2019. A Self-Attentive Model for Knowledge Tracing. In Proceedings of the 12th International Conference on Educational Data Mining, Collin F. Lynch, Agathe Merceron, Michel Desmarais, and Roger Nkambou (Eds.). International Educational Data Mining Society, 384--389.
[19]
Shalini Pandey and Jaideep Srivastava. 2020. RKT: relation-aware self-attention for knowledge tracing. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1205--1214.
[20]
Zachary A Pardos and Neil T Heffernan. 2010. Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing. In Proceedings of the 18th International Conference on User Modeling, Adaptation, and Personalization. Springer, 255--266.
[21]
Philip I Pavlik Jr, Hao Cen, and Kenneth R Koedinger. 2009. Performance Factors Analysis--A New Alternative to Knowledge Tracing. Proceedings of the 2009 Conference on Artificial Intelligence in Education (2009).
[22]
Radek Pelánek, Jir'i Rihák, and Jan Papouvs ek. 2016. Impact of Data Collection on Interpretation and Evaluation of Student Models. In Proceedings of the 6th International Conference on Learning Analytics & Knowledge. 40--47.
[23]
Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. 2015. Deep Knowledge Tracing. Advances in Neural Information Processing Systems, Vol. 28 (2015).
[24]
Shai Shalev-Shwartz et al. 2012. Online Learning and Online Convex Optimization. Foundations and Trends® in Machine Learning, Vol. 4, 2 (2012), 107--194.
[25]
Shuanghong Shen, Qi Liu, Enhong Chen, Zhenya Huang, Wei Huang, Yu Yin, Yu Su, and Shijin Wang. 2021. Learning process-consistent knowledge tracing. In Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining. 1452--1460.
[26]
Shuanghong Shen, Qi Liu, Enhong Chen, Han Wu, Zhenya Huang, Weihao Zhao, Yu Su, Haiping Ma, and Shijin Wang. 2020. Convolutional Knowledge Tracing: Modeling Individualization in Student Learning Process. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1857--1860.
[27]
Nguyen Thai-Nghe, Lucas Drumond, Tomávs Horváth, Artus Krohn-Grimberghe, Alexandros Nanopoulos, and Lars Schmidt-Thieme. 2012. Factorization Techniques for Predicting Student Performance. In Educational Recommender Systems and Technologies: Practices and Challenges. IGI Global, 129--153.
[28]
Jill-Jênn Vie and Hisashi Kashima. 2019. Knowledge Tracing Machines: Factorization Machines for Knowledge Tracing. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 750--757.
[29]
Chunpai Wang, Shaghayegh Sahebi, Siqian Zhao, Peter Brusilovsky, and Laura O Moraes. 2021a. Knowledge Tracing for Complex Problem Solving: Granular Rank-Based Tensor Factorization. In Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization. 179--188.
[30]
Chunpai Wang, Siqian Zhao, and Shaghayegh Sahebi. 2021b. Learning from Non-Assessed Resources: Deep Multi-Type Knowledge Tracing. International Educational Data Mining Society (2021).
[31]
Liwei Wu, Shuqing Li, Cho-Jui Hsieh, and James Sharpnack. 2020. SSE-PT: Sequential Recommendation via Personalized Transformer. In Proceedings of the 14th ACM Conference on Recommender Systems. 328--337.
[32]
Liwei Wu, Shuqing Li, Cho-Jui Hsieh, and James L Sharpnack. 2019. Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers. Advances in Neural Information Processing Systems, Vol. 32 (2019).
[33]
Michael V Yudelson, Kenneth R Koedinger, and Geoffrey J Gordon. 2013. Individualized Bayesian Knowledge Tracing Models. In Proceedings of the 16th International Conference on Artificial Intelligence in Education. Springer, 171--180.
[34]
Jiani Zhang, Xingjian Shi, Irwin King, and Dit-Yan Yeung. 2017. Dynamic Key-Value Memory Networks for Knowledge Tracing. In Proceedings of the 26th International Conference on World Wide Web (Perth, Australia) (WWW '17). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 765--774. https://doi.org/10.1145/3038912.3052580
[35]
Moyu Zhang, Xinning Zhu, Chunhong Zhang, Yang Ji, Feng Pan, and Changchuan Yin. 2021. Multi-factors aware dual-attentional knowledge tracing. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2588--2597.
[36]
Wenxin Zhang, Yupei Zhang, Shuhui Liu, and Xuequn Shang. 2022. Online Deep Knowledge Tracing. In 2022 IEEE International Conference on Data Mining Workshops (ICDMW). IEEE, 292--297.
[37]
Siqian Zhao, Chunpai Wang, and Shaghayegh Sahebi. 2020. Modeling Knowledge Acquisition from Multiple Learning Resource Types. In Proceedings of The 13th International Conference on Educational Data Mining. 313--324.
[38]
Siqian Zhao, Chunpai Wang, and Shaghayegh Sahebi. 2022. Transition-Aware Multi-Activity Knowledge Tracing. In 2022 IEEE International Conference on Big Data (Big Data). IEEE, 1760--1769.

Cited By

View all
  • (2024)Multi-Task Modeling of Student Knowledge and BehaviorProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679823(3363-3373)Online publication date: 21-Oct-2024
  • (2024)Coding Buddy: An Adaptive AI-Powered Platform for Personalized Learning2024 International Symposium on Networks, Computers and Communications (ISNCC)10.1109/ISNCC62547.2024.10759044(1-6)Online publication date: 22-Oct-2024
  • (2024)Knowledge ontology enhanced model for explainable knowledge tracingJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2024.10206536:5Online publication date: 24-Jul-2024
  • Show More Cited By

Index Terms

  1. Continuous Personalized Knowledge Tracing: Modeling Long-Term Learning in Online Environments

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
      October 2023
      5508 pages
      ISBN:9798400701245
      DOI:10.1145/3583780
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 October 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. intelligent education
      2. knowledge tracing
      3. learner modeling
      4. online learning
      5. personalization

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      CIKM '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

      Upcoming Conference

      CIKM '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)229
      • Downloads (Last 6 weeks)37
      Reflects downloads up to 13 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Multi-Task Modeling of Student Knowledge and BehaviorProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679823(3363-3373)Online publication date: 21-Oct-2024
      • (2024)Coding Buddy: An Adaptive AI-Powered Platform for Personalized Learning2024 International Symposium on Networks, Computers and Communications (ISNCC)10.1109/ISNCC62547.2024.10759044(1-6)Online publication date: 22-Oct-2024
      • (2024)Knowledge ontology enhanced model for explainable knowledge tracingJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2024.10206536:5Online publication date: 24-Jul-2024
      • (2024)Enhanced Dynamic Key-Value Memory Networks for Personalized Student Modeling and Learning Ability ClassificationCognitive Computation10.1007/s12559-024-10341-w16:6(2878-2901)Online publication date: 27-Aug-2024

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media