[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Modeling learner’s dynamic knowledge construction procedure and cognitive item difficulty for knowledge tracing

Published: 01 November 2020 Publication History

Abstract

Knowledge tracing (KT) is essential for adaptive learning to obtain learners’ current states of knowledge for the purpose of providing adaptive service. Generally, the knowledge construction procedure is constantly evolving because students dynamically learn and forget over time. Unfortunately, to the best of our knowledge most existing approaches consider only a fragment of the information that relates to learning or forgetting, and the problem of making use of rich information during learners’ learning interactions to achieve more precise prediction of learner performance in KT remains under-explored. Moreover, existing work either neglects the problem difficulty or assumes that it is constant, and this is unrealistic in the actual learning process as problem difficulty affects performance undoubtedly and also varies overtime in terms of the cognitive challenge it presents to individual learners. To this end, we herein propose a novel model, KTM-DLF (Knowledge Tracing Machine by modeling cognitive item Difficulty and Learning and Forgetting), to trace the evolution of each learner’s knowledge acquisition during exercise activities by modeling his or her dynamic knowledge construction procedure and cognitive item difficulty. Specifically, we first specify the concept of cognitive item difficulty and propose a method to model the cognitive item difficulty adaptively based on learners’ learning histories. Then, based on two classical theories (the learning curve theory and the Ebbinghaus forgetting curve theory), we propose a method for modeling learners’ learning and forgetting over time. Finally, the KTM-DLF model is proposed to incorporate learners’ abilities, the cognitive item difficulty, and the two dynamic procedures (learning and forgetting) together. We then use the factorization machine framework to embed features in high dimensions and model pairwise interactions to increase the model’s accuracy. Extensive experiments have been conducted on three public real-world datasets, and the results confirm that our proposed model outperforms the other state-of-the-art educational data mining models.

References

[1]
Abdelrahman G, Wang Q (2019) Knowledge tracing with sequential key-value memory networks. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, NY, USA, pp 175–184
[2]
Adamopoulos P (2013) What makes a great mooc? an interdisciplinary analysis of student retention in online courses. In: Proceedings of the 34th International Conference on Information Systems, pp. 1–21. Association for Information Systems
[3]
Adler PS and Clark KB Behind the learning curve: a sketch of the learning process Manag Sci 1991 37 3 267-281
[4]
Ai F, Chen Y, Guo Y, Zhao Y, Wang Z, Fu G, Wang G (2019) Concept-aware deep knowledge tracing and exercise recommendation in an online learning system. In: Proceedings of The 12th International Conference on Educational Data Mining, pp. 240–245
[5]
Anderson JR, Corbett AT, Koedinger KR, and Pelletier R Cognitive tutors: Lessons learned The journal of the learning sciences 1995 4 2 167-207
[6]
d Baker RS, Corbett AT, Aleven V (2008) More accurate student modeling through contextual estimation of slip and guess probabilities in bayesian knowledge tracing. In: International conference on intelligent tutoring systems, pp 406-415, Springer, Berlin, Heidelberg
[7]
Cen H, Koedinger K, Junker B (2006) Learning factors analysis–a general method for cognitive model evaluation and improvement. In: Ikeda M, Ashley KD, Chan TW (eds) Intelligent tutoring systems, ITS 2006, pp 164-175, Springer, Berlin, Heidelberg
[8]
Chen Y, Liu Q, Huang Z, Wu L, Chen E, Wu R, Su Y, Hu G (2017) Tracking knowledge proficiency of students with educational priors. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 989–998. ACM
[9]
Choffin B, Popineau F, Bourda Y, Vie JJ (2019) DAS3h: Modeling student learning and forgetting for optimally scheduling distributed practice of skills. In: Proceedings of the 12th International Conference on Educational Data Mining (EDM), pp. 29–38
[10]
Corbett AT and Anderson JR Knowledge tracing: Modeling the acquisition of procedural knowledge User modeling and user-adapted interaction 1994 4 4 253-278
[11]
Daroczy G, Wolska M, Meurers WD, and Nuerk HC Word problems: a review of linguistic and numerical factors contributing to their difficulty Frontiers in psychology 2015 6 348
[12]
De La Torre JDina model and parameter estimation: a didacticJournal of educational and behavioral statistics2009341115-1301658188
[13]
Delacre M, Lakens D, and Leys C Why psychologists should by default use welch’s t-test instead of student’s t-test International Review of Social Psychology 2017 30 1 92-101
[14]
Desmarais MC and Baker RS A review of recent advances in learner and skill modeling in intelligent learning environments User Model User-Adap Inter 2012 22 9-38
[15]
Ebbinghaus H Memory: a contribution to experimental psychology Annals of neurosciences 2013 20 4 155-156
[16]
Feng M, Heffernan N, and Koedinger K Addressing the assessment challenge with an online system that tutors as it assesses User Model User-Adap Inter 2009 19 3 243-266
[17]
Gan W, Sun Y, Ye S, Fan Y, Sun Y (2019) Field-aware knowledge tracing machine by modelling students’ dynamic learning procedure and item difficulty. In: 2019 International conference on data mining workshops (ICDMW), pp. 1045–1046. IEEE
[18]
Gan W, Sun Y, Ye S, Fan Y, Sun Y (2019) AI-tutor: Generating tailored remedial questions and answers based on cognitive diagnostic assessment. In: 2019 6Th international conference on behavioral, economic and socio-cultural computing (BESC), pp. 1–6. IEEE
[19]
Ha H, Hwang U, Hong Y, Yoon S (2018) Memory-augmented neural networks for knowledge tracing from the perspective of learning and forgetting. arXiv:1805.10768
[20]
Huang Z, Yin Y, Chen E, Xiong H, Su Y, Hu G, et al. (2019) EKT: Exercise-aware knowledge tracing for student performance prediction. IEEE Trans Knowl Data Eng, pp 1
[21]
Khajah M, Lindsey RV, Mozer MC (2016) How deep is knowledge tracing?. In: Proceedings of the 9th International Conference on Educational Data Mining, pp. 94–101
[22]
Koedinger KR, Brunskill E, Baker RS, McLaughlin EA, and Stamper J New potentials for data-driven intelligent tutoring system development and optimization AI Magazine 2013 34 3 27-41
[23]
Kotovsky K, Hayes JR, and Simon HA Why are some problems hard? evidence from tower of hanoi Cognitive psychology 1985 17 2 248-294
[24]
Kotovsky K and Simon HA What makes some problems really hard: Explorations in the problem space of difficulty Cognitive psychology 1990 22 2 143-183
[25]
Kubinger KD and Gottschall CH Item difficulty of multiple choice tests dependant on different item response formats–an experiment in fundamental research on psychological assessment Psychology science 2007 49 4 361-374
[26]
Lindsey RV, Shroyer JD, Pashler H, and Mozer MC Improving students’ long-term knowledge retention through personalized review Psychological science 2014 25 3 639-647
[27]
Liu Q, Wu R, Chen E, Xu G, Su Y, Chen Z, and Hu G Fuzzy cognitive diagnosis for modelling examinee performance ACM Transactions on Intelligent Systems and Technology 2018 9 4 1-26
[28]
Minn S, Yu Y, Desmarais MC, Zhu F, Vie JJ (2018) Deep knowledge tracing and dynamic student classification for knowledge tracing. In: 2018 IEEE International conference on data mining (ICDM), pp. 1182–1187. IEEE
[29]
Minn S, Zhu F, Desmarais MC (2018) Improving knowledge tracing model by integrating problem difficulty. In: 2018 IEEE International conference on data mining workshops (ICDMW), pp. 1505–1506. IEEE
[30]
Nagatani K, Zhang Q, Sato M, Chen YY, Chen F, Ohkuma T (2019) Augmenting knowledge tracing by considering forgetting behavior. In: The world wide web conference, pp. 3101–3107. ACM
[31]
Pardos ZA, Bergner Y, Seaton DT, Pritchard DE (2013) Adapting bayesian knowledge tracing to a massive open online course in edx. In: Proceedings of the 6th Annual International Conference on Educational Data Mining, pp. 137–144
[32]
Pardos ZA, Heffernan NT (2011) KT-IDEM: introducing item difficulty to the knowledge tracing model. In: International conference on user modeling, adaptation, and personalization, pp. 243–254. Springer
[33]
Pavlik PI, Cen H, Koedinger KR (2009) Performance factors analysis–a new alternative to knowledge tracing, pp 531–538
[34]
Piech C, Bassen J, Huang J, Ganguli S, Sahami M, Guibas LJ, Sohl-Dickstein J (2015) Deep knowledge tracing. In: Advances in neural information processing systems, pp. 505–513
[35]
Rasch G (1960) Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests Nielsen & Lydiche
[36]
Rathore AS, Arjaria SK (2020) Intelligent tutoring system. In: Utilizing educational data mining techniques for improved learning: emerging research and opportunities, pp. 121–144. IGI global
[37]
Reckase MD and McKinley RL The discriminating power of items that measure more than one dimension Applied psychological measurement 1991 15 4 361-373
[38]
Rendle S (2010) Factorization machines. In: 2010 IEEE International conference on data mining, pp. 995–1000. IEEE
[39]
Rendle S Factorization machines with libfm ACM Transactions on Intelligent Systems and Technology 2012 3 3 57
[40]
Saranti A, Taraghi B, Ebner M, Holzinger A (2019) Insights into learning competence through probabilistic graphical models. In: International cross-domain conference for machine learning and knowledge extraction, pp. 250–271. Springer
[41]
Settles B, Meeder B (2016) A trainable spaced repetition model for language learning. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1848–1858
[42]
Stamper J, Niculescu-Mizil A, Ritter S, Gordon G, Koedinger K (2010) Algebra i 2005-2006 and bridge to algebra 2006-2007. challenge data set from kdd cup 2010 educational data mining challenge. Find it at, http://pslcdatashop.web.cmu.edu/KDDCup/downloads.jsp
[43]
Sun Y, Ye S, Inoue S, Sun Y (2014) Alternating recursive method for q-matrix learning. In: Proceedings of the 7th International Conference on Educational Data Mining, pp. 14–20
[44]
Thai-Nghe N, Schmidt-Thieme L (2015) Multi-relational factorization models for student modeling in intelligent tutoring systems. In: 2015 Seventh international conference on knowledge and systems engineering (KSE), pp. 61–66. IEEE
[45]
Vie JJ, Kashima H (2019) Knowledge tracing machines: Factorization machines for knowledge tracing. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 750–757
[46]
Wang X, Berger JO, Burdick DS, et al.Bayesian analysis of dynamic item response models in educational testingThe Annals of Applied Statistics201371126-153308641306171266
[47]
Wang Z, Feng X, Tang J, Huang GY, Liu Z (2019) Deep knowledge tracing with side information. In: International conference on artificial intelligence in education, pp. 303–308. Springer
[48]
Wang Z, Zhu J, Li X, Hu Z, Zhang M (2016) Structured knowledge tracing models for student assessment on coursera. In: Proceedings of the Third ACM Conference on Learning at Scale, pp. 209–212. ACM
[49]
Wilson KH, Karklin Y, Han B, Ekanadham C (2016) Back to the basics: Bayesian extensions of irt outperform neural networks for proficiency estimation. In: Proceedings of the 9th International Conference on Educational Data Mining, pp. 539–544
[50]
Wilson KH, Xiong X, Khajah M, Lindsey RV, Zhao S, Karklin Y, Van Inwegen EG, Han B, Ekanadham C, Beck JE, et al. (2016) Estimating student proficiency: Deep learning is not the panacea. In: In 30th conference on neural information processing systems, workshop on machine learning for education, pp. 1–8
[51]
Yeung CK (2019) Deep-IRT,: Make deep learning based knowledge tracing explainable using item response theory. arXiv:1904.11738
[52]
Zhang J, Huang T, Zhang Z (2019) FAT-DeepFFM,: Field attentive deep field-aware factorization machine. arXiv:1905.06336
[53]
Zhang J, Shi X, King I, Yeung DY (2017) Dynamic key-value memory networks for knowledge tracing. In: Proceedings of the 26th international conference on World Wide Web, pp. 765–774. International World Wide Web Conferences Steering Committee

Cited By

View all
  • (2024)Enhancing Knowledge Tracing Efficacy with Expert-defined Graphs: A Case Study in Introductory Physics ClassesProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664683(433-437)Online publication date: 9-Jul-2024
  • (2024)The Sequence Matters in Learning - A Systematic Literature ReviewProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636880(263-272)Online publication date: 18-Mar-2024
  • (2024)Hybrid Models for Knowledge Tracing: A Systematic Literature ReviewIEEE Transactions on Learning Technologies10.1109/TLT.2023.334869017(1021-1036)Online publication date: 1-Jan-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Applied Intelligence
Applied Intelligence  Volume 50, Issue 11
Nov 2020
610 pages

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 November 2020

Author Tags

  1. Knowledge tracing
  2. Learner modeling
  3. Knowledge construction procedure
  4. Cognitive item difficulty
  5. Learning and forgetting

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 13 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Enhancing Knowledge Tracing Efficacy with Expert-defined Graphs: A Case Study in Introductory Physics ClassesProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664683(433-437)Online publication date: 9-Jul-2024
  • (2024)The Sequence Matters in Learning - A Systematic Literature ReviewProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636880(263-272)Online publication date: 18-Mar-2024
  • (2024)Hybrid Models for Knowledge Tracing: A Systematic Literature ReviewIEEE Transactions on Learning Technologies10.1109/TLT.2023.334869017(1021-1036)Online publication date: 1-Jan-2024
  • (2024)Meta-path structured graph pre-training for improving knowledge tracing in intelligent tutoringExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124451254:COnline publication date: 18-Oct-2024
  • (2023)Procedural Driving Skill Coaching from More Skilled Drivers to Safer Drivers: A SurveyProceedings of the 4th ACM Workshop on Intelligent Cross-Data Analysis and Retrieval10.1145/3592571.3592973(10-18)Online publication date: 12-Jun-2023
  • (2022)Building an Open Sharing Platform for ELT CoursesAdvances in Multimedia10.1155/2022/87935212022Online publication date: 1-Jan-2022
  • (2022)Knowledge Tracing: A SurveyACM Computing Surveys10.1145/356957655:11(1-37)Online publication date: 26-Oct-2022
  • (2022)IoT-based Multimodal Analysis for Smart Education: Current Status, Challenges and OpportunitiesProceedings of the 3rd ACM Workshop on Intelligent Cross-Data Analysis and Retrieval10.1145/3512731.3534208(32-40)Online publication date: 27-Jun-2022
  • (2022)Knowledge-Enhanced Multi-task Learning for Course RecommendationDatabase Systems for Advanced Applications10.1007/978-3-031-00126-0_6(85-101)Online publication date: 11-Apr-2022
  • (2021)Knowledge structure enhanced graph representation learning model for attentive knowledge tracingInternational Journal of Intelligent Systems10.1002/int.2276337:3(2012-2045)Online publication date: 24-Nov-2021

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media