[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Reinforced Explainable Knowledge Concept Recommendation in MOOCs

Published: 01 April 2023 Publication History

Abstract

In this article, we study knowledge concept recommendation in Massive Open Online Courses (MOOCs) in an explainable manner. Knowledge concepts, composing course units (e.g., videos) in MOOCs, refer to topics and skills that students are expected to master. Compared to traditional course recommendation in MOOCs, knowledge concepts recommendation has drawn more attention because students’ interests over knowledge concepts can better revealstudents’ real intention in a more refined granularity. However, there are three unique challenges in knowledge concept recommendation: (1) How to design an appropriate data structure to capture complex relationships between knowledge concepts, course units, and other participants (e.g., students, teachers)? (2) How to model interactions between students and knowledge concepts? (3) How to make explainable recommendation results to students? To tackle these challenges, we formulate the knowledge concept recommendation as a reinforcement learning task integrated with MOOC knowledge graph (KG). Specifically, we first construct MOOC KG as the environment to capture all the relationships and behavioral histories by considering all the entities (e.g., students, teachers, videos, courses, and knowledge concepts) on the MOOC provider. Then, to model the interactions between students and knowledge concepts, we train an agent to mimic students’ learning behavioral patterns facing the complex environment. Moreover, to provide explainable recommendation results, we generate recommended knowledge concepts in the format of a path from MOOC KG to indicate semantic reasons. Finally, we conduct extensive experiments on a real-world MOOC dataset to demonstrate the effectiveness of our proposed method.

References

[1]
Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering 17, 6 (2005), 734–749.
[2]
Mashael A. Al-Barrak and Muna Al-Razgan. 2016. Predicting students final GPA using decision trees: A case study. International Journal of Information and Education Technology 6, 7 (2016), 528.
[3]
Hana Bydžovská. 2015. Are collaborative filtering methods suitable for student performance prediction? In Portuguese Conference on Artificial Intelligence. Springer, 425–430.
[4]
Yixin Cao, Xiang Wang, Xiangnan He, Zikun Hu, and Tat-Seng Chua. 2019. Unifying knowledge graph learning and recommendation: Towards a better understanding of user preferences. In The World Wide Web Conference (WWW’19). 151–161.
[5]
Chong Chen, Min Zhang, Weizhi Ma, Yiqun Liu, and Shaoping Ma. 2020. Jointly non-sampling learning for knowledge graph enhanced recommendation. In The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’20). 189–198.
[6]
Hui Chen, Chuantao Yin, Xin Fan, Lei Qiao, Wenge Rong, and Zhang Xiong. 2021. Learning path recommendation for MOOC platforms based on a knowledge graph. In Knowledge Science, Engineering and Management - 14th International Conference (KSEM’21), Proceedings, Part II (Lecture Notes in Computer Science), Vol. 12816. Springer, 600–611.
[7]
Hui Chen, Chuantao Yin, Rumei Li, Wenge Rong, Zhang Xiong, and Bertrand David. 2020. Enhanced learning resource recommendation based on online learning style model. Tsinghua Science and Technology 25, 3 (2020), 348–356.
[8]
Jiejiang Chen, Shaowei Cai, Yiyuan Wang, Wenhao Xu, Jia Ji, and Minghao Yin. 2023. Improved local search for the minimum weight dominating set problem in massive graphs by using a deep optimization mechanism. Artificial Intelligence 314 (2023), 103819.
[9]
Asmaa Elbadrawy, R. Scott Studham, and George Karypis. 2015. Collaborative multi-regression models for predicting students’ performance in course activities. In Proceedings of the 5th International Conference on Learning Analytics and Knowledge. 103–107.
[10]
Wei Fan, Kunpeng Liu, Hao Liu, Pengyang Wang, Yong Ge, and Yanjie Fu. 2020. AutoFS: Automated feature selection via diversity-aware interactive reinforcement learning. In The IEEE International Conference on Data Mining (ICDM’20). 1008–1013.
[11]
Jibing Gong, Shen Wang, Jinlong Wang, Wenzheng Feng, Hao Peng, Jie Tang, and Philip S. Yu. 2020. Attentional graph convolutional networks for knowledge concept recommendation in MOOCs in a heterogeneous view. In The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’20), 79–88.
[12]
Niannian Guan, Dandan Song, and Lejian Liao. 2019. Knowledge graph embedding with concepts. Knowl. Based Syst. 164 (2019), 38–44.
[13]
Tao Gui, Peng Liu, Qi Zhang, Liang Zhu, Minlong Peng, Yunhua Zhou, and Xuanjing Huang. 2019. Mention recommendation in Twitter with cooperative multi-agent reinforcement learning. In The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). 535–544.
[14]
Qian Hu and Huzefa Rangwala. 2018. Course-specific Markovian models for grade prediction. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 29–41.
[15]
Qian Hu and Huzefa Rangwala. 2019. Reliable deep grade prediction with uncertainty estimation. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge. 76–85.
[16]
Lu Jiang, Pengyang Wang, Ke Cheng, Kunpeng Liu, Minghao Yin, Bo Jin, and Yanjie Fu. 2021. EduHawkes: A neural Hawkes process approach for online study behavior modeling. In SIAM International Conference on Data Mining (SDM’21). 567–575.
[17]
Lu Jiang, Yuqi Wang, Shasha Xie, Jun Wu, Minghao Yin, and Jianan Wang. 2022. Which courses to choose? Recommending courses to groups of students in online tutoring platforms. Applied Intelligence (2022), 1–10.
[18]
Lu Jiang, Wanfei Zhang, Yibin Wang, Na Luo, and Lin Yue. 2022. Augmenting personalized question recommendation with hierarchical information for online test platform. Advanced Data Mining and Applications - 17th International Conference (ADMA) 13087 (2022), 103–117.
[19]
H. Jin, W. X. Zhao, H. Dou, J. R. Wen, and E. Y. Chang. 2018. Improving sequential recommendation with knowledge-enhanced memory networks. In The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’18). 505–514.
[20]
Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In 5th International Conference on Learning Representations (ICLR’17), Conference Track Proceedings. OpenReview.net.
[21]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37.
[22]
Jing Li and Zhou Ye. 2020. Course recommendations in online education based on collaborative filtering recommendation algorithm. Complex. 2020 (2020), 6619249:1–6619249:10.
[23]
Feng Liu, Ruiming Tang, Xutao Li, Yunming Ye, Haokun Chen, Huifeng Guo, and Yuzhou Zhang. 2018. Deep reinforcement learning based recommendation with explicit user-item interactions modeling. CoRR/arXiv (2018).
[24]
Kunpeng Liu, Yanjie Fu, Pengfei Wang, Le Wu, Rui Bo, and Xiaolin Li. 2019. Automating feature subspace exploration via multi-agent reinforcement learning. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). 207–215.
[25]
Kunpeng Liu, Pengyang Wang, Jiawei Zhang, Yanjie Fu, and Sajal K. Das. 2018. Modeling the interaction coupling of multi-view spatiotemporal contexts for destination prediction. In Proceedings of the 2018 SIAM International Conference on Data Mining. SIAM, 171–179.
[26]
Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, and Guoping Hu. 2019. Ekt: Exercise-aware knowledge tracing for student performance prediction. IEEE Trans. Knowl. Data Eng. 33, 1 (2019), 100–115.
[27]
S. Pandey, A. Lan, G. Karypis, and J. Srivastava. 2021. Learning student interest trajectory for MOOC thread recommendation. International Conference on Data Mining Workshops. 400–407.
[28]
Agoritsa Polyzou and George Karypis. 2016. Grade prediction with models specific to students and courses. International Journal of Data Science and Analytics 2, 3–4 (2016), 159–171.
[29]
Jiezhong Qiu, Jie Tang, Tracy Xiao Liu, Jie Gong, Chenhui Zhang, Qian Zhang, and Yufei Xue. 2016. Modeling and predicting learning behavior in MOOCs. In ACM International Conference on Web Search and Data Mining (WSDM’16). 93–102.
[30]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In The Conference on Uncertainty in Artificial Intelligence (UAI’09). 452–461.
[31]
Ruslan Salakhutdinov and Andriy Mnih. 2008. Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In International Conference on Machine Learning (ICML’08). 880–887.
[32]
Badrul Munir Sarwar, George Karypis, Joseph A. Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In The World Wide Web Conference (WWW’01). 285–295.
[33]
Shuanghong Shen, Qi Liu, Enhong Chen, Han Wu, Zhenya Huang, Weihao Zhao, Yu Su, Haiping Ma, and Shijin Wang. 2020. Convolutional knowledge tracing: Modeling individualization in student learning process. In The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’20). 1857–1860.
[34]
Chuan Shi, Binbin Hu, Wayne Xin Zhao, and Philip S. Yu. 2019. Heterogeneous information network embedding for recommendation. IEEE Trans. Knowl. Data Eng. 31, 2 (2019), 357–370.
[35]
Weiping Song, Zhijian Duan, Ziqing Yang, Hao Zhu, Ming Zhang, and Jian Tang. 2022. Ekar: An Explainable Method for Knowledge Aware Recommendation. (2022). arxiv:cs.IR/1906.09506.
[36]
Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction. MIT Press.
[37]
Xiaoli Tang, Tengyun Wang, Haizhi Yang, and Hengjie Song. 2019. AKUPM: Attention-enhanced knowledge-aware user preference model for recommendation. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). 1891–1899.
[38]
Georgios Theocharous, Philip S. Thomas, and Mohammad Ghavamzadeh. 2015. Ad recommendation systems for life-time value optimization. In The World Wide Web Conference (WWW’15). 1305–1310.
[39]
Shiwei Tong, Qi Liu, Wei Huang, Zhenya Huang, Enhong Chen, Chuanren Liu, Haiping Ma, and Shijin Wang. 2020. Structure-based knowledge tracing: An influence propagation view. In The IEEE International Conference on Data Mining (ICDM’20). 541–550.
[40]
Sajid Umair and Muhammad Majid Sharif. 2018. Predicting students grades using artificial neural networks and support vector machine. In Encyclopedia of Information Science and Technology. 5169–5182.
[41]
Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems 20, Proceedings of the Twenty-First Annual Conference on Neural Information Processing (Nips’07). 1257–1264.
[42]
Chao Wang, Hengshu Zhu, Chen Zhu, Xi Zhang, Enhong Chen, and Hui Xiong. 2020. Personalized employee training course recommendation with career development awareness. In The World Wide Web Conference (WWW’20). 1648–1659.
[43]
Dongjie Wang, Pengyang Wang, Kunpeng Liu, Yuanchun Zhou, Charles E. Hughes, and Yanjie Fu. 2021. Reinforced imitative graph representation learning for mobile user profiling: An adversarial training perspective. In The AAAI Conference on Artificial Intelligence (AAAI’21). 4410–4417.
[44]
P. Wang, K. Liu, L. Jiang, X. Li, and Y. Fu. 2020. Incremental mobile user profiling: Reinforcement learning with spatial knowledge graph for modeling event streams. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’20). 853–861.
[45]
Xiting Wang, Yiru Chen, Jie Yang, Le Wu, Zhengtao Wu, and Xing Xie. 2018. A reinforcement learning framework for explainable recommendation. In The IEEE International Conference on Data Mining (ICDM’18). 587–596.
[46]
Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019. KGAT: Knowledge graph attention network for recommendation. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). 950–958.
[47]
Xiang Wang, Tinglin Huang, Dingxian Wang, Yancheng Yuan, Zhenguang Liu, Xiangnan He, and Tat-Seng Chua. 2021. Learning intents behind interactions with knowledge graph for recommendation. In The World Wide Web Conference (WWW’21). 878–887.
[48]
Xiang Wang, Dingxian Wang, Canran Xu, Xiangnan He, Yixin Cao, and Tat-Seng Chua. 2019. Explainable reasoning over knowledge graphs for recommendation. In The 33rd AAAI Conference on Artificial Intelligence. AAAI Press, 5329–5336.
[49]
Yiyuan Wang, Shaowei Cai, Jiejiang Chen, and Minghao Yin. 2020. SCCWalk: An efficient local search algorithm and its improvements for maximum weight clique problem. Artificial Intelligence 280 (2020), 103230.
[50]
Le Wu, Peijie Sun, Yanjie Fu, Richang Hong, Xiting Wang, and Meng Wang. 2019. A neural influence diffusion model for social recommendation. In The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). 235–244.
[51]
Yikun Xian, Zuohui Fu, Shan Muthukrishnan, Gerard De Melo, and Yongfeng Zhang. 2019. Reinforcement knowledge graph reasoning for explainable recommendation. In The International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). 285–294.
[52]
Jifan Yu, Chenyu Wang, Gan Luo, Lei Hou, Juanzi Li, Jie Tang, Minlie Huang, and Zhiyuan Liu. 2020. ExpanRL: Hierarchical reinforcement learning for course concept expansion in MOOCs. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL/IJCNLP). 770–780.
[53]
Ruiyun Yu, Dezhi Ye, Zhihong Wang, Biyun Zhang, Ann Oguti, Jie Li, Bo Jin, and Fadi Kurdahi. 2021. CFFNN: Cross feature fusion neural network for collaborative filtering. IEEE Transactions on Knowledge and Data Engineering 34, 10 (2021), 4650–4662.
[54]
Jing Zhang, Bowen Hao, Bo Chen, Cuiping Li, Hong Chen, and Jimeng Sun. 2019. Hierarchical reinforcement learning for course recommendation in moocs. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 435–442.
[55]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM Comput. Surv. 52, 1 (2019), 1–38.
[56]
Jun Zhao, Zhou Zhou, Ziyu Guan, Wei Zhao, Wei Ning, Guang Qiu, and Xiaofei He. 2019. Intentgc: A scalable graph convolution framework fusing heterogeneous information for recommendation. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). 2347–2357.
[57]
Xiaosa Zhao, Kunpeng Liu, Wei Fan, Lu Jiang, Xiaowei Zhao, Minghao Yin, and Yanjie Fu. 2020. Simplifying reinforced feature selection via restructured choice strategy of single agent. In The IEEE International Conference on Data Mining (ICDM’18). 871–880.
[58]
Xiangyu Zhao, Liang Zhang, Zhuoye Ding, Long Xia, Jiliang Tang, and Dawei Yin. 2018. Recommendations with negative feedback via pairwise deep reinforcement learning. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’18). 1040–1048.
[59]
Guanjie Zheng, Fuzheng Zhang, Zihan Zheng, Yang Xiang, Nicholas Jing Yuan, Xing Xie, and Zhenhui Li. 2018. DRN: A deep reinforcement learning framework for news recommendation. In The World Wide Web Conference (WWW’18). 167–176.
[60]
Guorui Zhou, Xiaoqiang Zhu, Chenru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, and Kun Gai. 2018. Deep interest network for click-through rate prediction. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’18). 1059–1068.
[61]
Lixin Zou, Long Xia, Zhuoye Ding, Jiaxing Song, Weidong Liu, and Dawei Yin. 2019. Reinforcement learning to optimize long-term user engagement in recommender systems. In The ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). 2810–2818.

Cited By

View all
  • (2024)Hierarchical reinforcement learning for point of interest recommendationProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/272(2460-2468)Online publication date: 3-Aug-2024
  • (2024)Hierarchical reinforcement learning on multi-channel hypergraph neural network for course recommendationProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/232(2099-2107)Online publication date: 3-Aug-2024
  • (2024)Spatial-temporal interplay in human mobilityProceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v38i8.28793(9396-9404)Online publication date: 20-Feb-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 14, Issue 3
June 2023
451 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3587032
  • Editor:
  • Huan Liu
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2023
Online AM: 01 February 2023
Accepted: 12 December 2022
Revised: 26 November 2022
Received: 15 September 2021
Published in TIST Volume 14, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Reinforcement learning
  2. knowledge concept recommendation
  3. MOOC knowledge graph

Qualifiers

  • Research-article

Funding Sources

  • Natural Science Research Foundation of Jilin Province of China
  • Fundamental Research Funds for the Central Universities
  • NSFC
  • Jilin Science and Technology Department
  • Science and Technology Development Fund, Macau SAR
  • Start-up Research Grant of University of Macau

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)339
  • Downloads (Last 6 weeks)21
Reflects downloads up to 08 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Hierarchical reinforcement learning for point of interest recommendationProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/272(2460-2468)Online publication date: 3-Aug-2024
  • (2024)Hierarchical reinforcement learning on multi-channel hypergraph neural network for course recommendationProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/232(2099-2107)Online publication date: 3-Aug-2024
  • (2024)Spatial-temporal interplay in human mobilityProceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v38i8.28793(9396-9404)Online publication date: 20-Feb-2024
  • (2024)A Framework for MOOC Learning Assessment based on Facial Expression driven by Knowledge Contextual AwarenessProceedings of the 2024 International Conference on Intelligent Education and Computer Technology10.1145/3687311.3687411(560-566)Online publication date: 28-Jun-2024
  • (2024)Explainable and Faithful Educational Recommendations through Causal Language Modelling via Knowledge GraphsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688022(1358-1360)Online publication date: 8-Oct-2024
  • (2024)Capturing Homogeneous Influence among Students: Hypergraph Cognitive Diagnosis for Intelligent Education SystemsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3672002(2628-2639)Online publication date: 25-Aug-2024
  • (2024)ORCDF: An Oversmoothing-Resistant Cognitive Diagnosis Framework for Student Learning in Online Education SystemsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671988(2455-2466)Online publication date: 25-Aug-2024
  • (2024)Finding Paths for Explainable MOOC Recommendation: A Learner PerspectiveProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636898(426-437)Online publication date: 18-Mar-2024
  • (2024)Modeling Balanced Explicit and Implicit Relations with Contrastive Learning for Knowledge Concept Recommendation in MOOCsProceedings of the ACM Web Conference 202410.1145/3589334.3645559(3712-3722)Online publication date: 13-May-2024
  • (2024)AestheNet: Revolutionizing Aesthetic Perception Diagnosis in Education With Hybrid Deep NetsIEEE Transactions on Learning Technologies10.1109/TLT.2024.340596617(2117-2129)Online publication date: 1-Jan-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media