Improving Robot-Assisted Virtual Teaching Using Transformers, GANs, and Computer Vision
Pages 1 - 32
Abstract
This study aims to enhance the efficacy of personalized learning paths by amalgamating transformer models, generative adversarial networks (GANs), and reinforcement learning techniques. To refine personalized learning trajectories, the authors integrated the transformer model for enhanced information assimilation and learning path planning. Through generative adversarial networks, the authors simulated the fusion and interaction of multi-modal information, refining the training of virtual teaching assistants. Lastly, reinforcement learning was employed to optimize the interaction strategies of these assistants, aligning them better with student needs. In the experimental phase, the authors benchmarked their approach against six state-of-the-art models to assess its effectiveness. The experimental outcomes highlight significant enhancements achieved by the authors' virtual teaching assistant compared to traditional methods. Precision improved to 95% and recall to 96%, and an F1 score exceeding 95% was attained.
References
[1]
Aggarwal, A., Mittal, M., & Battineni, G. (2021). Generative adversarial network: An overview of theory and applications. International Journal of Information Management Data Insights, 1(1), 100004.
[2]
Alam, A. (2021). Should robots replace teachers? Mobilisation of AI and learning analytics in education. 2021 International Conference on Advances in Computing, Communication, and Control (ICAC3). IEEE. 10.1109/ICAC353642.2021.9697300
[3]
Alam, A. (2022). Employing adaptive learning and intelligent tutoring robots for virtual classrooms and smart campuses: Reforming education in the age of artificial intelligence. In Advanced computing and intelligent technologies [Springer.]. Proceedings of ICACIT, 2022, 395–406.
[4]
Bala, R. (2021). Privacy and ethical issues in digitalization world. In Internet of things (pp. 113–117). CRC Press.
[5]
Banaeian, H., & Gilanlioglu, I. (2021). Influence of the NAO robot as a teaching assistant on university students’ vocabulary learning and attitudes. Australasian Journal of Educational Technology, 37(3), 71–87.
[6]
Choi, S. H., Park, K.-B., Roh, D. H., Lee, J. Y., Mohammed, M., Ghasemi, Y., & Jeong, H. (2022). An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation. Robotics and Computer-integrated Manufacturing, 73, 102258.
[7]
ChoiY.LeeY.ShinD.ChoJ.ParkS.LeeS.BaekJ.BaeC.KimB.HeoJ. (2020). Ednet: A large-scale hierarchical dataset in education. Artificial Intelligence in Education: 21st International Conference, AIED 2020, Ifrane, Morocco.
[8]
Cooney, M., & Leister, W. (2019). Using the engagement profile to design an engaging robotic teaching assistant for students. Robotics (Basel, Switzerland), 8(1), 21.
[9]
Delgrange, C., Dussoux, J.-M., & Dominey, P. F. (2019). Usage-based learning in human interaction with an adaptive virtual assistant. IEEE Transactions on Cognitive and Developmental Systems, 12(1), 109–123.
[10]
DewiT.RismaP.OktarinaY.MusliminS. (2018). Visual servoing design and control for agriculture robot; A review. 2018 International Conference on Electrical Engineering and Computer Science (ICECOS). IEEE. 10.1109/ICECOS.2018.8605209
[11]
Diao, X., Zeng, Q., Duan, H., Song, Z., & Zhou, C. (2021). Personalized learning resource recommendation based on course ontology and cognitive ability. Journal of Computers, 32(2), 149–163.
[12]
Fröhlich, H., Balling, R., Beerenwinkel, N., Kohlbacher, O., Kumar, S., Lengauer, T., Maathuis, M. H., Moreau, Y., Murphy, S. A., Przytycka, T. M., Rebhan, M., Röst, H., Schuppert, A., Schwab, M., Spang, R., Stekhoven, D., Sun, J., Weber, A., Ziemek, D., & Zupan, B. (2018). From hype to reality: Data science enabling personalized medicine. BMC Medicine, 16(1), 1–15.
[13]
Gao, S., Zhou, C., Ma, C., Wang, X., & Yuan, J. (2022). Aiatrack: Attention in attention for transformer visual tracking. European Conference on Computer Vision. Springer. 10.1007/978-3-031-20047-2_9
[14]
Haiguang, F., Shichong, W., Shushu, X., & Xianli, W. (2020). Research on human-computer cooperative teaching supported by artificial intelligence robot assistant. Artificial Intelligence Supported Educational Technologies, 45-58. Research Gate.
[15]
Jais, I. K. M., Ismail, A. R., & Nisa, S. Q. (2019). Adam optimization algorithm for wide and deep neural network. Knowledge Engineering and Data Science, 2(1), 41–46.
[16]
Kardan, A. A., Ebrahim, M. A., & Imani, M. B. (2014). A new personalized learning path generation method: Aco-map. Indian Journal of Scientific Research, 5(1), 17–24.
[17]
LiuX.HsiehC.-J. (2019). Rob-gan: Generator, discriminator, and adversarial attacker. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE.
[18]
Maseleno, A., Sabani, N., Huda, M., Ahmad, R., Jasmi, K. A., & Basiron, B. (2018). Demystifying learning analytics in personalised learning. International Journal of Engineering and Technology.
[19]
Nabizadeh, A. H., Leal, J. P., Rafsanjani, H. N., & Shah, R. R. (2020). Learning path personalization and recommendation methods: A survey of the state-of-the-art. Expert Systems with Applications, 159, 113596.
[20]
Ning, X., Tian, W., He, F., Bai, X., Sun, L., & Li, W. (2023). Hyper-sausage coverage function neuron model and learning algorithm for image classification. Pattern Recognition, 136, 109216.
[21]
Ning, X., Tian, W., Yu, Z., Li, W., Bai, X., & Wang, Y. (2022). HCFNN: High-order coverage function neural network for image classification. Pattern Recognition, 131, 108873.
[22]
Nixon, M., & Aguado, A. (2019). Feature extraction and image processing for computer vision. Academic Press.
[23]
Peng, H., Ma, S., & Spector, J. M. (2019). Personalized adaptive learning: An emerging pedagogical approach enabled by a smart learning environment. Smart Learning Environments, 6(1), 1–14.
[24]
Raja, R., & Nagasubramani, P. (2018). Impact of modern technology in education. Journal of Applied and Advanced Research, 3(1), 33–35.
[25]
Rashid, T., Samvelyan, M., De Witt, C. S., Farquhar, G., Foerster, J., & Whiteson, S. (2020). Monotonic value function factorisation for deep multi-agent reinforcement learning. Journal of Machine Learning Research, 21(1), 7234–7284.
[26]
Rosenberg-Kima, R. B., Koren, Y., & Gordon, G. (2020). Robot-supported collaborative learning (RSCL): Social robots as teaching assistants for higher education small group facilitation. Frontiers in Robotics and AI, 6, 148.
[27]
Settles, B. T., LaFlair, G., & Hagiwara, M. (2020). Machine learning–driven language assessment. Transactions of the Association for Computational Linguistics, 8, 247–263.
[28]
Sophokleous, A., Christodoulou, P., Doitsidis, L., & Chatzichristofis, S. A. (2021). Computer vision meets educational robotics. Electronics (Basel), 10(6), 730.
[29]
Suganthan, P. N., & Katuwal, R. (2021). On the origins of randomization-based feedforward neural networks. Applied Soft Computing, 105, 107239.
[30]
Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. MIT Press.
[31]
Wang, K., Wu, Q., Song, L., Yang, Z., Wu, W., Qian, C., He, R., Qiao, Y., & Loy, C. C. (2020). Mead: A large-scale audio-visual dataset for emotional talking-face generation. European Conference on Computer Vision. Springer. 10.1007/978-3-030-58589-1_42
[32]
Zhen, S., Zhang, T., Tao, W., & Chen, H. (2022). Storage optimization of three-dimensional warehouse based on multi population space mapping genetic algorithm. Journal of Jilin University Science Edition, 60, 127–134.
[33]
ZhuX.ChengD.ZhangZ.LinS.DaiJ. (2019). An empirical study of spatial attention mechanisms in deep networks. Proceedings of the IEEE/CVF International Conference on Computer Vision. IEEE. 10.1109/ICCV.2019.00679
Index Terms
- Improving Robot-Assisted Virtual Teaching Using Transformers, GANs, and Computer Vision
Index terms have been assigned to the content through auto-classification.
Recommendations
Starting engagement detection towards a companion robot using multimodal features
Recognition of intentions is a subconscious cognitive process vital to human communication. This skill enables anticipation and increases the quality of interactions between humans. Within the context of engagement, non-verbal signals are used to ...
Footstep planning of humanoid robot in ROS environment using Generative Adversarial Networks (GANs) deep learning
AbstractThis paper proposes deep learning-based footstep planning using Generative Adversarial Networks (GANs) for the indoor navigation of humanoid robots. The GAN-based architecture presents an efficient and accurate path to plan the ...
Highlights- This paper proposes deep learning-based footstep planning using GANs for the indoor navigation of humanoid robots.
Convolutional Neural Network-Assisted Strategies for Improving Teaching Quality of College English Flipped Class
The “flipped classroom” teaching paradigm not only follows the cognitive rules of the learners, but it also subverts and reverses the standard classroom teaching process. Problem-oriented, teacher-led, student-centered, and mixed teaching approaches are ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2024.
Publisher
IGI Global
United States
Publication History
Published: 30 January 2024
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 22 Dec 2024