Integrating Students’ Real-Time Gaze in Teacher–Student Interactions: Case Studies on the Benefits and Challenges of Eye Tracking in Primary Education
<p>Mathematics activity. (<b>A</b>) A challenge in which students needed to reproduce the path without repeating any edges. (<b>B</b>) The activity was designed to be impossible to solve without repeating edges, prompting students to recognize and analyze why the task could not be completed as instructed.</p> "> Figure 2
<p>Student gaze estimation. The video displays the real-time eye movements of a student as he works on a problem during class. First, the student realizes he made a mistake. Then, he rereads the problem statement, compares it with the previously created code block, identifies where they could make the change, and checks to see if it is correct. The student’s gaze is focused on the area where they can identify the correct solution.</p> "> Figure 3
<p>Geography eye-tracking activity. Image of the map “Distribution of Soybean across Different Biomes” (2016) used in the Geography activity. The red cross represents the student’s gaze.</p> "> Figure 4
<p>Biology eye-tracking activity. Screenshot from video showing student’s gaze path during one of the activities.</p> ">
Abstract
:1. Introduction
1.1. Background and Motivation
1.1.1. Uses of Eye Tracking in Educational Research
1.1.2. Current State of Eye-Tracking Technology in Educational Environments
1.1.3. Purpose and Objectives
2. Materials and Methods
2.1. Participants
2.2. Educational Interactional Activities
- Case Study 1—Mathematics (A.Y.A.O.)
- Case Study 2—Computational Thinking (E.D.P.)
- Case Study 3—Geography (M.B.R.)
- Case Study 4—Biology (C.N.V.)
2.3. Instrumentation
3. Results
3.1. Summary of the Teachers’ Testimony
3.2. Teachers’ Comments About Their Experience of Teaching with a Real-Time Gaze
- Case Study 1—Mathematics perspectives [A.Y.A.O.]
- Case Study 2—Computational Thinking perspectives [E.D.P.]
- Case Study 3—Geography perspectives [M.B.R.]
- Case Study 4—Biology perspective [C.N.V.]
4. Discussion
5. Final Considerations and Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Vygotsky, L.S. Mind in Society: The Development of Higher Psychological Processes; Harvard University Press: Cambridge, MA, USA, 1978; Volume 86. [Google Scholar]
- Hattie, J.; Timperley, H. The Power of Feedback. Rev. Educ. Res. 2007, 77, 81–112. [Google Scholar] [CrossRef]
- Colvin, R. Optimising, Generalising and Integrating Educational Practice Using Neuroscience. npj Sci. Learn. 2016, 1, 16012. [Google Scholar] [CrossRef]
- Szűcs, D.; Goswami, U. Educational Neuroscience: Defining a New Discipline for the Study of Mental Representations. Mind Brain Educ. 2007, 1, 114–127. [Google Scholar] [CrossRef]
- Jarodzka, H.; van Gog, T.; Dorr, M.; Scheiter, K.; Gerjets, P. Learning to See: Guiding Students’ Attention via a Model’s Eye Movements Fosters Learning. Learn. Instr. 2013, 25, 62–70. [Google Scholar] [CrossRef]
- Mason, L.; Pluchino, P.; Tornatora, M.C. Using Eye-Tracking Technology as an Indirect Instruction Tool to Improve Text and Picture Processing and Learning: Eye-Tracking Technology as an Indirect Instruction Tool. Br. J. Educ. Technol. 2016, 47, 1083–1095. [Google Scholar] [CrossRef]
- Molina, A.I.; Navarro, Ó.; Ortega, M.; Lacruz, M. Evaluating Multimedia Learning Materials in Primary Education Using Eye Tracking. Comput. Stand. Interfaces 2018, 59, 45–60. [Google Scholar] [CrossRef]
- van Gog, T.; Jarodzka, H. Eye Tracking as a Tool to Study and Enhance Cognitive and Metacognitive Processes in Computer-Based Learning Environments. In International Handbook of Metacognition and Learning Technologies; Azevedo, R., Aleven, V., Eds.; Springer International Handbooks of Education; Springer: New York, NY, USA, 2013; Volume 28, pp. 143–156. ISBN 978-1-4419-5545-6. [Google Scholar]
- Harvey, A.; Vickers, J.N.; Snelgrove, R.; Scott, M.F.; Morrison, S. Expert Surgeon’s Quiet Eye and Slowing down: Expertise Differences in Performance and Quiet Eye Duration during Identification and Dissection of the Recurrent Laryngeal Nerve. Am. J. Surg. 2014, 207, 187–193. [Google Scholar] [CrossRef] [PubMed]
- Tien, T.; Pucher, P.H.; Sodergren, M.H.; Sriskandarajah, K.; Yang, G.-Z.; Darzi, A. Differences in Gaze Behaviour of Expert and Junior Surgeons Performing Open Inguinal Hernia Repair. Surg. Endosc. 2015, 29, 405–413. [Google Scholar] [CrossRef]
- Rayner, K.; Pollatsek, A. Eye Movements and Scene Perception. Can. J. Psychol. Can. Psychol. 1992, 46, 342. [Google Scholar] [CrossRef]
- Rayner, K.; Chace, K.H.; Slattery, T.J.; Ashby, J. Eye Movements as Reflections of Comprehension Processes in Reading. Sci. Stud. Read. 2006, 10, 241–255. [Google Scholar] [CrossRef]
- Bolden, D.; Barmby, P.; Raine, S.; Gardner, M. How Young Children View Mathematical Representations: A Study Using Eye-Tracking Technology. Educ. Res. 2015, 57, 59–79. [Google Scholar] [CrossRef]
- Epelboim, J.; Suppes, P. A Model of Eye Movements and Visual Working Memory during Problem Solving in Geometry. Vision Res. 2001, 41, 1561–1574. [Google Scholar] [CrossRef] [PubMed]
- Hyönä, J. The Use of Eye Movements in the Study of Multimedia Learning. Learn. Instr. 2010, 20, 172–176. [Google Scholar] [CrossRef]
- Tsai, M.-J.; Hou, H.-T.; Lai, M.-L.; Liu, W.-Y.; Yang, F.-Y. Visual Attention for Solving Multiple-Choice Science Problem: An Eye-Tracking Analysis. Comput. Educ. 2012, 58, 375–385. [Google Scholar] [CrossRef]
- Ke, F.; Liu, R.; Sokolikj, Z.; Dahlstrom-Hakki, I.; Israel, M. Using Eye-Tracking in Education: Review of Empirical Research and Technology. Educ. Technol. Res. Dev. 2024, 72, 1383–1418. [Google Scholar] [CrossRef]
- van Berlo, E.; Roth, T.S.; Kim, Y.; Kret, M.E. Selective and Prolonged Attention to Emotional Scenes in Humans and Bonobos. Proc. R. Soc. B Biol. Sci. 2024, 291, 20240433. [Google Scholar] [CrossRef] [PubMed]
- Bacos, C.A.; McCreery, M.P.; Boone, R. Using Eye-Tracking Methods for Social Attention Research and Interventions. J. Spec. Educ. Technol. 2024, 39, 542–556. [Google Scholar] [CrossRef]
- Miller, A.L.; Unsworth, N. Variation in Attention at Encoding: Insights from Pupillometry and Eye Gaze Fixations. J. Exp. Psychol. Learn. Mem. Cogn. 2020, 46, 2277–2294. [Google Scholar] [CrossRef]
- Holmqvist, K.; Nyström, M.; Andersson, R.; Dewhurst, R.; Jarodzka, H.; van de Weijer, J. Eye Tracking: A Comprehensive Guide to Methods and Measures; OUP Oxford: Oxford, UK, 2011; ISBN 978-0-19-162542-8. [Google Scholar]
- Hyönä, J.; Lorch, R.F., Jr.; Kaakinen, J.K. Individual Differences in Reading to Summarize Expository Text: Evidence from Eye Fixation Patterns. J. Educ. Psychol. 2002, 94, 44–55. [Google Scholar] [CrossRef]
- Bar-Zvi Shaked, K.; Shamir, A.; Vakil, E. An Eye Tracking Study of Digital Text Reading: A Comparison between Poor and Typical Readers. Read. Writ. 2020, 33, 1925–1944. [Google Scholar] [CrossRef]
- Foulsham, T.; Walker, E.; Kingstone, A. The Where, What and When of Gaze Allocation in the Lab and the Natural Environment. Vision Res. 2011, 51, 1920–1931. [Google Scholar] [CrossRef] [PubMed]
- Marius’t Hart, B.; Vockeroth, J.; Schumann, F.; Bartl, K.; Schneider, E.; König, P.; Einhäuser, W. Gaze Allocation in Natural Stimuli: Comparing Free Exploration to Head-Fixed Viewing Conditions. Vis. Cogn. 2009, 17, 1132–1158. [Google Scholar] [CrossRef]
- Jung, Y.J.; Zimmerman, H.T.; Pérez-Edgar, K. A Methodological Case Study with Mobile Eye-Tracking of Child Interaction in a Science Museum. TechTrends 2018, 62, 509–517. [Google Scholar] [CrossRef]
- Liu, Y.; Odic, D.; Tang, X.; Ma, A.; Laricheva, M.; Chen, G.; Wu, S.; Niu, M.; Guo, Y.; Milner-Bolotin, M. Effects of Robotics Education on Young Children’s Cognitive Development: A Pilot Study with Eye-Tracking. J. Sci. Educ. Technol. 2023, 32, 295–308. [Google Scholar] [CrossRef] [PubMed]
- Ashraf, H.; Sodergren, M.H.; Merali, N.; Mylonas, G.; Singh, H.; Darzi, A. Eye-Tracking Technology in Medical Education: A Systematic Review. Med. Teach. 2018, 40, 62–69. [Google Scholar] [CrossRef]
- Causer, J.; Vickers, J.N.; Snelgrove, R.; Arsenault, G.; Harvey, A. Performing under Pressure: Quiet Eye Training Improves Surgical Knot-Tying Performance. Surgery 2014, 156, 1089–1096. [Google Scholar] [CrossRef]
- Wilson, M.; McGrath, J.; Vine, S.; Brewer, J.; Defriend, D.; Masters, R. Psychomotor Control in a Virtual Laparoscopic Surgery Training Environment: Gaze Control Parameters Differentiate Novices from Experts. Surg. Endosc. 2010, 24, 2458–2464. [Google Scholar] [CrossRef]
- Sodergren, M.H.; Orihuela-Espina, F.; Froghi, F.; Clark, J.; Teare, J.; Yang, G.Z.; Darzi, A. Value of Orientation Training in Laparoscopic Cholecystectomy. J. Br. Surg. 2011, 98, 1437–1445. [Google Scholar] [CrossRef]
- Li, S.; Duffy, M.C.; Lajoie, S.P.; Zheng, J.; Lachapelle, K. Using Eye Tracking to Examine Expert-Novice Differences during Simulated Surgical Training: A Case Study. Comput. Hum. Behav. 2023, 144, 107720. [Google Scholar] [CrossRef]
- Ghebremichael, A. Gaze Patterns of Anatomy Students through Classroom Learning and Familiarization. Master’s Thesis, Boston University, Boston, MA, USA, 2014. [Google Scholar]
- Soh, B.P.; Reed, W.M.; Poulos, A.; Brennan, P.C. E-Tutorial Improves Students’ Ability to Detect Lesions. Radiol. Technol. 2013, 85, 17–26. [Google Scholar]
- Wood, G.; Knapp, K.M.; Rock, B.; Cousens, C.; Roobottom, C.; Wilson, M.R. Visual Expertise in Detecting and Diagnosing Skeletal Fractures. Skeletal Radiol. 2013, 42, 165–172. [Google Scholar] [CrossRef] [PubMed]
- Jarodzka, H.M.; Skuballa, I.T.; Gruber, H. Eye-Tracking in Educational Practice: Investigating Visual Perception Underlying Teaching and Learning in the Classroom. Educ. Psychol. Rev. 2021, 33, 1–10. [Google Scholar] [CrossRef]
- Ooms, K.; De Maeyer, P.; Fack, V. Study of the Attentive Behavior of Novice and Expert Map Users Using Eye Tracking. Cartogr. Geogr. Inf. Sci. 2014, 41, 37–54. [Google Scholar] [CrossRef]
- da Silva Soares, R.; Lukasova, K.; Carthery-Goulart, M.T.; Sato, J.R. Student’s Perspective and Teachers’ Metacognition: Applications of Eye-Tracking in Education and Scientific Research in Schools. Front. Psychol. 2021, 12, 673615. [Google Scholar] [CrossRef]
- da Silva Soares, R., Jr.; Barreto, C.; Sato, J.R. Perspectives in Eye-Tracking Technology for Applications in Education. S. Afr. J. Child. Educ. 2023, 13, a1204. [Google Scholar] [CrossRef]
- Pan, Y.; Novembre, G.; Song, B.; Zhu, Y.; Hu, Y. Dual Brain Stimulation Enhances Interpersonal Learning through Spontaneous Movement Synchrony. Soc. Cogn. Affect. Neurosci. 2020, 16, 210–221. [Google Scholar] [CrossRef]
- da Silva Soares, R.; Oku, A.Y.A.; Barreto, C.d.S.F.; Sato, J.R. Exploring the Potential of Eye Tracking on Personalized Learning and Real-Time Feedback in Modern Education. Prog. Brain Res. 2023, 282, 49–70. [Google Scholar] [CrossRef]
- Holmqvist, K.; Andersson, R. Eye Tracking: A Comprehensive Guide to Methods, Paradigms, and Measures, 2nd ed.; Lund Eye-Tracking Research Institute: Lund, Sweden, 2017; ISBN 978-1-979484-89-3. [Google Scholar]
- Deane, O.; Toth, E.; Yeo, S.-H. Deep-SAGA: A Deep-Learning-Based System for Automatic Gaze Annotation from Eye-Tracking Data. Behav. Res. Methods 2023, 55, 1372–1391. [Google Scholar] [CrossRef]
- Zhang, X.; Sugano, Y.; Fritz, M.; Bulling, A. Appearance-Based Gaze Estimation in the Wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 7–12 June 2015; pp. 4511–4520. [Google Scholar]
- Falch, L.; Lohan, K.S. Webcam-Based Gaze Estimation for Computer Screen Interaction. Front. Robot. AI 2024, 11, 1369566. [Google Scholar] [CrossRef]
- Semmelmann, K.; Weigelt, S. Online Webcam-Based Eye Tracking in Cognitive Science: A First Look. Behav. Res. Methods 2018, 50, 451–465. [Google Scholar] [CrossRef]
- Valliappan, N.; Dai, N.; Steinberg, E.; He, J.; Rogers, K.; Ramachandran, V.; Xu, P.; Shojaeizadeh, M.; Guo, L.; Kohlhoff, K. Accelerating Eye Movement Research via Accurate and Affordable Smartphone Eye Tracking. Nat. Commun. 2020, 11, 4553. [Google Scholar] [CrossRef] [PubMed]
- Krafka, K.; Khosla, A.; Kellnhofer, P.; Kannan, H.; Bhandarkar, S.; Matusik, W.; Torralba, A. Eye Tracking for Everyone. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 26 June–1 July 2016; pp. 2176–2184. [Google Scholar]
- Jin, Z.; Yin, J.; Pan, Y.; Zhang, Y.; Li, Y.; Xu, X.; Luo, J. Teach a Man to Fish: Hyper-Brain Evidence on Scaffolding Strategy Enhancing Creativity Acquisition and Transfer. NeuroImage 2024, 297, 120757. [Google Scholar] [CrossRef] [PubMed]
- Puntambekar, S. Distributed Scaffolding: Scaffolding Students in Classroom Environments. Educ. Psychol. Rev. 2022, 34, 451–472. [Google Scholar] [CrossRef]
- Van De Pol, J.; Volman, M.; Beishuizen, J. Scaffolding in Teacher–Student Interaction: A Decade of Research. Educ. Psychol. Rev. 2010, 22, 271–296. [Google Scholar] [CrossRef]
- Reiser, B.; Tabak, I. Scaffolding. In The Cambridge Handbook of the Learning Sciences; Cambridge University Press: Cambridge, UK, 2014; pp. 44–62. [Google Scholar]
- Stofer, K.; Che, X. Comparing Experts and Novices on Scaffolded Data Visualizations Using Eye-Tracking. J. Eye Mov. Res. 2014, 7, 1–15. [Google Scholar] [CrossRef]
- Sun, J.C.-Y.; Yu, S.-J.; Chao, C.-H. Effects of Intelligent Feedback on Online Learners’ Engagement and Cognitive Load: The Case of Research Ethics Education. Educ. Psychol. 2019, 39, 1293–1310. [Google Scholar] [CrossRef]
- Daraghmi, E.Y.; Fan, C.-T.; Lin, W.-J.; Peng, Z.-Y.; Yuan, S.M. Eye-Tracking Assisted Self-Directed Learning System. In Proceedings of the 2015 IEEE 15th International Conference on Advanced Learning Technologies, Hualien, Taiwan, 6–9 July 2015; IEEE: Hualien, Taiwan, 2015; pp. 52–54. [Google Scholar]
- Khosravi, S.; Khan, A.R.; Zoha, A.; Ghannam, R. Employing a Wearable Eye-Tracker to Observe Mind-Wandering in Dynamic Stimuli. In Proceedings of the 2022 29th IEEE International Conference on Electronics, Circuits and Systems (ICECS), Glasgow, UK, 24–26 October 2022; pp. 1–4. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Soares, R.d.S., Jr.; Pinheiro, E.D.; Oku, A.Y.A.; Rizzo, M.B.; Vieira, C.d.N.; Sato, J.R. Integrating Students’ Real-Time Gaze in Teacher–Student Interactions: Case Studies on the Benefits and Challenges of Eye Tracking in Primary Education. Appl. Sci. 2024, 14, 11007. https://doi.org/10.3390/app142311007
Soares RdS Jr., Pinheiro ED, Oku AYA, Rizzo MB, Vieira CdN, Sato JR. Integrating Students’ Real-Time Gaze in Teacher–Student Interactions: Case Studies on the Benefits and Challenges of Eye Tracking in Primary Education. Applied Sciences. 2024; 14(23):11007. https://doi.org/10.3390/app142311007
Chicago/Turabian StyleSoares, Raimundo da Silva, Jr., Eneyse Dayane Pinheiro, Amanda Yumi Ambriola Oku, Marilia Biscaia Rizzo, Carolinne das Neves Vieira, and João Ricardo Sato. 2024. "Integrating Students’ Real-Time Gaze in Teacher–Student Interactions: Case Studies on the Benefits and Challenges of Eye Tracking in Primary Education" Applied Sciences 14, no. 23: 11007. https://doi.org/10.3390/app142311007
APA StyleSoares, R. d. S., Jr., Pinheiro, E. D., Oku, A. Y. A., Rizzo, M. B., Vieira, C. d. N., & Sato, J. R. (2024). Integrating Students’ Real-Time Gaze in Teacher–Student Interactions: Case Studies on the Benefits and Challenges of Eye Tracking in Primary Education. Applied Sciences, 14(23), 11007. https://doi.org/10.3390/app142311007