[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3649902.3655642acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
abstract

Predictive Modelling of Cognitive Workload in VR: An Eye-Tracking Approach

Published: 04 June 2024 Publication History

Abstract

Cognitive training can boost and sharpen the brain’s abilities to remember, focus, and switch between different tasks. One of the key elements of cognitive training is cognitive load. It allows a manipulation of the intensity of the intervention to suit the participant’s ability level and keep the session enjoyable, i.e. neither too frustrating/hard nor too boring/easy). However, measuring cognitive workload in an objective way is still under-researched and difficult. Here, we have developed a novel sustained attention Virtual Reality (VR) task, using Unity, that aims to predict load in a controlled manner. We demonstrate promising results in that machine learning algorithms can identify perceived as well as objective difficulty of the game accurately, using a combination of eye-tracking and physiological data obtained directly within the VR environment.

References

[1]
Lora Appel, Eva Appel, Orly Bogler, Micaela Wiseman, Leedan Cohen, Natalie Ein, Howard B Abrams, and Jennifer L Campos. 2020. Older adults with cognitive and/or physical impairments can benefit from immersive virtual reality experiences: A feasibility study. Frontiers in medicine 6 (2020), 329.
[2]
Valentina Bachurina, Svetlana Sushchinskaya, Maxim Sharaev, Evgeny Burnaev, and Marie Arsalidou. 2022. A machine learning investigation of factors that contribute to predicting cognitive performance: Difficulty level, reaction time and eye-movements. Decision Support Systems 155 (2022), 113713. https://doi.org/10.1016/j.dss.2021.113713
[3]
Ronald A. Cohen. 2011. Continuous Performance Tests. Springer New York, New York, NY, 699–701. https://doi.org/10.1007/978-0-387-79948-3_1280
[4]
Dengbo He, Ziquan Wang, Elias B Khalil, Birsen Donmez, Guangkai Qiao, and Shekhar Kumar. 2022. Classification of driver cognitive load: Exploring the benefits of fusing eye-tracking and physiological measures. Transportation research record 2676, 10 (2022), 670–681.
[5]
Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.
[6]
Lukassmithjer Magel. 2023. PyShimmer. https://github.com/seemoo-lab/pyshimmer
[7]
Fred Paas, Alexander Renkl, and John Sweller. 2003. Cognitive load theory and instructional design: Recent developments. Educational psychologist 38, 1 (2003), 1–4.
[8]
Mina Shojaeizadeh, Soussan Djamasbi, Randy C Paffenroth, and Andrew C Trapp. 2019. Detecting task demand via an eye tracking machine learning system. Decision Support Systems 116 (2019), 91–101.
[9]
Vasileios Skaramagkas, Emmanouil Ktistakis, Dimitris Manousos, Nikolaos S Tachos, Eleni Kazantzaki, Evanthia E Tripoliti, Dimitrios I Fotiadis, and Manolis Tsiknakis. 2021. Cognitive workload level estimation based on eye tracking: A machine learning approach. In 2021 IEEE 21st International Conference on Bioinformatics and Bioengineering (BIBE). IEEE, 1–5.
[10]
Lisa G Smithers, Alyssa CP Sawyer, Catherine R Chittleborough, Neil M Davies, George Davey Smith, and John W Lynch. 2018. A systematic review and meta-analysis of effects of early life non-cognitive skills on academic, psychosocial, cognitive and health outcomes. Nature human behaviour 2, 11 (2018), 867–880.
[11]
Tristan Stenner. 2022. Lab Streaming Layer (LSL) - A software framework for synchronizing a large array of data collection and stimulation devices.https://github.com/sccn/labstreaminglayer

Cited By

View all
  • (2024)Exploring Eye Tracking to Detect Cognitive Load in Complex Virtual Reality Training2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00022(51-54)Online publication date: 21-Oct-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
ETRA '24: Proceedings of the 2024 Symposium on Eye Tracking Research and Applications
June 2024
525 pages
ISBN:9798400706073
DOI:10.1145/3649902
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2024

Check for updates

Author Tags

  1. Cognitive Load
  2. Cognitive Training
  3. Eye-Tracking
  4. Physiological Data
  5. Virtual Reality

Qualifiers

  • Abstract
  • Research
  • Refereed limited

Funding Sources

Conference

ETRA '24

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)76
  • Downloads (Last 6 weeks)11
Reflects downloads up to 19 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Exploring Eye Tracking to Detect Cognitive Load in Complex Virtual Reality Training2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00022(51-54)Online publication date: 21-Oct-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media