Open Iris - An Open Source Framework for Video-Based Eye-Tracking Research and Development
Article No.: 17, Pages 1 - 7
Abstract
Eye-tracking is an essential tool in many fields, yet existing solutions are often limited for customized applications due to cost or lack of flexibility. We present OpenIris, an adaptable and user-friendly open-source framework for video-based eye-tracking. OpenIris is developed in C# with modular design that allows further extension and customization through plugins for different hardware systems, tracking, and calibration pipelines. It can be remotely controlled via a network interface from other devices or programs. Eye movements can be recorded online from camera stream or offline post-processing recorded videos. Example plugins have been developed to track eye motion in 3-D, including torsion. Currently implemented binocular pupil tracking pipelines can achieve frame rates of more than 500Hz. With the OpenIris framework, we aim to fill a gap in the research tools available for high-precision and high-speed eye-tracking, especially in environments that require custom solutions that are not currently well-served by commercial eye-trackers.
References
[1]
Isayas Berhe Adhanom, Paul MacNeilage, and Eelke Folmer. 2023. Eye Tracking in Virtual Reality: a Broad Review of Applications and Challenges. Virtual Reality 27, 2 (June 2023), 1481–1505. https://doi.org/10.1007/s10055-022-00738-z
[2]
Simon Arvin, Rune Nguyen Rasmussen, and Keisuke Yonehara. 2021. EyeLoop: An Open-Source System for High-Speed, Closed-Loop Eye-Tracking. Frontiers in Cellular Neuroscience 15, (2021). Retrieved January 26, 2024 from https://www.frontiersin.org/articles/10.3389/fncel.2021.779628
[3]
Luis-Alberto Casado-Aranda, Juan Sánchez-Fernández, and José-Ángel Ibáñez-Zapata. 2023. Evaluating Communication Effectiveness Through Eye Tracking: Benefits, State of the Art, and Unresolved Questions. International Journal of Business Communication 60, 1 (January 2023), 24–61. https://doi.org/10.1177/2329488419893746
[4]
Jorge Paolo Casas and Chandramouli Chandrasekaran. 2019. openEyeTrack - A high speed multi-threaded eye tracker for head-fixed applications. J Open Source Softw 4, 42 (2019), 1631. https://doi.org/10.21105/joss.01631
[5]
Kathleen E. Cullen. 2023. Chapter 3 - Vestibular motor control. In Handbook of Clinical Neurology, David S. Younger (ed.). Elsevier, 31–54. https://doi.org/10.1016/B978-0-323-98818-6.00022-4
[6]
Matthieu Duvinage, Thierry Castermans, and Thierry Dutoit. 2011. Control of a lower limb active prosthesis with eye movement sequences. In 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), April 2011. 1–7. https://doi.org/10.1109/CCMB.2011.5952116
[7]
Agostino Gibaldi and Martin S. Banks. 2019. Binocular Eye Movements Are Adapted to the Natural Environment. J. Neurosci. 39, 15 (April 2019), 2877–2888. https://doi.org/10.1523/JNEUROSCI.2591-18.2018
[8]
Alessandro Grillini, Remco J. Renken, Anne C. L. Vrijling, Joost Heutink, and Frans W. Cornelissen. 2020. Eye Movement Evaluation in Multiple Sclerosis and Parkinson's Disease Using a Standardized Oculomotor and Neuro-Ophthalmic Disorder Assessment (SONDA). Frontiers in Neurology 11, (2020). Retrieved January 26, 2024 from https://www.frontiersin.org/articles/10.3389/fneur.2020.00971
[9]
Benedikt Hosp, Shahram Eivazi, Maximilian Maurer, Wolfgang Fuhl, David Geisler, and Enkelejda Kasneci. 2020. RemoteEye: An open-source high-speed remote eye tracker. Behav Res 52, 3 (June 2020), 1387–1401. https://doi.org/10.3758/s13428-019-01305-2
[10]
Zehao Huang, Xiaoting Duan, Gancheng Zhu, Shuai Zhang, Rong Wang, and Zhiguo Wang. 2024. Assessing the data quality of AdHawk MindLink eye-tracking glasses. Behav Res (January 2024). https://doi.org/10.3758/s13428-023-02310-2
[11]
Daria Ivanchenko, Katharina Rifai, Ziad M. Hafed, and Frank Schaeffel. 2021. A low-cost, high-performance video-based binocular eye tracker for psychophysical research. J Eye Mov Res 14, 3, 10.16910/jemr.14.3.3. https://doi.org/10.16910/jemr.14.3.3
[12]
Moritz Kassner, William Patera, and Andreas Bulling. 2014. Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp ’14 Adjunct), September 13, 2014. Association for Computing Machinery, New York, NY, USA, 1151–1160. https://doi.org/10.1145/2638728.2641695
[13]
Todd A. Kelley, John T. Serences, Barry Giesbrecht, and Steven Yantis. 2008. Cortical Mechanisms for Shifting and Holding Visuospatial Attention. Cerebral Cortex 18, 1 (January 2008), 114–125. https://doi.org/10.1093/cercor/bhm036
[14]
Athanasia Korda, David S. Zee, Thomas Wyss, Ewa Zamaro, Marco D. Caversaccio, Franca Wagner, Roger Kalla, and Georgios Mantokoudis. 2021. Impaired fixation suppression of horizontal vestibular nystagmus during smooth pursuit: pathophysiology and clinical implications. European Journal of Neurology 28, 8 (2021), 2614–2621. https://doi.org/10.1111/ene.14909
[15]
R. John Leigh and David S. Zee. 2015. The Neurology of Eye Movements (5th ed.). Oxford University Press. https://doi.org/10.1093/med/9780199969289.001.0001
[16]
Benjamin Moon, Martina Poletti, Austin Roorda, Pavan Tiruveedhula, Soh Hang Liu, Glory Linebach, Michele Rucci, and Jannick P. Rolland. 2024. Alignment, calibration, and validation of an adaptive optics scanning laser ophthalmoscope for high-resolution human foveal imaging. Appl. Opt., AO 63, 3 (January 2024), 730–742. https://doi.org/10.1364/AO.504283
[17]
Jorge Otero-Millan and Amir Kheradmand. 2016. Upright Perception and Ocular Torsion Change Independently during Head Tilt. Front Hum Neurosci 10, (November 2016). https://doi.org/10.3389/fnhum.2016.00573
[18]
Jorge Otero-Millan, Dale C. Roberts, Adrian Lasker, David S. Zee, and Amir Kheradmand. 2015. Knowing what the brain is seeing in three dimensions: A novel, noninvasive, sensitive, accurate, and low-noise technique for measuring ocular torsion. Journal of Vision 15, 14 (October 2015), 11. https://doi.org/10.1167/15.14.11
[19]
Thiago Santini, Wolfgang Fuhl, David Geisler, and Enkelejda Kasneci. 2017. EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking. VISIGRAPP (6: VISAPP) (2017), 96–101.
[20]
Ehsan Sedaghat-Nejad and Reza Shadmehr. 2021. The cost of correcting for error during sensorimotor adaptation. Proceedings of the National Academy of Sciences 118, 40 (October 2021), e2101717118. https://doi.org/10.1073/pnas.2101717118
[21]
Hiroyuki Sogo. 2013. GazeParser: an open-source and multiplatform library for low-cost eye tracking and analysis. Behav Res 45, 3 (September 2013), 684–695. https://doi.org/10.3758/s13428-012-0286-x
[22]
Scott B. Stevenson, Austin Roorda, and Girish Kumar. 2010. Eye tracking with the adaptive optics scanning laser ophthalmoscope. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (ETRA ’10), March 22, 2010. Association for Computing Machinery, New York, NY, USA, 195–198. https://doi.org/10.1145/1743666.1743714
[23]
Junichi Takahashi, Yoji Hirano, Kenichiro Miura, Kentaro Morita, Michiko Fujimoto, Hidenaga Yamamori, Yuka Yasuda, Noriko Kudo, Emiko Shishido, Kosuke Okazaki, Tomoko Shiino, Tomohiro Nakao, Kiyoto Kasai, Ryota Hashimoto, and Toshiaki Onitsuka. 2021. Eye Movement Abnormalities in Major Depressive Disorder. Frontiers in Psychiatry 12, (2021). Retrieved January 26, 2024 from https://www.frontiersin.org/articles/10.3389/fpsyt.2021.673443
[24]
Gail J Walker-Smith, Alastair G Gale, and John M Findlay. 2013. Eye Movement Strategies Involved in Face Perception. Perception 42, 11 (November 2013), 1120–1133. https://doi.org/10.1068/p060313n
[25]
Ruei-Jr Wu, Ashley M. Clark, Michele A. Cox, Janis Intoy, Paul C. Jolly, Zhetuo Zhao, and Michele Rucci. 2023. High-resolution eye-tracking via digital imaging of Purkinje reflections. Journal of Vision 23, 5 (May 2023), 4. https://doi.org/10.1167/jov.23.5.4
[26]
Yuk-Hoi Yiu, Moustafa Aboulatta, Theresa Raiser, Leoni Ophey, Virginia L. Flanagin, Peter zu Eulenburg, and Seyed-Ahmad Ahmadi. 2019. DeepVOG: Open-source pupil segmentation and gaze estimation in neuroscience using deep learning. Journal of Neuroscience Methods 324, (August 2019), 108307. https://doi.org/10.1016/j.jneumeth.2019.05.016
[27]
Niklas Zdarsky, Stefan Treue, and Moein Esghaei. 2021. A Deep Learning-Based Approach to Video-Based Eye Tracking for Human Psychophysics. Frontiers in Human Neuroscience 15, (2021). Retrieved January 26, 2024 from https://www.frontiersin.org/articles/10.3389/fnhum.2021.685830
[28]
Xiaoying Zhang, Ruosong Chang, Xue Sui, and Yutong Li. 2022. Influences of Emotion on Driving Decisions at Different Risk Levels: An Eye Movement Study. Frontiers in Psychology 13, (2022). Retrieved January 26, 2024 from https://www.frontiersin.org/articles/10.3389/fpsyg.2022.788712
[29]
Jan Zimmermann, Yuriria Vazquez, Paul W. Glimcher, Bijan Pesaran, and Kenway Louie. 2016. Oculomatic: High speed, reliable, and accurate open-source eye tracking for humans and non-human primates. Journal of Neuroscience Methods 270, (September 2016), 138–146. https://doi.org/10.1016/j.jneumeth.2016.06.016
[30]
ITUGazeTracker. 1999. ITU Gaze Tracker. Retrieved Feb 1, 2024 from https://eyecomtec.com/3104-ITU-Gaze-Tracker
[31]
OpenCV. 2024. OpenCV. Retrieved Feb 1, 2024 from https://opencv.org/releases/
[32]
Intracoustics. 2000. Micromedical head-mounted eye tracking system by Intracoustics. Retrieved Feb 1, 2024 from https://www.interacoustics.com/balance-testing-equipment/visualeyes
[33]
Blackfly-S-USB3. 2024. IR Camera. Retrieved Feb 1, 2024 from https://www.flir.com/products/blackfly-s-usb3/?model=BFS-U3-04S2M-C&vertical=machine+vision&segment=iis
Index Terms
- Open Iris - An Open Source Framework for Video-Based Eye-Tracking Research and Development
Recommendations
Analysis of eye tracking movements using FIR median hybrid filters
ETRA '00: Proceedings of the 2000 symposium on Eye tracking research & applicationsThis paper presents an approach of using FIR Median Hybrid Filters for analysis of eye tracking movements. The proposed filter can remove the eye blink artifact from the eye movement signal. The background of the project is described first. The whole ...
Compensation of head movements in mobile eye-tracking data using an inertial measurement unit
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationAnalysis of eye movements recorded with a mobile eye-tracker is difficult since the eye-tracking data are severely affected by simultaneous head and body movements. Automatic analysis methods developed for remote-, and tower-mounted eye-trackers do not ...
Eye Tracking Methodology in Screen-based Usability Testing
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsEye tracking is an important tool in usability testing of a screen-based user interface. Though eye tracking has been used in usability testing for quite a while, challenges remain. For example, how to accurately calibrate gaze point? How to interpret a ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2024
525 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
ETRA '24: The 2024 Symposium on Eye Tracking Research and Applications
June 4 - 7, 2024
Glasgow, United Kingdom
Acceptance Rates
Overall Acceptance Rate 69 of 137 submissions, 50%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 234Total Downloads
- Downloads (Last 12 months)234
- Downloads (Last 6 weeks)58
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in