More Web Proxy on the site http://driver.im/

research-article

Towards accurate and robust cross-ratio based gaze trackers through learning from simulation

Authors:

Narendra Ahuja,

Zhengyou ZhangAuthors Info & Claims

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 75 - 82

https://doi.org/10.1145/2578153.2578162

Published: 26 March 2014 Publication History

Abstract

Cross-ratio (CR) based methods offer many attractive properties for remote gaze estimation using a single camera in an uncalibrated setup by exploiting invariance of a plane projectivity. Unfortunately, due to several simplification assumptions, the performance of CR-based eye gaze trackers decays significantly as the subject moves away from the calibration position. In this paper, we introduce an adaptive homography mapping for achieving gaze prediction with higher accuracy at the calibration position and more robustness under head movements. This is achieved with a learning-based method for compensating both spatially-varying gaze errors and head pose dependent errors simultaneously in a unified framework. The model of adaptive homography is trained offline using simulated data, saving a tremendous amount of time in data collection. We validate the effectiveness of the proposed approach using both simulated and real data from a physical setup. We show that our method compares favorably against other state-of-the-art CR based methods.

References

[1]

Cerrolaza, J. J., Villanueva, A., and Cabeza, R. 2008. Taxonomic study of polynomial regressions applied to the calibration of video-oculographic systems. In Proceedings of the symposium on Eye tracking research & applications, 259--266.

Digital Library

[2]

Cerrolaza, J. J., Villanueva, A., Villanueva, M., and Cabeza, R. 2012. Error characterization and compensation in eye tracking systems. In Proceedings of the Symposium on Eye Tracking Research & Applications, 205--208.

Digital Library

[3]

Coutinho, F. L., and Morimoto, C. H. 2006. Free head motion eye gaze tracking using a single camera and multiple light sources. In Computer Graphics and Image Processing, 171--178.

[4]

Coutinho, F. L., and Morimoto, C. H. 2010. A depth compensation method for cross-ratio based eye tracking. In Proceedings of the Symposium on Eye-Tracking Research & Applications, 137--140.

Digital Library

[5]

Coutinho, F. L., and Morimoto, C. H. 2012. Augmenting the robustness of cross-ratio gaze tracking methods to head movement. In Proceedings of the Symposium on Eye Tracking Research and Applications, 59--66.

Digital Library

[6]

Duchowski, A. T. 2007. Eye tracking methodology: Theory and practice, vol. 373. Springer.

Digital Library

[7]

Guestrin, E. D., and Eizenman, M. 2006. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Transactions on Biomedical Engineering 53, 6, 1124--1133.

[8]

Hansen, D. W., and Ji, Q. 2010. In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 3, 478--500.

Digital Library

[9]

Hansen, D. W., Agustin, J. S., and Villanueva, A. 2010. Homography normalization for robust gaze estimation in uncalibrated setups. In Proceedings of the Symposium on Eye-Tracking Research & Applications, 13--20.

Digital Library

[10]

Hennessey, C., Noureddin, B., and Lawrence, P. 2006. A single camera eye-gaze tracking system with free head motion. In Proceedings of the symposium on Eye tracking research & applications, 87--94.

Digital Library

[11]

Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., and Van de Weijer, J. 2011. Eye tracking: A comprehensive guide to methods and measures. Oxford University Press.

[12]

Kang, J. J., Guestrin, E., MacLean, W., and Eizenman, M. 2007. Simplifying the cross-ratios method of point-of-gaze estimation. In Canadian medical and biological engineering conference.

[13]

Kang, J. J., Eizenman, M., Guestrin, E. D., and Eizenman, E. 2008. Investigation of the cross-ratios method for point-of-gaze estimation. IEEE Transactions on Biomedical Engineering 55, 9, 2293--2302.

[14]

Model, D., and Eizenman, M. 2010. An automatic personal calibration procedure for advanced gaze estimation systems. IEEE Transactions on Biomedical Engineering 57, 5, 1031--1039.

[15]

Morimoto, C. H., and Mimica, M. R. 2005. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding 98, 1, 4--24.

Digital Library

[16]

Pantic, M., Pentland, A., Nijholt, A., and Huang, T. S. 2007. Human computing and machine understanding of human behavior: a survey. 47--71.

Digital Library

[17]

Yoo, D. H., and Chung, M. J. 2005. A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Computer Vision and Image Understanding 98, 1, 25--51.

Digital Library

[18]

Yoo, D. H., Kim, J. H., Lee, B. R., and Chung, M. J. 2002. Non-contact eye gaze tracking system by mapping of corneal reflections. In IEEE International Conference on Automatic Face and Gesture Recognition, 94--99.

Digital Library

[19]

Zhai, S., Morimoto, C., and Ihde, S. 1999. Manual and gaze input cascaded (magic) pointing. In Proceedings of the SIGCHI conference on Human factors in computing systems, 246--253.

Digital Library

Cited By

Yeh CShen WChi HLin CChen J(2023)Enhancing Online Learning Monitoring with Novel Image Recognition Method Using Dlib for Eye Feature Detection2023 12th International Conference on Awareness Science and Technology (iCAST)10.1109/iCAST57874.2023.10359300(340-345)Online publication date: 9-Nov-2023
https://doi.org/10.1109/iCAST57874.2023.10359300
Skaramagkas VGiannakakis GKtistakis EManousos DKaratzanis ITachos NTripoliti EMarias KFotiadis DTsiknakis M(2023)Review of Eye Tracking Metrics Involved in Emotional and Cognitive ProcessesIEEE Reviews in Biomedical Engineering10.1109/RBME.2021.306607216(260-277)Online publication date: 2023
https://doi.org/10.1109/RBME.2021.3066072
Liu JWu JYang HChi J(2023)An Improved Cross-Ratio Based Gaze Estimation Method Using Weighted Average and Polynomial CompensationIEEE Access10.1109/ACCESS.2023.323412011(2410-2423)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3234120
Show More Cited By

Index Terms

Towards accurate and robust cross-ratio based gaze trackers through learning from simulation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Improving cross-ratio-based eye tracking techniques by leveraging the binocular fixation constraint
ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

The cross-ratio approach has recently attracted increasing attention in eye-gaze tracking due to its simplicity in setting up a tracking system. Its accuracy, however, is lower than that of the model-based approach, and substantial efforts have been ...
Augmenting the robustness of cross-ratio gaze tracking methods to head movement
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Remote gaze estimation using a single non-calibrated camera, simple user calibration or calibration free, and robust to head movements are very desirable features of eye tracking systems. Because cross-ratio (CR) is an invariant property of projective ...
Estimating fusion weights of a multi-camera eye tracking system by leveraging user calibration data
ETRA '16: Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications

Cross-ratio (CR)-based eye tracking has been attracting much interest due to its simple setup, yet its accuracy is lower than that of the model-based approaches. In order to improve the estimation accuracy, a multi-camera setup can be exploited rather ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2014

394 pages

ISBN:9781450327510

DOI:10.1145/2578153

Conference Chairs:
Pernilla Qvarfordt
FX Palo Alto Laboratory
,
Dan Witzner Hansen
IT University, Denmark

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Office of Naval Research

Conference

ETRA '14

Sponsor:

ETRA '14: Eye Tracking Research and Applications

March 26 - 28, 2014

Florida, Safety Harbor

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
313
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yeh CShen WChi HLin CChen J(2023)Enhancing Online Learning Monitoring with Novel Image Recognition Method Using Dlib for Eye Feature Detection2023 12th International Conference on Awareness Science and Technology (iCAST)10.1109/iCAST57874.2023.10359300(340-345)Online publication date: 9-Nov-2023
https://doi.org/10.1109/iCAST57874.2023.10359300
Skaramagkas VGiannakakis GKtistakis EManousos DKaratzanis ITachos NTripoliti EMarias KFotiadis DTsiknakis M(2023)Review of Eye Tracking Metrics Involved in Emotional and Cognitive ProcessesIEEE Reviews in Biomedical Engineering10.1109/RBME.2021.306607216(260-277)Online publication date: 2023
https://doi.org/10.1109/RBME.2021.3066072
Liu JWu JYang HChi J(2023)An Improved Cross-Ratio Based Gaze Estimation Method Using Weighted Average and Polynomial CompensationIEEE Access10.1109/ACCESS.2023.323412011(2410-2423)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3234120
Liu JGu R(2022)Gaze tracking technology for flight simulator2022 IEEE 4th International Conference on Civil Aviation Safety and Information Technology (ICCASIT)10.1109/ICCASIT55263.2022.9987200(569-573)Online publication date: 12-Oct-2022
https://doi.org/10.1109/ICCASIT55263.2022.9987200
Qian KArichi TPrice ADall’Orso SEden JNoh YRhode KBurdet ENeil MEdwards AHajnal J(2021)An eye tracking based virtual reality system for use inside magnetic resonance imaging systemsScientific Reports10.1038/s41598-021-95634-y11:1Online publication date: 11-Aug-2021
https://doi.org/10.1038/s41598-021-95634-y
Kim JJeong J(2020)Gaze in the Dark: Gaze Estimation in a Low-Light Environment with Generative Adversarial NetworksSensors10.3390/s2017493520:17(4935)Online publication date: 31-Aug-2020
https://doi.org/10.3390/s20174935
Luo KJia XXiao HLiu DPeng LQiu JHan P(2020)A New Gaze Estimation Method Based on Homography Transformation Derived from Geometric RelationshipApplied Sciences10.3390/app1024907910:24(9079)Online publication date: 18-Dec-2020
https://doi.org/10.3390/app10249079
Ahmed N(2020)Real-time accurate eye center localization for low-resolution grayscale imagesJournal of Real-Time Image Processing10.1007/s11554-020-00955-218:1(193-220)Online publication date: 4-Apr-2020
https://dl.acm.org/doi/10.1007/s11554-020-00955-2
Uhm KKang MKim JKo S(2020)Improving the robustness of gaze tracking under unconstrained illumination conditionsMultimedia Tools and Applications10.1007/s11042-020-08679-y79:29-30(20603-20616)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1007/s11042-020-08679-y
Sasaki MNagamatsu TTakemura KKrejtz KSharif B(2019)Screen corner detection using polarization camera for cross-ratio based gaze estimationProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3314111.3319814(1-9)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3314111.3319814
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents