More Web Proxy on the site http://driver.im/

poster

Cross-Ratio Based Gaze Estimation using Polarization Camera System

Authors:

Takashi Nagamatsu,

Kentaro TakemuraAuthors Info & Claims

ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

Pages 333 - 338

https://doi.org/10.1145/3279778.3279909

Published: 19 November 2018 Publication History

Abstract

Eye-based interaction is one of the solutions for achieving intuitive interfaces on surfaces such as a large display, and thus, various eye-tracking methods have been studied. Cross-ratio based gaze estimation, which determines the point-of-gaze on a screen, has been studied actively as a novel eye-tracking method because the method does not require a hardware calibration defining the relationship between a camera and monitor. We expect that the cross-ratio method will be a breakthrough for eye-based interaction under various circumstances such as tabletop devices and digital whiteboards. In eye-tracking, near-infrared light is often emitted, and at least four LEDs are located on display corners for detecting the screen plane in the cross-ratio based method. However, long-time radiation of near-infrared light can make a user fatigued. Therefore, in this study, we attempted to extract the screen area correctly without near-infrared radiation emission. A polarizing filter is included in the display, and thus, visibility of the screen can be controlled by the light's polarization direction of the external polarized light filter. We propose gaze estimation based on the cross-ratio method using a developed polarization camera system, which can capture two polarized images of different angles simultaneously. Further, we confirmed that the point-of-gaze could be estimated using the screen reflection detected by computing the differences between two images without near-infrared emission.

Supplementary Material

suppl.mov (isspp20.mp4)

Supplemental video

Download
15.42 MB

References

[1]

Beymer, D., and Flickner, M. Eye gaze tracking using an active stereo head. In 2003 IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognition, 2003. Proc., vol. 2 (2003), II--451--8.

[2]

Coutinho, F. L., and Morimoto, C. H. Improving head movement tolerance of cross-ratio based eye trackers. Int. J. of Computer Vision 101, 3 (2013), 459--481.

Digital Library

[3]

Guestrin, E. D., and Eizenman, M. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomedical Eng. 53, 6 (2006), 1124--1133.

[4]

Hansen, D. W. D., Agustin, J. S. J., and Villanueva, A. Homography Normalization for Robust Gaze Estimation in Uncalibrated Setups. In Proc. 2010 Symp. Eye-Tracking Research & Applications - ETRA '10, vol. 1 (2010), 13--20.

Digital Library

[5]

Huang, J.-b., Cai, Q., Liu, Z., Ahuja, N., and Zhang, Z. Towards Accurate and Robust Cross-Ratio based Gaze Trackers Through Learning From Simulation. In Proc. Symp. Eye Track. Res. Appl. - ETRA '14 (2014), 75--82.

Digital Library

[6]

Jacob, R. J. K. What you look at is what you get: Eye movement-based interaction techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '90 (1990), 11--18.

Digital Library

[7]

Ji, Q., and Yang, X. Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance. Real-Time Imaging 8, 5 (oct 2002), 357--377.

Digital Library

[8]

Kang, J. J., Guestrin, E. D., Maclean, W. J., and Eizenman, M. Simplifying the Cross-Ratios Method of Point-of-Gaze Estimation. In 30th Canadian medical and biological Engineering Conf. (CMBEC30) (2007), 1--4.

[9]

Morimoto, C. H., and Mimica, M. R. Eye gaze tracking techniques for interactive applications. Comput. Vis. Image Underst. 98, 1 (2005), 4--24.

Digital Library

[10]

Nagamatsu, T., Kamahara, J., and Tanaka, N. Calibration-free gaze tracking using a binocular 3d eye model. In CHI '09 Extended Abstracts on Human Factors in Computing Systems, CHI EA '09 (2009), 3613--3618.

Digital Library

[11]

Nishino, K., and Nayar, S. K. Corneal Imaging System: Environment from Eyes. Int. J. Comput. Vis. 70, 1 (oct 2006), 23--40.

Digital Library

[12]

Plopski, A., Itoh, Y., Nitschke, C., Kiyokawa, K., Klinker, G., and Takemura, H. Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays. IEEE Trans. Vis. Comput. Graph. 21, 4 (apr 2015), 481--490.

[13]

Takemura, K., Yamakawa, T., Takamatsu, J., and Ogasawara, T. Estimation of a focused object using a corneal surface image for eye-based interaction. 2014 Journal of Eye Movement Research 7, 3 (2014), 1--9.

[14]

Vidal, M., Bulling, A., and Gellersen, H. Pursuits: Spontaneous interaction with displays based on smooth pursuit eye movement and moving targets. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '13 (2013), 439--448.

Digital Library

[15]

Yoo, D. H., Kim, J. H., Lee, B. R., and Chung, M. J. Non-contact eye gaze tracking system by mapping of corneal reflections. In Proc. of 5th IEEE Int. Conf. on Automatic Face Gesture Recognition (2002), 101--106.

Digital Library

[16]

Zhai, S., Morimoto, C., and Ihde, S. Manual and gaze input cascaded (magic) pointing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '99 (1999), 246--253.

Digital Library

Cited By

Liu JChi JYang Z(2024)A review on personal calibration issues for video-oculographic-based gaze trackingFrontiers in Psychology10.3389/fpsyg.2024.130904715Online publication date: 20-Mar-2024
https://doi.org/10.3389/fpsyg.2024.1309047
Nakamura ATakemura K(2024)Extracting Corneal Reflection of Screen by High-Speed Control of PolarizationCompanion Proceedings of the 2024 Conference on Interactive Surfaces and Spaces10.1145/3696762.3698048(33-36)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3696762.3698048
Liu JWu JYang HChi J(2023)An Improved Cross-Ratio Based Gaze Estimation Method Using Weighted Average and Polynomial CompensationIEEE Access10.1109/ACCESS.2023.323412011(2410-2423)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3234120
Show More Cited By

Index Terms

Cross-Ratio Based Gaze Estimation using Polarization Camera System
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

Gaze Estimation with Imperceptible Marker Displayed Dynamically using Polarization
ETRA '22: 2022 Symposium on Eye Tracking Research and Applications

Conventional eye-tracking methods require NIR-LEDs at the corners and edges of displays as references. However, extensive eyeball rotation results in the loss of reflections. Therefore, we propose imperceptible markers that can be dynamically displayed ...
Cross-Ratio Based Gaze Estimation for Multiple Displays using a Polarization Camera
UIST '19 Adjunct: Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

While eye tracking has been typically used for achieving intuitive user interfaces, it is not sufficient when it comes to dealing with multiple-display environments. In such environments, which have become popular recently, the point-of-gaze should be ...
Screen corner detection using polarization camera for cross-ratio based gaze estimation
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Eye tracking, which measures line of sight, is expected to advance as an intuitive and rapid input method for user interfaces, and a cross-ratio based method that calculates the point-of-gaze using homography matrices has attracted attention because it ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

November 2018

499 pages

ISBN:9781450356947

DOI:10.1145/3279778

General Chairs:
Hideki Koike
Tokyo Institute of Technology, Japan
,
Carlo Ratti
Massachusetts Institute of Technology, USA
,
Yuichiro Takeuchi
Sony Computer Science Laboratories Inc., Japan
,
Program Chairs:
Kentaro Fukuchi
Meiji University, Japan
,
Stacey Scott
University of Guelph, Canada
,
Diego Martinez Plasencia
University of Sussex, United Kingdom

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 November 2018

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Japan Society for the Promotion of Science

Conference

ISS '18

Sponsor:

SIGCHI

ISS '18: 2018 ACM International Conference on Interactive Surfaces and Spaces

November 25 - 28, 2018

Tokyo, Japan

Acceptance Rates

ISS '18 Paper Acceptance Rate 28 of 105 submissions, 27%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
165
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu JChi JYang Z(2024)A review on personal calibration issues for video-oculographic-based gaze trackingFrontiers in Psychology10.3389/fpsyg.2024.130904715Online publication date: 20-Mar-2024
https://doi.org/10.3389/fpsyg.2024.1309047
Nakamura ATakemura K(2024)Extracting Corneal Reflection of Screen by High-Speed Control of PolarizationCompanion Proceedings of the 2024 Conference on Interactive Surfaces and Spaces10.1145/3696762.3698048(33-36)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3696762.3698048
Liu JWu JYang HChi J(2023)An Improved Cross-Ratio Based Gaze Estimation Method Using Weighted Average and Polynomial CompensationIEEE Access10.1109/ACCESS.2023.323412011(2410-2423)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3234120
Koshikawa KNagamatsu TTakemura K(2022)Model-based Gaze Estimation with Transparent Markers on Large ScreensProceedings of the ACM on Human-Computer Interaction10.1145/35308886:ETRA(1-16)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530888
Inoue YKoshikawa KTakemura K(2022)Gaze Estimation with Imperceptible Marker Displayed Dynamically using Polarization2022 Symposium on Eye Tracking Research and Applications10.1145/3517031.3529640(1-5)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3517031.3529640
Koshikawa KSasaki MUtsu TTakemura K(2020)Polarized Near-Infrared Light Emission for Eye Gaze EstimationACM Symposium on Eye Tracking Research and Applications10.1145/3379156.3391342(1-4)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379156.3391342
Sasaki MNagamatsu TTakemura KGuimbretière FBernstein MReinecke K(2019)Cross-Ratio Based Gaze Estimation for Multiple Displays using a Polarization CameraAdjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332167.3357095(1-3)Online publication date: 14-Oct-2019
https://dl.acm.org/doi/10.1145/3332167.3357095
Sasaki MNagamatsu TTakemura KKrejtz KSharif B(2019)Screen corner detection using polarization camera for cross-ratio based gaze estimationProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3314111.3319814(1-9)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3314111.3319814

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents