Abstract
This paper presents a principled analysis of various combinations of image features to determine their suitability for remote eye tracking. It begins by reviewing the basic theory underlying the connection between eye image and gaze direction. Then a set of approaches is proposed based on different combinations of well-known features and their behaviour is evaluated, taking into account various additional criteria such as free head movement, and minimum hardware and calibration requirements. The paper proposes a final method based on multiple glints and the pupil centre; the method is evaluated experimentally. Future trends in eye tracking technology are also discussed.
Similar content being viewed by others
References
Babcock, J.S., Pelz, J.B.: Building a lightweight eyetracking headgear. In: Proceedings of the Eye Tracking Research and Applications symposium, pp. 109–114. ACM Press (2004)
Barth, E., Dorr, M., Böhme, M., Gegenfurtner, K.R., Martinetz, T.: Guiding the mind’s eye: improving communication and vision by external control of the scanpath. In: Rogowitz, B.E., Pappas, T.N., Daly, S.J. (eds.) Human Vision and Electronic Imaging, Proceeddings of SPIE, 2006, vol. 6057. Invited Contribution for a Special Session on Eye Movements, Visual Search, and Attention: a Tribute to Larry Stark
Beymer, D., Flickner, M.: Eye gaze tracking using an active stereo head. In: Proceedings of Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 451–458 (2003)
Brolly, X.L.C., Mulligan, J.B.: Implicit calibration of a remote gaze tracker. In: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2004), vol. 8, p. 134 (2004)
COGAIN: D3.1 user requirements report, with observations of difficulties users are experiencing. Technical report, European Union Network of Excellence COGAIN (contract no. IST-2003-511598) of the 6th Framework Programme, 2005. http://www.cogain.org/results/reports/COGAIN-D3.1.pdf (2005)
COGAIN: D3.2 report on features of the different systems and development needs. Technical report, European Union Network of Excellence COGAIN (contract no. IST2 003-511598) of the 6th Framework Programme, 2006. http://www.cogain.org/results/reports/COGAIN-D3.2.pdf (2006)
Crane, H., Steele, C.: Accurate three-dimensional eye tracker. J. Opt. Soc. Am. 17(5), 691–705 (1978)
CSEM: SwissRanger SR-3000, CSEM SA, Zurich, Switzerland. http://www.swissranger.ch (2006)
Duchowski, A.T.: Eye tracking methodology, theory and practice. Springer, London (2003)
Ebisawa, Y.: Unconstrained pupil detection technique using two light sources and the image difference method. In: Visualization and Intelligent Design in Engineering, pp. 79–89 (1989)
Guestrin, E.D., Eizenman, M.: General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomed. Eng. 53(6), 1124–1133 (2006)
Hansen, D.W., Pece, A.E.C.: Eye tracking in the wild. Comput. Vis. Image. Underst. 98(1), 155–181 (2005)
Hennessey, C., Noureddin, B., Lawrence, P.: A single camera eye-gaze tracking system with free head motion. In: Proceedings of Eye Tracking Research and Applications (ETRA), pp. 87–94 (2006)
Hutchinson, T.E.: Human-computer interaction using eye-gaze input. IEEE Trans. Syst. Man Cybern. 19(6) (1989)
Ji, Q., Yang, X.: Real time visual cues extraction for monitoring driver vigilance. In: ICVS: Second International Workshop on Computer Vision Systems, Vancouver, Canada (2001)
Karmali, F., Shelhamer, M.: Compensating for camera translation in video eye movement recordings by tracking a landmark selected automatically by a genetic algorithm. In: Annual International Conference of the IEEE Engineering in Medicine and Biology Proceedings, pp. 5298–5301 (2006)
Kolakowski, S.M., Pelz, J.B.: Compensating for eye tracker camera movement. In: ETRA 2006: Proceedings of the 2006 symposium on Eye Tracking Research and Applications, pp. 79–85 (2006)
Li, D., Winfield, D., Parkhurst, D.J.: Starburst: a hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In: Proceedings of the IEEE Vision for Human-Computer Interaction Workshop at CVPR, pp. 1–8 (2005)
Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. SIAM J. Appl. Math. 11, 431–441 (1963)
Meyer, A., Böhme, M., Martinetz, T., Barth, E.: A single-camera remote eye tracker. In: Perception and Interactive Technologies. Lecture Notes in Artificial Intelligence, vol. 4021, pp. 208–211. Springer, New York (2006)
Morimoto, C.H., Koons, D., Amir, A., Flickner, M.: Pupil detection and tracking using multiple light sources. IVC 18(4), 331–335 (2000)
Morimoto, C.H., Mimica, M.R.M.: Eye gaze tracking techniques for interactive applications. Comput. Vis. Image. Underst. 98(1), 4–24 (2005)
Müller, P., Cavegn, D., d’Ydewalle, G., Groner, R.: A comparison of a new limbus tracker, corneal reflection technique, purkinje eye tracking and electro-oculography. In: d’Ydewalle, G., Rensbergen, J.V., (eds.) Perception and Cognition, pp. 393–401. Elsevier, Amsterdam (1993)
Newman, R., Matsumoto, Y., Rougeaux, S., Zelinsky, A.: Real-time stereo tracking for head pose and gaze estimation. In: International Conference on Automatic Face and Gesture Recognition, pp. 122–128 (2000)
Ohno, T., Mukawa, N.: A free-head, simple calibration, gaze tracking system that enables gaze-based interaction. In: Eye Tracking Research and Applications (ETRA), pp. 115–122 (2004)
Pomerleau, D.A., Baluja, S.: Non-intrusive gaze tracking using artificial neural networks. In: CMU-CS-TR (1994)
Rabbetts, R.B.: Bennett and Rabbetts clinical visual optics, 3rd edn. Butterworth-Heinemann, Elsevier, Edinburgh (1998)
Shih, S.W., Liu, J.: A novel approach to 3-D gaze tracking using stereo cameras. IEEE Trans. Syst. Man Cybern. B. 34(1), 234–245 (2004)
Shih, S.-W., Wu, Y.-T., Liu, J.: A calibration-free gaze tracking technique. In: Proceedings of the 15th International Conference on Pattern Recognition, pp. 201–204 (2000)
Tan, K.-H., Kriegman, D.J., Ahuja, N.: Appearance-based eye gaze estimation. In: IEEE Workshop on Applications of Computer Vision, pp. 191–195 (2002)
Tobii: Tobii 1750 eye tracker, Tobii Technology AB, Stockholm, Sweden. http://www.tobii.se (2002)
Villanueva, A., Cabeza, R., Porta, S.: Eye tracking: pupil orientation geometrical modeling. Image Vis. Comput. 24(7), 663–679 (2006)
Wyszecki, G., Stiles, W.S.: Color science: concepts and methods, quantitative data and formulae, 2nd edn. Wiley, New York (1982)
Yoo, D.H., Chung, M.J.: A novel non-instrusive eye gaze estimation using cross-ratio under large head motion. Comput. Vis. Image Underst. 98, 25–51 (2005)
Young, L., Sheena, D.: Methods & designs: survey of eye movement recording methods. Behav. Res. Methods Instrum. 7(5), 397–429 (1975)
Acknowledgments
Our research has received funding from the European Commission within the Network of Excellence COGAIN (contract no. IST-2003-511598) of the 6th Framework Programme. Additionally, research at the University of Lübeck has received funding from the European Commission within the project GazeCom (contract no. IST-C-033816) of the 6th FP. All views expressed herein are those of the authors alone; the European Community is not liable for any use made of the information.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Villanueva, A., Daunys, G., Hansen, D.W. et al. A geometric approach to remote eye tracking. Univ Access Inf Soc 8, 241–257 (2009). https://doi.org/10.1007/s10209-009-0149-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-009-0149-0