Cited By
View all- Mi JGao YYuan SLi W(2023)Accurate and Robust Eye Center Localization by Deep VotingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.323938133:8(4070-4082)Online publication date: 1-Aug-2023
Eye center localization using gradient and intensity information under uncontrolled environment
Pages 7145 - 7168
Abstract
Accurate localization of eyes in low-resolution facial images is a challenging problem in computer vision community. The existing techniques provides inaccurate results for eye center localization in an uncontrolled environment, e.g. low resolution, low contrast, scale, pose and illumination variations etc. This study proposes a hybrid method for accurate eye center localization which shows robustness to above-mentioned problems. The proposed hybrid method is a two stage method. In the first stage, a new operator based on gradient and intensity information is proposed to extract the coarse eye candidates. The proposed operator uses the integral image and the dot product operations that make the system computationally efficient. The likelihood of eye centers are further verified in the second stage using a convolutional neural network architecture. In the verification stage, the normalized region of interest is adopted to solve the variations of different scales. The eye pair satisfying the predefined constraints is selected as the true eye pair. The proposed method is extensively tested on various databases to check its accuracy to the uncontrolled environment. The experimental analysis suggests that the proposed hybrid method can localize the eye center more precisely and eventually shows superior performance over some of the competitive state-of-the-art methods.
References
[1]
Abiyev RH and Arslan M Head mouse control system for people with disabilities Expert Syst 2019 3 e12398
[2]
Ahmed NY Real-time accurate eye center localization for low-resolution grayscale images J Real-Time Image Proc 2021 18 1 193-220
[3]
Ahmed M and Laskar RH Eye center localization in a facial image based on geometric shapes of iris and eyelid under natural variability Image Vis Comput 2019
[4]
Ahmed M and Laskar RH Eye detection and localization in a facial image based on partial geometric shape of iris and eyelid under practical scenarios J Electron Imaging 2019 28 3
[5]
Ahmed M and Laskar RH Evaluation of accurate iris center and eye corner localization method in a facial image for gaze estimation Multimed Syst 2021
[6]
Alonso-Fernandez F and Bigun J A survey on periocular biometrics research Pattern Recogn Lett 2016 82 92-105
[7]
Asadifard M, Shanbezadeh J (2010) Automatic adaptive center of pupil detection using face detection and CDF analysis, In: Proceedings of the International Multiconference of Engineers and Computer Scientists, vol 1, p 3
[8]
Baek SJ, Choi KA, Ma C, Kim YH, and Ko SJ Eyeball model-based iris center localization for visible image-based eye-gaze tracking systems IEEE Trans Consum Electron 2013 59 2 415-421
[9]
BF Database. Dataset for face detection, Facedb - BioID, https://www.bioid.com/facedb/. Google Scholar
[10]
Borza D, Darabant AS, and Danescu R Real-time detection and measurement of eye features from color images Sensors 2016 16 7 1105
[11]
Chen S and Liu C Eye detection using discriminatory Haar features and a new efficient SVM Image Vis Comput 2015 33 68-77
[12]
Choi JH, Lee KI, and Song BC Eye pupil localization algorithm using convolutional neural networks Multimed Tools Appl 2020 79 43 32563-32574
[13]
Cootes TF, Taylor CJ, and Cooper DH Graham J (1995) Active shape models-their training and application Comput Vis Image Underst 1995 61 1 38-59
[14]
Cootes TF, Edwards GJ, and Taylor CJ Active appearance models IEEE Trans Pattern Anal Mach Intell 2001 23 6 681-685
[15]
Cristinacce D, Cootes TF (2006) Feature detection and tracking with constrained local models. In Bmvc, vol 1, no. 2, p 3
[16]
Daugman J (2009) How iris recognition works. In: The essential guide to image processing, pp 715–739
[17]
Drewes H (2014) Eye gaze tracking. Interactive displays: natural human interface technologies, pp 251–283
[18]
Duchowski AT (2007) Eye tracking methodology. Theory and practice, p 328
[19]
Farkas LG and Katic MJ Forrest CR, International anthropometric study of facial morphology in various ethnic groups/races J Craniofac Surg 2005 16 4 615-646
[20]
Fasel I, Fortenberry B, and Movellan J A generative framework for real-time object detection and classification Comput Vis Image Underst 2005 98 1 182-210
[21]
Gao W, Cao B, Shan S, Chen X, Zhou D, Zhang X, and Zhao D The CAS-PEAL large-scale Chinese face database and baseline evaluations IEEE Trans Syst Man Cybern A Syst Hum 2008 38 1 149-161
[22]
George A and Routray A Fast and accurate algorithm for eye localization for gaze tracking in low-resolution images IET Comput Vision 2016 10 7 660-669
[23]
Gross R, Matthews I, Cohn J, Kanade T, and Baker S Multi-pie Image Vis Comput 2010 28 5 807-813
[24]
Hamouz M, Kittler J, Kamarainen JK, Paalanen P, Kalviainen H, and Matas J Feature-based affine-invariant localization of faces IEEE Trans Pattern Anal Mach Intell 2005 27 9 1490-1495
[25]
Hassaballah M, Kandazawa T, and Ido S Efficient eye detection method based on grey intensity variance and independent components analysis IET Comput Vision 2010 4 4 261-271
[26]
Hsu WY and Chung CJ A novel eye center localization method for multiview faces Pattern Recognit 2021 119 108078
[27]
Ito Y, Ohyama W, Wakabayashi T, Kimura F (2012) Detection of eyes by circular Hough transform and histogram of gradient. In: Pattern Recognition (ICPR), 21st IEEE International Conference, pp 1795–1798
[28]
Jain AK Fundamentals of digital image processing 1989 Englewood Cliffs Prentice Hall
[29]
Jariwala KN, Nandi A, and Dalal UD A real-time robust eye center localization using geometric eye model and edge gradients in unconstrained visual environment Int J Comput Appl 2015 128 1 22-27
[30]
Jesorsky O, Kirchberg KJ, Frischholz RW (2001) Robust face detection using the Hausdorff distance. In: International Conference on audio-and video-based biometric person authentication. Springer, Berlin, pp 90–95
[31]
Jing MQ and Chen LH A novel method for horizontal eye line detection under various environments Int J Pattern Recognit Artif Intell 2010 24 03 475-498
[32]
Jo J, Lee SJ, Park KR, Kim IJ, and Kim J Detecting driver drowsiness using feature-level fusion and user-specific classification Expert Syst Appl 2014 41 4 1139-1152
[33]
Jo J, Choi H, Kim IJ, and Kim J Single-view-based 3D facial reconstruction method robust against pose variations Pattern Recogn 2015 48 1 73-85
[34]
Kim BS, Lee H, and Kim WY Rapid eye detection method for non-glasses type 3D display on portable devices IEEE Trans Consum Electron 2010 56 4 2498-2505
[35]
Kim H, Jo J, Toh KA, and Kim J Eye detection in a facial image under pose variation based on multi-scale iris shape feature Image Vis Comput 2017 57 147-164
[36]
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, pp 1097–1105
[37]
Kroon B, Maas S, Boughorbel S, and Hanjalic A Eye localization in low and standard definition content with application to face matching Comput Vis Image Underst 2009 113 8 921-933
[38]
LeCun Y, Bottou L, Bengio Y, and Haffner P Gradient-based learning applied to document recognition Proc IEEE 1998 86 11 2278-2324
[39]
Leo M, Cazzato D, De Marco T, and Distante C Unsupervised eye pupil localization through differential geometry and local self-similarity matching PLoS ONE 2014 9 8 e102829
[40]
Levinshtein A, Phung E, and Aarabi P Hybrid eye center localization using cascaded regression and hand-crafted model fitting Image Vis Comput 2018 71 17-24
[41]
Liu ZT, Jiang CS, Li SH, Wu M, Cao WH, and Hao M Eye state detection based on weight binarization convolution neural network and transfer learning Appl Soft Comput 2021 109 107565
[42]
Markuš N, Frljak M, Pandžić IS, Ahlberg J, and Forchheimer R Eye pupil localization with an ensemble of randomized trees Pattern Recogn 2014 47 2 578-587
[43]
Monzo D, Albiol A, Sastre J, and Albiol A Precise eye localization using HOG descriptors Mach Vis Appl 2011 22 3 471-480
[44]
Morimoto CH and Mimica MRM Eye gaze tracking techniques for interactive applications Comput Vis Image Underst 2005 98 1 4-24
[45]
Oliveira LS, Borges DL, Vidal FB, Chang L (2012) A fast eye localization and verification method to improve face matching in surveillance videos. IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp 840–845
[46]
Ponz V, Villanueva A, Cabeza R (2012) Dataset for the evaluation of eye detector for gaze estimation. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, pp 681–684
[47]
Ren Y, Wang S, Hou B, and Ma J A novel eye localization method with rotation invariance IEEE Trans Image Process 2014 23 1 226-239
[48]
Savakis A, Sharma R, Kumar M (2014) Efficient eye detection using HOG-PCA descriptor. In Imaging and Multimedia Analytics in a Web and Mobile World 2014, vol 9027, p 90270J. International Society for Optics and Photonics
[49]
Skodras E and Fakotakis N Precise localization of eye centers in low-resolution color images Image Vis Comput 2015 36 51-60
[50]
Song F, Tan X, Chen S, and Zhou ZH A literature survey on robust and efficient eye localization in real-life scenarios Pattern Recogn 2013 46 12 3157-3173
[51]
Tan X, Song F, Zhou ZH, Chen S (2009) Enhanced pictorial structures for precise eye localization under uncontrolled conditions. Computer Vision and Pattern Recognition, IEEE Conference, pp 1621–1628
[52]
Timm F and Barth E Accurate eye centre localisation by means of gradients Visapp 2011 11 125-130
[53]
Valenti R and Gevers T Accurate eye center location through invariant isocentric patterns IEEE Trans Pattern Anal Mach Intell 2012 34 9 1785-1798
[54]
Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. Computer Vision and Pattern Recognition, Proceedings of the 2001 IEEE Computer Society Conference, vol 1, pp I-I
[55]
Wang P and Ji Q Multi-view face and eye detection using discriminant features Comput Vis Image Underst 2007 105 2 99-111
[56]
Wang J, Sung A, Venkateswarlu R (2003) Eye gaze estimation from a single image of one eye. In: Computer Vision, Proceedings, Ninth IEEE International Conference; pp 136–143
[57]
Wang P, Green MB, Ji Q, Wayman, J (2005) Automatic eye detection and its validation. Computer Vision and Pattern Recognition, IEEE Computer Society Conference, 3, pp 164-172
[58]
Xia Y, Lou J, Dong J, Qi L, Li G, and Yu H Hybrid regression and isophote curvature for accurate eye center localization Multimed Tools Appl 2020 79 1 805-824
[59]
Young D, Tunley H, Samuels R (1995) Specialized Hough transform and active contour methods for real-time eye tracking. University of Sussex, Cognitive & Computing Science
[60]
Zhao S, Grigat RR (2006) Robust eye detection under active infrared illumination. In Proceedings of the 18th International Conference on Pattern Recognition, IEEE Computer Society, pp 481–484
Index Terms
- Eye center localization using gradient and intensity information under uncontrolled environment
Index terms have been assigned to the content through auto-classification.
Recommendations
Precise localization of eye centers with multiple cues
Automatic detection and precise localization of human eye centers are the essential processes in photo related multimedia applications. Since eye center points are used as reference base points for further intelligent processing, precise eye center ...
Eye center localization in a facial image based on geometric shapes of iris and eyelid under natural variability
AbstractThe estimation of the human eye centers is one of the important step in several computer vision applications such as driver drowsiness detection, eye tracking, face recognition etc. Most of the existing techniques are able to localize ...
Highlights- We proposed semi-circular edge shape (sCES) and semi-ellipse edge shape (sEES) features for possible eye detection.
Eye detection and coarse localization of pupil for video-based eye tracking systems
AbstractA video-based eye tracking system generally captures NIR images, each of which contains one or two eyes of a subject. The subject’s point of gaze is then determined using 3D eye model and pupil centre corneal reflection technique. Eye detection ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 01 February 2022
Accepted: 14 December 2021
Revision received: 16 September 2021
Received: 07 June 2021
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Jan 2025
Other Metrics
Citations
Cited By
View all- Mi JGao YYuan SLi W(2023)Accurate and Robust Eye Center Localization by Deep VotingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.323938133:8(4070-4082)Online publication date: 1-Aug-2023