Abstract
Face recognition is one of the most common authentication methods. Although much research has been conducted in this area, there are still many challenging issues to be addressed on face recognition, such as a large number of images in a dataset, with only one sample per person. The goal of this paper is to provide a robust face recognition method for a database having a large number of images with only one sample per person. The proposed method first uses a simple clustering approach to divide the images hierarchically into balanced clusters. Balanced clustering helps us to continue clustering in several hierarchies and finally reach very small clusters of equal size. Then, the face recognition task is performed within each cluster. A combination of the Non-negative Matrix Factorization (NMF) and the Fast Retina Key-point (FREAK) descriptors has been used to match the faces. The proposed method was evaluated on the FERET dataset that achieved an accuracy of 98.36%. Also, some other experiments have been done to validate the efficiency of the proposed method. The results of the experiments show that the proposed method can be applied to even larger datasets, while its complexity increases linearly.
Similar content being viewed by others
Notes
Available on http://pics.stir.ac.uk.
Available on https://cswww.essex.ac.uk/mv/allfaces/faces94.html.
References
Ahonen T, Hadid A, Pietikäinen M (2004) Face recognition with local binary patterns. In: Computer vision - ECCV 2004, vol 3021. Springer Berlin Heidelberg, pp 469–481
Al-Obaydy WNI, Suandi SA (2020) Open-set face recognition in video surveillance: a survey. In: Kasruddin Nasir AN, Ahmad MA, Najib MS, Abdul Wahab Y, Othman NA, Abd Ghani NM, Irawan A, Khatun S, Raja Ismail RMT, Saari MM, Daud MR, Mohd Faudzi AA (eds) InECCE2019. Springer Singapore, Singapore, pp 425–436
Alahi A, Ortiz R, Vandergheynst P (2012) FREAK: fast retina keypoint. In: 2012 IEEE conference on computer vision and pattern recognition. IEEE, Providence, pp 510–517
Annalakshmi M, Roomi SMM, Naveedh AS (2019) A hybrid technique for gender classification with SLBP and HOG features. Clust Comput 22 (S1):11–20
Bai G, Zhu Y, Ding Z (2008) A hierarchical face recognition method based on local binary pattern. In: 2008 Congress on image and signal processing. IEEE, Sanya, pp 610–614
Bartlett M, Movellan J, Sejnowski T (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464
Bastanfard A, Takahashi H, Nakajima M (2004) Toward e-appearance of human face and hair by age, expression and rejuvenation. In: 2004 International conference on cyberworlds. IEEE, Tokyo, pp 306–311
Biglari M, Neycharan J, Mirzaei F, Soleimani A (2014) Robust feature extraction using gabor filter, lbp and lda for face recognition
Chen Y, Zhao Y (2006) Face recognition using DCT and hierarchical RBF model. In: Hutchison D, Kanade T, Kittler J, Kleinberg JM, Mattern F, Mitchell JC, Naor M, Nierstrasz O, Pandu Rangan C, Steffen B, Sudan M, Terzopoulos D, Tygar D, Vardi MY, Weikum G, Corchado E, Yin H, Botti V, Fyfe C (eds) Intelligent data engineering and automated learning – IDEAL 2006, vol 4224. Springer Berlin, Heidelberg, Berlin, pp 355–362. Series title: lecture notes in computer science
Chen S, Liu J, Zhou ZH (2004) Making FLDA applicable to face recognition with one sample per person. Pattern Recogn 37(7):1553–1555
Cheng Z, Zhu X, Gong S (2020) Face re-identification challenge: are face recognition models good enough? Pattern Recogn 107:107422
Choi SE, Lee YJ, Lee SJ, Park KR, Kim J (2011) Age estimation using a hierarchical classifier based on global and local facial features. Pattern Recogn 44(6):1262–1281
Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27
Deng J, Guo J, Xue N, Zafeiriou S (2019) Arcface: additive angular margin loss for deep face recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR)
Du G, Su F, Cai A (2009) Face recognition using SURF features, p 749628. Yichang, China
Duong VH, Bui MQ, Wang JC (2019) Matrix factorization on complex domain for face recognition. In: Luigi Mazzeo P, Ramakrishnan S, Spagnolo P (eds) Visual object tracking with deep neural networks. IntechOpen
Gutta S, Wechsler H (1996) Face recognition using hybrid classifier systems. In: Proceedings of international conference on neural networks (ICNN’96), vol 2. IEEE, Washington, pp 1017–1022
Hao L, Yu W (2019) Face image set recognition based on improved HOG-NMF and convolutional neural networks. Progress Hum Comput Interact 2(1)
Harris C, Stephens M (1988) A combined corner and edge detector. In: Proceedings of the Alvey vision conference. Alvety Vision Club, pp 23.1–23.6
Hassaballah M, Aly S (2015) Face recognition: challenges, achievements and future directions. IET Comput Vis 9(4):614–626
Hassaballah M, Awad AI (2016) Detection and description of image features: an introduction. Series title: studies in computational intelligence, vol 630. Springer International Publishing, Cham, pp 1–8
Hassaballah M, Awad AI (eds) (2020) Deep learning in computer vision: principles and applications. Digital imaging and computer vision, 1st edn. CRC Press/Taylor and Francis, Boca Raton
He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. arXiv:1512.03385
Hu C, Lu X (2015) Single sample face recognition via lower-upper decomposition. In: 2015 10th asian control conference (ASCC). IEEE, Kota Kinabalu, pp 1–6
Ji HK, Sun QS, Ji ZX, Yuan YH, Zhang GQ (2017) Collaborative probabilistic labels for face recognition from single sample per person. Pattern Recogn 62:125–134
Kan M, Shan S, Su Y, Xu D, Chen X (2013) Adaptive discriminant learning for face recognition. Pattern Recogn 46(9):2497–2509
Khan A, Sohail A, Zahoora U, Qureshi AS (2020) A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev. arXiv:1901.06032
Kim J, Park H (2011) Fast nonnegative matrix factorization: an active-set-like method and comparisons. SIAM J Sci Comput 33(6):3261–3281
Kortli Y, Jridi M, Falou AA, Atri M (2020) Face recognition systems: a survey. Sensors 20(2):342
Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90
Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. Neural Inf Proces Syst 13:7
Li SZ, Jain AK (eds) (2011) Handbook of face recognition. Springer, London
Li H, Doermann D, Kia O (2000) Automatic text detection and tracking in digital video. IEEE Trans Image Process 9(1):147–156
Li Y, Hu H, Zhu Z, Zhou G (2020) SCANet: sensor-based continuous authentication with two-stream convolutional neural networks. ACM Transactions on Sensor Networks 16(3):1–27
Liu HH, Hsu SC, Huang CL (2014) Single-sample-per-person-based face recognition using fast discriminative multi-manifold analysis. In: Signal and information processing association annual summit and conference (APSIPA), 2014 Asia-Pacific. IEEE, Chiang Mai, pp 1–9
Lu J, Plataniotis KN (2002) Boosting face recognition on a large-scale database. In: Proceedings. international conference on image processing, vol 2, pp II–II
Lu J, Tan YP, Wang G (2013) Discriminative multi-manifold analysis for face recognition from a single training sample per person. IEEE Trans Pattern Anal Mach Intel 35(1):39–51
Martinez A (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763
Milborrow S, Morkel J, Nicolls F (2010) The MUCT landmarked face database. Pattern Recognition Association of South Africa 201(0)
Min R, Xu S, Cui Z (2019) Single-sample face recognition based on feature expansion. IEEE Access 7:45219–45229
Moussa M, Hmila M, Douik A (2018) A novel face recognition approach based on genetic algorithm optimization. Studies in Informatics and Control 27(1)
Nikan F, Hassanpour H (2020) Face recognition using non-negative matrix factorization with a single sample per person in a large database. Multimed Tools Appl 79:28265–28276
Nikolaus R (2007) Learning the parts of objects using non-negative matrix factorization (nmf). MMer Team
Otto C, Wang D, Jain AK (2016) Clustering millions of faces by identity. arXiv:1604.00989 [cs]
Pan J, Wang XS, Cheng YH (2016) Single-sample face recognition based on LPP feature transfer. IEEE Access 4:2873–2884
Perronnin F, Dugelay JL (2005) Clustering face images with application to image retrieval in large databases, p 256. Orlando, Florida, USA
Phillips PJ, Moon H, Rizvi SA, Rauss PJ (1999) The FERET evaluation methodology for face-recognition algorithms. IEEE Trans Pattern Anal Mach Intel 22(10):1090–1104
Qx G, Zhang L, Zhang D (2008) Face recognition using FLDA with single training image per person. Appl Math Comput 205(2):726–734
Reza AM (2004) Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 38(1):35–44
Rosten E, Drummond T (2006) Machine learning for high-speed corner detection. In: Computer vision – ECCV 2006, vol 3951. Springer Berlin, Heidelberg, pp 430–443
Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Boston, pp 815–823
Shi J, Tomasi C (1994) Good features to track. In: Proceedings of IEEE conference on computer vision and pattern recognition CVPR-94. IEEE Comput. Soc. Press, Seattle, pp 593–600
Simonyan K, Parkhi O, Vedaldi A, Zisserman A (2013) Fisher vector faces in the wild. In: Proceedings of the British machine vision conference 2013. British Machine Vision Association, Bristol, pp 8.1–8.11
Sireesha V, Latha L, Anuradha A, Kumar NP (2019) Histogram equalization techniques in image enhancement. J Info Tech Softw Eng 09((01)):254
Sun Y, Wang X, Tang X (2014) Deep learning face representation from predicting 10,000 classes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
Sun L, Zhao C, Yan Z, Liu P, Duckett T, Stolkin R (2019) A novel weakly-supervised approach for RGB-D-based nuclear waste object detection. IEEE Sensors J 19(9):3487–3500
Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
Taskiran M, Kahraman N, Erdem CE (2020) Face recognition: past, present and future (a review). Digit Signal Process 106:102809
Thomaz CE, Giraldi GA (2010) A new ranking method for principal components analysis and its application to face image analysis. Image Vis Comput 28 (6):902–913
Tuncer T, Dogan S, Abdar M, Pławiak P (2020) A novel facial image recognition method based on perceptual hash using quintet triple binary pattern. Multimedia Tools and Applications
Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86
Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001, vol 1. IEEE Comput. Soc, Kauai, pp I–511–I–518
Wang H, Schmid C (2013) Action recognition with improved trajectories. In: 2013 IEEE international conference on computer vision. IEEE, Sydney, pp 3551–3558
Wild S, Curry J, Dougherty A (2004) Improving non-negative matrix factorizations through structured initialization. Pattern Recogn 37 (11):2217–2232
Wu B, Liu Z, Yuan Z, Sun G, Wu C (2017) Reducing overfitting in deep convolutional neural networks using redundancy regularizer. In: Lintas A, Rovetta S, Verschure PF, Villa AE (eds) Artificial neural networks and machine learning – ICANN 2017, vol 10614. Springer International Publishing, Cham, pp 49–55
Xi M (2015) Local binary patter network: a deep learning approach for face recognition. In: 2016 IEEE international conference on Image processing (ICIP), pp 3224–3228
Xin M, Zhou Y, Yan J (2015) Single sample face recognition using lgbp and locality preserving discriminant analysis. Applied Mathematics & Information Sciences 9:353–360
Yang H, Wang XA (2016) Cascade classifier for face detection. J Algorithms Comput Tech 10(3):187–197
Yang M, Van L, Zhang L (2013) Sparse variation dictionary learning for face recognition with a single training sample per person. In: 2013 IEEE international conference on computer vision. IEEE, Sydney, pp 689–696
Yang M, Wen W, Wang X, Shen L, Gao G (2020) Adaptive convolution local and global learning for class-level joint representation of facial recognition with a single sample per data subject. IEEE Trans Info Forensics Secur 15:2469–2484
Zeng J, Zhao X, Gan J, Mai C, Zhai Y, Wang F (2018) Deep convolutional neural network used in single sample per person face recognition. Comput Intell Neurosci 2018:1–11
Zhang D, Chen S, Zhou ZH (2005) A new face recognition method based on SVD perturbation for single example image per person. Appl Math Comput 163(2):895–907
Zhang K, Zhang Z, Li Z, Qiao Y (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process Lett 23(10):1499–1503
Zhong S, Ghosh J (2003) Model-based clustering with soft balancing. In: The 3rd IEEE international conference on data mining (ICDM), pp 459–466
Zhou H, Yuan Y, Shi C (2009) Object tracking using SIFT features and mean shift. Comput Vis Image Underst 113(3):345–352
Zhou E, Cao Z, Yin Q (2015) Naive-deep face recognition: touching the limit of LFW benchmark or not? arXiv:1501.04690
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Abbaspoor, N., Hassanpour, H. Face recognition in a large dataset using a hierarchical classifier. Multimed Tools Appl 81, 16477–16495 (2022). https://doi.org/10.1007/s11042-022-12382-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12382-5