A Masked Facial Landmarks Localization Method Considering the Mask-Face Contact Characteristics
Authors: 
Yiwen Chen, Lingyun ZhuAuthors Info & Claims
Pages 113 - 118
Abstract
At present, it has become normal for people to travel with masks. In order to meet the challenge of face recognition caused by mask occlusion, a new method for landmark localization of masked face was proposed in this study. Correspondingly, a 68-point shape model including face and mask was designed and the distribution of the related landmarks was pre-positioned according to the fitting characteristics between the face and mask. To generate a regressor with function of accurate localization of facial landmarks, the masked face dataset marked by the shape model was constructed; Meanwhile, the regression tree integration algorithm was used to accurately locate the pre-positioned landmarks of the masked face. By means of the method established in this study, the tested value of IPN and ION is respectively equal to 5.68 and 3.65, being less than those of other classical algorithms. The experimental results indicate that this method can achieve an acceptable landmark localization effect and is likely to provide certain technical supports for the masked face recognition.
References
[1]
XIN J, TAN X.Face alignment in-the-wild: A survey[J].Computer Vision Image Understanding, 2017, 162: 1-22.
[2]
CHRYSOS G G, ANTONAKOS E, SNAPE P, A comprehensive performance evaluation of deformable face tracking ”in-the-wild”[J].International Journal of Computer Vision, 2016, 126 (2): 198-232.
[3]
KHAN R A, MEYER A, KONIK H, Saliency based framework for facial expression recognition[J].Frontiers of Computer Science (electronic), 2019, (1): 183-198.
[4]
CHI N D, LUU K, QUACH K G, Deep appearance models: A deep boltzmann machine approach for face modeling[J].International Journal of Computer Vision, 2019, 127(3): 437-455.
[5]
Liu J, Cheng P, Wu B, Yang Z. Face characterization and 3D reconstruction based on self-supervised deep learning [J].Sensors and Microsystems, 2019,38 (9): 126-128,133.
[6]
COOTES T.Active shape models-their training and application[J].Comput.Vis.Image Understand, 1995, 61(1): 38-59.
[7]
WANG J, YUAN Y, YU G.Face attention network: An effective face detector for the occluded faces[J].2020, https://blog.csdn.net/cdknight happy/article/details/105773331.
[8]
CHEN Y, SONG L, RAN H.Masquer hunter: Adversarial occlusion-aware face detection : 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS)[C].Los Angeles: 2018 IEEE, 2018.
[9]
Zou Baihan, Qin Yating, Yuan Xiaobing, Status study of mask face detection methods based on lightweight CNN [J].Software, 2020,41 (8): 186-188.
[10]
Chen Jiali, Liu Kechun, Tang cong, A method to identify the key points of the face and forehead: China, CN201811493855.7 [P].2019-02-22.
[11]
Li Yuan, Yang Yandan, Wang Jinwei.Identification of the eye key points and the training method and device of the detection model: China, 201910541988.5 [P].2020-04-03.
[12]
KAZEMI V, SULLIVAN J.One millisecond face alignment with an ensemble of regression trees : 2014 IEEE Conference on Computer Vision Pattern Recognition [C]Columbus: 2014 IEEE, 2014.
[13]
CABANI A, HAMMOUDI K, BENHABILES H, Maskedface-net a dataset of correctly/incorrectly masked face images in the context of covid-19[J].Smart Health(Amsterdam, Netherlands), 2020, 19: 100144.
[14]
SAGONAS C, TZIMIROPOULOS G, ZAFEIRIOU S, 300 faces in-the-wild challenge: The first facial landmark localization challenge : Proceedings of the 2013 IEEE International Conference on Computer Vision Workshops [C].Sydney: 2013 IEEE, 2013.
[15]
GUO X, LI S, ZHANG J, Pfld: A practical facial landmark detector[J].Computer Vision and Pattern Recognition, 2019(lasted revised 3 Mar 2019).
[16]
Wu W, Qian C, Yang S, Look at Boundary: A Boundary-Aware Face Alignment Algorithm : 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition [C].Salt Lake City: 2018 IEEE, 2018.
Recommendations
Automatic face analysis system based on face recognition and facial physiognomy
ICHIT'06: Proceedings of the 1st international conference on Advances in hybrid information technologyAn automatic face analysis system is proposed which uses face recognition and facial physiognomy. It first detects human's face, extracts its features, and classifies the shape of facial features. It will analyze the person's facial physiognomy and then ...
Masked face recognition using domain adaptation
Highlights- We develop an approach to enhance the face recognition performance for masked faces.The refinement layer makes the feature matchings between masked and unmasked faces more robust, thus improving face recognition performance....
AbstractWearing facial masks has become a must in our daily life due to the global COVID-19 pandemic. However, the performance of a face recognition system is severely degraded due to the fact that the face images in the gallery are unmasked faces while ...
Face Mask Invariant End-to-End Face Recognition
Computer Vision – ECCV 2020 WorkshopsAbstractThis paper introduces an end-to-end face recognition network that is invariant to face images with face masks. Conventional face recognition networks have degraded performance on images with face masks due to inaccurate landmark prediction and ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
February 2022
124 pages
ISBN:9781450395724
DOI:10.1145/3528114
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 June 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
DSDE 2022
DSDE 2022: 2022 the 5th International Conference on Data Storage and Data Engineering
February 25 - 27, 2022
Sanya, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 53Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)2
Reflects downloads up to 19 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format