[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3394171.3413499acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Multi-Features Fusion and Decomposition for Age-Invariant Face Recognition

Published: 12 October 2020 Publication History

Abstract

Although the General Face Recognition (GFR) research achieves great success, Age-Invariant Face Recognition (AIFR) is still a challenging problem since facial appearance changing over time brings significant intra-class variations. The existing discriminative methods for the AIFR task mostly focus on decomposing the facial feature from a sigle image into age-related feature and age-independent feature for recognition, which suffer from the loss of facial identity information. To address this issue, in this work we propose a novel Multi-Features Fusion and Decomposition (MFFD) framework to learn more discriminative feature representations and alleviate the intra-class variations for AIFR. Specifically, we first sample multiple face images of different ages with the same identity as a face time series. Next, we combine feature decomposition with fusion based on the face time series to ensure that the final age-independent features effectively represent the identity information of the face and have stronger robustness against aging. Moreover, we also present two feature fusion methods and several different training strategies to explore the impact on the model. Extensive experiments on several cross-age datasets (CACD, CACD-VS) demonstrate the effectiveness of our proposed method. Besides, our method also shows comparable generalization performance on the well-known LFW dataset.

Supplementary Material

MP4 File (3394171.3413499.mp4)
At present, general face recognition technology has been a great success. However, for some specific application scenarios, the facial appearance changes greatly due to the interference of age, which limits the performance of the GFR methods. In this paper, we decompose the facial features into age-related features and age-independent features, which suffer from the loss of facial identity information. To solve this problem, we sample multiple face images of different ages with the same identity as a face time series. Then, we perform feature fusion based on face time series. By combine feature decomposition with fusion, we propose a novel Multi-Features Fusion and Decomposition (MFFD) framework. We demonstrate the effectiveness of our method in Ablation Study experiments and compare our method with other state-of-the-art algorithms to further illustrate the superiority of our method.

References

[1]
Bor-Chun Chen, Chu-Song Chen, and Winston H Hsu. 2014. Cross-age reference coding for age-invariant face recognition and retrieval. In European conference on computer vision. Springer, 768--783.
[2]
Bor-Chun Chen, Chu-Song Chen, and Winston H Hsu. 2015. Face recognition and retrieval using cross-age reference coding with cross-age celebrity dataset. IEEE Transactions on Multimedia 17, 6 (2015), 804--815.
[3]
Dong Chen, Xudong Cao, Fang Wen, and Jian Sun. 2013. Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3025--3032.
[4]
Ke Chen, Joni-Kristian Kämäräinen, and Zhaoxiang Zhang. 2016. Facial age estimation using robust label distribution. In Proceedings of the 24th ACM international conference on Multimedia. 77--81.
[5]
Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou. 2019. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4690--4699.
[6]
Amanda Cardoso Duarte. 2019. Cross-modal Neural Sign Language Translation. In Proceedings of the 27th ACM International Conference on Multimedia. 1650--1654.
[7]
Chuang Gan, Ting Yao, Kuiyuan Yang, Yi Yang, and Tao Mei. 2016. You lead, we exceed: Labor-free video concept learning by jointly exploiting web videos and images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 923--932.
[8]
Dihong Gong, Zhifeng Li, Dahua Lin, Jianzhuang Liu, and Xiaoou Tang. 2013. Hidden factor analysis for age invariant face recognition. In Proceedings of the IEEE international conference on computer vision. 2872--2879.
[9]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Identity mappings in deep residual networks. In European conference on computer vision. Springer, 630--645.
[10]
Lingxiao He, Haiqing Li, Qi Zhang, and Zhenan Sun. 2018. Dynamic feature learning for partial face recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7054--7063.
[11]
Lingxiao He, Haiqing Li, Qi Zhang, Zhenan Sun, and Zhaofeng He. 2016. Multiscale representation for partial face recognition under near infrared illumination. In 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS). IEEE, 1--7.
[12]
Lingxiao He, Yinggang Wang, Wu Liu, He Zhao, Zhenan Sun, and Jiashi Feng. 2019. Foreground-aware pyramid reconstruction for alignment-free occluded person re-identification. In Proceedings of the IEEE International Conference on Computer Vision. 8450--8459.
[13]
Gary B Huang, Marwan Mattar, Tamara Berg, and Eric Learned-Miller. 2008. Labeled faces in the wild: A database forstudying face recognition in unconstrained environments.
[14]
Shuangqun Li, Xinchen Liu,Wu Liu, Huadong Ma, and Haitao Zhang. 2016. A discriminative null space based deep learning approach for person re-identification. In 2016 4th International Conference on Cloud Computing and Intelligence Systems (CCIS). IEEE, 480--484.
[15]
Zhifeng Li, Dihong Gong, Xuelong Li, and Dacheng Tao. 2016. Aging face recognition: a hierarchical learning model based on local patterns selection. IEEE Transactions on Image Processing 25, 5 (2016), 2146--2154.
[16]
Liang Lin, Guangrun Wang, Wangmeng Zuo, Xiangchu Feng, and Lei Zhang. 2016. Cross-domain visual matching via generalized similarity measure and feature learning. IEEE transactions on pattern analysis and machine intelligence 39, 6 (2016), 1089--1102.
[17]
Ziwei Liu, Ping Luo, XiaogangWang, and Xiaoou Tang. 2015. Deep Learning Face Attributes in the Wild. In Proceedings of International Conference on Computer Vision (ICCV).
[18]
Xiang Long, Chuang Gan, and Gerard de Melo. 2018. Video captioning with multifaceted attention. Transactions of the Association for Computational Linguistics 6 (2018), 173--184.
[19]
Xiang Long, Chuang Gan, Gerard De Melo, Xiao Liu, Yandong Li, Fu Li, and Shilei Wen. 2018. Multimodal keyless attention fusion for video classification. In Thirty-Second AAAI Conference on Artificial Intelligence.
[20]
Ping Luo, Zhenyao Zhu, Ziwei Liu, Xiaogang Wang, and Xiaoou Tang. 2016. Face model compression by distilling knowledge from neurons. In Thirtieth AAAI conference on artificial intelligence.
[21]
Jinna Lv, Wu Liu, Meng Zhang, He Gong, Bin Wu, and Huadong Ma. 2017. Multifeature fusion for predicting social media popularity. In Proceedings of the 25th ACM international conference on Multimedia. 1883--1888.
[22]
Gayathri Mahalingam and Chandra Kambhamettu. 2010. Age invariant face recognition using graph matching. In 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS). IEEE, 1--7.
[23]
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in pytorch. (2017).
[24]
Narayanan Ramanathan and Rama Chellappa. 2006. Modeling age progression in young faces. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), Vol. 1. IEEE, 387--394.
[25]
Rasmus Rothe, Radu Timofte, and Luc Van Gool. 2015. DEX: Deep EXpectation of apparent age from a single image. In IEEE International Conference on Computer Vision Workshops (ICCVW).
[26]
Jingkuan Song, Jingqiu Zhang, Lianli Gao, Xianglong Liu, and Heng Tao Shen. 2018. Dual Conditional GANs for Face Aging and Rejuvenation. In IJCAI. 899--905.
[27]
Yu Sun, Yun Ye,Wu Liu,Wenpeng Gao, YiLi Fu, and Tao Mei. 2019. Human mesh recovery from monocular images via a skeleton-disentangled representation. In Proceedings of the IEEE International Conference on Computer Vision. 5349--5358.
[28]
Yaniv Taigman, Ming Yang, Marc?Aurelio Ranzato, and LiorWolf. 2014. Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1701--1708.
[29]
Feng Wang, Xiang Xiang, Jian Cheng, and Alan Loddon Yuille. 2017. Normface: L2 hypersphere embedding for face verification. In Proceedings of the 25th ACM international conference on Multimedia. 1041--1049.
[30]
Hao Wang, Dihong Gong, Zhifeng Li, and Wei Liu. 2019. Decorrelated adversarial learning for age-invariant face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3527--3536.
[31]
Hao Wang, Yitong Wang, Zheng Zhou, Xing Ji, Dihong Gong, Jingchao Zhou, Zhifeng Li, and Wei Liu. 2018. Cosface: Large margin cosine loss for deep face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5265--5274.
[32]
Wei Wang, Zhen Cui, Yan Yan, Jiashi Feng, Shuicheng Yan, Xiangbo Shu, and Nicu Sebe. 2016. Recurrent face aging. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2378--2386.
[33]
Yitong Wang, Dihong Gong, Zheng Zhou, Xing Ji, Hao Wang, Zhifeng Li, Wei Liu, and Tong Zhang. 2018. Orthogonal deep features decomposition for age-invariant face recognition. In Proceedings of the European Conference on Computer Vision (ECCV). 738--753.
[34]
Yandong Wen, Zhifeng Li, and Yu Qiao. 2016. Latent factor guided convolutional neural networks for age-invariant face recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4893--4901.
[35]
Yandong Wen, Kaipeng Zhang, Zhifeng Li, and Yu Qiao. 2016. A discriminative feature learning approach for deep face recognition. In European conference on computer vision. Springer, 499--515.
[36]
Bichen Wu, Alvin Wan, Xiangyu Yue, Peter Jin, Sicheng Zhao, Noah Golmant, Amir Gholaminejad, Joseph Gonzalez, and Kurt Keutzer. 2018. Shift: A zero flop, zero parameter alternative to spatial convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9127--9135.
[37]
Chenfei Xu, Qihe Liu, and Mao Ye. 2017. Age invariant face recognition and retrieval by coupled auto-encoder networks. Neurocomputing 222 (2017), 62--71.
[38]
Tongkun Xu, Xin Zhao, Jiamin Hou, Xinhong Hao, Jian Yin, et al. 2020. A General Re-Ranking Method Based On Metric Learning For Person Re-Identification. In 2020 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6.
[39]
Chenggang Yan, Biao Gong, Yuxuan Wei, and Yue Gao. 2020. Deep multi-view enhancement hashing for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020).
[40]
C Yan, Z Li, Y Zhang, P Qin, X Ji, and Q Dai. 2019. Depth image denoising using nuclear norm and learning graph model. IEEE Transactions on Multimedia (2019).
[41]
Chenggang Yan, Biyao Shao, Hao Zhao, Ruixin Ning, Yongdong Zhang, and Feng Xu. 2020. 3d room layout estimation from a single rgb image. IEEE Transactions on Multimedia (2020).
[42]
Dong Yi, Zhen Lei, Shengcai Liao, and Stan Z Li. 2014. Learning face representation from scratch. arXiv preprint arXiv:1411.7923 (2014).
[43]
Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao. 2016. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Processing Letters 23, 10 (2016), 1499--1503.
[44]
Zhifei Zhang, Yang Song, and Hairong Qi. 2017. Age progression/regression by conditional adversarial auto encoder. In Proceedings of the IEEE conference on computer vision and pattern recognition. 5810--5818.
[45]
Jian Zhao, Yu Cheng, Yi Cheng, Yang Yang, Fang Zhao, Jianshu Li, Hengzhu Liu, Shuicheng Yan, and Jiashi Feng. 2019. Look across elapse: Disentangled representation learning and photorealistic cross-age face synthesis for age-invariant face recognition. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 9251--9258.
[46]
Tianyue Zheng, Weihong Deng, and Jiani Hu. 2017. Age estimation guided convolutional neural network for age-invariant face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 1--9.
[47]
Haiping Zhu, Qi Zhou, Junping Zhang, and James Z Wang. 2018. Facial aging and rejuvenation by conditional multi-adversarial autoencoder with ordinal regression. arXiv preprint arXiv:1804.02740 (2018).

Cited By

View all
  • (2025)Beyond shadows and light: Odyssey of face recognition for social goodComputer Vision and Image Understanding10.1016/j.cviu.2025.104293253(104293)Online publication date: Mar-2025
  • (2024)A New Approach to Recognize Faces Amidst Challenges: Fusion Between the Opposite Frequencies of the Multi-Resolution FeaturesAlgorithms10.3390/a1711052917:11(529)Online publication date: 17-Nov-2024
  • (2024)Age-Invariant Face Recognition: A Comprehensive Study of Methods, Datasets, and New Algorithm for Immigration Control2024 Horizons of Information Technology and Engineering (HITE)10.1109/HITE63532.2024.10777245(1-8)Online publication date: 15-Oct-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '20: Proceedings of the 28th ACM International Conference on Multimedia
October 2020
4889 pages
ISBN:9781450379885
DOI:10.1145/3394171
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. age-invariant face recognition
  2. feature decomposition
  3. feature fusion

Qualifiers

  • Research-article

Funding Sources

  • Zhejiang Province Nature Science Foundation of China
  • National Nature Science Foundation of China

Conference

MM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)35
  • Downloads (Last 6 weeks)6
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Beyond shadows and light: Odyssey of face recognition for social goodComputer Vision and Image Understanding10.1016/j.cviu.2025.104293253(104293)Online publication date: Mar-2025
  • (2024)A New Approach to Recognize Faces Amidst Challenges: Fusion Between the Opposite Frequencies of the Multi-Resolution FeaturesAlgorithms10.3390/a1711052917:11(529)Online publication date: 17-Nov-2024
  • (2024)Age-Invariant Face Recognition: A Comprehensive Study of Methods, Datasets, and New Algorithm for Immigration Control2024 Horizons of Information Technology and Engineering (HITE)10.1109/HITE63532.2024.10777245(1-8)Online publication date: 15-Oct-2024
  • (2023)Bidirectional Maximum Entropy Training With Word Co-Occurrence for Video CaptioningIEEE Transactions on Multimedia10.1109/TMM.2022.317730825(4494-4507)Online publication date: 1-Jan-2023
  • (2023)Age Invariant Face Recognition using Deep Sub-Pixel Resolution Features2023 OITS International Conference on Information Technology (OCIT)10.1109/OCIT59427.2023.10430971(7-10)Online publication date: 13-Dec-2023
  • (2023)Review of Cross-Age Face Recognition in Discriminative Models2023 8th International Conference on Image, Vision and Computing (ICIVC)10.1109/ICIVC58118.2023.10270506(124-130)Online publication date: 27-Jul-2023
  • (2023)LIAADNeurocomputing10.1016/j.neucom.2023.03.059543:COnline publication date: 28-Jul-2023
  • (2023)Feature fusion and decomposition: exploring a new way for Chinese calligraphy style classificationThe Visual Computer10.1007/s00371-023-02875-140:3(1631-1642)Online publication date: 18-May-2023
  • (2022)Effective Attention-Based Feature Decomposition for Cross-Age Face RecognitionApplied Sciences10.3390/app1210481612:10(4816)Online publication date: 10-May-2022
  • (2022)Age-Invariant Face Recognition by Multi-Feature Fusionand Decomposition with Self-attentionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/347281018:1s(1-18)Online publication date: 25-Jan-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media