More Web Proxy on the site http://driver.im/

research-article

CFSM: a novel frame analyzing mechanism for real-time face recognition system on the embedded system

Authors:

Chien-Fang Chen,

Yu-Chen ZhengAuthors Info & Claims

Multimedia Tools and Applications, Volume 81, Issue 2

Pages 1867 - 1891

https://doi.org/10.1007/s11042-021-11599-0

Published: 01 January 2022 Publication History

Abstract

The development of web cameras and smart phones is mature, and more and more facial recognition-related applications are implemented on embedded systems. The demand for real-time face recognition on embedded systems is also increasing. In order to improve the accuracy of face recognition, most of the modern face recognition systems consist of multiple deep neural network models for recognition. However, in an embedded system, integrating these complex neural network models and execute simultaneously is not easy to achieve the goal of real-time recognition of human faces and their identities. In view of this, this study proposes a new frame analysis mechanism, continuous frames skipping mechanism (CFSM), which can analyze the frame in real time to determine whether it is necessary to perform face recognition on the current frame. Through the analysis of CFSM, the frames that do not need to be re-recognized for face are omitted. In this way, the workload of the face recognition system will be greatly reduced to achieve the goal of real-time face recognition in the embedded system. The experimental results show that the proposed CFSM mechanism can greatly increase the speed of face recognition in the video on the embedded system, achieving the goal of real-time face recognition.

References

[1]

Abu-El-Haija S, et al (2016) Youtube-8m: a large-scale video classification benchmark. arXiv, abs:1609.08675

[2]

Chen S et al (2018) MobileFaceNets: efficient CNNs for accurate real-time face verification on mobile devices. Chinese conference on biometric recognition 2018. Lecture notes in computer science, 10996, pp 428–438

[3]

Dabhade SB, et al (2017) Double layer PCA based hyper spectral face recognition using KNN classifier. International conference on current trends in computer, electrical, electronics and communication (CTCEEC), pp 289–293

[4]

Dadi HS and Pillutla GM Improved face recognition rate using HOG features and SVM classifier IOSR J Electron Commun Eng IOSR-JECE 2016 11 34-44

[5]

Danelljan M et al (2014) Accurate scale estimation for robust visual tracking. Proceedings of the British machine vision conference, pp 1–5

[6]

Deng J et al (2019) ArcFace: additive angular margin loss for deep face recognition. IEEE conference on computer vision and pattern recognition (CVPR), pp 4685–4694

[7]

Dhamecha TI (2016) On frame selection for video face recognition. In: Kawulok M (ed) Proceedings of advances in face detection and facial image analysis. Springer, Cham, pp 279–297

[8]

Gygli M (2018) Ridiculously fast shot boundary detection with fully convolutional neural networks. International conference on content-based multimedia indexing (CBMI), pp 1–4

[9]

Hassanien A et al (2017) Large-scale, fast and accurate shot boundary detection through spatio-temporal convolutional neural networks. arXiv, abs:1705.03281

[10]

He K et al (2016) Deep residual learning for image recognition. IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778

[11]

He Q, He B, Zhang Y, et al. Multimedia based fast face recognition algorithm of speed up robust features Multimed Tools Appl 2019 78 24035-24045

[12]

Holmes SA, Klein G, and Murray DW An O(N²) square root unscented Kalman filter for visual simultaneous localization and mapping IEEE Trans Pattern Anal Mach Intell 2008 31 7 1251-1263

[13]

Huang GB et al (2007) Labeled Faces in the wild: a database for studying face recognition in unconstrained environments. University of Massachusetts, pp 7–49

[14]

Jain AK, Ross AA, and Nandakumar K Introduction to biometrics 2011 Berlin Springer Science & Business Media 111-117

[15]

Jin X et al. Efficient blind face recognition in the cloud Multimed Tools Appl 2020 79 12533-12550

[16]

Jose E et al (2019) Face recognition based surveillance system using FaceNet and MTCNN on Jetson TX2. 5th International conference on advanced computing & communication systems (ICACCS), pp 608–613

[17]

Kuhn HW The Hungarian method for the assignment problem Naval Res Logist Q 1955 2 1–2 83-97

[18]

Liu W et al (2017. SphereFace: deep hypersphere embedding for face recognition. IEEE conference on computer vision and pattern recognition (CVPR), pp 6738–6746

[19]

Murray S (2017) Real-time multiple object tracking-a study on the importance of speed. arXiv abs:1709.03572

[20]

Parveen P, Thuraisingham B (2016) Face recognition using multiple classifiers. 18th IEEE international conference on tools with artificial intelligence, pp 179–186

[21]

Qi X, Liu C, Schuckers S (2016) Key-frame analysis for face related video on GPU-Accelerated embedded platform. International conference on computational science and computational intelligence (CSCI), pp 682–687

[22]

Saez-Trigueros D, Meng L, Hartnett M (2018) Face recognition: from traditional to deep learning methods. arXiv, abs/1811.00116

[23]

Sajjad M et al. Raspberry Pi assisted face recognition framework for enhanced law-enforcement services in smart cities Futur Gener Comput Syst 2020 108 995-1007

[24]

Saypadith S, Aramvith S (2018) Real-time multiple face recognition using deep learning on embedded GPU System. Asia-Pacific signal and information processing association annual summit and conference (APSIPA ASC), pp 1318–1324

[25]

Schroff F, Kalenichenko D, Philbin J (2015) FaceNet: a unified embedding for face recognition and clustering. IEEE conference on computer vision and pattern recognition (CVPR), pp 815–823

[26]

Shi X et al (2018) Real-time rotation-invariant face detection with progressive calibration networks. IEEE conference on computer vision and pattern recognition (CVPR), pp 2295–2303

[27]

Sinha D, El-Sharkawy M (2019) Thin MobileNet: an enhanced MobileNet architecture. IEEE 10th annual ubiquitous computing, electronics & mobile communication conference (UEMCON), pp 280–285

[28]

Stekas N, van den Heuvel D (2016) Face recognition using local binary patterns histograms (LBPH) on an FPGA-Based system on chip (SoC). IEEE international parallel and distributed processing symposium workshops (IPDPSW), pp 300–304

[29]

Sujay SN, Reddy HM, Ravi J (2017) Face recognition using extended LBP features and multilevel SVM classifier. International conference on electrical, electronics, communication, computer, and optimization techniques, pp 1–4

[30]

Sun Y, Wang X, Tang X (2014) Deep learning face representation from predicting 10,000 classes. IEEE conference on computer vision and pattern recognition, pp 1891–1898

[31]

Taigman Y et al (2014) DeepFace: closing the gap to human-level performance in face verification. IEEE conference on computer vision and pattern recognition, pp 1701–1708

[32]

Tran D et al (2015) Learning spatiotemporal features with 3D convolutional networks. Proceedings of the IEEE international conference on computer vision

[33]

Viola P and Jones MJ Robust real-time face detection Int J Comput Vision 2004 57 2 137-154

[34]

Wang H et al (2018) CosFace: large margin cosine loss for deep face recognition. IEEE conference on computer vision and pattern recognition (CVPR), pp 5265–5274

[35]

Yang F and Paindavoine M Implementation of an RBF neural network on embedded systems: real-time face tracking and identity verification IEEE Trans Neural Netw 2003 14 5 1162-1175

[36]

Zhang K et al. Joint face detection and alignment using multitask cascaded convolutional networks IEEE Signal Process Lett 2016 23 10 1499-1503

[37]

Zhang M et al (2019) Embedded face recognition system based on multi-task convolutional neural network and LBP features. IEEE international conference of intelligent applied systems on engineering (ICIASE), pp 132–135

[38]

Zhang S et al. Faceboxes: a CPU real-time and accurate unconstrained face detector Neurocomputing 2019 364 297-309

Cited By

Kutlugün MŞirin Y(2023)Reducing false positive rate with the help of scene change indicator in deep learning based real-time face recognition systemsMultimedia Tools and Applications10.1007/s11042-023-15769-082:30(47517-47536)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s11042-023-15769-0

Index Terms

CFSM: a novel frame analyzing mechanism for real-time face recognition system on the embedded system
1. Computer systems organization
  1. Embedded and cyber-physical systems
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks

Index terms have been assigned to the content through auto-classification.

Recommendations

Automatic face analysis system based on face recognition and facial physiognomy
ICHIT'06: Proceedings of the 1st international conference on Advances in hybrid information technology

An automatic face analysis system is proposed which uses face recognition and facial physiognomy. It first detects human's face, extracts its features, and classifies the shape of facial features. It will analyze the person's facial physiognomy and then ...
Age-Invariant Face Recognition

One of the challenges in automatic face recognition is to achieve temporal invariance. In other words, the goal is to come up with a representation and matching scheme that is robust to changes due to facial aging. Facial aging is a complex process that ...
Robust real-time face recognition
SAICSIT '13: Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference

This paper describes and discusses the algorithms required to perform face detection and face recognition in real-time. Simple features, similar to Haar basis functions, are used for detection and the eigenfaces technique is used for recognition. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications

Multimedia Tools and Applications Volume 81, Issue 2

Jan 2022

1497 pages

ISSN:1380-7501

Issue’s Table of Contents

© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 January 2022

Accepted: 22 September 2021

Revision received: 14 July 2021

Received: 12 September 2020

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kutlugün MŞirin Y(2023)Reducing false positive rate with the help of scene change indicator in deep learning based real-time face recognition systemsMultimedia Tools and Applications10.1007/s11042-023-15769-082:30(47517-47536)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s11042-023-15769-0

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents