[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3487075.3487100acmotherconferencesArticle/Chapter ViewAbstractPublication PagescsaeConference Proceedingsconference-collections
research-article

GaitPVD: Part-based View Distillation Network for Cross-View Gait Recognition

Published: 07 December 2021 Publication History

Abstract

Gait is a biometric feature used for long-distance identification which has important applications in video surveillance. However, the performance of gait recognition is limited by view angle variation. To solve the problem, we propose a Part-based View Distillation network (GaitPVD) which is a teacher-student framework. Firstly, we design a part-based network and use the part-based teacher network in GaitPVD to extract the gait feature from the gait sequences under the normative view. Secondly, we adopt knowledge distillation to solve cross-view gait recognition and design a loss function(PVDLoss) that is used to train the student network, which can achieve the propagation of view knowledge in GaitPVD. Finally, we extract the gait features from the gait sequences by the student network and calculate the Euclidean distance among the features to get the identity information. It is demonstrated by comprehensive experiments that our method(GaitPVD) can achieve state-of-the-art recognition accuracy on the two most popular cross-view gait recognition datasets CASIA-B and OU-MVLP.

References

[1]
Shiraga, Kohei, (2016). Geinet: View-invariant gait recognition using a convolutional neural network. 2016 international conference on biometrics (ICB). IEEE.
[2]
Wu, Zifeng, (2016) "A comprehensive study on cross-view gait based human identification with deep cnns."IEEE transactions on pattern analysis and machine intelligence 39(2): 209-226.
[3]
Bashir, Khalid, T. Xiang, and S. Gong . (2010) "Gait recognition using Gait Entropy Image." International Conference on Crime Detection & Prevention IET.
[4]
Huynh-The, Thien, (2020). Learning 3D spatiotemporal gait feature by convolutional network for person identification. Neurocomputing 397: 192-202.
[5]
Sokolova, Anna, and Anton Konushin. (2019) "Pose-based deep gait recognition." IET Biometrics 8(2): 134-143.
[6]
Chen, Qiang, (2017). Feature map pooling for cross-view gait recognition based on silhouette sequence images. 2017 IEEE International Joint Conference on Biometrics (IJCB). IEEE.
[7]
Chao, Hanqing, (2018) "GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition."
[8]
He, Y.; Zhang, J.; Shan, H.; and Wang, L. (2019) Multi-task GANs for view-specific feature learning in gait recognition. IEEE TIFS 14(1):102–113
[9]
Yu, S.; Chen, H.; Reyes, E. B. G.; and Poh, N. (2017). GaitGAN: Invariant gait feature extraction using generative adversarial networks. In CVPR Workshops, 532– 539.
[10]
Zhang, Rui, (2019) “Improving Cross-View Gait Recognition With Generative Adversarial Networks.” Electrical Engineering and Computer Science (EECS) 3: 43-47
[11]
Gu, X., Ma, B., Chang, H., Shan, S., Chen, X. (2019): Temporal knowledge propagation for image-to-video person re-identification. In: IEEE International Conference on Computer Vision.
[12]
Hinton, Geoffrey, Oriol Vinyals, and Jeff Dean. (2015) "Distilling the knowledge in a neural network." arXiv preprint arXiv:1503.02531.
[13]
Yu, Shiqi, D. Tan, and T. Tan . "A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition." 18th International Conference on Pattern Recognition (ICPR 2006), 20-24 August 2006, Hong Kong, China IEEE.
[14]
Hu, Maodi, (2013) “View-invariant discriminative projection for multi-view gait-based human identification.” IEEE Transactions on Information Forensics and Security 8(12): 2034-2045.
[15]
Yang, Yazhou, (2014) "Gait recognition using flow histogram energy image." 2014 22nd International Conference on Pattern Recognition. IEEE.
[16]
Zhang, Ziyuan, (2019) "Gait recognition via disentangled representation learning." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.
[17]
Chattopadhyay, Pratik, (2014) "Pose Depth Volume extraction from RGB-D streams for frontal gait recognition." Journal of Visual Communication and Image Representation 25(1): 53-63.
[18]
Liao, Rijun, (2017) “Pose-based temporal-spatial network (PTSN) for gait recognition with carrying and clothing variations.” Chinese Conference on Biometric Recognition. Springer, Cham.
[19]
Sun, Yifan, (2018) “Beyond part models: Person retrieval with refined part pooling (and a strong convolutional baseline).” Proceedings of the European Conference on Computer Vision (ECCV).
[20]
Hinton, Geoffrey, Oriol Vinyals, and Jeff Dean. (2015) “Distilling the knowledge in a neural network.” arXiv preprint arXiv:1503.02531.
[21]
Gu, Xinqian, (2019) “Temporal knowledge propagation for image-to-video person reidentification.” Proceedings of the IEEE International Conference on Computer Vision.
[22]
Radenovi´c, Filip, Giorgos Tolias, and Ondˇrej Chum. (2018) “Fine-tuning CNN image retrieval with no human annotation.” IEEE transactions on pattern analysis and machine intelligence 41(7): 1655-1668.
[23]
Hermans, Alexander, Lucas Beyer, and Bastian Leibe. (2017) “In defense of the triplet loss for person re-identification.” arXiv preprint arXiv:1703.07737.

Cited By

View all
  • (2023)Frame Correlation Knowledge Distillation for Gait Recognition in the WildBiometric Recognition10.1007/978-981-99-8565-4_27(280-290)Online publication date: 2-Dec-2023

Index Terms

  1. GaitPVD: Part-based View Distillation Network for Cross-View Gait Recognition
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        CSAE '21: Proceedings of the 5th International Conference on Computer Science and Application Engineering
        October 2021
        660 pages
        ISBN:9781450389853
        DOI:10.1145/3487075
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 07 December 2021

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Deep learning
        2. Gait recognition
        3. Knowledge distillation

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Funding Sources

        • Anhui Province 2020 Major Science and Technology Special Project

        Conference

        CSAE 2021

        Acceptance Rates

        Overall Acceptance Rate 368 of 770 submissions, 48%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)9
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 26 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2023)Frame Correlation Knowledge Distillation for Gait Recognition in the WildBiometric Recognition10.1007/978-981-99-8565-4_27(280-290)Online publication date: 2-Dec-2023

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media