[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3497623.3497630acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

A Survey of Person Re-identification Based on Deep Learning

Published: 04 February 2022 Publication History

Abstract

Person re-identification (Re-ID) has been a popular research topic in computer vision in recent years, and it has important application value in numerous fields, such as intelligent security. The person Re-ID task is to identify whether the pedestrians appearing under different cameras are the same person. The traditional person Re-ID methods mainly rely on the characteristics of manual design, and it has difficulty in solving the problems of person occlusion, posture change, and illumination variation. With the wide application of deep learning, the person Re-ID based on deep learning has brought new ideas for solving these problems, and has been widely concerned by scholars. This paper summarizes and analyzes the latest research trends of person Re-ID based on deep learning. In our work, the recent research works of person Re-ID are coarsely categorized into the supervised learning methods and the unsupervised learning methods according to whether the pedestrian images in the training set have real labels. We then describe the representative datasets used in the person Re-ID task. Finally, we conclude and discuss the future directions of the person Re-ID based on deep learning.

References

[1]
Zajdel, W., Zivkovic, Z., and Krose, B. (2005). “Keeping track of humans: have I seen this person before?”. Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, 2081-2086.
[2]
Zheng, L., Yang, Y., and Hauptmann, A. G. (2016). “Person re-identification: Past, present and future”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 1-20.
[3]
Pedagadi, S. (2016). “Pedestrian detection and re-identification in surveillance video”. Kingston University, 2016.
[4]
Gong, S., Chen, C. L., and Tao, X. (2011). “Security and Surveillance.”, Springer London, 2011.
[5]
Geronimo, D. (2010) “Survey of pedestrian detection for advanced driver assistance systems”. IEEE trans. on Pattern Analysis and Machine Intelligence, 32(7):1239-1258.
[6]
Matsukawa, T., Okabe, T., Suzuki, E., and Sato, Y. (2016). “Hierarchical gaussian descriptor for person re-identification”. Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, Nevada, USA, 1363-1372.
[7]
Lisanti, G., Masi, I., Bagdanov, A. D., and Bimbo, A. D. (2015). “Person re-identification by iterative re-weighted sparse ranking”. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(8): 1629-1642.
[8]
Hinton, G.E., and Salakhutdinov, R.R. (2006). “Reducing the dimensionality of data with neural networks”. Science, 313, (5786), 504–507.
[9]
Ciresan, D. C., Meier, U., Masci, J., Gambardella, L. M. and Schmidhuber, J. (2011). “Flexible, high performance convolutional neural networks for image classification”. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Barcelona, Spain.
[10]
Dyer, C., Kuncoro, A., Ballesteros, M., and Smith, N. A. (2016). “Recurrent neural network grammars”. Proceeding of the North American Chapter of the Association for Computational Linguistics, San Diego, CA.
[11]
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). “Generative Adversarial Nets”. Proceedings of the 2014 Advances in Neural Information Processing Systems, Montreal, Canada, 2672−2680.
[12]
Zheng, Z., Yang, X., Yu, Z., Zheng, Z., Yang, Y., and Kautz, J. (2019). “Joint Discriminative and Generative Learning for Person Re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 2138-2147.
[13]
Yu, H., Zheng, W., Wu, A., Guo, X., Gong, S., and Lai, J. (2019). “Unsupervised Person Re-identification by Soft Multilabel Learning”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 2148-2157.
[14]
Chen, T., Ding, S., Xie, J., Yuan Y., Chen, W., Yang, Y., Ren, Z., and Wang, Z. (2019). “ABD-Net: Attentive but Diverse Person Re-Identification” Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea, 8351-8361.
[15]
Chen, B., Deng, W., and Hu, J. (2019). “Mixed high-order attention network for person re-identification”. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea, 371-381.
[16]
Dai, Y., Liu, J., Sun, Y., Tong, Z., Zhang, C., and Duan, L. (2021). “IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID”. Proceedings of the IEEE International Conference on Computer Vision, Montreal, Canada.
[17]
Yi, D., Lei, Z., Liao, S., and Li, S. Z. (2014). “Deep metric learning for person re-identification”. Proceeding of the International Conference on Pattern Recognition, Stockholm, Sweden, 34-39.
[18]
W, Li., R, Zhao., T, Xiao., and X, Wang., (2014). “Deepreid: Deep filter pairing neural network for person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, USA, 152–159.
[19]
Zheng, L., Huang, Y., Lu, H., and Yang, Y. (2019). “Pose invariant embedding for deep person re-identification”. IEEE Transactions on Image Processing, 28(9): 4500-4509.
[20]
Sun, Y., Xu, Q., Li, Y., Zhang, C., Li, Y., Wang, S., and Sun, Jian. (2019). “Perceive where to focus: Learning visibility-aware part-level features for partial person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, USA, 393-402.
[21]
Cheng, D., Gong, Y., Zhou, S., Wang, J., and Zheng, N. (2016). “Person re-identification by multi-channel parts-based cnn with improved triplet loss function”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, USA, 1335-1344.
[22]
Hermans, A., Beyer, L., and Leibe, B. (2017). “In defense of the triplet loss for person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hawaii, USA.
[23]
Fan, H., Zheng, L., Yan, C., and Yang, Y. (2018). “Unsupervised person re-identification: Clustering and fine-tuning”. ACM Transactions on Multimedia Computing, Communications, and Applications, 14(4): 1-18.
[24]
Lin, Y., Dong, X., Zheng, L., Yan, Y., and Yang Y. (2019). “A Bottom-Up Clustering Approach to Unsupervised Person Re-Identification”. Proceedings of the AAAI Conference on Artificial Intelligence, Hawaii, USA, 33(01): 8738-8745.
[25]
Deng, W., Zheng, L., Ye, Q., Kang, G., Yang, Y., and Jiao, J. (2018). “Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, 994-1003.
[26]
Zhong, Z., Zheng, L., Zheng, Z., Li, S., and Yang, Y. (2018). “Camera Style Adaptation for Person Re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, 5157-5166.
[27]
Song, S., Zhang, W., Liu, J., and Mei, T. (2019). “Unsupervised person image generation with semantic parsing transformation”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Long Beach, USA, 2357-2366.
[28]
Felzenszwalb, P., McAllester, D., and Ramanan, D. (2008). “A discriminatively trained, multiscale, deformable part model”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Anchorage, Alaska, USA, 1-8.
[29]
Ren, S., He, K., Girshick, R., and Sun, J. (2015). “Faster r-cnn: Towards real-time object detection with region proposal networks”. Proceedings of the Advances in Neural Information Processing Systems, Montreal, Canada, 28: 91-99.
[30]
Zheng, Z., Zheng, L., and Yang, Y. (2017). “Unlabeled samples generated by gan improve the person re-identification baseline in vitro”. Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy, 3754-3762.
[31]
Wei, L., Zhang, S., Gao, W., and Tian, Q. (2018). “Person transfer gan to bridge domain gap for person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, 79-88.
[32]
Ning, X., Gong, K., Li, W., Zhang, L., Bai, X., and Tian, S. (2021). “Feature refinement and filter network for person Re-identification”. IEEE Transactions on Circuits and Systems for Video Technology, PP (99):1-1.
[33]
Quan, R., Dong, X., Wu, Y., Zhu, L., and Yang Y. (2019). “Auto-reid: Searching for a part-aware convnet for person re-identification,” Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea, 3750–3759.
[34]
Zoph, B., and Le, Q. V. (2016). “Neural architecture search with reinforcement learning”. arXiv preprint arXiv:1611.01578.
[35]
Yu, H., Wu, A., and Zheng, W. (2017). “Cross-view asymmetric metric learning for unsupervised person re-identification”. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 994-1002.
[36]
Li, H., Wu, G., and Zheng, W. (2021). “Combined Depth Space based Architecture Search For Person Re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, online, 6729-6738.
[37]
Ge, Y., Zhu, F., Chen D, Zhao, R., and Li, H. (2020). “Self-paced contrastive learning with hybrid memory for domain adaptive object re-id”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, USA.
[38]
Bai, S., Bai, X., and Tian, Q. (2017). “Scalable person re-identification on supervised smoothed manifold”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii, USA. 2530-2539.
[39]
Song, C., Huang, Y., Ouyang, W., and Wang, L. (2018). “Mask-guided contrastive attention model for person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, 1179-1188.
[40]
Zhou, K., Yang, Y., Cavallaro, A., and Xiang, T. (2019). “Omni-scale feature learning for person re-identification”. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea, 3702-3712.
[41]
Wei, L., Wei, Z., Jin, Z., Yu, Z., Huang, J., Cai, D., He, X. and Hua, X. (2020). “SIF: Self-inspirited feature learning for person re-identification”. IEEE Transactions on Image Processing, 29: 4942-4951.
[42]
Liu, J., Zha, Z., Chen, D., Hong, R., and Wang, M. (2019). “Adaptive transfer network for cross-domain person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, USA, 7202-7211.
[43]
Yang, Q., Yu, H., Wu, A., and Zheng, W. (2019). “Patch-based discriminative feature learning for unsupervised person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, USA, 3633-3642.
[44]
Luo, H., Gu, Y., Liao, X., Lai, S., and Jiang, W. (2019). “Bag of tricks and a strong baseline for deep person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, USA, 0-0.
[45]
Zhong, Z., Zheng, L., Luo, Z., Li, S., and Yang, Y. (2019). “Invariance matters: Exemplar memory for domain adaptive person re-identification”. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, USA, 598-607.
[46]
Ge, Y., Chen, D., and Li, H. (2020). “Mutual mean-teaching: Pseudo label refinery for unsupervised domain adaptation on person re-identification”. International Conference on Learning Representations.

Index Terms

  1. A Survey of Person Re-identification Based on Deep Learning
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCPR '21: Proceedings of the 2021 10th International Conference on Computing and Pattern Recognition
    October 2021
    393 pages
    ISBN:9781450390439
    DOI:10.1145/3497623
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 February 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Deep learning
    2. Person re-identification
    3. Supervised learning
    4. Unsupervised learning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • Natural Science Foundation of Fujian Province
    • Young Teacher Education Research Project of Fujian Province
    • Natural Science Foundation of China
    • Youth Innovation Fund Project of Xiamen City
    • Scientific Research Climbing Program of Xiamen University of Technology

    Conference

    ICCPR '21

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 138
      Total Downloads
    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 10 Dec 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media