[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3581807.3581817acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

VRGNet: A Robust Visible Region-Guided Network for Occluded Pedestrian Detection

Published: 22 May 2023 Publication History

Abstract

Pedestrian detection has made significant progress in both academic and industrial fields. However, there are still some challenging questions with regard to occlusion scene. In this paper, we propose a novel and robust visible region-guided network (VRGNet) to specially improve the occluded pedestrian detection performance. Specifically, we leverage the adapted FPN-based framework to extract multi-scale features, and fuse them together to encode more precision localization and semantic information. In addition, we construct a pedestrian part pool that covers almost all the scale of different occluded body regions. Meanwhile, we propose a new occlusion handling strategy by elaborately integrating the prior knowledge of different visible body regions with visibility prediction into the detection framework to deal with pedestrians with different degree of occlusion. The extensive experiments demonstrate that our VRGNet achieves a leading performance under different evaluation settings on Caltech-USA dataset, especially for occluded pedestrians. In addition, it also achieves a competitive of 48.4%, 9.3%, 6.7% under the Heavy, Partial and Bare settings respectively on CityPersons dataset compared with other state-of-the-art pedestrian detection algorithms, while keeping a better speed-accuracy trade-off.

References

[1]
Zhang S, Benenson R, Schiele B.: Citypersons: A diverse dataset for pedestrian detection. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 3213-3221. (2017).
[2]
Yan J, Zhang X, Lei Z, : Robust multi-resolution pedestrian detection in traffic scenes. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 3033-3040. (2013).
[3]
Zhang S, Benenson R, Schiele B.: Filtered channel features for pedestrian detection. In: the IEEE Conference on Computer Vision and Pattern Recognition. 1(2), (2015).
[4]
Dollár P, Tu Z, Perona P, : Integral channel features. (2019).
[5]
Chen C, Xiao H, Liu Y, : Dual-Task Integrated Network for Fast Pedestrian Detection in Crowded Scenes. IEICE TRANSACTIONS on Information and Systems. 103(6), 1371-1379. (2020).
[6]
Zhang S, Wen L, Bian X, : Occlusion-aware R-CNN: detecting pedestrians in a crowd. In: the European Conference on Computer Vision. pp. 637-653. (2018).
[7]
Tian Y, Luo P, Wang X, : Deep learning strong parts for pedestrian detection. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1904-1912. (2015).
[8]
Dollar P, Wojek C, Schiele B, : Pedestrian detection: An evaluation of the state of the art. IEEE transactions on pattern analysis and machine intelligence. 34(4),743-761. (2011).
[9]
Zhang S, Yang J, Schiele B.: Occluded Pedestrian Detection Through Guided Attention in CNNs. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 6995-7003. (2018).
[10]
Cai Z, Fan Q, Feris R S, : A unified multi-scale deep convolutional neural network for fast object detection. In: European conference on computer vision. Springer, Cham, pp. 354-370. (2016).
[11]
Li J, Liang X, Shen S M, : Scale-aware fast R-CNN for pedestrian detection. IEEE transactions on Multimedia. 20(4): 985-996. (2017).
[12]
Wang S, Cheng J, Liu H, : PCN: Part and Context Information for Pedestrian Detection with CNNs. arXiv preprint arXiv:1804.04483.
[13]
Du X, El-Khamy M, Lee J, : Fused DNN: A deep neural network fusion approach to fast and robust pedestrian detection. In: 2017 IEEE winter conference on applications of computer vision (WACV). pp. 953-961. (2017).
[14]
Lin C, Lu J, Wang G, : Graininess-aware deep feature learning for pedestrian detection. In: the European Conference on Computer Vision. pp. 732-747. (2018).
[15]
Liu W, Liao S, Hu W, : Learning efficient single-stage pedestrian detectors by asymptotic localization fitting. In: the European Conference on Computer Vision. pp. 618-634. (2018).
[16]
Wang X, Xiao T, Jiang Y, : Repulsion Loss: Detecting Pedestrians in a Crowd. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 7774-7783. (2018).
[17]
Song T, Sun L, Xie D, Small-scale pedestrian detection based on topological line localization and temporal feature aggregation. In: the European Conference on Computer Vision. pp. 536-551. (2018).
[18]
Zhou C, Yuan J.: Bi-box regression for pedestrian detection and occlusion estimation. In: the European Conference on Computer Vision. pp. 135-151. (2018).
[19]
Viola P, Jones M J. Robust real-time face detection[J]. International journal of computer vision, 57(2): 137-154. (2004)
[20]
Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 886-893. (2005).
[21]
Lin T Y, Dollár P, Girshick R, Feature pyramid networks for object detection. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2117-2125. (2017).
[22]
Liu S, Qi L, Qin H, Path aggregation network for instance segmentation. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 8759-8768. (2018).
[23]
Ren S, He K, Girshick R, Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28. (2015).
[24]
Liu W, Anguelov D, Erhan D, Ssd: Single shot multibox detector. In: the European Conference on Computer Vision. pp. 21-37. (2016).
[25]
Liu W, Liao S, Ren W, High-level semantic feature detection: A new perspective for pedestrian detection. In: the IEEE Conference on Computer Vision and Pattern Recognition. pp. 5187-5196. (2019)
[26]
Zhou P, Zhou C, Peng P, Noh-nms: Improving pedestrian detection by nearby objects hallucination[C]//Proceedings of the 28th ACM International Conference on Multimedia. 2020: 1967-1975.
[27]
Liu M, Zhu C, Wang J, Adaptive Pattern-Parameter Matching for Robust Pedestrian Detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 2021, 35(3): 2154-2162.
[28]
Song X, Chen B, Li P, PRNet++: Learning towards generalized occluded pedestrian detection via progressive refinement network[J]. Neurocomputing, 2022, 482: 98-115.

Index Terms

  1. VRGNet: A Robust Visible Region-Guided Network for Occluded Pedestrian Detection

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      ICCPR '22: Proceedings of the 2022 11th International Conference on Computing and Pattern Recognition
      November 2022
      683 pages
      ISBN:9781450397056
      DOI:10.1145/3581807
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 22 May 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. CityPersons
      2. Occlusion scene
      3. Part pool
      4. Pedestrian detection

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      ICCPR 2022

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 16
        Total Downloads
      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 13 Dec 2024

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media