More Web Proxy on the site http://driver.im/

article

Multicamera Human Re-Identification based on Covariance Descriptor

Authors:

V. V. Devyatkov,

A. N. Alfimtsev,

A. R. TaranyanAuthors Info & Claims

Pattern Recognition and Image Analysis, Volume 28, Issue 2

Pages 232 - 242

https://doi.org/10.1134/S1054661818020025

Published: 01 April 2018 Publication History

Abstract

Human re-identification is a crucial component of security and surveillance systems, smart environments and robots. In this paper a novel selective covariance-based method for human re-identification in video streams from multiple cameras is proposed. Our method, which includes human localization and human classification stages, is called selective covariance-based because before classifying the object using covariance descriptors (in this case the classes are the different people being re-identified) we extract (selection) specific regions, which are definitive for the class of objects we deal with (people). In our case, the region being extracted is the human head and shoulders. In the paper new feature functions for covariance region descriptors are developed and compared to basic feature functions, and a mask, filtering out the most of the background information from the region of interest, is proposed and evaluated. The use of the proposed feature functions and mask significantly improved the human classification performance (from 75% when using basic feature functions to 94.6% accuracy with the proposed method), while keeping computational complexity moderate.

References

[1]

J. Watada and Z.B. Musaand, "Tracking human motions for security system," in Proc. 2008 SICE Annual Conference (IEEE, 2008), pp. 3344---3349.

[2]

A. A. Morozov, A. Vaish, A. F. Polupanov, V. E. Antciperov, I. I. Lychkov, A. N. Alfimtsev, and V. V. Deviatkov, "Development of concurrent object-oriented logic programming platform for the intelligent monitoring of anomalous human activities," in Biomedical Engineering Systems and Technologies, BIOSTEC 2014, Ed. by G. Plantier, T. Schultz, A. Fred, and H. Gamboa, Communications in Computer and Information Science (Springer, Cham, 2015), vol. 511, pp. 82---97.

Digital Library

[3]

V. Devyatkov, A. Alfimtsev, and S. Sakulin, "Web personalization based on fuzzy aggregation and recognition of user activity," Int. J. Web Portals (IJWP) 4 (1), 33---41 (2012).

Digital Library

[4]

N. Bellotto and H. Hu, "Multisensor-based human detection and tracking for mobile service robots," IEEE Trans. Syst., Man, Cybernet. Part B: Cybernet. 39 (1), 167---181 (2009).

Digital Library

[5]

D. G. Lowe, "Distinctive image features from scaleinvariant keypoints," Int. J. Comput. Vision 60 (2), 91---110 (2004).

Digital Library

[6]

K.-E. Aziz, D. Merad, and B. Fertil, "People re-identification across multiple non-overlapping cameras system by appearance classification and silhouette part segmentation," in Proc. 2011 8th IEEE Int. Conf. on Advanced Video and Signal-Based Surveillance (AVSS) (IEEE, 2011), pp. 303---308.

Digital Library

[7]

S. Fazli, H. M. Pour, and H. Bouzari, "Particle filter based object tracking with Sift and color feature," in Proc. 2009 Second Int. Conf. on Machine Vision (IEEE Computer Society, 2009), pp. 89---93.

Digital Library

[8]

S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intellig. 24 (4), 509---522 (2002).

Digital Library

[9]

S. Ioffe and D. A. Forsyth, "Probabilistic methods for finding people," Int. J. Comput. Vision 43 (1), 45---68 (2001).

Digital Library

[10]

A. Li, L. Liu, K. Wang, et al. "Clothing attributes assisted person reidentification," IEEE Trans. Circuits Syst. Video Technol. 25 (5), 869---878 (2015).

Digital Library

[11]

H. Elzein, S. Lakshmanan, and P. Watta, "A motion and shape-based pedestrian detection algorithm," in Proc. 2003 IEEE Intelligent Vehicles Symposium (IEEE, 2003), pp. 500---504.

[12]

M. Hasan and N. Babaguchi, "Long-term people reidentification using anthropometric signature," in Proc. 2016 IEEE 8th Int. Conf. on Biometrics Theory, Applications and Systems (BTAS) (IEEE, 2016). pp. 1---6.

Digital Library

[13]

H. Liu, L. Wang, and F. Sun, "Mean-shift tracking using fuzzy coding histogram," Int. J. Fuzzy Syst. 16 (4), 457---467 (2014).

[14]

D. Comaniciu, V. Ramesh, and P. Meer, "Kernelbased object tracking," IEEE Trans. Pattern Anal. Mach. Intellig. 25 (5), 564---577 (2003).

Digital Library

[15]

P. Pérez, C. Hue, J. Vermaak, and M. Gangnet, "Color-based probabilistic tracking," in European Conf. on Computer Vision -- ECCV 2002, Ed. by A. Heyden, G. Sparr, M. Nielsen, and P. Johansen, Lecture Notes in Computer Science (Springer, Berlin, 2002), Vol. 2350, pp. 661---675.

Digital Library

[16]

O. Tuzel, F. Porikli, and P. Meer, "Region covariance: A fast descriptor for detection and classification," in European Conf. on Computer Vision -- ECCV 2006, Ed. by A. Leonardis, H. Bischof, and A. Pinz, Lecture Notes in Computer Science (Springer, Berlin, 2006), vol. 3952, pp. 589---600.

Digital Library

[17]

F. Porikli, O. Tuzel, and P. Meer, "Covariance tracking using model update based on Lie algebra," in Proc. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'06) (IEEE Computer Society, 2006), vol. 1, pp. 728---735.

Digital Library

[18]

Y. Wu, J. Cheng, J. Wang, and H. Lu, "Real-time visual tracking via incremental covariance tensor learning," in Proc. 2009 IEEE 12th Int. Conf. on Computer Vision (IEEE, 2009), pp. 1631---1638.

[19]

Y. Wu, J. Wang, and H. Lu, "Robust Bayesian tracking on Riemannian manifolds via fragments-based representation," in Proc. 2009 IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, 2009), pp. 765---768.

Digital Library

[20]

Y. H. Hassen, T. Ouni, W. Ayedi, and M. Jallouli, "Mono-camera person tracking based on template matching and covariance descriptor," in Proc. 2015 Int. Conf. on Computer Vision and Image Analysis Applications (ICCVIA) (IEEE, 2015), pp. 225---229.

[21]

Y. Wu, J. Cheng, J. Wang, et al. "Real-time probabilistic covariance tracking with efficient model update," IEEE Trans. Image Process. 21 (5), 2824---2837 (2012).

Digital Library

[22]

S. Bąk, E. Corvee, F. Bremond, and M. Thonnat, "Person re-identification using spatial covariance regions of human body parts," in Proc. 2010 7th IEEE Int. Conf. on Advanced Video and Signal Based Surveillance (AVSS) (IEEE, 2010), pp. 435---440.

Digital Library

[23]

H. Ergezer and K. Leblebicioğlu, "Anomaly detection and activity perception using covariance descriptor for trajectories," in European Conf. on Computer Vision---ECCV 2016 Workshops, Ed. by G. Hua and H. Jégou, Lecture Notes in Computer Science (Springer, Cham, 2016), Vol. 9914, pp. 728---742.

[24]

A. Sanin, C. Sanderson, M. T. Harandi, and B. C. Lovell, "Spatio-temporal covariance descriptors for action and gesture recognition," in Proc. 2013 IEEE Workshop on Applications of Computer Vision (WACV) (IEEE, 2013). pp. 103---110.

Digital Library

[25]

Z. Zivkovic, "Improved adaptive Gaussian mixture model for background subtraction," in Proc. 17th International Conference on Pattern Recognition (ICPR 2004) (IEEE, 2004), pp. 28---31.

Digital Library

[26]

P. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vision 57 (2), 137---154 (2004).

Digital Library

[27]

Human tracking dataset (2016 November 29). Retrieved from https://github.com/Taranyan/Human-Tracking-DataSet

[28]

3DPeS dataset (2016 October 17). Retrieved from http://www.openvisor.org/3dpes.asp

[29]

SARC3D dataset (2016 October 17). Retrieved from http://www.openvisor.org/sarc3d.asp

[30]

Town Centre dataset (2016 October 17). Retrieved from http://www.robots.ox.ac.uk/ActiveVision/Research/Projects/2009bbenfold_headpose/project.html#datasets

Cited By

Duy LHung P(2022)Adaptive Graph Attention Network in Person Re-IdentificationPattern Recognition and Image Analysis10.1134/S105466182202008032:2(384-392)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1134/S1054661822020080
Luna CLosada-Gutiérrez CFuentes-Jimenez DMazo M(2021)People re-identification using depth and intensity information from an overhead cameraExpert Systems with Applications: An International Journal10.1016/j.eswa.2021.115287182:COnline publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1016/j.eswa.2021.115287

Multicamera Human Re-Identification based on Covariance Descriptor
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
  2. Machine learning
    1. Learning paradigms
      1. Supervised learning
    2. Machine learning algorithms

Recommendations

Multi-shot human re-identification using a fast multi-scale video covariance descriptor

Multi-shot person re-identification in non-overlapping camera networks has become an important research area. In order to tackle this problem, a robust and adaptive person modeling against occlusion and uncontrolled changes is required. In this paper, a ...
Gabor-LBP Based Region Covariance Descriptor for Person Re-identification
ICIG '11: Proceedings of the 2011 Sixth International Conference on Image and Graphics

Person re-identification is an important problem in computer vision, which involves matching appearance of individuals between non-overlapping camera views. In this paper we present a novel appearance-based method for person re-identification problem. ...
Motion keypoint trajectory and covariance descriptor for human action recognition

Human action recognition from videos is a challenging task in computer vision. In recent years, histogram-based descriptors that are calculated along dense trajectories have shown promising results for human action recognition, but they usually ignore ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Pattern Recognition and Image Analysis

Pattern Recognition and Image Analysis Volume 28, Issue 2

April 2018

193 pages

ISSN:1054-6618

Issue’s Table of Contents

Copyright © Copyright © 2018 Pleiades Publishing, Ltd.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 April 2018

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Duy LHung P(2022)Adaptive Graph Attention Network in Person Re-IdentificationPattern Recognition and Image Analysis10.1134/S105466182202008032:2(384-392)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1134/S1054661822020080
Luna CLosada-Gutiérrez CFuentes-Jimenez DMazo M(2021)People re-identification using depth and intensity information from an overhead cameraExpert Systems with Applications: An International Journal10.1016/j.eswa.2021.115287182:COnline publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1016/j.eswa.2021.115287

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents