More Web Proxy on the site http://driver.im/

short-paper

Dense Scene Multiple Object Tracking with Box-Plane Matching

Authors:

Feiyue HuangAuthors Info & Claims

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

Pages 4615 - 4619

https://doi.org/10.1145/3394171.3416283

Published: 12 October 2020 Publication History

Abstract

Multiple Object Tracking (MOT) is an important task in computer vision. MOT is still challenging due to the occlusion problem, especially in dense scenes. Following the tracking-by-detection framework, we propose the Box-Plane Matching (BPM) method to improve the MOT performacne in dense scenes. First, we design the Layer-wise Aggregation Discriminative Model (LADM) to filter the noisy detections. Then, to associate remaining detections correctly, we introduce the Global Attention Feature Model (GAFM) to extract appearance feature and use it to calculate the appearance similarity between history tracklets and current detections. Finally, we propose the Box-Plane Matching strategy to achieve data association according to the motion similarity and appearance similarity between tracklets and detections. With the effectiveness of the three modules, our team achieves the 1st place on the Track-1 leaderboard in the ACM MM Grand Challenge HiEve 2020.

Supplementary Material

MP4 File (3394171.3416283.mp4)

Following the tracking-by-detection framework, we propose the Box-Plane Matching (BPM) method to improve the MOT performacne in dense scenes. First, we design the Layer-wise Aggregation Discriminative Model (LADM) to filter the noisy detections. Then, to associate remaining detections correctly, we introduce the Global Attention Feature Model (GAFM) to extract appearance feature and use it to calculate the appearance similarity between history tracklets and current detections. Finally, we propose the Box-Plane Matching strategy to achieve data association according to the motion similarity and appearance similarity between tracklets and detections. With the effectiveness of the three modules, our team achieves the 1st place on the Track-1 leaderboard in the ACM MM Grand Challenge HiEve 2020.

Download
243.72 MB

References

[1]

Shayan Modiri Assari, Haroon Idrees, and Mubarak Shah. 2016. Human re-identification in crowd videos using personal, social and environmental constraints. In ECCV.

[2]

Keni Bernardin and Rainer Stiefelhagen. 2008. Evaluating multiple object tracking performance: the CLEAR MOT metrics. EURASIP Journal on Image and Video Processing (2008).

[3]

Jiahui Chen, Hao Sheng, Yang Zhang, and Zhang Xiong. 2017. Enhancing detection model for multiple hypothesis tracking. In CVPRW.

[4]

Qi Chu, Wanli Ouyang, Hongsheng Li, Xiaogang Wang, Bin Liu, and Nenghai Yu. 2017. Online multi-object tracking using CNN-based single object tracker with spatial-temporal attention mechanism. In ICCV.

[5]

Shan Gao, Xiaogang Chen, Qixiang Ye, Junliang Xing, Arjan Kuijper, and Xiangyang Ji. 2017. Beyond Group: Multiple Person Tracking via Minimal Topology-Energy-Variation. IEEE TIP (2017).

[6]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR.

[7]

Roberto Henschel, Laura Leal-Taixé, Daniel Cremers, and Bodo Rosenhahn. 2018. Fusion of head and full-body detectors for multi-object tracking. In CVPRW.

[8]

Chanho Kim, Fuxin Li, and James M Rehg. 2018. Multi-object Tracking with Neural Gating Using Bilinear LSTM. In ECCV.

[9]

Harold W Kuhn. 1955. The Hungarian method for the assignment problem. NRL (1955).

[10]

Weiyao Lin, Huabin Liu, Shizhan Liu, Yuxi Li, Guo-Jun Qi, Rui Qian, Tao Wang, Nicu Sebe, Ning Xu, Hongkai Xiong, et al. 2020. Human in Events: A Large-Scale Benchmark for Human-centric Video Analysis in Complex Events. arXiv preprint arXiv:2005.04490 (2020).

[11]

Jinlong Peng, Fan Qiu, John See, Qi Guo, Shaoshuai Huang, Ling-Yu Duan, and Weiyao Lin. 2018. Tracklet Siamese Network with Constrained Clustering for Multiple Object Tracking. In VCIP.

[12]

Jinlong Peng, Changan Wang, Fangbin Wan, Yang Wu, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang, and Yanwei Fu. 2020 b. Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking. In ECCV.

[13]

Jinlong Peng, Tao Wang, Weiyao Lin, Jian Wang, John See, Shilei Wen, and Erui Ding. 2020 a. TPM: Multiple Object Tracking with Tracklet-Plane Matching. Pattern Recognition (2020).

[14]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In NIPS.

[15]

Ergys Ristani, Francesco Solera, Roger Zou, Rita Cucchiara, and Carlo Tomasi. 2016. Performance measures and a data set for multi-target, multi-camera tracking. In ECCV.

[16]

Shuai Shao, Zijian Zhao, Boxun Li, Tete Xiao, Gang Yu, Xiangyu Zhang, and Jian Sun. 2018. Crowdhuman: A benchmark for detecting human in a crowd. arXiv preprint arXiv:1805.00123 (2018).

[17]

Jeany Son, Mooyeol Baek, Minsu Cho, and Bohyung Han. 2017. Multi-Object Tracking with Quadruplet Convolutional Neural Networks. In CVPR.

[18]

Siyu Tang, Bjoern Andres, Mykhaylo Andriluka, and Bernt Schiele. 2015. Subgraph decomposition for multi-target tracking. In CVPR.

[19]

Siyu Tang, Mykhaylo Andriluka, Bjoern Andres, and Bernt Schiele. 2017. Multiple people tracking by lifted multicut and person re-identification. In CVPR.

[20]

Min Yang, Yuwei Wu, and Yunde Jia. 2017. A Hybrid Data Association Framework for Robust Online Multi-Object Tracking. IEEE TIP (2017).

[21]

Fengwei Yu, Wenbo Li, Quanquan Li, Yu Liu, Xiaohua Shi, and Junjie Yan. 2016. POI: multiple object tracking with high performance detection and appearance feature. In ECCV.

[22]

Ji Zhu, Hua Yang, Nian Liu, Minyoung Kim, Wenjun Zhang, and Ming-Hsuan Yang. 2018. Online multi-object tracking with dual matching attention networks. In ECCV.

Cited By

Li GJian YJian YYan YYan YWang HWang HCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)GLATrack: Global and Local Awareness for Open-Vocabulary Multiple Object TrackingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681530(2457-2466)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681530
Shim KHwang JKo KKim C(2024)A Confidence-Aware Matching Strategy For Generalized Multi-Object Tracking2024 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP51287.2024.10647729(4042-4048)Online publication date: 27-Oct-2024
https://doi.org/10.1109/ICIP51287.2024.10647729
Zhang MLiu WXia X(2024)Dense Small Object Tracking via DeepSort Integrated with YOLOv.X-based Detection2024 13th International Conference on Control, Automation and Information Sciences (ICCAIS)10.1109/ICCAIS63750.2024.10814176(1-6)Online publication date: 26-Nov-2024
https://doi.org/10.1109/ICCAIS63750.2024.10814176
Show More Cited By

Index Terms

Dense Scene Multiple Object Tracking with Box-Plane Matching
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Matching
        Object detection
        Object identification
        Tracking

Recommendations

Heterogeneous Fusion of Omnidirectional and PTZ Cameras for Multiple Object Tracking

Dual-camera systems have been widely used in surveillance because of the ability to explore the wide field of view (FOV) of the omnidirectional camera and the wide zoom range of the PTZ camera. Most existing algorithms require a priori knowledge of the ...
Cascaded-Scoring Tracklet Matching for Multi-object Tracking
Pattern Recognition and Computer Vision
Abstract
Multi-object tracking (MOT) aims at locating the object of interest in a successive video sequence and associating the same moving object frame by frame. Most existing approaches to MOT lack the integration of both motion and appearance ...
Tracking in a Dense Crowd Using Multiple Cameras

Tracking people in a dense crowd is a challenging problem for a single camera tracker due to occlusions and extensive motion that make human segmentation difficult. In this paper we suggest a method for simultaneously tracking all the people in a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

October 2020

4889 pages

ISBN:9781450379885

DOI:10.1145/3394171

General Chairs:
Chang Wen Chen
Chinese University of Hong Kong, Shenzhen, China
,
Rita Cucchiara
UNIMORE, Italy
,
Xian-Sheng Hua
Alibaba Group, China
,
Program Chairs:
Guo-Jun Qi
Futurewei Technologies, USA
,
Elisa Ricci
UNITN & Fondazione Bruno Kessler, Italy
,
Zhengyou Zhang
Tencent, China
,
Roger Zimmermann
National University of Singapore, Singapore

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '20

Sponsor:

SIGMM

MM '20: The 28th ACM International Conference on Multimedia

October 12 - 16, 2020

WA, Seattle, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
140
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li GJian YJian YYan YYan YWang HWang HCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)GLATrack: Global and Local Awareness for Open-Vocabulary Multiple Object TrackingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681530(2457-2466)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681530
Shim KHwang JKo KKim C(2024)A Confidence-Aware Matching Strategy For Generalized Multi-Object Tracking2024 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP51287.2024.10647729(4042-4048)Online publication date: 27-Oct-2024
https://doi.org/10.1109/ICIP51287.2024.10647729
Zhang MLiu WXia X(2024)Dense Small Object Tracking via DeepSort Integrated with YOLOv.X-based Detection2024 13th International Conference on Control, Automation and Information Sciences (ICCAIS)10.1109/ICCAIS63750.2024.10814176(1-6)Online publication date: 26-Nov-2024
https://doi.org/10.1109/ICCAIS63750.2024.10814176
Du CLin CJin RChai BYao YSu S(2024)Exploring the State-of-the-Art in Multi-Object Tracking: A Comprehensive Survey, Evaluation, Challenges, and Future DirectionsMultimedia Tools and Applications10.1007/s11042-023-17983-283:29(73151-73189)Online publication date: 9-Feb-2024
https://doi.org/10.1007/s11042-023-17983-2
Yao MWang JPeng JChi MLiu CEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical FlowProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611868(3375-3383)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3611868
Tyagi BNigam SSingh R(2023)Human Detection and Tracking Based on YOLOv3 and DeepSORTCommunication and Intelligent Systems10.1007/978-981-99-2100-3_11(125-135)Online publication date: 25-Jul-2023
https://doi.org/10.1007/978-981-99-2100-3_11
Xu NLin WLu XWei YXu NLin WLu XWei Y(2023)HiEve Challenge on VOTVideo Object Tracking10.1007/978-3-031-44660-3_3(117-123)Online publication date: 5-Dec-2023
https://doi.org/10.1007/978-3-031-44660-3_3
He YWei XHong XKe WGong Y(2022)Identity-Quantity Harmonic Multi-Object TrackingIEEE Transactions on Image Processing10.1109/TIP.2022.315428631(2201-2215)Online publication date: 2022
https://doi.org/10.1109/TIP.2022.3154286
Wang GYang YZhong XYang Y(2022)An Improved FairMOT Method for Crowd Tracking and Counting in Subway Passages2021 6th International Conference on Intelligent Transportation Engineering (ICITE 2021)10.1007/978-981-19-2259-6_11(130-139)Online publication date: 1-Jun-2022
https://doi.org/10.1007/978-981-19-2259-6_11
Gan YHan RYin LFeng WWang SShen HZhuang YSmith JYang YCesar PMetze FPrabhakaran B(2021)Self-supervised Multi-view Multi-Human Association and TrackingProceedings of the 29th ACM International Conference on Multimedia10.1145/3474085.3475177(282-290)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3474085.3475177
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten