[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3394171.3414540acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

PyAnomaly: A Pytorch-based Toolkit for Video Anomaly Detection

Published: 12 October 2020 Publication History

Abstract

Video anomaly detection is an essential task in computer vision which attracts massive attention from academia and industry. The existing approaches are implemented in diverse deep learning frameworks and settings, making it difficult to reproduce the results published by the original authors. Undoubtedly, this phenomenon is detrimental to the development of Video Anomaly detection and community communication. In this paper, we present a PyTorch-based video anomaly detection toolbox, namely PyAnomaly that contains high modular and extensible components, comprehensive and impartial evaluation platforms, a friendly manageable system configuration, and the abundant engineering deployment functions. To make it easy-to-use and easy-to-extend, we implement the architecture by hooks and registers functionality. Remarkably, we have reproduced the comparable experimental results of six representative methods as those published by the original authors, and we will release these pre-trained models with more rich configurations. To our best knowledge, the PyAnomaly is the first open-source tool in video anomaly detection and is available at https://github.com/YuhaoCheng/PyAnomaly.

Supplementary Material

MP4 File (3394171.3414540.mp4)
This video introduces the PyAnomaly, which is the first open-source toolbox for video anomaly detection. This video contains our motivation to do this project, the project's introduction, and some detailed information related to the project. Specifically, we introduce the network reproduced in our project and the reasons we choose them, and we also describe the usage of our APIs and why we design them. And we show the whole project's structure to make readers have a better view of our project. We also explain our open-source project's designing principles, which will help readers understand our work better and design their open-source projects. In the end, we show the outputs of our project and how it can accelerate the development of video anomaly detection.

References

[1]
2013. UCSD dataset. http://www.svcl.ucsd.edu/projects/anomaly/dataset.html
[2]
Zhe Cao, Tomas Simon, Shih-En Wei, and et al. 2017. Realtime multi-person 2d pose estimation using part affinity fields. In CVPR. 7291--7299.
[3]
Kai Chen, Jiaqi Wang, Jiangmiao Pang, and et al. 2019. MMDetection: Open MMLab Detection Toolbox and Benchmark. arXiv:1906.07155 (2019).
[4]
R. Girshick. 2018. YACS. https://github.com/rbgirshick/yacs.
[5]
Dong Gong, Lingqiao Liu, Vuong Le, and et al. 2019. Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. In ICCV. 1705--1714.
[6]
Dongliang He, Zhichao Zhou, Gan Chuang, and et al. 2019. Stnet: Local and global spatial-temporal modeling for action recognition. In Proceedings of the AAAI Conference on Artificial Intelligence. 8401--8408.
[7]
Lingxiao He, Xingyu Liao, Wu Liu, and et al. 2020. FastReID: A Pytorch Toolbox for Real-world Person Re-identification. arXiv:cs.CV/2006.02631
[8]
Radu Tudor Ionescu, Fahad Shahbaz Khan, Mariana-Iuliana Georgescu, and Ling Shao. 2019. Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. In CVPR. 7842--7851.
[9]
Alexander B. Jung, Kentaro Wada, Jon Crall, and et al. 2020. imgaug. https://github.com/aleju/imgaug. Online; accessed 01-Feb-2020.
[10]
Weixin Li, Vijay Mahadevan, and Nuno Vasconcelos. 2014. Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1 (2014), 18--32.
[11]
Kun Liu, Wu Liu, Ma Huadong, and et al. 2019. Generalized zero-shot learning for action recognition with web-scale video data. World Wide Web 22, 2 (2019), 80--824.
[12]
Wen Liu, Weixin Luo, Dongze Lian, and et al. 2018. Future frame prediction for anomaly detection--a new baseline. In CVPR. 6536--6545.
[13]
Cewu Lu, Jianping Shi, and Jiaya Jia. 2013. Abnormal event detection at 150 fps in matlab. In ICCV. 2720--2727.
[14]
Weixin Luo, Wen Liu, and Shenghua Gao. 2017. A revisit of sparse coding based anomaly detection in stacked rnn framework. In ICCV. 341--349.
[15]
Trong-Nguyen Nguyen and Jean Meunier. 2019. Anomaly detection in video sequence with appearance-motion correspondence. In ICCV. 1273--1283.
[16]
Karishma Pawar and Vahida Attar. 2019. Deep learning approaches for videobased anomalous activity detection. World Wide Web 22 (2019), 571--601.
[17]
Waqas Sultani, Chen Chen, and Mubarak Shah. 2018. Real-world anomaly detection in surveillance videos. In CVPR. 6479--6488.
[18]
Muchao Ye, Xiaojiang Peng,Weihao Gan, and et al. 2019. Anopcn: Video anomaly detection via deep predictive coding network. In ACM Multimedia. 1805--1813.
[19]
Kexin Yi, Chuang Gan, Yunzhu Li, and et al. 2020. Clevrer: Collision events for video representation and reasoning. ICLR (2020).
[20]
Dahua Lin Yue Zhao, Yuanjun Xiong. 2019. MMAction. https://github.com/openmmlab/mmaction.
[21]
Yiru Zhao, Bing Deng, Chen Shen, and et al. 2017. Spatio-temporal autoencoder for video anomaly detection. In ACM Multimedia. 1933--1941.

Cited By

View all
  • (2024)Normal Image Guided Segmentation Framework for Unsupervised Anomaly DetectionIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.332744834:6(4639-4652)Online publication date: Jun-2024
  • (2021)Semi-supervised Graph Edge Convolutional Network for Anomaly DetectionArtificial Neural Networks and Machine Learning – ICANN 202110.1007/978-3-030-86362-3_12(141-152)Online publication date: 7-Sep-2021

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '20: Proceedings of the 28th ACM International Conference on Multimedia
October 2020
4889 pages
ISBN:9781450379885
DOI:10.1145/3394171
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. open-source
  2. toolkit
  3. video anomaly detection

Qualifiers

  • Short-paper

Funding Sources

  • National Key Research and Development Program of China

Conference

MM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)30
  • Downloads (Last 6 weeks)1
Reflects downloads up to 10 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Normal Image Guided Segmentation Framework for Unsupervised Anomaly DetectionIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.332744834:6(4639-4652)Online publication date: Jun-2024
  • (2021)Semi-supervised Graph Edge Convolutional Network for Anomaly DetectionArtificial Neural Networks and Machine Learning – ICANN 202110.1007/978-3-030-86362-3_12(141-152)Online publication date: 7-Sep-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media