A Lightweight Deep Learning-based Weapon Detection Model for Mobile Robots
Article No.: 70, Pages 1 - 6
Abstract
As mobile robotics continues to advance, the need for adequate surveillance in robotic environments is becoming increasingly important. Detecting suspicious objects in sensitive areas using mobile robots is challenging due to the limited computational resources available on these devices. This paper describes a new system for automatically detecting weapons in real-time video footage designed for low-computing devices in mobile robots. We present a novel weapon detection model that aims to balance the trade-off between inference time and detection accuracy, making it a lightweight model compared to existing models. The proposed model is trained and tested on existing benchmark datasets. The model is compared to existing lightweight weapon detection models to determine its suitability for low-computing devices. We obtain the mAP of 90.3%, 85.13% and 92.38% for the IITP_W, Handgun and Sohas datasets, respectively. The results outperforming the well-known PicoDet model. We envisage that the proposed model could be a useful tool for surveillance using mobile robots during events such as riots and anti-terrorist operations.
References
[1]
Muhammad Tahir Bhatti, Muhammad Gufran Khan, Masood Aslam, and Muhammad Junaid Fiaz. 2021. Weapon detection in real-time cctv videos using deep learning. IEEE Access 9 (2021), 34366–34382.
[2]
Alexey Bochkovskiy, Chien-Yao Wang, and Hong-Yuan Mark Liao. 2020. Yolov4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 (2020).
[3]
Yuxuan Cai, Hongjia Li, Geng Yuan, Wei Niu, Yanyu Li, Xulong Tang, Bin Ren, and Yanzhi Wang. 2021. Yolobile: Real-time object detection on mobile devices via compression-compilation co-design. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 955–963.
[4]
Mark Everingham, SM Ali Eslami, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman. 2015. The pascal visual object classes challenge: A retrospective. International journal of computer vision 111 (2015), 98–136.
[5]
Zheng Ge, Songtao Liu, Feng Wang, Zeming Li, and Jian Sun. 2021. Yolox: Exceeding yolo series in 2021. arXiv preprint arXiv:2107.08430 (2021).
[6]
Ross Girshick. 2015. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision. 1440–1448.
[7]
Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 580–587.
[8]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE transactions on pattern analysis and machine intelligence 37, 9 (2015), 1904–1916.
[9]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.
[10]
Jan Hosang, Rodrigo Benenson, and Bernt Schiele. 2017. Learning non-maximum suppression. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4507–4515.
[11]
Andrew Howard, Mark Sandler, Grace Chu, Liang-Chieh Chen, Bo Chen, Mingxing Tan, Weijun Wang, Yukun Zhu, Ruoming Pang, Vijay Vasudevan, 2019. Searching for mobilenetv3. In Proceedings of the IEEE/CVF international conference on computer vision. 1314–1324.
[12]
Jie Hu, Li Shen, and Gang Sun. 2018. Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7132–7141.
[13]
Saffeer M Khan, Syed A Haider, and Ishaq Unwala. 2020. A deep learning based classifier for crack detection with robots in underground pipes. In 2020 IEEE 17th International Conference on Smart Communities: Improving Quality of Life Using ICT, IoT and AI (HONET). IEEE, 78–81.
[14]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2017. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 6 (2017), 84–90.
[15]
Xiang Long, Kaipeng Deng, Guanzhong Wang, Yang Zhang, Qingqing Dang, Yuan Gao, Hui Shen, Jianguo Ren, Shumin Han, Errui Ding, 2020. PP-YOLO: An effective and efficient implementation of object detector. arXiv preprint arXiv:2007.12099 (2020).
[16]
Thomas Müller and Markus Müller. 2011. Vision-based drone flight control and crowd or riot analysis with efficient color histogram based tracking. In Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VIII, Vol. 8020. SPIE, 222–235.
[17]
Mohammad Nakib, Rozin Tanvir Khan, Md Sakibul Hasan, and Jia Uddin. 2018. Crime scene prediction by detecting threatening objects using convolutional neural network. In 2018 International Conference on Computer, Communication, Chemical, Material and Electronic Engineering (IC4ME2). IEEE, 1–4.
[18]
Roberto Olmos, Siham Tabik, and Francisco Herrera. 2018. Automatic handgun detection alarm in videos using deep learning. Neurocomputing 275 (2018), 66–72.
[19]
Francisco Pérez-Hernández, Siham Tabik, Alberto Lamas, Roberto Olmos, Hamido Fujita, and Francisco Herrera. 2020. Object detection binary classifiers methodology based on deep learning to identify small objects handled similarly: Application in video surveillance. Knowledge-Based Systems 194 (2020), 105590.
[20]
Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems 28 (2015).
[21]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
[22]
Prashant Varshney, Nikhil Kr Harsh Tyagi, Abhishek Kajla Lohia, and Palak Girdhar. 2021. A Deep Learning Based Approach to Detect Suspicious Weapons. Proceedings http://ceur-ws. org ISSN 1613 (2021), 0073.
[23]
Chien-Yao Wang, Hong-Yuan Mark Liao, Yueh-Hua Wu, Ping-Yang Chen, Jun-Wei Hsieh, and I-Hau Yeh. 2020. CSPNet: A new backbone that can enhance learning capability of CNN. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops. 390–391.
[24]
Arif Warsi, Munaisyah Abdullah, Mohd Nizam Husen, Muhammad Yahya, Sheroz Khan, and Nasreen Jawaid. 2019. Gun detection system using YOLOv3. In 2019 IEEE International Conference on Smart Instrumentation, Measurement and Application (ICSIMA). IEEE, 1–4.
[25]
Hualin Yang, Long Chen, Miaoting Chen, Zhibin Ma, Fang Deng, Maozhen Li, and Xiangrong Li. 2019. Tender tea shoots recognition and positioning for picking robot using improved YOLO-V3 model. IEEE Access 7 (2019), 180998–181011.
[26]
Lingxiao Yang, Ru-Yuan Zhang, Lida Li, and Xiaohua Xie. 2021. Simam: A simple, parameter-free attention module for convolutional neural networks. In International conference on machine learning. PMLR, 11863–11874.
[27]
Guanghua Yu, Qinyao Chang, Wenyu Lv, Chang Xu, Cheng Cui, Wei Ji, Qingqing Dang, Kaipeng Deng, Guanzhong Wang, Yuning Du, 2021. PP-PicoDet: A better real-time object detector on mobile devices. arXiv preprint arXiv:2111.00902 (2021).
Index Terms
- A Lightweight Deep Learning-based Weapon Detection Model for Mobile Robots
Recommendations
Weapon Detection Using Deep Learning
SOICT '23: Proceedings of the 12th International Symposium on Information and Communication TechnologyNowadays, security and safety issues are very complex and tend to be related to criminals using weapons to commit crimes, posing many potential risks to society. Recently, Deep Learning models have been researched and applied to Computer Vision problems. ...
The AllSeeing Eye for Constructive Weapon Detection Using YOLOv8 Object Detection Model
ICIMMI '23: Proceedings of the 5th International Conference on Information Management & Machine IntelligenceGun and weapon detection is a challenging task that has a wide range of applications in security, surveillance, and law enforcement. In this paper, we present a novel gun and weapon detection system using the YOLOv8 (You Only Look Once) object detection ...
Weapon Detection System on Android Devices: A Portable Machine Learning Technology
APIT '24: Proceedings of the 2024 6th Asia Pacific Information Technology ConferenceThe machine learning techniques paired with augmented reality (AR) systems extend the capabilities of surveillance systems for the social good through analyzing and extracting complex patterns in a simple and cost-effective AR-based app running on any ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2023
583 pages
ISBN:9781450399807
DOI:10.1145/3610419
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 November 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- IMPACTING RESEARCH INNOVATION AND TECHNOLOGY-2
Conference
AIR 2023
AIR 2023: Advances In Robotics - 6th International Conference of The Robotics Society
July 5 - 8, 2023
Ropar, India
Acceptance Rates
Overall Acceptance Rate 69 of 140 submissions, 49%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 52Total Downloads
- Downloads (Last 12 months)38
- Downloads (Last 6 weeks)2
Reflects downloads up to 12 Jan 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format