[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

A lightweight Tiny-YOLOv3 vehicle detection approach

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

In recent years, vehicle detection from video sequences has been one of the important tasks in intelligent transportation systems and is used for detection and tracking of the vehicles, capturing their violations, and controlling the traffic. This paper focuses on a lightweight real-time vehicle detection model developed to run on common computing devices. This method can be developed on low power systems (e.g. devices without GPUs or low power GPU modules), relying on the proposed real-time lightweight algorithm. The system employs an end-to-end approach for identifying, locating, and classifying vehicles in the images. The pre-trained Tiny-YOLOv3 network is adopted as the main reference model and subsequently pruned and simplified by training on the BIT-vehicle dataset, and excluding some of the unnecessary layers. The results indicated advantages of the proposed method in terms of accuracy and speed. Also, the network is capable to detect and classify six different types of vehicles with MAP = 95.05%, at the speed of 17 fps. Hence, it is about two times faster than the original Tiny-YOLOv3 network.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. https://github.com/qqwweee/keras-yolo3.

  2. https://github.com/taheritajar/A-lightweight-Tiny-YOLOv3-vehicle-detection-approach.

  3. The developers of the BIT-Vehicle dataset verified in a correspondence that these errors were mainly due to human and inadvertent mistakes.

  4. https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html.

  5. https://jkjung-avt.github.io/tensorrt-yolov3/.

References

  1. Alvar, S.R., Bajić, I.V.: Mv-yolo: motion vector-aided tracking by semantic object detection. In: 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP), pp. 1–5. IEEE (2018)

  2. Anisimov, D., Khanova, T.: Towards lightweight convolutional neural networks for object detection. In: 2017 14th IEEE international conference on advanced video and signal based surveillance (AVSS), pp. 1–8. IEEE (2017)

  3. Azam, S., Rafique, A., Jeon, M.: Vehicle pose detection using region based convolutional neural network. In: 2016 International Conference on Control, Automation and Information Sciences (ICCAIS), pp. 194–198. IEEE (2016)

  4. Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: Yolov4: optimal speed and accuracy of object detection (2020). arXiv:2004.10934

  5. Cai, Y., Wang, H., Zheng, Z., Sun, X.: Scene-adaptive vehicle detection algorithm based on a composite deep structure. IEEE Access 5, 22804–22811 (2017)

    Article  Google Scholar 

  6. Cao, X., Wu, C., Yan, P., Li, X.: Linear svm classification using boosting hog features for vehicle detection in low-altitude airborne videos. In: 2011 18th IEEE International Conference on Image Processing, pp. 2421–2424. IEEE (2011)

  7. Caraffi, C., Vojíř, T., Trefnỳ, J., Šochman, J., Matas, J.: A system for real-time detection and tracking of vehicles from a single car-mounted camera. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems, pp. 975–982. IEEE (2012)

  8. Chapelle, O., Haffner, P., Vapnik, V.N.: Support vector machines for histogram-based image classification. IEEE Trans. Neural Netw. 10(5), 1055–1064 (1999)

    Article  Google Scholar 

  9. Chen, B.H., Huang, S.C.: Probabilistic neural networks based moving vehicles extraction algorithm for intelligent traffic surveillance systems. Inf. Sci. 299, 283–295 (2015)

    Article  Google Scholar 

  10. Chen, S., Zhan, R., Wang, W., Zhang, J.: Learning slimming sar ship object detector through network pruning and knowledge distillation. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 14, 1267–1282 (2021)

    Article  Google Scholar 

  11. Dai, J., Li, Y., He, K., Sun, J.: R-fcn: Object detection via region-based fully convolutional networks. In: Advances in Neural Information Processing Systems, pp. 379–387 (2016)

  12. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)

  13. Dollár, P., Appel, R., Belongie, S., Perona, P.: Fast feature pyramids for object detection. IEEE Trans. Pattern Anal. Mach. Intell. 36(8), 1532–1545 (2014)

    Article  Google Scholar 

  14. Dong, Z., Wu, Y., Pei, M., Jia, Y.: Vehicle type classification using a semisupervised convolutional neural network. IEEE Trans. Intell. Transport. Syst. 16(4), 2247–56 (2015)

    Article  Google Scholar 

  15. Fleet, D., Weiss, Y.: Optical flow estimation. In: Handbook of Mathematical Models in Computer Vision, pp. 237–257. Springer (2006)

  16. Gao, Y., Guo, S., Huang, K., Chen, J., Gong, Q., Zou, Y., Bai, T., Overett, G.: Scale optimization for full-image-cnn vehicle detection. In: 2017 IEEE Intelligent Vehicles Symposium (IV), pp. 785–791. IEEE (2017)

  17. Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? the kitti vision benchmark suite. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3354–3361. IEEE (2012)

  18. Girshick, R.: Fast r-cnn. In: Processing of IEEE International Conference on Computer Vision, Santiago, pp. 13–16 (2015)

  19. Gong, H., Li, H., Xu, K., Zhang, Y.: Object detection based on improved yolov3-tiny. In: 2019 Chinese Automation Congress (CAC), pp. 3240–3245. IEEE (2019)

  20. Guo, E., Bai, L., Zhang, Y., Han, J.: Vehicle detection based on superpixel and improved hog in aerial images. In: International Conference on Image and Graphics, pp. 362–373. Springer (2017)

  21. Hadi, R.A., Sulong, G., George, L.E.: Vehicle detection and tracking techniques: a concise review (2014). arXiv:1410.5894

  22. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

  23. Hu, X., Xu, X., Xiao, Y., Chen, H., He, S., Qin, J., Heng, P.A.: Sinet: a scale-insensitive convolutional neural network for fast vehicle detection. IEEE Trans. Intell. Transport. Syst. 20(3), 1010–1019 (2018)

    Article  Google Scholar 

  24. Huang, C.L., Liao, W.C.: A vision-based vehicle identification system. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 4, pp. 364–367. IEEE (2004)

  25. Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)

  26. Huang, R., Pedoeem, J., Chen, C.: Yolo-lite: a real-time object detection algorithm optimized for non-gpu computers. In: 2018 IEEE International Conference on Big Data (Big Data), pp. 2503–2510. IEEE (2018)

  27. Kamkar, S., Safabakhsh, R.: Vehicle detection, counting and classification in various conditions. IET Intell. Transport Syst. 10(6), 406–413 (2016)

    Article  Google Scholar 

  28. Kanhere, N.: Vision-based detection, tracking and classification of vehicles using stable features with automatic camera calibration. Ph.D. thesis, Clemson University (2008)

  29. Lai, A.H., Fung, G.S., Yung, N.H.: Vehicle type classification from visual-based dimension estimation. In: ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No. 01TH8585), pp. 201–206. IEEE (2001)

  30. Laopracha, N., Sunat, K.: Comparative study of computational time that hog-based features used for vehicle detection. In: International Conference on Computing and Information Technology, pp. 275–284. Springer (2017)

  31. Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)

  32. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., Berg, A.C.: Ssd: single shot multibox detector. In: European Conference on Computer Vision, pp. 21–37. Springer (2016)

  33. Luo, Z.: Traffic analysis of low and ultra-low frame-rate videos. Ph.D. thesis, Université de Sherbrooke (2018)

  34. Ma, J., Chen, L., Gao, Z.: Hardware implementation and optimization of tiny-yolo network. In: International Forum on Digital TV and Wireless Multimedia Communications, pp. 224–234. Springer (2017)

  35. Machida, T., Naito, T.: Gpu & cpu cooperative accelerated pedestrian and vehicle detection. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV workshops), pp. 506–513. IEEE (2011)

  36. Mahto, P., Garg, P., Seth, P., Panda, J.: Refining yolov4 for vehicle detection. Int. J. Adv. Res. Eng. Technol. (IJARET) 11(5), 409–419 (2020)

    Google Scholar 

  37. Nguyen, H.H., Tran, D.N.N., Jeon, J.W.: Towards real-time vehicle detection on edge devices with nvidia jetson tx2. In: 2020 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), pp. 1–4. IEEE (2020)

  38. Pan, C., Sun, M., Yan, Z.: The study on vehicle detection based on dpm in traffic scenes. In: International Conference on Frontier Computing, pp. 19–27. Springer (2016)

  39. Pyo, J., Bang, J., Jeong, Y.: Front collision warning based on vehicle detection using cnn. In: 2016 International SoC Design Conference (ISOCC), pp. 163–164. IEEE (2016)

  40. Qu, T., Zhang, Q., Sun, S.: Vehicle detection from high-resolution aerial images using spatial pyramid pooling-based deep convolutional neural networks. Multimed. Tools Appl. 76(20), 21651–21663 (2017)

    Article  Google Scholar 

  41. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)

  42. Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)

  43. Ringwald, T., Sommer, L., Schumann, A., Beyerer, J., Stiefelhagen, R.: Uav-net: a fast aerial vehicle detector for mobile platforms. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (2019)

  44. Sang, J., Wu, Z., Guo, P., Hu, H., Xiang, H., Zhang, Q., Cai, B.: An improved yolov2 for vehicle detection. Sensors 18(12), 4272 (2018)

    Article  Google Scholar 

  45. Sen-Ching, S.C., Kamath, C.: Robust techniques for background subtraction in urban traffic video. In: Visual Communications and Image Processing 2004, vol. 5308, pp. 881–893. International Society for Optics and Photonics (2004)

  46. Song, H., Liang, H., Li, H., Dai, Z., Yun, X.: Vision-based vehicle detection and counting system using deep learning in highway scenes. Eur. Transport Res. Rev. 11(1), 51 (2019)

    Article  Google Scholar 

  47. Tan, M., Pang, R., Le, Q.V.: Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10781–10790 (2020)

  48. Tang, T., Zhou, S., Deng, Z., Lei, L., Zou, H.: Arbitrary-oriented vehicle detection in aerial imagery with single convolutional neural networks. Remote Sens. 9(11), 1170 (2017)

    Article  Google Scholar 

  49. Tang, T., Zhou, S., Deng, Z., Zou, H., Lei, L.: Vehicle detection in aerial images based on region convolutional neural networks and hard negative example mining. Sensors 17(2), 336 (2017)

    Article  Google Scholar 

  50. Tang, Y., Zhang, C., Gu, R., Li, P., Yang, B.: Vehicle detection and recognition for intelligent traffic surveillance system. Multimed. Tools Appl. 76(4), 5817–5832 (2017)

    Article  Google Scholar 

  51. Tian, B., Li, Y., Li, B., Wen, D.: Rear-view vehicle detection and tracking by combining multiple parts for complex urban surveillance. IEEE Trans. Intell. Transport. Syst. 15(2), 597–606 (2013)

    Article  Google Scholar 

  52. Tian, B., Morris, B.T., Tang, M., Liu, Y., Yao, Y., Gou, C., Shen, D., Tang, S.: Hierarchical and networked vehicle surveillance in its: a survey. IEEE Trans. Intell. Transport. Syst. 16(2), 557–580 (2014)

    Article  Google Scholar 

  53. Wang, X., Cheng, P., Liu, X., Uzochukwu, B.: Focal loss dense detector for vehicle surveillance. In: 2018 International Conference on Intelligent Systems and Computer Vision (ISCV), pp. 1–5. IEEE (2018)

  54. Wen, L., Du, D., Cai, Z., Lei, Z., Chang, M.C., Qi, H., Lim, J., Yang, M.H., Lyu, S.: Ua-detrac: a new benchmark and protocol for multi-object detection and tracking. Comput. Vis. Image Underst. 193, 102907 (2020)

    Article  Google Scholar 

  55. Xu, P., Xiao, Z., Wang, X., Chen, L., Wang, C., An, F.: A multi-core object detection coprocessor for multi-scale/type classification applicable to iot devices. Sensors 20(21), 6239 (2020)

    Article  Google Scholar 

  56. Zhang, F., Li, C., Yang, F.: Vehicle detection in urban traffic surveillance images based on convolutional neural networks with feature concatenation. Sensors 19(3), 594 (2019)

    Article  Google Scholar 

  57. Zhang, P., Zhong, Y., Li, X.: Slimyolov3: Narrower, faster and better for real-time uav applications. In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (2019)

  58. Zhang, W., Wu, Q.J., Yang, X., Fang, X.: Multilevel framework to detect and handle vehicle occlusion. IEEE Trans. Intell. Transport. Syst. 9(1), 161–174 (2008)

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank Dr. M. Tousi for his valuable comments on an earlier version of this paper. We would also thank Mr. B. Seyedi for providing us some of the required hardware.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Faculty of Engineering, Bu-Ali Sina University, Hamedan, Iran

    Alireza Taheri Tajar & Abbas Ramazani

  2. Department of Computer Engineering, Faculty of Engineering, Bu-Ali Sina University, Hamedan, Iran

    Muharram Mansoorizadeh

Authors
  1. Alireza Taheri Tajar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abbas Ramazani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muharram Mansoorizadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abbas Ramazani.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (XLSX 135 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Taheri Tajar, A., Ramazani, A. & Mansoorizadeh, M. A lightweight Tiny-YOLOv3 vehicle detection approach. J Real-Time Image Proc 18, 2389–2401 (2021). https://doi.org/10.1007/s11554-021-01131-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-021-01131-w

Keywords

Search

Navigation