Abstract
Unlike text analysis for which topic models are historically developed, traffic video analysis is dealing with much simpler topics, made of restricted motion patterns. In this paper, we propose a dual-layer direction-oriented framework for more efficient traffic motion patterns description based on topic models through considering the simplicity of traffic topics. The aforesaid framework compels the involved topic models to learn the foreknown visually meaningful motion patterns that exist in traffic scenes, as developed theoretically in this paper. Experimental results produced by common datasets show that the proposed method provides more intuitive topics for traffic flow description. Based on experimental results, our framework outperforms other topic-model based methods by 4% to more than 11% in detecting abnormal events, in terms of the area under the Receiver Operating Characteristic curve. In addition to that, in a scene analysis evaluation at intersections equipped with traffic signals, our method reaches 4% higher traffic phase detection accuracy, compared to conventional topic models.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
Dataset is Publically available at: http://www.eecs.qmul.ac.uk/~sgg/QMUL_Junction_Datasets/Junction/Junction.html.
Notes
Publically available at http://www.eecs.qmul.ac.uk/~sgg/QMUL_Junction_Datasets/Junction/Junction.html.
Publically available at http://www.eecs.qmul.ac.uk/~sgg/QMUL_Junction_Datasets/Roundabout/Roundabout.html.
Abbreviations
- AUROC :
-
Area under ROC
- DPMM :
-
Dirichlet Process Mixture Model
- FPR :
-
False Positive Rate
- FSTM :
-
Fully Sparse Topic Model
- GSTC :
-
Group Sparse Topical Coding
- HDP :
-
Hierarchical Dirichlet Process
- LDA :
-
Latent Dirichlet Allocation
- PCA :
-
Principal component analysis
- PLSA :
-
Probabilistic Latent Semantic Analysis
- ROC :
-
Receiver Operating Characteristic
- SRC :
-
sparse reconstruction cost
- STC :
-
Sparse Topical Coding
- TPR :
-
True Positive Rate
References
Fu, W., Wang, J., Lu, H., Ma, S.: Dynamic scene understanding by improved sparse topical coding. Pattern Recogn 46(7), 1841–1850 (2013)
Wan, Y., Yang, T.I., Keathly, D., Buckles, B.: Dynamic scene modeling and anomaly detection based on trajectory analysis. IET Intel Transport Syst 8(6), 526–533 (2014)
Cai, Y., Wang, H., Chen, X., Jiang, H.: Trajectory-based anomalous behavior detection for intelligent traffic surveillance. IET Intel Transport Syst 9(8), 810–816 (2015)
Morris, B.T., Trivedi, M.M.: Understanding vehicular traffic behavior from video: A survey of unsupervised approaches. J Electron Imaging 22(4), 041113–041113 (2013)
Wang, X., Ma, X., Grimson, W.E.L.: Unsupervised activity perception in crowded and complicated scenes using hierarchical bayesian models. IEEE Trans Pattern Anal Mach Intell 31(3), 539–555 (2009)
Kuettel, D., Breitenstein, M., Van Gool, L., Ferrari, V.: What’s going on? Discovering spatio-temporal dependencies in dynamic scenes. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1951–1958, (2010)
Song, L., Jiang, F., Shi, Z., Katsaggelos, A.: Understanding dynamic scenes by hierarchical motion pattern mining. IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6, (2011)
Li, J., Gong, S., Xiang, T.: Learning behavioural context. Int J Comput Vis 97(3), 276–304 (2012)
Varadarajan, J., Emonet, R., Odobez, J.-M.: A sequential topic model for mining recurrent activities from long term video logs. Int J Comput Vis 103(1), 100–126 (2012)
Rana, S., Phung, D., Pham, S., Venkatesh, S.: Large-scale statistical modeling of motion patterns: a bayesian nonparametric approach. Indian Conference on Computer Vision, Graphics and Image Processing, (2012)
Kaviani, R., Ahmadi, P., Gholampour, I.: Incorporating Fully Sparse Topic Models for Abnormality Detection in Traffic Videos, 4th International Conference on Computer and Knowledge Engineering, (2014)
Pathak, D., Sharang, A., Mukerjee, A.: Anomaly localization in topic-based analysis of surveillance videos. IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, pp. 389–395, (2015)
Fan, Y., Zhou, Q., Yue, W., Zhu, W.: A dynamic causal topic model for mining activities from complex videos. Multimedia Tools and Applications 77, 10669–10684 (2018)
Wang, J., Xia, L., Hu, X., Xiao, Y.: Abnormal event detection with semi-supervised sparse topic model. Neural Comput Appl 31(5), 1607–1617 (2019)
Zhou, H., Yu, H., Hu, R., Zhang, G., Hu, J., He, J.T.: Analyzing multiple types of behaviors from traffic videos via nonparametric topic model. J Vis Commun Image Represent 64, 102649 (2019)
Hofmann, T.: Probabilistic latent semantic analysis, arXiv preprint arXiv:1301.6705, (2013)
Blei, D.M., Ng, A.Y., Jordan, M.I., Lafferty, J.: Latent dirichlet allocation. J Mach Learn Res 3, 993–1022 (2003)
Teh, Y.W., Jordan, M.I., Beal, M.J., Blei, D.M.: Hierarchical dirichlet processes. J Am Stat Assoc 101(476), 1566–1581 (2006)
Than, K., Ho, T.B.: Fully sparse topic models. Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases, pp. 490–505, Springer Berlin Heidelberg, (2012)
Zhu, J., Xing, E.: Sparse topical coding. Proceedings of the Twenty-Seventh Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI), pp. 831–838, (2011)
Bai, L., Guo, J., Lan, Y., Cheng, X.: Group sparse topical coding: from code to topic. Proceedings of the sixth ACM international conference on Web search and data mining, pp. 315–324, (2013)
Ricci, E., Zen, G., Sebe, N., Messelodi, S.: A prototype learning framework using EMD: Application to complex scenes analysis. IEEE Trans Pattern Anal Mach Intell 35(3), 513–526 (2013)
Ahmadi, P., Gholampour, I., Tabandeh, M.: A new two-stage topic model based framework for modeling traffic motion patterns. 10th Iranian Conference on Machine Vision and Image Processing (MVIP IEEE, pp. 276–280, 2017. (2017)
Shi, J., Tomasi, C.: Good features to track. Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 593–600, Seattle, Washington, June (1994)
Lucas, B.D., Kanade, T.: An Iterative Image Registration Technique with an Application to Stereo Vision. In IJCAI'81: 7th international joint conference on Artificial intelligence, vol. 2, pp. 674–679, (1981)
Varadarajan, J., Odobez, J.: Topic models for scene analysis and abnormality detection. IEEE International Workshop on Visual Surveillance, Kyoto, Japan, (2009)
Haines, T.S., Xiang, T.: Video topic modelling with behavioural segmentation. Proceedings of the 1st ACM international workshop on Multimodal pervasive video analysis, ACM, pp. 53–58, (2010)
Hospedales, T., Gong, S., Xiang, T.: Video Behaviour Mining using a dynamic topic Model. Int J Comput Vision 98(3), 303–323 (2012)
Li, J., Gong, S., Xiang, T.: Global behaviour inference using probabilistic latent semantic analysis. British Machine Vision Conference, pp. 193–202, (2008)
Chan, A.B., Vasconcelos, N.: Modeling, clustering, and segmenting video with mixtures of dynamic textures. IEEE Trans. Pattern Anal. Mach. Intell. 30(5), 909–926 (2008)
Funding
This research did not receive any grant from funding agencies in the public, commercial, or non-profit sectors.
Author information
Authors and Affiliations
Contributions
PA: Study design, reviewing the literature, proposing the method, interpretation of the results, drafting the manuscript.
IGH: Study design, interpretation of the results, statistical analysis, revision of the manuscript.
Corresponding author
Ethics declarations
Ethics Approval and Consent to Participate
Not applicable.
Consent for Publication
Not applicable.
Competing Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ahmadi, P., Gholampour, I. Direction-Oriented Topic Modeling with Applications in Traffic Scene Analysis. Int. J. ITS Res. 22, 18–33 (2024). https://doi.org/10.1007/s13177-023-00373-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13177-023-00373-1