Abstract
Mining patterns of large-scale trajectory data streams has been of increase research interest. In this paper, we are interested in mining group patterns of moving objects. Group pattern mining describes a special type of trajectory mining task that requires to efficiently discover trajectories of objects that are found in close proximity to each other for a period of time. In particular, we focus on trajectories of pedestrians coming from motion video analysis and we are interested in interactive analysis and exploration of group dynamics, including various definitions of group gathering and dispersion. Traditional approaches to solve the problem adhere to strict definition of group semantics. That restricts their application to specific problems and renders them inadequate for many real-world scenarios. To address this limitation, we propose a novel versatile method, timeWgroups, for efficient discovery of pedestrian groups that can adhere to different pattern semantics. First, the method efficiently discovers pairs of pedestrians that move together over time, under varying conditions of space and time. Subsequently, pairs of pedestrians are used as a building block for effectively discovering groups of pedestrians that can satisfy versatile group pattern semantics. As such, the proposed method can accommodate many different scenarios and application requirements. In addition, we introduce a new group pattern, individual perspective grouping that focuses on how individuals perceive groups. Based on the new group pattern we define the concept of dominant groups, a global metric for defining important groups that respects the individual perspective group pattern. Through experiments on real data, we demonstrate the effectiveness of our methods on discovering group patterns of pedestrian trajectories against sensible baselines, for a varying range of conditions. Furthermore, a query-based search method is provided that allows for interactive exploration and analysis of group dynamics over time and space. In addition, a visual testing is performed on real motion video to assert the group dynamics discovered by our methods.
Similar content being viewed by others
References
Abuolaim A, Leow WK, Varadarajan J, Ahuja N (2017) On the essence of unsupervised detection of anomalous motion in surveillance videos. In: International Conference on Computer Analysis of Images and Patterns, pp 160–171
Andriluka M, Roth S, Schiele B (2008) People-tracking-by-detection and people-detection-by-tracking. In: Computer vision and Pattern Recognition (CVPR), pp 1–8
Bae SH, Yoon KJ (2014) Robust online multiobject tracking with data association and track management. IEEE Trans Image Process 23(7):2820–2833
Bastani V, Campo D, Marcenaro L, Regazzoni C (2015) Online pedestrian group walking event detection using spectral analysis of motion similarity graph. In: International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp 1–5
Benkert M, Gudmundsson J, Hübner F, Wolle T (2008) Reporting flock patterns. Comput Geom 41(3):111–125
Brščić D, Zanlungo F, Kanda T (2017) Modelling of pedestrian groups and application to group recognition. In: International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp 564–569
Cartwritht D, Zander A (1960) Group dynamics. Harper and Row, New York
Dollar P, Wojek C, Schiele B, Perona P (2012) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34(4):743–761
Ester M, Kriegel HP, Sander J, Xu X, et al. (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD, vol 96, pp 226–231
Fan Q, Zhang D, Wu H, Tan KL (2016) A general and parallel platform for mining co-movement patterns over large-scale trajectories. Proceed VLDB Endowment 10(4):313–324
Faugeras O (1993) Three-dimensional computer vision: a geometric viewpoint. MIT Press, Cambridge
Gaffney S, Smyth P (1999) Trajectory clustering with mixtures of regression models. In: Knowledge Discovery and Data Mining (SIGKDD), pp 63–72
Guo D, Liu S, Jin H (2010) A graph-based approach to vehicle trajectory analysis. J Locat Based Serv 4(3-4):183–199
Hwang S, Park J, Kim N, Choi Y, So Kweon I (2015) Multispectral pedestrian detection: Benchmark dataset and baseline. In: Computer Vision and Pattern Recognition (CVPR), pp 1037–1045
Jeung H, Shen HT, Zhou X (2008) Convoy queries in spatio-temporal databases. In: International Conference on Data Engineering (ICDE), pp 1457–1459
Jeung H, Yiu ML, Zhou X, Jensen CS, Shen HT (2008) Discovery of convoys in trajectory databases. Proc VLDB Endowment 1(1):1068–1080
Kalnis P, Mamoulis N, Bakiras S (2005) On discovering moving clusters in spatio-temporal data. In: Spatial and Temporal Databases (SSTD), pp 364–381
Lan R, Yu Y, Cao L, Song P, Wang Y (2017) Discovering evolving moving object groups from massive-scale trajectory streams. In: Mobile Data Management (MDM), pp 256–265
Le Bon G (1921) The Crowd: A study of the popular mind. Macmillan New York, New York
Lee JG, Han J, Whang KY (2007) Trajectory clustering: a partition-and-group framework. In: Proceedings of the international conference on Management of data (SIGMOD). ACM, pp 593–604
Lerner A, Chrysanthou Y, Lischinski D (2007) Crowds by example. In: Computer Graphics Forum, vol 26, pp 655–664
Moussaïd M, Perozo N, Garnier S, Helbing D, Theraulaz G (2010) The walking behaviour of pedestrian social groups and its impact on crowd dynamics. PloS one 5(4):e10047
Nanopoulos A, Theodoridis Y, Manolopoulos Y (2001) C2p: clustering based on closest pairs. In: VLDB, pp 331–340
Pelekis N, Tampakis P, Vodas M, Doulkeridis C, Theodoridis Y (2017) On temporal-constrained sub-trajectory cluster analysis. Data Min Knowl Disc 31:1294–1330
Rupasinghe R, Senanayake S, Padmasiri D, Ekanayake M, Godaliyadda G, Wijayakulasooriya J (2016) Modes of clustering for motion pattern analysis in video surveillance. In: Information and Automation for Sustainability (ICIAfs), pp 1–6
Sakr MA, Güting RH (2014) Group spatiotemporal pattern queries. GeoInformatica 18(4):699–746
Sawas A, Abuolaim A, Afifi M, Papagelis M (2018) Tensor methods for group pattern discovery of pedestrian trajectories. In: 2018 19Th IEEE International Conference on Mobile Data Management (MDM), pp 76–85. IEEE
Sawas A, Abuolaim A, Afifi M, Papagelis M (2018) Trajectolizer: Interactive analysis and exploration of trajectory group dynamics. In: Mobile Data Management (MDM), pp 286–287
Shu G, Dehghan A, Oreifej O, Hand E, Shah M (2012) Part-based multiple-person tracking with partial occlusion handling. In: Computer Vision and Pattern Recognition (CVPR), pp 1815–1821
Siła-Nowicka K, Vandrol J, Oshan T, Long JA, Demšar U, Fotheringham AS (2016) Analysis of human mobility patterns from gps trajectories and contextual information. Int J Geogr Inf Sci 30(5):881–906
Solera F, Calderara S, Cucchiara R (2016) Socially constrained structural learning for groups detection in crowd. IEEE Trans Pattern Anal Mach Intell 38 (5):995–1008
Vilain M, Burger J, Aberdeen J, Connolly D, Hirschman L (1995) A model-theoretic coreference scoring scheme. In: Proceedings of the 6th Conference on Message Understanding. Association for Computational Linguistics, pp 45–52
Volkhardt M, Schneemann F, Gross HM (2013) Fallen person detection for mobile robots using 3d depth data. In: International Conference on Systems, Man, and Cybernetics (SMC), pp 3573–3578
Wakuda Y, Asano S, Koshizuka N, Sakamura K (2012) An adaptive map-matching based on dynamic time warping for pedestrian positioning using network map. In: Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium, pp 590–597
Wu S, Wong HS, Yu Z (2014) A bayesian model for crowd escape behavior detection. IEEE Trans Circ Syst Video Technol 24(1):85–98
Yi S, Li H, Wang X (2015) Understanding pedestrian behaviors from stationary crowd groups. In: Computer Vision and Pattern Recognition (CVPR), pp 3488–3496
Yuan G, Sun P, Zhao J, Li D, Wang C (2017) A review of moving object trajectory clustering algorithms. Artif Intell Rev 47(1):123–144
Zanlungo F, Ikeda T, Kanda T (2014) Potential for the dynamics of pedestrians in a socially interacting group. Phys Rev E 89(1):012811
Zanlungo F, Kanda T (2013) Do walking pedestrians stabily interact inside a large group? analysis of group and sub-group spatial structure. In: Cogsci
Zhang T, Soh SH, Fu X, Lee KK, Wong L, Ma S, Xiao G, Kwoh CK (2009) Hpcgen a fast generator of contact networks of large urban cities for epidemiological studies. In: Computational Intelligence, Modelling and Simulation (CSSim), pp 198–203
Zheng K, Zheng Y, Yuan NJ, Shang S (2013) On discovery of gathering patterns from trajectories. In: International Conference on Data Engineering (ICDE), pp 242–253
Acknowledgements
This research has been partially supported by a Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery Grant (#RGPIN-2017-05680).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Reproducibility
The source code, data, sample rendered videos and an online interactive demonstration are publicly available to encourage reproducibility of results. They can be accessed onlineFootnote 4.
Rights and permissions
About this article
Cite this article
Sawas, A., Abuolaim, A., Afifi, M. et al. A versatile computational framework for group pattern mining of pedestrian trajectories. Geoinformatica 23, 501–531 (2019). https://doi.org/10.1007/s10707-019-00353-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10707-019-00353-2