[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3664647.3681277acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Hydrodynamics-Informed Neural Network for Simulating Dense Crowd Motion Patterns

Published: 28 October 2024 Publication History

Abstract

With global occurrences of crowd crushes and stampedes, dense crowd simulation has been drawing great attention. In this research, our goal is to simulate dense crowd motions under six classic motion patterns, more specifically, to generate subsequent motions of dense crowds from the given initial states. Since dense crowds share similarities with fluids, such as continuity and fluidity, one common approach for dense crowd simulation is to construct hydrodynamics-based models, which consider dense crowds as fluids, guide crowd motions with Navier-Stokes equations, and conduct dense crowd simulation by solving governing equations. Despite the proposal of these models, dense crowd simulation faces multiple challenges, including the difficulty of directly solving Navier-Stokes equations due to their nonlinear nature, the ignorance of distinctive crowd characteristics which fluids lack, and the gaps in the evaluation and validation of crowd simulation models. To address the above challenges, we build a hydrodynamic model, which captures the crowd physical properties (continuity, fluidity, etc.) with Navier-Stokes equations and reflects the crowd social properties (sociality, personality, etc.) with operators that describe crowd interactions and crowd-environment interactions. To tackle the computational problem, we propose to solve the governing equation based on Navier-Stokes equations using neural networks, and introduce the Hydrodynamics-Informed Neural Network (HINN) which preserves the structure of the governing equation in its network architecture. To facilitate the evaluation, we construct a new dense crowd motion video dataset called Dense Crowd Flow Dataset (DCFD), containing six classic motion patterns (line, curve, circle, cross, cluster and scatter) and 457 video clips, which can serve as the groundtruths for various objective metrics. Numerous experiments are conducted using HINN to simulate dense crowd motions under six motion patterns with video clips from DCFD. Objective evaluation metrics that concerns authenticity, fidelity and diversity demonstrate the superior performance of our model in dense crowd simulation compared to other simulation models. Our code and dataset are available at https://github.com/shanshan-zys/HINN.

References

[1]
Saad Ali and Mubarak Shah. 2007. A lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In 2007 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1--6.
[2]
Saad Ali and Mubarak Shah. 2008. Floor fields for tracking in high density crowd scenes. In Computer Vision--ECCV 2008: 10th European Conference on Computer Vision, Marseille, France, October 12--18, 2008, Proceedings, Part II 10. Springer, 1--14.
[3]
Jo ao E Almeida, Rosaldo JF Rosseti, and António Lecca Coelho. 2013. Crowd simulation modeling applied to emergency and evacuation simulations using multi-agent systems. arXiv preprint arXiv:1303.4692 (2013).
[4]
GE Bradley. 1993. A proposed mathematical model for computer prediction of crowd movements and their associated risks. In Proceedings of the International Conference on Engineering for Crowd Safety. Elsevier Publishing Company London, 303--311.
[5]
Adriana Braun, Soraia Raupp Musse, Luiz Paulo Luna de Oliveira, and Bardo EJ Bodmann. 2003. Modeling individual behaviors in crowd simulation. In Proceedings 11th IEEE international workshop on program comprehension. IEEE, 143--148.
[6]
John Canny. 1986. A computational approach to edge detection. IEEE Transactions on pattern analysis and machine intelligence, Vol. 8, 6 (1986), 679--698.
[7]
Kenta Cho, Naoki Iketani, Masaaki Kikuchi, Keisuke Nishimura, Hisashi Hayashi, and Masanori Hattori. 2008. Bdi model-based crowd simulation. In Intelligent Virtual Agents: 8th International Conference, IVA 2008, Tokyo, Japan, September 1--3, 2008. Proceedings 8. Springer, 364--371.
[8]
Funda Durupinar, Uugur Güdükbay, Aytek Aman, and Norman I Badler. 2015. Psychological parameters for crowd simulation: From audiences to mobs. IEEE transactions on visualization and computer graphics, Vol. 22, 9 (2015), 2145--2159.
[9]
Funda Durupinar, Nuria Pelechano, Jan Allbeck, U?ur Güdükbay, and Norman I Badler. 2009. How the ocean personality model affects the perception of crowds. IEEE Computer Graphics and Applications, Vol. 31, 3 (2009), 22--31.
[10]
Tian Feng, Lap-Fai Yu, Sai-Kit Yeung, KangKang Yin, and Kun Zhou. 2016. Crowd-driven mid-scale layout design. ACM Trans. Graph., Vol. 35, 4 (2016), 132--1.
[11]
Matthew Flagg and James M Rehg. 2012. Video-based crowd synthesis. IEEE transactions on visualization and computer graphics, Vol. 19, 11 (2012), 1935--1947.
[12]
Robert A Gingold and Joseph J Monaghan. 1977. Smoothed particle hydrodynamics: theory and application to non-spherical stars. Monthly notices of the royal astronomical society, Vol. 181, 3 (1977), 375--389.
[13]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[14]
Dirk Helbing, Illés Farkas, and Tamas Vicsek. 2000. Simulating dynamical features of escape panic. Nature, Vol. 407, 6803 (2000), 487--490.
[15]
Dirk Helbing and Peter Molnar. 1995. Social force model for pedestrian dynamics. Physical review E, Vol. 51, 5 (1995), 4282.
[16]
LF Henderson. 1971. The statistics of crowd fluids. nature, Vol. 229, 5284 (1971), 381--383.
[17]
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc.
[18]
Kurt Hornik, Maxwell Stinchcombe, and Halbert White. 1989. Multilayer feedforward networks are universal approximators. Neural networks, Vol. 2, 5 (1989), 359--366.
[19]
Peter J Huber. 1992. Robust estimation of a location parameter. In Breakthroughs in statistics: Methodology and distribution. Springer, 492--518.
[20]
Roger L Hughes. 2003. The flow of human crowds. Annual review of fluid mechanics, Vol. 35, 1 (2003), 169--182.
[21]
Xiaowei Jin, Shengze Cai, Hui Li, and George Em Karniadakis. 2021. NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations. J. Comput. Phys., Vol. 426 (2021), 109951.
[22]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings.
[23]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2017. ImageNet classification with deep convolutional neural networks. Commun. ACM, Vol. 60, 6 (2017), 84--90.
[24]
Solomon Kullback and Richard A Leibler. 1951. On information and sufficiency. The annals of mathematical statistics, Vol. 22, 1 (1951), 79--86.
[25]
Alon Lerner, Yiorgos Chrysanthou, and Dani Lischinski. 2007. Crowds by example. In Computer graphics forum, Vol. 26. Wiley Online Library, 655--664.
[26]
Zongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede liu, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar. 2021. Fourier Neural Operator for Parametric Partial Differential Equations. In International Conference on Learning Representations. 1--16.
[27]
Xin-Yang Liu, Min Zhu, Lu Lu, Hao Sun, and Jian-Xun Wang. 2024. Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics. Communications Physics, Vol. 7, 1 (2024), 31.
[28]
Zichao Long, Yiping Lu, Xianzhong Ma, and Bin Dong. 2018. Pde-net: Learning pdes from data. In International conference on machine learning. PMLR, 3208--3216.
[29]
Lu Lu, Pengzhan Jin, Guofei Pang, Zhongqiang Zhang, and George Em Karniadakis. 2021. Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators. Nature machine intelligence, Vol. 3, 3 (2021), 218--229.
[30]
CD Tharindu Mathew, Paulo R Knob, Soraia Raupp Musse, and Daniel G Aliaga. 2019. Urban walkability design using virtual population simulation. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 455--469.
[31]
Xuhui Meng, Zhen Li, Dongkun Zhang, and George Em Karniadakis. 2020. PPINN: Parareal physics-informed neural network for time-dependent PDEs. Computer Methods in Applied Mechanics and Engineering, Vol. 370 (2020), 113250.
[32]
Mehdi Moussa"id, Mubbasir Kapadia, Tyler Thrash, Robert W Sumner, Markus Gross, Dirk Helbing, and Christoph Hölscher. 2016. Crowd behaviour during high-stress evacuations in an immersive virtual environment. Journal of The Royal Society Interface, Vol. 13, 122 (2016), 20160414.
[33]
Soraia Raupp Musse and Daniel Thalmann. 1997. A model of human crowd behavior: Group inter-relationship and collision detection analysis. In Computer Animation and Simulation'97: Proceedings of the Eurographics Workshop in Budapest, Hungary, September 2--3, 1997. Springer, 39--51.
[34]
Ouguzcan Ouguz, Atecs Akaydin, Türker Yilmaz, and Uugur Güdükbay. 2010. Emergency crowd simulation for outdoor environments. Computers & Graphics, Vol. 34, 2 (2010), 136--144.
[35]
Jan Ondvrej, Julien Pettré, Anne-Hélène Olivier, and Stéphane Donikian. 2010. A synthetic-vision based steering approach for crowd simulation. ACM Transactions on Graphics (TOG), Vol. 29, 4 (2010), 1--9.
[36]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems, Vol. 32. Curran Associates, Inc., 8024--8035.
[37]
Núria Pelechano Gómez, Kevin O'Brien, Barry G Silverman, and Norman Badler. 2005. Crowd simulation incorporating agent psychological models, roles and communication. In First International Workshop on Crowd Simulation.
[38]
Stefano Pellegrini, Andreas Ess, Konrad Schindler, and Luc Van Gool. 2009. You'll never walk alone: Modeling social behavior for multi-target tracking. In 2009 IEEE 12th international conference on computer vision. IEEE, 261--268.
[39]
Julien Pettré, Pablo de Heras Ciechomski, Jonathan Ma"im, Barbara Yersin, Jean-Paul Laumond, and Daniel Thalmann. 2006. Real-time navigating crowds: scalable simulation and rendering. Computer Animation and Virtual Worlds, Vol. 17, 3--4 (2006), 445--455.
[40]
Maziar Raissi, Paris Perdikaris, and George E Karniadakis. 2019. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, Vol. 378 (2019), 686--707.
[41]
Craig W Reynolds. 1987. Flocks, herds and schools: A distributed behavioral model. In Proceedings of the 14th annual conference on Computer graphics and interactive techniques. 25--34.
[42]
Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, Xi Chen, and Xi Chen. 2016. Improved techniques for training gans. In Advances in Neural Information Processing Systems, Vol. 29. Curran Associates, Inc., 2234--2242.
[43]
M Safdari Shadloo, G Oger, and David Le Touzé. 2016. Smoothed particle hydrodynamics method for fluid flows, towards industrial applications: Motivations, current state, and challenges. Computers & Fluids, Vol. 136 (2016), 11--34.
[44]
Jing Shao, Chen Change Loy, and Xiaogang Wang. 2014. Scene-independent group profiling in crowd. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2219--2226.
[45]
Ameya Shendarkar, Karthik Vasudevan, Seungho Lee, and Young-Jun Son. 2008. Crowd simulation for emergency response using BDI agents based on immersive virtual reality. Simulation Modelling Practice and Theory, Vol. 16, 9 (2008), 1415--1429.
[46]
Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings.
[47]
Mankyu Sung, Lucas Kovar, and Michael Gleicher. 2005. Fast and accurate goal-directed motion synthesis for crowds. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation. 291--300.
[48]
Branislav Ulicny and Daniel Thalmann. 2002. Towards interactive real-time crowd behavior simulation. In Computer Graphics Forum, Vol. 21. Wiley Online Library, 767--775.
[49]
Jur Van Den Berg, Stephen J Guy, Ming Lin, and Dinesh Manocha. 2011. Reciprocal n-body collision avoidance. In Robotics Research: The 14th International Symposium ISRR. Springer, 3--19.
[50]
Wouter van Toll, Thomas Chatagnon, Cédric Braga, Barbara Solenthaler, and Julien Pettré. 2021. SPH crowds: Agent-based crowd simulation up to extreme densities using fluid dynamics. Computers & Graphics, Vol. 98 (2021), 306--321.
[51]
Tamás Vicsek, András Czirók, Eshel Ben-Jacob, Inon Cohen, and Ofer Shochet. 1995. Novel type of phase transition in a system of self-driven particles. Physical review letters, Vol. 75, 6 (1995), 1226.
[52]
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, Vol. 13, 4 (2004), 600--612.
[53]
David Wolinski, S J. Guy, A-H Olivier, Ming Lin, Dinesh Manocha, and Julien Pettré. 2014. Parameter estimation and comparative evaluation of crowd simulations. In Computer Graphics Forum, Vol. 33. Wiley Online Library, 303--312.
[54]
Shuai Yi, Hongsheng Li, and Xiaogang Wang. 2015. Understanding pedestrian behaviors from stationary crowd groups. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3488--3496.
[55]
Yufei Yuan, Bernat Go ni-Ros, Ha H Bui, Winnie Daamen, Hai L Vu, and Serge P Hoogendoorn. 2020. Macroscopic pedestrian flow simulation using Smoothed Particle Hydrodynamics (SPH). Transportation research part C: emerging technologies, Vol. 111 (2020), 334--351.
[56]
Bolei Zhou, Xiaoou Tang, and Xiaogang Wang. 2013. Measuring crowd collectiveness. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3049--3056.
[57]
Bolei Zhou, Xiaogang Wang, and Xiaoou Tang. 2012. Understanding collective crowd behaviors: Learning a mixture model of dynamic pedestrian-agents. In 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2871--2878.

Index Terms

  1. Hydrodynamics-Informed Neural Network for Simulating Dense Crowd Motion Patterns

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '24: Proceedings of the 32nd ACM International Conference on Multimedia
    October 2024
    11719 pages
    ISBN:9798400706868
    DOI:10.1145/3664647
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 October 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. crowd simulation
    2. dense crowd motion
    3. hydrodynamic model

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    MM '24
    Sponsor:
    MM '24: The 32nd ACM International Conference on Multimedia
    October 28 - November 1, 2024
    Melbourne VIC, Australia

    Acceptance Rates

    MM '24 Paper Acceptance Rate 1,150 of 4,385 submissions, 26%;
    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 35
      Total Downloads
    • Downloads (Last 12 months)35
    • Downloads (Last 6 weeks)33
    Reflects downloads up to 14 Dec 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media