Particle tracking in open simulation laboratories
Authors: 
Kalin Kanov, Randal BurnsAuthors Info & Claims
Article No.: 43, Pages 1 - 11
Abstract
Particle tracking along streamlines and pathlines is a common scientific analysis technique, which has demanding data, computation and communication requirements. It has been studied in the context of high-performance computing due to the difficulty in its efficient parallelization and its high demands on communication and computational load. In this paper, we study efficient evaluation methods for particle tracking in open simulation laboratories. Simulation laboratories have a fundamentally different architecture from today's supercomputers and provide publicly-available analysis functionality. We focus on the I/O demands of particle tracking for numerical simulation datasets 100s of TBs in size. We compare data-parallel and task-parallel approaches for the advection of particles and show scalability results on data-intensive workloads from a live production environment. We have developed particle tracking capabilities for the Johns Hopkins Turbulence Databases, which store computational fluid dynamics simulation data, including forced isotropic turbulence, magnetohydrodynamics, channel flow turbulence and homogeneous buoyancy-driven turbulence.
References
[1]
H. Aluie, G. Eyink, E. Vishniac, S. Chen, K. Kanov, R. Burns, C. Meneveau, and A. Szalay. Forced MHD turbulence data set (2013). Available at http://turbulence.pha.jhu.edu/docs/README-MHD.pdf.
[2]
P. Baumann, A. Dehmel, P. Furtado, R. Ritsch, and N. Widmann. The Multidimensional Database System RasDaMan. In Proceedings of the 1998 ACM SIGMOD International Conference on Management of Data, SIGMOD '98, pages 575--577, 1998.
[3]
D. Benveniste and T. Drivas. Asymptotic results for backwards two-particle dispersion in a turbulent flow. Physical Review E, 89(4):041003, 2014.
[4]
DataScope. http://idies.jhu.edu/datascope.
[5]
G. Eyink and D. Benveniste. Diffusion approximation in turbulent two-particle dispersion. Physical Review E, 88(4):041001, 2013.
[6]
G. Eyink, E. Vishniac, C. Lalescu, H. Aluie, K. Kanov, K. Bürger, R. Burns, C. Meneveau, and A. Szalay. Flux-freezing breakdown in high-conductivity magnetohydrodynamic turbulence. Nature, 497(7450):466--9, 2013.
[7]
K. Gustavsson, J. Einarsson, and B. Mehlig. Tumbling of small axisymmetric particles in random and turbulent flows. Physical Review Letters, 112(1):014501, 2014.
[8]
G. Haller. Finding finite-time invariant manifolds in two-dimensional velocity fields. Chaos: An Interdisciplinary Journal of Nonlinear Science, 10(1):99--108, 2000.
[9]
Haller, G. Distinguished material surfaces and coherent structures in three-dimensional fluid flows. Physica D, 149(4):248--277, 2001.
[10]
A. J. G. Hey, S. Tansley, and K. M. Tolle. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, 2009.
[11]
M. Holzner, A. Liberzon, N. Nikitin, B. Lüthi, W. Kinzelbach, and A. Tsinober. A lagrangian investigation of the small-scale features of turbulent entrainment through particle tracking and direct numerical simulation. Journal of Fluid Mechanics, 598:465--475, 3 2008.
[12]
J. Jucha, H. Xu, A. Pumir, and E. Bodenschatz. Time-reversal-symmetry breaking in turbulence. Physical Review Letters, 113(5):054501, 2014.
[13]
K. Kanov, E. Perlman, R. Burns, Y. Ahmad, and A. Szalay. I/O Streaming Evaluation of Batch Queries for Data-intensive Computational Turbulence. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC '11, pages 29:1--29:10, 2011.
[14]
W. Kendall, J. Wang, M. Allen, T. Peterka, J. Huang, and D. Erickson. Simplified parallel domain traversal. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC '11, pages 10:1--10:11, 2011.
[15]
N. Li and A. R. Thakar. CasJobs and MyDB: A Batch Query Workbench. Computing in Science and Engineering, 10(1):18--29, 2008.
[16]
Y. Li, E. Perlman, M. Wan, Y. Yang, C. Meneveau, R. Burns, S. Chen, A. Szalay, and G. Eyink. A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence. Journal of Turbulence, 9:N31, 2008.
[17]
D. Livescu, C. Canada, K. Kanov, Burns, R. & IDIES staff, and J. Pulido. Homogeneous Buoyancy driven turbulence data set (2014). Available at http://turbulence.pha.jhu.edu/docs/README-HBDT.pdf.
[18]
MonetDB. http://monetdb.cwi.nl/.
[19]
B. Nouanesengsy, T.-Y. Lee, K. Lu, H.-W. Shen, and T. Peterka. Parallel particle advection and FTLE computation for time-varying flow fields. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC '12, pages 61:1--61:11, 2012.
[20]
E. Perlman, R. Burns, Y. Li, and C. Meneveau. Data Exploration of Turbulence Simulations Using a Database Cluster. In Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC '07, pages 23:1--23:11, 2007.
[21]
T. Peterka, R. Ross, B. Nouanesengsy, T.-Y. Lee, H.-W. Shen, W. Kendall, and J. Huang. A study of parallel particle tracing for steady-state and time-varying flow fields. In Proceedings of the 2011 IEEE International Parallel & Distributed Processing Symposium, IPDPS '11, pages 580--591, 2011.
[22]
S. B. Pope. Lagrangian pdf methods for turbulent flows. Annual Review of Fluid Mechanics, 26(1):23--63, 1994.
[23]
D. Pugmire, H. Childs, C. Garth, S. Ahern, and G. H. Weber. Scalable computation of streamlines on very large datasets. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC '09, pages 16:1--16:12, 2009.
[24]
M. Raiola, S. Discetti, and A. Ianiro. On piv random error minimization with optimal pod-based low-order reconstruction. Experiments in Fluids, 56(4), 2015.
[25]
The Sloan Digital Sky Survey. http://www.sdss.org/.
[26]
M. Stonebraker, J. Becla, D. J. DeWitt, K. Lim, D. Maier, O. Ratzesberger, and S. B. Zdonik. Requirements for Science Data Bases and SciDB. In Proceedings of the Fourth Biennial Conference on Innovative Data Systems Research, CIDR '09, 2009.
[27]
A. S. Szalay, G. Bell, J. Vandenberg, A. Wonders, R. Burns, D. Fay, J. Heasley, T. Hey, M. Nieto-Santisteban, A. Thakar, C. van Ingen, and R. Wilton. GrayWulf: Scalable Clustered Architecture for Data Intensive Computing. In Proceedings of the 42nd Hawaii International Conference on System Sciences, HICSS '09, pages 1--10, 2009.
[28]
S.-K. Ueng, C. Sikorski, and K.-L. Ma. Out-of-core streamline visualization on large unstructured meshes. IEEE Transactions on Visualization and Computer Graphics, 3(4):370--380, 1997.
[29]
H. Yu, K. Kanov, E. Perlman, J. Graham, E. Frederix, R. Burns, A. Szalay, G. Eyink, and C. Meneveau. Studying lagrangian dynamics of turbulence using on-demand fluid particle tracking in a public turbulence database. Journal of Turbulence, 13:N12, 2012.
[30]
H. Yu, C. Wang, and K.-L. Ma. Parallel hierarchical visualization of large time-varying 3d vector fields. In Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC '07, pages 24:1--24:12, 2007.
[31]
Y. Zhang, M. Kersten, M. Ivanova, and N. Nes. SciQL: Bridging the Gap Between Science and Relational DBMS. In Proceedings of the 15th Symposium on International Database Engineering & Applications, IDEAS '11, pages 124--133, 2011.
Index Terms
- Particle tracking in open simulation laboratories
Recommendations
Numerical Simulation of Combustion in a Wall Jet Combustor with a Fast Particle Tracking Algorithm
ICCIS '11: Proceedings of the 2011 International Conference on Computational and Information SciencesA fast particle tracking algorithm based on unstructured grids is proposed. The cost of CPU time with this algorithm is compared with a recently developed one for a spray on a fixed chamber with different particle numbers. It shows a clear advantage of ...
Particle tracking and particle---shock interaction in compressible-flow computations with the V-SGS stabilization and $$YZ\beta $$YZβ shock-capturing
The $$YZ\beta $$YZβ shock-capturing technique, which is residual-based, was introduced in conjunction with the Streamline-Upwind/Petrov---Galerkin (SUPG) formulation of compressible flows in conservation variables. It was later also combined with the ...
Lattice Boltzmann simulation of turbulent flow laden with finite-size particles
The paper describes a particle-resolved simulation method for turbulent flow laden with finite size particles. The method is based on the multiple-relaxation-time lattice Boltzmann equation. The no-slip boundary condition on the moving particle ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2015
985 pages
Copyright © 2015 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 November 2015
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
SC15: The International Conference for High Performance Computing, Networking, Storage and Analysis
November 15 - 20, 2015
Texas, Austin
Acceptance Rates
SC '15 Paper Acceptance Rate 79 of 358 submissions, 22%;
Overall Acceptance Rate 1,516 of 6,373 submissions, 24%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 332Total Downloads
- Downloads (Last 12 months)58
- Downloads (Last 6 weeks)5
Reflects downloads up to 10 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in