Cited By
View all- Zhao NChong HLi Q(2022)Agent-based modelling of helping behaviour diffusion in project teams as an evolutionary processJournal of Simulation10.1080/17477778.2021.199734217:3(279-296)Online publication date: 14-Feb-2022
Statistical Analysis of Simulation Output from Parallel Computing
Authors: 
Chen Zhang, Nan ChenAuthors Info & Claims
Article No.: 21, Pages 1 - 22
Abstract
This article addresses statistical output analysis of transient simulations in the parallel computing environment with fixed computing time. Using parallel computing, most commonly used unbiased estimators based on the output sequence compromise. To rectify this issue, this article proposes an estimation procedure in the Bayesian framework. The proposed procedure is particularly useful when the computing time depends on the output value in each simulation replication. The effectiveness of our method is demonstrated through studies on queuing simulation and control chart simulation.
References
[1]
Nilay Tanik Argon, Sigrún Andradóttir, Christos Alexopoulos, and David Goldsman. 2013. Steady-state simulation with replication-dependent initial transients: Analysis and examples. INFORMS J. Comput. 25, 1 (2013), 177--191.
[2]
Mogens Bladt, Antonio Gonzalez, and Steffen L. Lauritzen. 2003. The estimation of phase-type related functionals using markov chain monte carlo methods. Scand. Actuar. J. 2003, 4 (2003), 280--300.
[3]
D. Brook and D. A. Evans. 1972. An approach to the probability distribution of CUSUM run length. Biometrika 59, 3 (1972), 539--549.
[4]
W. Bux and U. Herzog. 1977. The phase concept: Approximation of measured data and performance analysis. In Computer Performance, K. M. Chandy and M. Reiser (Eds.). North-Holland, Amsterdam, 23--38.
[5]
Michael A. Crane and Donald L. Iglehart. 1975. Simulating stable stochastic systems: III. Regenerative processes and discrete-event simulations. Operat. Res. 23, 1 (1975), 33--45.
[6]
Luz J. R. Esparza, Bo F. Nielsen, and M. Bladt. 2011. Maximum likelihood estimation of phase-type distributions. Kgs. Lyngby, Denmark: Technical University of Denmark (DTU). (IMM-PHD-2010-245).
[7]
Peter W. Glynn and Philip Heidelberger. 1990. Bias properties of budget constrained simulations. Operat. Res. 38, 5 (1990), 801--814.
[8]
Peter W. Glynn and Philip Heidelberger. 1991. Analysis of parallel replicated simulations under a completion time constraint. ACM Trans. Model. Comput. Simul. 1, 1 (1991), 3--23.
[9]
Philip Heidelberger. 1988. Discrete event simulations and parallel processing: Statistical properties. SIAM J. Sci. Statist. Comput. 9, 6 (1988), 1114--1132.
[10]
Shane G. Henderson and Peter W. Glynn. 1999. Can the regenerative method be applied to discrete-event simulation?. In Proceedings of the 31st Conference on Winter Simulation: Simulation—A Bridge to the Future, Volume 1. ACM, 367--373.
[11]
Shane G. Henderson and Peter W. Glynn. 2001. Regenerative steady-state simulation of discrete-event systems. ACM Trans. Model. Comput. Simul. 11, 4 (2001), 313--345.
[12]
A. M. Law, W. D. Kelton, and W. D. Kelton. 1991. Simulation Modeling and Analysis (Vol. 2). New York: McGraw-Hill.
[13]
Averill M. Law. 2007. Statistical analysis of simulation output data: The practical state of the art. In Proceedings of the 2007 Winter Simulation Conference. IEEE, 77--83.
[14]
A. J. Lawrence. 1973. Dependency of intervals between events in superposition processes. Journal of the Royal Statistical Society. Series B (Methodological) (1973), 306--315.
[15]
Jun Luo, L. Jeff Hong, Barry L. Nelson, and Yang Wu. 2015. Fully sequential procedures for large-scale ranking-and-selection problems in parallel computing environments. Operat. Res. 63, 5 (2015), 1177--1194.
[16]
Kerrie L. Mengersen, Richard L. Tweedie, and others. 1996. Rates of convergence of the hastings and metropolis algorithms. Ann. Stat. 24, 1 (1996), 101--121.
[17]
Eric C. Ni, Dragos F. Ciocan, Shane G. Henderson, and Susan R. Hunter. 2017. Efficient ranking and selection in parallel computing environments. Operations Research 65, 3 (2017), 821--836.
[18]
Eric C. Ni, Susan R Hunter, and Shane G. Henderson. 2013. Ranking and selection in a high performance computing environment. In Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World. IEEE Press, 833--845.
[19]
Colm Art O’cinneide. 1999. Phase-type distributions: Open problems and a few properties. Stoch. Models 15, 4 (1999), 731--757.
[20]
Ross L. Prentice, John D. Kalbfleisch, Arthur V. Peterson Jr., Nancy Flournoy, V. T. Farewell, and N. E. Breslow. 1978. The analysis of failure times in the presence of competing risks. Biometrics 34, 4 (1978), 541--554.
[21]
P. B. Robinson and T. Yr Ho. 1978. Average run lengths of geometric moving average charts by numerical methods. Technometrics 20, 1 (1978), 85--93.
[22]
C. Zhang, N. Chen, and C. Zou. 2016. Robust multivariate control chart based on goodness-of-fit test. Journal of Quality Technology, 48, 2, (2016), 139.
Index Terms
- Statistical Analysis of Simulation Output from Parallel Computing
Recommendations
Analyzing Markov chain Monte Carlo output
AbstractMarkov chain Monte Carlo (MCMC) is a sampling‐based method for estimating features of probability distributions. MCMC methods produce a serially correlated, yet representative, sample from the desired distribution. As such it can be difficult to ...
Visual representation of the multivariate correlation structure in a Markov chain. Output analysis that accounts for this multivariate structure is able to more accurately summarize variability in the simulation process. We review the output analysis ...
Multivariate Input Uncertainty in Output Analysis for Stochastic Simulation
When we use simulations to estimate the performance of stochastic systems, the simulation is often driven by input models estimated from finite real-world data. A complete statistical characterization of system performance estimates requires quantifying ...
Towards Automated Performance Prediction in Bulk-Synchronous Parallel Discrete-Event Simulation
SCCC '99: Proceedings of the 19th International Conference of the Chilean Computer Science SocietyThis paper discusses the running time cost of performing discrete-event simulation on the bulk-synchronous parallel (BSP) model of computing. The BSP model provides a general purpose framework for parallel computing which is independent of the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2018
151 pages
ISSN:1049-3301
EISSN:1558-1195
DOI:10.1145/3236631
- Editor:
- Adelinde M. Uhrmacher
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 August 2018
Accepted: 01 February 2018
Revised: 01 December 2017
Received: 01 February 2017
Published in TOMACS Volume 28, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Funding Sources
- Future Resilience System
- Singapore AcRF funding
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 138Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)1
Reflects downloads up to 26 Dec 2024
Other Metrics
Citations
Cited By
View all- Zhao NChong HLi Q(2022)Agent-based modelling of helping behaviour diffusion in project teams as an evolutionary processJournal of Simulation10.1080/17477778.2021.199734217:3(279-296)Online publication date: 14-Feb-2022
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in