History of improving statistical efficiency
Article No.: 11, Pages 1 - 23
Abstract
Statistical efficiency has been a focus of research since the inception of discrete-event simulation modeling and analysis, with origins perhaps twenty years before the first Winter Simulation Conference. We review important work in the design of simulation experiments, variance reduction through dependence structures, and efficient rare-event simulation. The focus is on the early developments, although some recent innovations also receive mention.
References
[1]
"A History of Early Computing at Princeton - Alan Turing Centennial." 2017. Accessed April 25. https://www.princeton.edu/turing/alan/history-of-computing-at-p/.
[2]
Alberts, W. E. 1957. "Report to the Eighth A.I.I.E. National Convention on the System Simulation Symposium, New York, May 16--17, 1957." Operations Research 5: 851--58.
[3]
Ankenman, B. E., R. C. H. Cheng, and S. M. Lewis. 2015. "Screening for Dispersion Effects by Sequential Bifurcation." ACM Transactions on Modeling and Computer Simulation 25:2:1--2:27.
[4]
Ankenman, B. E., B. L. Nelson, and J. Staum. 2010. "Stochastic Kriging for Simulation Metamodeling." Operations Research 58:371--82.
[5]
Asmussen, S. 1985. "Conjugate Processes and the Simulation of Ruin Problems." Stochastic Processes and their Applications 20:213--229.
[6]
Asmussen, S., K. Binswanger, and B. Hojgaard. 2000. "Rare Events Simulation for Heavy-tailed Distributions." Bernoulli 6:303--322.
[7]
Au, S.-K., and J. L. Beck. 2001. "Estimation of Small Failure Probabilities by Subset Simulation". Probabilistic Engineering Mechanics 16:263--277.
[8]
Avramidis, A. N., and J. R. Wilson. 1993. "Integrated Variance Reduction Strategies." In Proceedings of the 1993 Winter Simulation Conference, edited by G. W. Evans, M. Mollaghasemi, E. C. Russell, and W. E. Biles, 445--454. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[9]
Avramidis, A. N., and J. R. Wilson. 1993. "A Splitting Scheme for Control Variates." Operations Research Letters 14:187--198.
[10]
Avramidis, A. N., and J. R. Wilson. 1998. "Correlation-Induction Techniques for Estimating Quantiles in Simulation Experiments." Operations Research 46:574--59.
[11]
Barton, R. R. 1992. "Metamodels for Simulation Input-Output Relations." In Proceedings of the 1992 Winter Simulation Conference, edited by J. J. Swain, D. Goldsman, R. C. Crain, and J. R. Wilson, 289--299. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[12]
Barton, R. R. 1994. "Metamodeling: A State of the Art Review." In Proceedings of the 1994 Winter Simulation Conference, edited by J. D. Tew, S. Manivannan, D. A. Sadowski, and A. F. Seila, 237--244. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[13]
Barton, R. R., B. L. Nelson, and W. Xie. 2013. "Quantifying Input Uncertainty via Simulation Confidence Intervals." INFORMS Journal on Computing 26:74--87.
[14]
Bechhofer, R. 1955. "A Three Decision Problem Concerning the Mean of a Normal Population." Presentation at the December 30, 1955 American Statistical Society Meeting, New York, NY.
[15]
Bettonvil, B., and J. P. C. Kleijnen. 1997. "Searching for Important Factors in Simulation Models with Many Factors: Sequential Bifurcation." European Journal of Operational Research 96:180--94.
[16]
Biles, W. E. 1979. "Experimental Design in Computer Simulation." In Proceedings of the 1979 Winter Simulation Conference, edited by H. J. Highland, M. G. Spiegel, and R. Shannon, 3--9. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[17]
Blanchet, J., and H. Lam. 2012. "State-Dependent Importance Sampling for Rare-Event Simulation: An Overview and Recent Advances." Surveys in Operations Research and Management Science 17:38--59.
[18]
Booth, T. 2009. "Particle Transport Applications." Chapter 10, in Rare Event Simulation using Monte Carlo Methods, edited by G. Rubino and B. Tuffin, 215--242. Chichester, UK: Wiley.
[19]
Box, G. E. P., and K. B. Wilson. 1951. "On the Experimental Attainment of Optimum Conditions." Journal of the Royal Statistical Society. Series B (Methodological) 13:1--45.
[20]
Box, G. E. P. 1992. "George's Column." Quality Engineering, 5:321--330.
[21]
Bucklew, J. A. 2004. Introduction to Rare Event Simulation. Berlin: Springer.
[22]
Burdick, D. S., and T. H. Naylor. 1966. "Design of Computer Simulation Experiments for Industrial Systems." Communications of the ACM 9:329--339.
[23]
Burt J. M. Jr., D. P. Gaver, M. Perlas. 1970. "Simple Stochastic Networks: Some Problems and Procedures." Naval Research Logistics 17:439--445.
[24]
Carson, J. S., and A. M. Law. 1977. "Conservation Equations and Variance Reduction in Queueing Simulations." In Proceedings of the 1977 Winter Simulation Conference, edited by H. J. Highland, R. G. Sargent, and J. W. Schmidt, 186--189. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[25]
Chen, X., B. E. Ankenman, and B. L. Nelson. 2012. "The Effects of Common Random Numbers on Stochastic Kriging Metamodels." ACM Transactions on Modeling and Computer Simulation 22:7:17:20.
[26]
Cheng, R. C. H. 1976. "A Note on the Effect of Initial Conditions on a Simulation Run." Operational Research Quarterly 27:467--470.
[27]
Cheng, R. C. H. 1997. "Searching For Important Factors: Sequential Bifurcation Under Uncertainty." In Proceedings of the 1997 Winter Simulation Conference, edited by S. Andradottir, K. J. Healy, D. H. Withers, and B. L. Nelson, 275--280. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[28]
Cheng, R. C. H. 1985. "Generation of Multivariate Normal Samples with Given Sample Mean and Covariance Matrix." Journal of Statistical Computation and Simulation 21:39--49.
[29]
Cheng, R. C. H. 1986. "Variance Reduction Methods." In Proceedings of the 1986 Winter Simulation Conference, edited by J. R. Wilson, J. O. Henriksen, and S. D. Roberts, 60--68. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[30]
Cheng, R. C. H., J. P. C. Kleijnen, and V. B. Melas. 2000. "Optimal Design of Experiments with Simulation Models of Nearly Saturated Queues." Journal of Statistical Planning and Inference 85:19--26.
[31]
Cheng, R. C. H., and J. P. C. Kleijnen. 1999. "Improved Design of Queueing Simulation Experiments with Highly Heteroscedastic Responses." Operations Research 47:762--777.
[32]
Cochran, W. G. 1977. Sampling Techniques (3rd Ed). New York: John Wiley & Sons.
[33]
"Computer Simulation Archive Home | Computer Simulation Archive." 2017. https://d.lib.ncsu.edu/computer-simulation/.
[34]
Conway, A. E., and A. Goyal. 1987. "Monte Carlo Simulation of Computer System Availability/Reliability Models." In Digest of Papers: 17th Annual International Symposium on Fault-Tolerant Computing (FTCS-17), edited by F. Cristian and J. Goldberg, 230--235. Washington, D.C.: IEEE Computer Society Press.
[35]
Conway, R. W. 1963. "Some Tactical Problems in Digital Simulation." Management Science 10: 47--61.
[36]
Conway, R. W., B. M. Johnson, and W. L. Maxwell. 1959. "Some Problems of Digital Systems Simulation." Management Science 6:92--110.
[37]
Corynen, G. C. 1975. "Experimental Inquiries: A Mathematical Approach." In Proceedings of the 1975 Winter Simulation Conference, 121--143. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[38]
Cottrell, M., J.-C. Fort, and G. Malgouyres. 1983. "Large Deviations and Rare Events in the Study of Stochastic Algorithms." IEEE Transactions on Automatic Control 28:907--920.
[39]
Crane, M. A., and D. L. Iglehart. 1974. "Simulating Stable Stochastic Systems, II: Markov Chains." Journal of the ACM 21:114--123.
[40]
Crane, M. A., and A. J. Lemoine. 1976. "A Tutorial on the Regenerative Approach and Discrete-Event Simulations." In Proceedings of the 1976 Winter Simulation Conference, edited by R. G. Sargent, H. J. Highland, and T. J. Schriber, 41--47. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[41]
Currin, C., T. Mitchell, M. Morris, and D. Ylvisaker. 1991. "Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments." Journal of the American Statistical Association 86:953--963.
[42]
Dean, T., and P. Dupuis. 2009. "Splitting for Rare Event Simulation: A Large Deviation Approach to Design and Analysis." Stochastic Processes and their Applications 119: 562--587.
[43]
Dion, M., and P. L'Ecuyer. 2010. "American Option Pricing with Randomized Quasi-Monte Carlo Simulations." in the Proceedings of the 2010 Winter Simulation Conference, edited by B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, 2705--2720. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[44]
Dong, H., and M. K. Nakayama. 2014. "Constructing Confidence Intervals for a Quantile Using Batching and Sectioning when Applying Latin Hypercube Sampling." In Proceedings of the 2014 Winter Simulation Conference, edited by A. Tolk, S. Y. Diallo, I. O. Ryzhov, L. Yilmaz, S. Buckley, and J. A. Miller, 640--651. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[45]
Dupuis, P., and H. Wang. 2004. "Importance Sampling, Large Deviations, And Differential Games." Stochastics and Stochastic Reports 76:481--508.
[46]
Dupuis, P., and H. Wang. 2007. "Subsolutions of an Isaacs Equation and Efficient Schemes of Importance Sampling." Mathematics of Operations Research 32:723--757.
[47]
Donohue, J. M., E. C. Houck, and R. H. Myers. 1993. "A Sequential Experimental Design Procedure for the Estimation of First- and Second-Order Simulation Metamodels." ACM Transactions on Modeling and Computer Simulation 3:190--224.
[48]
Dudewicz, E. J. 1976. "Statistics in Simulation: How to Design for Selecting the Best Alternative." In Proceedings of the 1976 Winter Simulation Conference, edited by R. G. Sargent, H. J. Highland, and T. J. Schriber, 67--71. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[49]
Econopapers.repec.org 2017. http://econpapers.repec.org/scripts/search.pf?kw= 764%20 variance%20reduction%20techniques ;iframes=no
[50]
Ehrlichman, S. M. T., and S. G. Henderson. 2008. "Comparing Two Systems: Beyond Common Random Numbers." Proceedings of the 2008 Winter Simulation Conference, edited by S. J. Mason, R. R. Hill, L. Mönch, O. Rose, T. Jefferson, and J. W. Fowler, 245--251. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[51]
Fedorov, V. V. 1969. Theory of Optimal Experiments (in Russian), English translation 1970, New York, NY: Academic Press.
[52]
Fieller, E. C., and H. O. Hartley. 1954. "Sampling with Control Variables." Biometrika 41:494--501.
[53]
Fishman, G. S. 1967. "Problems in the Statistical Analysis of Simulation Experiments: The Comparison of Means and the Length of Sample Records." Communications of the ACM 10:94--99.
[54]
Fishman, G. S. 1968a. "Estimating Reliability in Simulation Experiments." In Proceedings of the Second Conference on Applications of Simulation, edited by A. Ockene and J. Reitman, 6--10. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[55]
Fishman, G. S. 1968b. "The Allocation of Computer Time in Comparing Simulation Experiments." Operations Research 16:280--295.
[56]
Fishman, G. S. 1971. "Estimating Sample Size in Computing Simulation Experiments." Management Science 18:21--38.
[57]
Fishman, G. S. 1973. Concepts and Methods in Discrete Event Digital Simulation. New York: John Wiley & Sons Inc.
[58]
Fishman, G. S. 1978. "Grouping Observations in Digital Simulation." Management Science 24:510--521.
[59]
Fishman, G. S., and B. D. Huang. 1980. "Antithetic Variates Revisited." Tech. Rep. 80--4, Operations Research and Systems Analysis, University of North Carolina, Chapel Hill, NC.
[60]
Fishman, G. S., and P. J. Kiviat. 1965. "Spectral Analysis of Time Series Generated by Simulation Models,." RM-4393-PR. RAND Corporation, Santa Monica, CA.
[61]
Fishman, G. S., and P. J. Kiviat. 1967. "The Analysis of Simulation-Generated Time Series." Management Science 13:525--557.
[62]
Frank, A. L. 1968. "The Use of Experimental Design Techniques in Simulation." In Proceedings of the Second Conference on Applications of Simulation, edited by A. Ockene and J. Reitman, 11--12. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[63]
Gaver, D. P. 1969. "Statistical Methods for Improving Simulation Efficiency." In Proceedings of the Third Conference on the Applications of Simulation, edited by P. J. Kiviat and A. Ockene, 38--46. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[64]
Glasserman, P., P. Heidelberger, and P. Shahabuddin. 2000. "Variance Reduction Techniques for Value-at-Risk with Heavy-Tailed Risk Factors." In Proceedings of the 2000 Winter Simulation Conference, edited by J. A. Joines, R. R. Barton, K. Kang, and P. A. Fishwick, 604--609. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[65]
Glasserman, P., P. Heidelberger, P. Shahabuddin, and T. Zajic. 1998. "A Large Deviations Perspective on the Efficiency of Multilevel Splitting." IEEE Transactions on Automatic Control AC-43:1666--1679.
[66]
Glasserman, P., P. Heidelberger, P. Shahabuddin, and T. Zajic. 1999. "Multilevel Splitting for Estimating Rare Event Probabilities." Operations Research 47:585--600.
[67]
Glasserman, P., and S. Kou. 1995. "Analysis of an Importance Sampling Estimator for Tandem Queues." ACM Transactions on Modeling and Computer Simulation 5:22--42.
[68]
Glasserman, P., and Y. Wang. 1997. "Counterexamples in Importance Sampling for Large Deviations Probabilities." Annals of Applied Probability 7:731--746.
[69]
Glynn, P. W., and D. L. Iglehart. 1989. "Importance Sampling For Stochastic Systems." Management Science 35:1367--1393.
[70]
Glynn, P. W., and W. Whitt. 1989. "Indirect Estimation Via L = λW." Operations Research 37:82--103.
[71]
Glynn, P. W., and W. Whitt. 1992. "The Asymptotic Efficiency of Simulation Estimators." Operations Research 40: 505--520.
[72]
Goertzel, G. 1949a. "A Proposed Particle Attenuation Problem." Technical Report ORNL-423, December 1949. Oak Ridge National Laboratory, Oak Ridge, TN.
[73]
Goertzel, G. 1949b. "Quota Sampling and Importance Functions in Stochastic Solution of Particle Problems." Technical Report ORNL-434, June, 1949. Oak Ridge National Laboratory, Oak Ridge, TN.
[74]
Goertzel, G., and H. Kahn. 1949. "Monte Carlo Methods for Shield Computation." Technical Report ORNL-429, December 1949. Oak Ridge National Laboratory, Oak Ridge, TN.
[75]
Goldsman, D., B. L. Nelson, and B. Schmeiser. 1991. "Methods for Selecting the Best System." In Proceedings of the 1991 Winter Simulation Conference, edited by B. L. Nelson, W. D. Kelton, and G. M. Clark, 177--186. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[76]
Goyal, A., P. Heidelberger, and P. Shahabuddin. 1987. "Measure Specific Dynamic Importance Sampling for Availability Simulations." In Proceedings of the 1987 Winter Simulation Conference, edited by A. Thesen, H. Grant, and W. D. Kelton, 351--357. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[77]
Goyal, A., W. C. Carter, E. De Souza e Silva, S. S. Lavenberg, and K. S. Trivedi. 1986. "The System Availability Estimator." In Digest of Papers: 16th Annual International Symposium on Fault-Tolerant Computing (FTCS-16), 84--89. Washington, D.C.: IEEE Computer Society Press.
[78]
Goyal, A., P. Shahabuddin, P. Heidelberger, V. Nicola, and P. W. Glynn. 1992. "A Unified Framework for Simulating Markovian Models of Highly Dependable Systems." IEEE Transactions on Computers C-41:36--51.
[79]
Gross, A. M. 1973. "A Monte Carlo Swindle for Estimators of Location." Journal of the Royal Statistical Society Series C 22:347--353.
[80]
Hammersley, J. M., and D. C. Handscomb. 1964. Monte Carlo Methods. London: Methuen.
[81]
Hammersley, J. M., and K. W. Morton. 1956. "A New Monte Carlo Technique: Antithetic Variates." Mathematical Proceedings of the Cambridge Philosophical Society 52(3):449--475.
[82]
Harling, J. 1958. "Simulation Techniques in Operational Research." OR 9:9--21.
[83]
Hauser, N., N. N. Barish, and S. Ehrenfeld. 1966. "Design Problems in a Process Control Simulation." Journal of Industrial Engineering 17:79--86.
[84]
Heidelberger, P. 1995. "Fast Simulation of Rare Events in Queueing and Reliability Models." ACM Transactions on Modeling and Computer Simulation 5:43--85.
[85]
Heidelberger, P., and P. D. Welch. 1981. "A Spectral Method for Confidence Interval Generation and Run Length Control in Simulations." Communications of the ACM 24:233--245.
[86]
Hordijk, A., D. L. Iglehart, and R. Schassberger. 1976. "Discrete-Time Methods for Simulating Continuous-Time Markov Chains." Advances in Applied Probability 8:772--788.
[87]
IAS Computer. 1953. "P-377_The_History_And_Development_Of_The_IAS_Computer_Mar53.pdf." http://bitsavers.trailing-edge.com/pdf/rand/
[88]
Jacobson, S. H. 1989. "Oscillation Amplitude Considerations in Frequency Domain Experiments." In Proceedings of the 1989 Winter Simulation Conference, edited by E. A. MacNair, K. J. Musselman, and P. Heidelberger, 406--410. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[89]
Jacobson, S. H., A. H. Buss, and L. W. Schruben. 1991. "Driving Frequency Selection for Frequency Domain Simulation Experiments." Operations Research 39:917--924.
[90]
Jacoby, J. E., and S. Harrison. 1962. "Multi-Variable Experimentation and Simulation Models." Naval Research Logistics Quarterly 9:121--136.
[91]
Jenkins, G. M. 1954. "Tests of Hypotheses in the Linear Autoregressive Model: 1. Null Hypothesis Distributions in the Yule Scheme." Biometrika 41:405--419.
[92]
Juneja, S., and P. Shahabuddin. 2002. "Simulating Heavy Tailed Processes Using Delayed Hazard Rate Twisting. ACM Transactions on Modeling and Computer Simulation 12(2):94--118.
[93]
Juneja, S., and P. Shahabuddin. 2006. "Rare Event Simulation Techniques: An Introduction and Recent Advances". In Elsevier Handbooks in Operations Research and Management Science: Simulation, edited by S. G. Henderson and B. L. Nelson, 291--350. Amsterdam: Elsevier.
[94]
Kabak, I. W. 1968. "Stopping Rules for Queuing Simulations." Operations Research 16:431--437.
[95]
Kafadar, K. 2006. "Monte Carlo Swindle." In Encyclopedia of Statistical Sciences. New York: John Wiley and Sons.
[96]
Kahn, H. 1950. "Modifications of the Monte Carlo Method". In Proceedings, Seminar on Scientific Computation, November 1949, edited by I. A. S. Department, 20--27. New York, NY: IBM.
[97]
Kahn, H. 1954. Applications of Monte Carlo. RM-1237-AEC.RAND Corporation, Santa Monica, CA. 19 April 1954. Revised 27 April 1956. Available at https://www.osti.gov/scitech/biblio/4353680.
[98]
Kahn, H., and T. E. Harris. 1949. "Estimation of Particle Transmission by Random Sampling." In Monte Carlo Method, Volume 12 of Applied Mathematics Series, 27--30: National Bureau of Standards.
[99]
Kahn, H. and A. Marshall. 1953. "Methods of Reducing Sample Size in Monte Carlo Computations." Journal of the Operations Research Society of America 1:263--278.
[100]
Kelton, W. D. 1999. "Designing Simulation Experiments." In Proceedings of the 1999 Winter Simulation Conference, edited by P. A. Farrington, H. B. Nembhard, D. T. Sturrock, and G. W. Evans, 33--38. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[101]
Kim, S., and S. G. Henderson. 2004. "Adaptive Control Variates." In Proceedings of the 2004 Winter Simulation Conference, edited by R. G. Ingalls, M. D. Rossetti, J. S. Smith, and B. A. Peters, 621--629. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[102]
Kleijnen, J. P. C. 1974. Statistical Techniques in Simulation. Vol. 9, Statistics, Textbooks and Monographs. New York: Marcel Dekker Inc.
[103]
Kleijnen, J. P. C. 1975. "Screening Designs for Poly-Factor Experimentation." Technometrics 17 (4): 487--493.
[104]
Kleijnen, J. P. C. 1987. Statistical Tools for Simulation Practitioners. New York: Marcel Dekker Inc.
[105]
Kleijnen, J. P. C and W. C. M. van Beers. 2004. "Application-Driven Sequential Designs for Simulation Experiments: Kriging Metamodelling." Journal of the Operational Research Society 55:876--883.
[106]
Kleijnen, J. P. C., S. M. Sanchez, T. W. Lucas, and T. M. Cioppa. 2005. "State-of-the-Art Review: A User's Guide to the Brave New World of Designing Simulation Experiments." INFORMS Journal on Computing 17:263--289.
[107]
Kleijnen, J. P. C., and R. G. Sargent. 2000. "A Methodology for Fitting and Validating Metamodels in Simulation." European Journal of Operational Research 120:14--29.
[108]
Krige, D. G. 1951. "A Statistical Approach to Some Basic Mine Valuation Problems on the Witwatersrand." Journal of the Chemical, Metallurgical and Mining Society of South Africa 52:119--139.
[109]
L'Ecuyer, P. 1994. "Efficiency Improvement and Variance Reduction." In Proceedings of the 1994 Winter Simulation Conference, edited J. D. Tew, S. Manivannan, D. A. Sadowski, and A. F. Seila, 122--132. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[110]
Lamb, J. D., and R. C. H. Cheng. 2002. "Optimal Allocation of Runs in a Simulation Metamodel with Several Independent Variables." Operations Research Letters 30:189--194.
[111]
Lavenberg, S. S., and P. D. Welch. 1978. "Variance Reduction Techniques." In Proceedings of the 1978 Winter Simulation Conference, edited by H. J. Highland, L. G. Hull, and N. R. Nielsen, 167--170. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[112]
Law, A. M., and J. S. Carson. 1979. "A Sequential Procedure for Determining the Length of a Steady-State Simulation." Operations Research 27:1011--1025.
[113]
Lemieux, C., and P. L'Ecuyer 2000. "Using Lattice Rules for Variance Reduction in Simulation." In Proceedings of the 2000 Winter Simulation Conference, edited by J. A. Joines, R. R. Barton, P. A. Fishwick, and K. Kang, 509--516. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[114]
Lewis, E. E., and F. Bohm. 1984. "Monte Carlo Simulation of Markov Unreliability Models." Nuclear Engineering and Design 77:49--62.
[115]
Lux, I., and L. Koblinger. 1991. Monte Carlo Particle Transport Methods: Neutron and Photon Calculations. Boca Raton, FL: CRC Press.
[116]
McKay, M. D., R. J. Beckman, and W. J. Conover. 1979. "A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code." Technometrics 21:239--245.
[117]
Mihram, G. A. 1972. Simulation: Statistical Foundations and Methodology. New York: Academic Press.
[118]
Mitchell, T. J., and M. D. Morris. 1992. "The Spatial Correlation Function Approach to Response Surface Estimation." In Proceedings of the 1992 Winter Simulation Conference, edited J. J. Swain, D. Goldsman, R. C. Crain, and J. R. Wilson, 565--571. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[119]
Montgomery, D. C., and G. Weatherby. 1979. "Factor Screening Methods in Computer Simulation Experiments." In Proceedings of the 1979 Winter Simulation Conference, edited by H. J. Highland, M. G. Spiegel, and R. Shannon, 347--358. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[120]
Morrice, D. J. 1995. "A Comparison of Frequency Domain Methodology and Conventional Factor Screening Methods." Operations Research Letters 17:165--174.
[121]
Morrice, D. J., and L. W. Schruben. 1993. "Simulation Factor Screening Using Harmonic Analysis." Management Science 39:1459--1476.
[122]
Nance, R. E., and R. G. Sargent 2002. "Perspectives on the Evolution of Simulation." Operations Research (50<sup>th</sup> Anniversary Issue) 50:161--172.
[123]
Nelson, B. L. 1985. "A Decomposition Approach to Variance Reduction." In Proceedings of the 1985 Winter Simulation Conference, edited by D. T. Gantz, G. C. Blais, and S. L. Solomon, 23--32. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[124]
Nelson, B. L. 1987. "A Perspective on Variance Reduction in Dynamic Simulation Experiments." Communications in Statistics: Simulation and Computation 16:385--426.
[125]
Nelson, B. L. 1989. "Batch Size Effects on the Efficiency of Control Variates in Simulation." European Journal of Operational Research 43:184--196.
[126]
Nelson, B. L. 1992. "Designing Efficient Simulation Experiments." In Proceedings of the 1992 Winter Simulation Conference, edited J. J. Swain, D. Goldsman, R. C. Crain, and J. R. Wilson, 126--132. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[127]
Nelson, B. L. and B. Schmeiser. 1983. "Variance Reduction: Basic Transformations." In Proceedings of the 1983 Winter Simulation Conference, edited by S. D. Roberts, J. Banks, and B. W. Schmeiser, 225--258. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[128]
Nelson, B. L., and B. W. Schmeiser. 1985. "Decomposition of Some Well-Known Variance Reduction Techniques. Revision." RM-84-6. School of Industrial Engineering, Purdue University.
[129]
Nicola, V. F., P. Shahabuddin, and M. K. Nakayama. 2001. "Techniques for Fast Simulation of Models of Highly Dependable Systems." IEEE Transactions on Reliability 50:246--264.
[130]
Parekh, S., and J. Walrand. 1989. "Quick Simulation of Rare Events in Networks." IEEE Transactions on Automatic Control 34:54--66.
[131]
Nozari, A., S. F. Arnold, and C. D. Pegden. 1987. "Statistical Analysis for Use with the Schruben and Margolin Correlation Induction Strategy." Operations Research 35:127--139.
[132]
Owen, A. B. 2017. "Monte Carlo Theory, Methods and Examples." http://statweb.stanford.edu/~owen/mc.
[133]
Page, E. S. 1965. "On Monte Carlo Methods in Congestion Problems, Simulation of Queueing Systems." Operations Research 13:300--305.
[134]
Princeton. 2017. https://paw.princeton.edu/sites/default/files/styles/feature_image/public/images/content/Turing_NeumannMANIAC.jpg?itok=Z7sThQ_i
[135]
Roeder, T., S. Fischbein, M. Janakiram, and L. W. Schruben. 2002. "Resource-Driven and Job-Driven Simulations." Proceedings of the 2002 International Conference on Modeling and Analysis of Semiconductor Manufacturing, edited by G. T. Mackulak, A. Schomig, J. Fowler, and D.-B. Perng, 78--83. Arizona State University.
[136]
Rubino, G., and B. Tuffin. 2009. Rare Event Simulation using Monte Carlo Methods. Chichester, UK: John Wiley.
[137]
Sadowsky, J. S. 1991. "Large Deviations Theory and Efficient Simulation of Excessive Backlogs in a GI/GI/m Queue." IEEE Transactions on Automatic Control 36:1383--1394.
[138]
Sadowsky, J., and J. Bucklew. 1990. "On Large Deviations Theory and Asymptotically Efficient Monte Carlo Estimation." IEEE Transactions on Information Theory 36:579--588.
[139]
Sacks, J., W. J. Welch, T. J. Mitchell, and H. P. Wynn. 1989. "Design and Analysis of Computer Experiments." Statistical Science 4:409--423.
[140]
Sanchez, S. M., F. Moeeni, and P. J. Sanchez. 2006. "So Many Factors, So Little Time... Simulation Experiments in the Frequency Domain." International Journal of Production Economics 103:149--165.
[141]
Sanchez, S. M., H. Wan, and T. W. Lucas. 2009. "Two-Phase Screening Procedure for Simulation Experiments." ACM Transactions on Modeling and Computer Simulation 19:1--24.
[142]
Schmeiser, B. 1982. "Batch Size Effects in the Analysis of Simulation Output." Operations Research 30:556--568.
[143]
Schriber, T. J., and R. W. Andrews. 1984. "ARMA-Based Confidence Intervals for Simulation Output Analysis." American Journal of Mathematical and Management Sciences 4:345--373.
[144]
Schruben, L. W. 1979. "Designing Correlation Induction Strategies for Simulation Experiments." Chapter 16 in Current Issues in Computer Simulation, edited by N. R. Adam and A. Dogramaci. Amsterdam: Elsevier.
[145]
Schruben, L. W. 1983. "Confidence Interval Estimation Using Standardized Time Series." Operations Research 31:1090--1108.
[146]
Schruben, L. W. 2010. "Simulation Modeling for Analysis." ACM Transactions on Modeling and Computer Simulation 20:1--22.
[147]
Schruben, L. W., and V. J. Cogliano. 1981. "Simulation Sensitivity Analysis: A Frequency Domain Approach." In Proceedings of the 1981 Winter Simulation Conference, edited by T. Oren, C. M. Delfosse, and C. M. Shub, 455--459. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[148]
Schruben, L. W., and V. J. Cogliano. 1987. "An Experimental Procedure for Simulation Response Surface Model Identification." Communications of the ACM 30:716--730.
[149]
Schruben, L. W., and B. H. Margolin. 1978. "Pseudorandom Number Assignment in Statistically Designed Simulation and Distribution Sampling Experiments." Journal of the American Statistical Association 73:504--520.
[150]
Shahabuddin, P. 1994. "Importance Sampling for Highly Reliable Markovian Systems." Management Science 40:333--352.
[151]
Shahabuddin, P., V. F. Nicola, P. Heidelberger, A. Goyal, and P. W. Glynn. 1988. "Variance Reduction in Mean Time to Failure Simulations." In Proceedings of the 1988 Winter Simulation Conference, edited by M. A. Abrams, P. L. Haigh, and J. C. Comfort, 491--499. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[152]
Siegmund, D. 1976. "Importance Sampling in the Monte Carlo Study of Sequential Tests." Annals of Statistics 4:673--684.
[153]
Sobel, M., and A. Wald. 1949. "A Sequential Decision Procedure for Choosing One of Three Hypotheses Concerning the Unknown Mean of a Normal Distribution." The Annals of Mathematical Statistics 20: 502--522.
[154]
Song, W. T., and M. Chih. 2008. "Implementable MSE-Optimal Dynamic Partial-Overlapping Batch Means Estimators for Steady-State Simulations." In Proceedings of the 2008 Winter Simulation Conference, edited by S. Mason, R. Hill, L. Moench, O. Rose, T. Jefferson, and J. Fowler, 426--435. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[155]
Szechtman, R., and P. W. Glynn. 2002. "Some New Perspectives on the Method of Control Variates." In Monte Carlo and Quasi-Monte Carlo Methods, edited by K. T. Fang, F. J. Hickernell, and H. Niederreiter, 27--49. Berlin: Springer-Verlag.
[156]
Tafazzoli, A., N. M. Steiger, and J. R. Wilson. 2011. "N-Skart: A Nonsequential Skewness- and Autoregression-Adjusted Batch-Means Procedure for Simulation Analysis." IEEE Transactions on Automatic Control 56:254--264.
[157]
Tafazzoli, A., J. R. Wilson, E. K. Lada, and N. M. Steiger. 2008. "Skart: A Skewness- and Autoregression-Adjusted Batch-Means Procedure for Simulation Analysis." In Proceedings of the 2008 Winter Simulation Conference, edited by S. Mason, R. Hill, L. Moench, O. Rose, T. Jefferson, and J. Fowler, 387--395. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[158]
Tew, J. D., and J. R. Wilson. 1992. "Validation of Simulation Analysis Methods for the Schruben-Margolin Correlation-Induction Strategy." Operations Research 40:87--103.
[159]
Tew, J. D. and J. R. Wilson. 1994. "Estimating Simulation Meta-Models Using Combined Correlation-Based Variance Reduction Techniques." IIE Transactions 26:2--16.
[160]
Villen-Altamirano, M., and J. Villén-Altamirano. 1991. "RESTART: A Method For Accelerating Rare Event Simulations." In Queueing, Performance and Control in ATM, edited by J. W. Cohen and C. D. Pack. New York: Elsevier Science.
[161]
Villén-Altamirano,M., and J. Villén-Altamirano. 1994. "RESTART: A Straightforward Method for Fast Simulation of Rare Events." In Proceedings of the 1994 Winter Simulation Conference, edited J. D. Tew, S. Manivannan, D. A. Sadowski, and A. F. Seila, 282--289. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[162]
Wan, H., B. E. Ankenman, and B. L. Nelson. 2006. "Controlled Sequential Bifurcation: A New Factor-Screening Method for Discrete-Event Simulation." Operations Research 54:743--755.
[163]
Whitt, W. 1991. "The Efficiency of One Long Run versus Independent Replications in Steady-State Simulation." Management Science 37:645--666.
[164]
Wiener, N. 1949. Extrapolation, Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications. Cambridge, MA: Technology Press of the Massachusetts Institute of Technology.
[165]
Wilson, J. R. 1984. "Variance Reduction Techniques for Digital Simulation." American Journal of Mathematical and Management Sciences 4: 277--312.
- History of improving statistical efficiency
Recommendations
Branch history matching: branch predictor warmup for sampled simulation
HiPEAC'07: Proceedings of the 2nd international conference on High performance embedded architectures and compilersComputer architects and designers rely heavily on simulation. The downside of simulation is that it is very time-consuming -- simulating an industry-standard benchmark on today's fastest machines and simulators takes several weeks. A practical solution ...
Branch Predictor Warmup for Sampled Simulation through Branch History Matching
Transactions on High-Performance Embedded Architectures and Compilers IIComputer architects and designers rely heavily on simulation. The downside of simulation is that it is very time-consuming -- simulating an industry-standard benchmark on today's fastest machines and simulators takes several weeks. A practical solution ...
The history of simulation modeling
WSC '17: Proceedings of the 2017 Winter Simulation ConferenceDuring the past half-century simulation has advanced as a tool of choice for operational systems analysis. The advances in technology have stimulated new products and new environments without software standards or methodological commonality. Each new ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2017
4389 pages
ISBN:9781538634271
Sponsors
Publisher
IEEE Press
Publication History
Published: 03 December 2017
Check for updates
Qualifiers
- Research-article
Conference
WSC '17
Sponsor:
Acceptance Rates
Overall Acceptance Rate 3,413 of 5,075 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 37Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in