Skip header Section
Skip Bibliometrics Section
Stochastic Simulation Optimization: An Optimal Computing Budget AllocationJune 2010
- Authors:
- Chun-hung Chen,
- Loo Hay Lee
Skip Abstract Section
Abstract
With the advance of new computing technology, simulation is becoming very popular for designing large, complex and stochastic engineering systems, since closed-form analytical solutions generally do not exist for such problems. However, the added flexibility of simulation often creates models that are computationally intractable. Moreover, to obtain a sound statistical estimate at a specified level of confidence, a large number of simulation runs (or replications) is usually required for each design alternative. If the number of design alternatives is large, the total simulation cost can be very expensive. Stochastic Simulation Optimization addresses the pertinent efficiency issue via smart allocation of computing resource in the simulation experiments for optimization, and aims to provide academic researchers and industrial practitioners with a comprehensive coverage of OCBA approach for stochastic simulation optimization. Starting with an intuitive explanation of computing budget allocation and a discussion of its impact on optimization performance, a series of OCBA approaches developed for various problems are then presented, from the selection of the best design to optimization with multiple objectives. Finally, this book discusses the potential extension of OCBA notion to different applications such as data envelopment analysis, experiments of design and rare-event simulation.
Cited By
- Shi X, Peng Y and Zhang G Top-Two Thompson Sampling for Selecting Context-Dependent Best Designs Proceedings of the Winter Simulation Conference, (3400-3411)
- Chen Y Data-Driven Optimal Allocation for Ranking and Selection under Unknown Sampling Distributions Proceedings of the Winter Simulation Conference, (3376-3387)
- Peng Y and Zhang G Thompson Sampling Meets Ranking and Selection Proceedings of the Winter Simulation Conference, (3075-3086)
- Zhang G, Peng Y and Xu Y An Efficient Dynamic Sampling Policy for Monte Carlo Tree Search Proceedings of the Winter Simulation Conference, (2760-2771)
- Nelson B Let's Do Ranking & Selection Proceedings of the Winter Simulation Conference, (180-191)
- Li Y and Gao S On the convergence of optimal computing budget allocation algorithms Proceedings of the Winter Simulation Conference, (1-12)
- Cao Y, Currie C, Onggo B and Higgins M Simulation optimization for a digital twin using a multi-fidelity framework Proceedings of the Winter Simulation Conference, (1-12)
- Zhang G, Peng Y, Zhang J and Zhou E Dynamic sampling policy for subset selection Proceedings of the Winter Simulation Conference, (1-12)
- Behrens H, Candan K, Chen X, Garg Y, Li M, Li X, Liu S, Sapino M, Shadab M, Turner D and Vijayakumaren M (2021). DataStorm: Coupled, Continuous Simulations for Complex Urban Environments, ACM/IMS Transactions on Data Science, 2:3, (1-37), Online publication date: 31-Aug-2021.
- Lin Y, Zhou E and Megahed A A nested simulation optimization approach for portfolio selection Proceedings of the Winter Simulation Conference, (3093-3104)
- Zhang G, Li H and Peng Y Sequential sampling for a ranking and selection problem with exponential sampling distributions Proceedings of the Winter Simulation Conference, (2984-2995)
- Li H, Peng Y, Xu X, Chen C and Heidergott B Dynamic sampling procedure for decomposable random networks Proceedings of the Winter Simulation Conference, (3752-3763)
- Pearce M, Poloczek M and Branke J Bayesian simulation optimization with common random numbers Proceedings of the Winter Simulation Conference, (3492-3503)
- Sun G, Li Y and Fu M Utility-based statistical selection procedures Proceedings of the Winter Simulation Conference, (3416-3427)
- Rojas-Gonzalez S, Branke J and Van Nieuwehuyse I Multiobjective ranking and selection with correlation and heteroscedastic noise Proceedings of the Winter Simulation Conference, (3392-3403)
- Chen Y and Ryzhov I Balancing optimal large deviations in ranking and selection Proceedings of the Winter Simulation Conference, (3368-3379)
- Branke J Simulation optimisation Proceedings of the Genetic and Evolutionary Computation Conference Companion, (862-889)
- Görder B and Kolonko M (2019). Ranking and Selection, ACM Transactions on Modeling and Computer Simulation, 29:1, (1-24), Online publication date: 23-Feb-2019.
- Hunter S, Applegate E, Arora V, Chong B, Cooper K, Rincón-Guevara O and Vivas-Valencia C (2019). An Introduction to Multiobjective Simulation Optimization, ACM Transactions on Modeling and Computer Simulation, 29:1, (1-36), Online publication date: 31-Jan-2019.
- Wu D and Zhou E Provably improving the optimal computing budget allocation algorithm Proceedings of the 2018 Winter Simulation Conference, (1921-1932)
- Peng Y, Chen C, Chong E and Fu M A review of static and dynamic optimization for ranking and selection Proceedings of the 2018 Winter Simulation Conference, (1909-1920)
- Ryzhov I (2018). The Local Time Method for Targeting and Selection, Operations Research, 66:5, (1406-1422), Online publication date: 1-Oct-2018.
- Branke J Simulation optimisation Proceedings of the Genetic and Evolutionary Computation Conference Companion, (745-772)
- Bandaru S and Ng A An empirical comparison of metamodeling strategies in noisy environments Proceedings of the Genetic and Evolutionary Computation Conference, (817-824)
- Cooper K, Hunter S and Nagaraj K An epsilon-constraint method for integer-ordered bi-objective simulation optimization Proceedings of the 2017 Winter Simulation Conference, (1-12)
- Ma S and Henderson S An efficient fully sequential selection procedure guaranteeing probably approximately correct selection Proceedings of the 2017 Winter Simulation Conference, (1-12)
- Xiao H, Chen H and Lee L Optimal computing budget allocation for ranking the top designs with stochastic constraints Proceedings of the 2017 Winter Simulation Conference, (1-7)
- Chen Y and Ryzhov I Rate-optimality of the complete expected improvement criterion Proceedings of the 2017 Winter Simulation Conference, (1-10)
- Meng Q and Ng S Enhancing pattern search for global optimization with an additive global and local gaussian process model Proceedings of the 2017 Winter Simulation Conference, (1-12)
- Wang B, Zhang Q and Xie W Bayesian sequential calibration using detailed sample paths Proceedings of the 2017 Winter Simulation Conference, (1-12)
- Fu M and Henderson S History of seeking better solutions, aka simulation optimization Proceedings of the 2017 Winter Simulation Conference, (1-27)
- Zhang S, Xu J, Lee L, Chew E, Wong W and Chen C (2017). Optimal Computing Budget Allocation for Particle Swarm Optimization in Stochastic Optimization, IEEE Transactions on Evolutionary Computation, 21:2, (206-219), Online publication date: 1-Apr-2017.
- Huang J, Liu L and Shi L Auction policy analysis Proceedings of the 2016 Winter Simulation Conference, (3417-3428)
- Branke J, Zhang W and Tao Y Multiobjective ranking and selection based on hypervolume Proceedings of the 2016 Winter Simulation Conference, (859-870)
- Meng Q and Ng S Combined global and local method for stochastic simulation optimization with an AGLGP model Proceedings of the 2016 Winter Simulation Conference, (827-838)
- Pedrielli G, Zhu Y, Lee L and Li H Empirical analysis of the performance of variance estimators in sequential single-run ranking & selection Proceedings of the 2016 Winter Simulation Conference, (738-748)
- Gao F and Gao S Optimal computing budget allocation with exponential underlying distribution Proceedings of the 2016 Winter Simulation Conference, (682-689)
- Branke J Simulation Optimisation Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, (663-686)
- Toscano-Palmerin S and Frazier P Asymptotic validity of the bayes-inspired indifference zone procedure Proceedings of the 2015 Winter Simulation Conference, (3868-3879)
- Gao S and Chen W A note on the subset selection for simulation optimization Proceedings of the 2015 Winter Simulation Conference, (3768-3776)
- Peng Y, Chen C, Fu M and Hu J Non-monotonicity of probability of correct selection Proceedings of the 2015 Winter Simulation Conference, (3678-3689)
- Ryzhov I Expected improvement is equivalent to OCBA Proceedings of the 2015 Winter Simulation Conference, (3668-3677)
- Feldman G, Hunter S and Pasupathy R Multi-objective simulation optimization on finite sets Proceedings of the 2015 Winter Simulation Conference, (3610-3621)
- Branke J and Zhang W A new myopic sequential sampling algorithm for multi-objective problems Proceedings of the 2015 Winter Simulation Conference, (3589-3598)
- Linz D, Huang H and Zabinsky Z Partition based optimization for updating sample allocation strategy using lookahead Proceedings of the 2015 Winter Simulation Conference, (3577-3588)
- Gao S and Shi L An optimal opportunity cost selection procedure for a fixed number of designs Proceedings of the 2014 Winter Simulation Conference, (3952-3958)
- Xu J, Zhang S, Huang E, Chen C, Lee L and Celik N Efficient multi-fidelity simulation optimization Proceedings of the 2014 Winter Simulation Conference, (3940-3951)
- Kamiński B and Szufel P Asynchronous knowledge gradient policy for ranking and selection Proceedings of the 2014 Winter Simulation Conference, (3785-3796)
- Bastani M, Thanos A, Celik N and Chen C Efficient design selection in microgrid simulations Proceedings of the 2014 Winter Simulation Conference, (2762-2773)
- Mattila V, Virtanen K, Muttilainen L, Jylhä J and Väisänen V Optimizing locations of decoys for protecting surface-based radar against anti-radiation missile with multi-objective ranking and selection Proceedings of the 2014 Winter Simulation Conference, (2319-2330)
- Chau M, Fu M, Qu H and Ryzhov I Simulation optimization Proceedings of the 2014 Winter Simulation Conference, (21-35)
- Wong W, Deng Q, Tseng M, Lee L and Hooy C (2014). A STOCHASTIC SETTING TO BANK FINANCIAL PERFORMANCE FOR REFINING EFFICIENCY ESTIMATES, International Journal of Intelligent Systems in Accounting and Finance Management, 21:4, (225-245), Online publication date: 1-Oct-2014.
- Zhu C, Xu J, Chen C, Lee L and Hu J Determining the optimal sampling set size for random search Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World, (1016-1024)
- Xie J and Frazier P Upper bounds on the Bayes-optimal procedure for ranking & selection with independent normal priors Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World, (877-887)
- Forstner L and Mönch L A heuristic to support make-to-stock, assemble-to-order, and make-to-order decisions in semiconductor supply chains Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World, (3696-3706)
- Rada-Vilela J, Zhang M and Johnston M Optimal computing budget allocation in particle swarm optimization Proceedings of the 15th annual conference on Genetic and evolutionary computation, (81-88)
- Horng S and Lin S (2013). Evolutionary algorithm assisted by surrogate model in the framework of ordinal optimization and optimal computing budget allocation, Information Sciences: an International Journal, 233, (214-229), Online publication date: 1-Jun-2013.
- LaPorte G, Branke J and Chen C Optimal computing budget allocation for small computing budgets Proceedings of the Winter Simulation Conference, (1-13)
- Qu H, Ryzhov I and Fu M Ranking and selection with unknown correlation structures Proceedings of the Winter Simulation Conference, (1-12)
- Waeber R, Frazier P and Henderson S (2012). A Framework for Selecting a Selection Procedure, ACM Transactions on Modeling and Computer Simulation, 22:3, (1-23), Online publication date: 1-Aug-2012.
- Piperagkas G, Georgoulas G, Parsopoulos K, Stylios C and Likas A Integrating particle swarm optimization with reinforcement learning in noisy problems Proceedings of the 14th annual conference on Genetic and evolutionary computation, (65-72)
- Frazier P and Kazachkov A Guessing preferences Proceedings of the Winter Simulation Conference, (4324-4336)
- Chen W, Song J and Shi L Optimizing local pickup and delivery with uncertain loads Proceedings of the Winter Simulation Conference, (4251-4261)
- Crain B, Chen C and Shortle J Combining simulation allocation and optimal splitting for rare-event simulation optimization Proceedings of the Winter Simulation Conference, (4003-4012)
Please enable JavaScript to view thecomments powered by Disqus.
Recommendations
Efficient multi-fidelity simulation optimization
WSC '14: Proceedings of the 2014 Winter Simulation ConferenceSimulation models of different fidelity levels are often available for a complex system. High-fidelity simulations are accurate but time-consuming. Therefore, they can only be applied to a small number of solutions. Low-fidelity simulations are faster ...