Design and Analysis of Computational Experiments: Overview

• Adenso-Diaz B, Laguna M (2006) Fine-tuning of algorithms using fractional experimental designs and local search. Operations Research 54(1):99–114

  Article  MATH  Google Scholar 

• Angün E, Kleijnen J (2009) An asymptotic test of optimality conditions in multiresponse simulation-based optimization, working paper

  Google Scholar 

• Angün E, Kleijnen J, den Hertog D, Gürkan G (2009) Response surface methodology with stochastic constrains for expensive simulation. Journal of the Operational Research Society 60:735–746

  Article  MATH  Google Scholar 

• Ankenman B, Nelson B, Staum J (2009) Stochastic kriging for simulation metamodeling. Operations Research (accepted)

  Google Scholar 

• Bartz-Beielstein T (2006) Experimental research in evolutionary computation—The new experimentalism. Natural Computing Series, Springer

  Google Scholar 

• Bartz-Beielstein T, Preuss M (2010) The future of experimental research. In: Bartz-Beielstein T, Chiarandini M, Paquete L, Preuss M (eds) Empirical methods for the analysis of optimization algorithms, Springer, pp 17–46

  Google Scholar 

• Ben-Tal A, Nemirovski A (2002) Robust optimization: methodology and applications. Mathematical Programming 92(3):353–380

  Article  MathSciNet  Google Scholar 

• Bettonvil B, Kleijnen J (1996) Searching for important factors in simulation models with many factors: sequential bifurcation. European Journal of Operational Research 96:180–194

  Article  Google Scholar 

• Bettonvil B, del Castillo E, Kleijnen J (2009) Statistical testing of optimality conditions in multiresponse simulation-based optimization. European Journal of Operational Research 199(2):448–458

  Article  MATH  MathSciNet  Google Scholar 

• Box G, Wilson K (1951) On the experimental attainment of optimum conditions. Journal Royal Statistical Society, Series B 13(1):1–38

  MathSciNet  Google Scholar 

• Cressie N (1993) Statistics for spatial data: revised edition. Wiley, New York

  Google Scholar 

• Dellino G, Kleijnen J, Meloni C (2009) Robust optimization in simulation: Taguchi and response surface methodology. In: Rossini M, Hill R, Johansson B, Dunkin A, Ingalls R (eds) Proceedings of the 2009 Winter Simulation Conference, (accepted)

  Google Scholar 

• Den Hertog D, Kleijnen J, Siem A (2006) The correct Kriging variance estimated by bootstrapping. Journal of the Operational Research Society 57(4):400–409

  Article  MATH  Google Scholar 

• Efron B, Tibshirani R (1993) An introduction to the bootstrap. Chapman & Hall, NY

  MATH  Google Scholar 

• Fu M (2008) What you should know about simulation and derivatives. Naval Research Logistics 55:723–736

  Article  MATH  MathSciNet  Google Scholar 

• Kleijnen J (2008) Design and analysis of simulation experiments. Springer

  MATH  Google Scholar 

• Kleijnen J, Sargent R (2000) A methodology for the fitting and validation of metamodels in simulation. European Journal of Operational Research 120(1):14–29

  Article  MATH  Google Scholar 

• Kleijnen J, Van Beers W (2009) Monotonicity-preserving bootstrapped Kriging metamodels for expensive simulations, working paper

  Google Scholar 

• Kleijnen J,Wan J (2007) Optimization of simulated systems: OptQuest and alternatives. Simulation Modelling Practice and Theory 15:354–362

  Article  Google Scholar 

• Kleijnen J, Sanchez S, Lucas T, Cioppa T (2005) State-of-the-art review: a user’s guide to the brave new world of designing simulation experiments. INFORMS Journal on Computing 17(3):263–289

  Article  Google Scholar 

• Kleijnen J, Bettonvil B, Persson F (2006a) Screening for the important factors in large discrete-event simulation: sequential bifurcation and its applications. In: Dean A, Lewis S (eds) Screening: Methods for experimentation in industry, drug discovery, and genetics, Springer, pp 287–307

  Google Scholar 

• Kleijnen J, den Hertog D, Angün E (2006b) Response surface methodology’s steepest ascent and step size revisited: correction. European Journal of Operational Research 170:664–666

  Article  MATH  Google Scholar 

• Kleijnen J, Van Beers W, Van Nieuwenhuyse I (2010) Constrained optimization in simulation: a novel approach. European Journal of Operational Research 202:164–174

  Article  MATH  Google Scholar 

• Law A (2007) Simulation modeling and analysis, 4th edn. McGraw-Hill, Boston

  Google Scholar 

• Lophaven S, Nielsen H, Søndergaard J (2002) DACE—A Matlab Kriging Toolbox. Tech. Rep. IMM-REP-2002-12, Informatics and Mathematical Modelling, Technical University of Denmark, Copenhagen, Denmark

  Google Scholar 

• Montgomery D (2009) Design and analysis of experiments, 7th edn. Wiley, Hoboken, New Jersey

  Google Scholar 

• Myers R, Montgomery D (1995) Response surface methodology: process and product optimization using designed experiments. Wiley, NY

  MATH  Google Scholar 

• Park S, Fowler J, Mackulak G, Keats J, Carlyle W (2002) D-optimal sequential experiments for generating a simulation-based cycle time-throughput curve. Operations Research 50(6):981–990

  Article  Google Scholar 

• Rajagopalan HK, Vergara FE, Saydam C, Xiao J (2007) Developing effective meta-heuristics for a probabilistic location model via experimental design. European Journal of Operational Research 177(1):83–101, URL http://dx.doi. org/10.1016/j.ejor.2005.11.007

  Article  MATH  Google Scholar 

• Ridge E, Kudenko D (2007) Screening the parameters affecting heuristic performance. In: Lipson H (ed) GECCO, ACM, p 180, URL http://doi.acm. org/10.1145/1276958.1276994

• Ridge E, Kudenko D (2010) Sequential experiment designs for screening and tuning parameters of stochastic heuristics. In: Bartz-Beielstein T, Chiarandini M, Paquete L, Preuss M (eds) Empirical Methods for the Analysis of Optimization Algorithms, Springer, pp 265–287

  Google Scholar 

• Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Statistical Science 4(4):409–435

  Article  MATH  MathSciNet  Google Scholar 

• Santner TJ, Williams BJ, Notz WI (2003) The design and analysis of computer experiments. Springer

  MATH  Google Scholar 

• Taguchi G (1987) System of experimental designs. Krauss International, NY

  Google Scholar 

• Van Beers W, Kleijnen J (2003) Kriging for interpolation in random simulation. Journal of the Operational Research Society (54):255–262

  Article  MATH  Google Scholar 

• Van Beers W, Kleijnen J (2008) Customized sequential designs for random simulation experiments: Kriging metamodeling and bootstrapping. European Journal of Operational Research 186(3):1099–1113

  Article  MATH  Google Scholar 

• Wu C, Hamada M (2000) Experiments; planning, analysis, and parameter design optimization. Wiley, NY

  MATH  Google Scholar 

• Xu J, Yang F, Wan H (2007) Controlled sequential bifurcation for software reliability study. In: Henderson S, Biller B, Hsieh MH, Shortle J, Tew J, Barton R (eds) Proceedings of the 2007 Winter Simulation Conference, pp 281–288

  Google Scholar 

• Yin J, Ng S, Ng K (2008) Kriging model with modified nugget effect. In: Proceedings of the 2008 IEEE International Conference on Industrial Engineering and Engineering Management, pp 1714–1718

  Google Scholar 

• Yu HF (2007) Designing a screening experiment with a reciprocal Weibull degradation rate. Computers & Industrial Engineering 52(2):175–191

  Article  Google Scholar 

Download references