[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Screening for Dispersion Effects by Sequential Bifurcation

Published: 08 December 2014 Publication History

Abstract

The mean of the output of interest obtained from a run of a computer simulation model of a system or process often depends on many factors; many times, however, only a few of these factors are important. Sequential bifurcation is a method that has been considered by several authors for identifying these important factors using as few runs of the simulation model as possible. In this article, we propose a new sequential bifurcation procedure whose steps use a key stopping rule that can be calculated explicitly, something not available in the best methods previously considered. Moreover, we show how this stopping rule can also be easily modified to efficiently identify those factors that are important in influencing the variability rather than the mean of the output. In empirical studies, the new method performs better than previously published fully sequential bifurcation methods in terms of achieving the prescribed Type I error. It also achieves higher power for detecting moderately large effects using fewer replications than earlier methods. To achieve this control for midrange effects, the new method sometimes requires more replications than other methods in the case where there are many very large effects.

Supplementary Material

a2-ankenman-apndx.pdf (ankenman.zip)
Supplemental movie, appendix, image and software files for, Screening for Dispersion Effects by Sequential Bifurcation

References

[1]
B. E. Ankenman, R. C. H. Cheng, and S. M. Lewis. 2006. A polytope method for estimating factor main effects efficiently. In Proceedings of the 2006 Winter Simulation Conference, L. F. Perrone, F. P. Wieland, J. Liu, B. G. Lawson, D. M. Nicol, and R. M. Fujimoto (Eds.). IEEE, Piscataway, NJ, 369--375.
[2]
F. J. Anscombe. 1953. Sequential estimation. Journal of the Royal Statistical Society, Series B 15 (1953), 1--29.
[3]
B. Bettonvil and J. P. C. Kleijnen. 1997. Searching for important factors in simulation models with many factors: Sequential bifurcation. European Journal of Operational Research 96 (1997), 180--194.
[4]
R. C. H. Cheng. 1997. Searching for important factors: Sequential bifurcation under uncertainty. In Proceedings of the 1997 Winter Simulation Conference, D. H. Withers S. Andradottir, K. J. Healy, and B. L. Nelson (Eds.). IEEE, Piscataway, NJ, 275--280.
[5]
Y. S. Chow and H. Robbins. 1965. On the asymptotic theory of fixed-width sequential confidence intervals for the mean. Annals of Mathematical Statistics 36 (1965), 457--462.
[6]
J. P. C. Kleijnen, B. Bettonvil, and F. Persson. 2006. Screening for the Important Factors in Large Discrete-Event Simulation Models: Sequential Bifurcation and Its Applications. Springer, New York, NY, 287--307.
[7]
W. Liu. 1997. On some sample size formulae for controlling both size and power in clinical trials. Journal of the Royal Statistical Society, Series D 46 (1997), 239--251.
[8]
S. M. Sanchez, H. Wan, and T. W. Lucas. 2009. A two-phase screening procedure for simulation experiments. ACM Transactions on Modeling and Computer Simulation 19 (2009).
[9]
H. Shen and H. Wan. 2009. Controlled sequential factorial design for simulation factor screening. European Journal of Operational Research 198 (2009), 511--519.
[10]
H. Shen, H. Wan, and S. M. Sanchez. 2010. The hybrid approach for simulation factor screening. Naval Research Logistics 57 (2010), 45--57.
[11]
D. I. Singham and L. W. Schruben. 2012. Finite-sample performance of absolute precision stopping rules. INFORMS Journal on Computing 24 (2012), 624--635.
[12]
N. Starr. 1966a. On the asymptotic efficiency of a sequential procedure for estimating the mean. Annals of Mathematical Statistics 37 (1966), 1173--1185.
[13]
N. Starr. 1966b. The performance of a sequential procedure for the fixed-width interval estimation of the mean. Annals of Mathematical Statistics 37 (1966), 36--50.
[14]
C. Stein. 1945. A two-sample test for a linear hypothesis whose power is independent of the variance. Annals of Mathematical Statistics 16 (1945), 243--258.
[15]
H. Wan and B. E. Ankenman. 2007. Two-stage controlled fractional factorial screening for simulation experiments. Journal of Quality Technology 39 (2007), 126--139.
[16]
H. Wan, B. E. Ankenman, and B. L. Nelson. 2006. Controlled sequential bifurcation: A new factor-screening method for discrete-event simulation. Operations Research 54 (2006), 743--755.
[17]
H. Wan, B. E. Ankenman, and B. L. Nelson. 2010. Improving the efficiency and the efficacy of controlled sequential bifurcation. INFORMS Journal on Computing 22 (2010), 482--492.
[18]
M. Woodroofe. 1977. Second order approximations for sequential point and interval estimation. Annals of Mathematical Statistics 5 (1977), 84--995.

Cited By

View all
  • (2023)Top-M Factor Screening for Stochastic Simulation: Multi-Armed Bandit and Sequential Bifurcation Combined2023 Winter Simulation Conference (WSC)10.1109/WSC60868.2023.10408534(528-539)Online publication date: 10-Dec-2023
  • (2023)Improving the efficiency and efficacy of robust sequential bifurcation under data contaminationCommunications in Statistics - Simulation and Computation10.1080/03610918.2023.217041653:11(5143-5159)Online publication date: 29-Jan-2023
  • (2022)Modified sequential bifurcation for simulation factor screening under skew-normal response modelComputers & Industrial Engineering10.1016/j.cie.2022.108274(108274)Online publication date: May-2022
  • Show More Cited By

Index Terms

  1. Screening for Dispersion Effects by Sequential Bifurcation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Modeling and Computer Simulation
    ACM Transactions on Modeling and Computer Simulation  Volume 25, Issue 1
    January 2015
    141 pages
    ISSN:1049-3301
    EISSN:1558-1195
    DOI:10.1145/2661171
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 December 2014
    Accepted: 01 July 2014
    Revised: 01 July 2014
    Received: 01 February 2012
    Published in TOMACS Volume 25, Issue 1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Stopping rules
    2. controlled sequential bifurcation
    3. fixed-width confidence intervals
    4. location effects
    5. multiplicative model
    6. multiplicative variance model
    7. simulation
    8. variance effects

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 23 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Top-M Factor Screening for Stochastic Simulation: Multi-Armed Bandit and Sequential Bifurcation Combined2023 Winter Simulation Conference (WSC)10.1109/WSC60868.2023.10408534(528-539)Online publication date: 10-Dec-2023
    • (2023)Improving the efficiency and efficacy of robust sequential bifurcation under data contaminationCommunications in Statistics - Simulation and Computation10.1080/03610918.2023.217041653:11(5143-5159)Online publication date: 29-Jan-2023
    • (2022)Modified sequential bifurcation for simulation factor screening under skew-normal response modelComputers & Industrial Engineering10.1016/j.cie.2022.108274(108274)Online publication date: May-2022
    • (2020)Energy-Efficiency Assessment and Improvement—Experiments and Analysis MethodsSustainability10.3390/su1218760312:18(7603)Online publication date: 15-Sep-2020
    • (2020)Cluster sampling for Morris method made easyNaval Research Logistics (NRL)10.1002/nav.2196868:4(412-433)Online publication date: 13-Dec-2020
    • (2019)An Efficient Morris Method-Based Framework for Simulation Factor ScreeningINFORMS Journal on Computing10.1287/ijoc.2018.083631:4(745-770)Online publication date: 1-Oct-2019
    • (2019)Controlled Morris Method: A New Factor Screening Approach Empowered by a Distribution-Free Sequential Multiple Testing ProcedureReliability Engineering & System Safety10.1016/j.ress.2019.04.038Online publication date: Apr-2019
    • (2019)Robust sequential bifurcation for simulation factor screening under data contaminationComputers & Industrial Engineering10.1016/j.cie.2019.01.017129(102-112)Online publication date: Mar-2019
    • (2018)Efficient budget allocation strategies for elementary effects method in stochastic simulationNaval Research Logistics (NRL)10.1002/nav.2180265:3(218-241)Online publication date: 6-Aug-2018
    • (2017)Controlled morris methodProceedings of the 2017 Winter Simulation Conference10.5555/3242181.3242332(1-12)Online publication date: 3-Dec-2017
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media