Article

Free access

Validation and verification of simulation models

Author:

Robert G. SargentAuthors Info & Claims

WSC '99: Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future - Volume 1

Pages 39 - 48

https://doi.org/10.1145/324138.324148

Published: 01 December 1999 Publication History

PDF eReader

References

[1]

Anderson, H. A. and R. G. Sargent. 1974. An Investigation into Scheduling for an Interactive Computer System, IBM Journal of Research and Development, 18, 2, pp. 125-137.

Digital Library

Google Scholar

[2]

Balci, O. 1989. How to Assess the Acceptability and Credibility of Simulation Results, Proc. of the 1989 Winter Simulation Conf., pp. 62-71.

Digital Library

Google Scholar

[3]

Balci, O. 1995. Principles and Techniques of Simulation Validation, Verification, and Testing, Proc. of the 1995 Winter Simulation Conf., pp. 147-154.

Digital Library

Google Scholar

[4]

Balci, O. and R. G. Sargent. 1981. A Methodology for Cost-Risk Analysis in the Statistical Validation of Simulation Models, Comm. of the ACM, 24, 4, pp. 190-197.

Digital Library

Google Scholar

[5]

Balci, O. and R. G. Sargent. 1982a. Validation of Multivari-ate Response Simulation Models by Using Hotelling's Two-Sample T 2 Test, Simulation, 39, 6, pp. 185-192.

Crossref

Google Scholar

[6]

Balci, O. and R. G. Sargent. 1982b. Some Examples of Simulation Model Validation Using Hypothesis Testing, Proc. of the 1982 Winter Simulation Conf., pp. 620-629.

Digital Library

Google Scholar

[7]

Balci, O. and R. G. Sargent. 1983. Validation of Mul-tivariate Response Trace-Driven Simulation Models, Performance 83, ed. Agrawada and Tripathi, North Holland, pp. 309-323.

Digital Library

Google Scholar

[8]

Balci, O. and R. G. Sargent. 1984a. A Bibliography on the Credibility Assessment and Validation of Simulation and Mathematical Models, Simuletter, 15, 3, pp. 15-27.

Google Scholar

[9]

Balci, O. and R. G. Sargent. 1984b. Validation of Simu-lation Models via Simultaneous Confidence Intervals, American Journal of Mathematical and Management Science, 4, 3, pp. 375-406.

Crossref

Google Scholar

[10]

Banks, J., J. S. Carson II, and B. L. Nelson. 1996. Discrete-Event System Simulation, 2nd Ed., Prentice-Hall, En-glewood Cliffs, N.J.

Google Scholar

[11]

Banks, J., D. Gerstein, and S. P. Searles. 1988. Model-ing Processes, Validation, and Verification of Complex Simulations: A Survey, Methodology and Validation, Simulation Series, Vol. 19, No. 1, The Society for Computer Simulation, pp. 13-18.

Google Scholar

[12]

DODSimulations: Improved Assessment Procedures Would Increase the Credibility of Results. 1987. U. S. General Accounting Office, PEMD-88-3.

Google Scholar

[13]

Fairley, R. E. 1976. Dynamic Testing of Simulation Soft-ware, Proc. of the 1976 Summer Computer Simulation Conf., Washington, D.C., pp. 40-46.

Google Scholar

[14]

Gass, S. I. 1983. Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis, Operations Research, 31, 4, pp. 601-663.

Digital Library

Google Scholar

[15]

Gass, S. I. 1984. Documenting a Computer-Based Model, Interfaces, 14, 3, pp. 84-93.

Digital Library

Google Scholar

[16]

Gass, S. I. 1993. Model Accreditation: A Rationale and Process for Determining a Numerical Rating, European Journal of Operational Research, 66, 2, pp. 250-258.

Crossref

Google Scholar

[17]

Gass, S. I. and L. Joel. 1987. Concepts of Model Con-fidence, Computers and Operations Research,8,4, pp. 341-346.

Crossref

Google Scholar

[18]

Gass, S. I. and B. W. Thompson. 1980. Guidelines for Model Evaluation: An Abridged Version of the U.S. General Accounting Office Exposure Draft, Operations Research, 28, 2, pp. 431-479.

Digital Library

Google Scholar

[19]

Johnson, R. A. 1994. Miller and Freund's Probability and Statistics for Engineers, 5th Ed., Prentice-Hall, Englewood Cliffs, N.J.

Digital Library

Google Scholar

[20]

Kleijnen, J. P. C. 1987. Statistical Tools for Simulation Practitioners, Marcel Dekker, New York.

Digital Library

Google Scholar

[21]

Kleindorfer, G. B. and R. Ganeshan. 1993. The Philosophy of Science and Validation in Simulation, Proc. of 1993 Winter Simulation Conf., 50-57.

Digital Library

Google Scholar

[22]

Knepell, P. L. and D. C. Arangno. 1993. Simulation Validation: A Confidence Assessment Methodology, IEEE Computer Society Press.

Digital Library

Google Scholar

[23]

Law, A. M. and W. D. Kelton. 1991. Simulation Modeling and Analysis, 2nd Ed., McGraw-Hill.

Digital Library

Google Scholar

[24]

Naylor, T. H. and J. M. Finger. 1967. Verification of Computer Simulation Models, Management Science, 14, 2, pp. B92-B101.

Digital Library

Google Scholar

[25]

Oren, T. 1981. Concepts and Criteria to Assess Acceptability of Simulation Studies: A Frame of Reference, Comm. of the ACM, 24, 4, pp. 180-189.

Digital Library

Google Scholar

[26]

Rao, M. J. and R. G. Sargent. 1988. An advisory System for Operational Validity, Artificial Intelligence and Simulation: The Diversity of Applications, ed. T. Hensen, Society for Computer Simulation, San Diego, CA, pp. 245-2250.

Google Scholar

[27]

Sargent, R. G. 1979. Validation of Simulation Models, Proc. of the 1979 Winter Simulation Conf., San Diego, CA, pp. 497-503.

Digital Library

Google Scholar

[28]

Sargent, R. G. 1981. An Assessment Procedure and a Set of Criteria for Use in the Evaluation of Computerized Models and Computer-Based Modelling Tools, Final Technical Report RADC-TR-80-409.

Google Scholar

[29]

Sargent, R. G. 1982. Verification and Validation of Simula-tion Models, Chapter IX in Progress in Modelling and Simulation, ed. F. E. Cellier, Academic Press, London, pp. 159-169.

Google Scholar

[30]

Sargent, R. G. 1984. Simulation Model Validation, Simula-tion and Model-Based Methodologies: An Integrative View, ed. Oren, et al., Springer-Verlag.

Google Scholar

[31]

Sargent, R. G. 1985. An Expository on Verification and Validation of Simulation Models, Proc. of the 1985 Winter Simulation Conf., pp. 15-22.

Digital Library

Google Scholar

[32]

Sargent, R. G. 1986. The Use of Graphic Models in Model Validation, Proc. of the 1986 Winter Simulation Conf., Washington, D.C., pp. 237-241.

Digital Library

Google Scholar

[33]

Sargent, R. G. 1988. A Tutorial on Validation and Veri-fication of Simulation Models, Proc. of 1988 Winter Simulation Conf., pp. 33-39.

Digital Library

Google Scholar

[34]

Sargent, R. G. 1990. Validation of Mathematical Mod-els, Proc. of Geoval-90: Symposium on Validation of Geosphere Flow and Transport Models, Stockholm, Sweden, pp. 571-579.

Google Scholar

[35]

Sargent, R. G. 1991. Simulation Model Verification and Val-idation, Proc. of 1991 Winter Simulation Conf., Phoenix, AZ, pp. 37-47.

Digital Library

Google Scholar

[36]

Sargent, R. G. 1994. Verification and Validation of Simu-lation Models, Proc. of 1994 Winter Simulation Conf., Lake Buena Vista, FL, pp. 77-87.

Digital Library

Google Scholar

[37]

Sargent, R. G. 1996a. Some Subjective Validation Methods Using Graphical Displays of Data, Proc. of 1996 Winter Simulation Conf., pp. 345-351.

Digital Library

Google Scholar

[38]

Sargent, R. G. 1996b. Verifying and Validating Simulation Models, Proc. of 1996 Winter Simulation Conf., pp. 55-64.

Digital Library

Google Scholar

[39]

Sargent, R. G. 1998. Verification and Validation of Simu-lation Models, Proc. of 1998 Winter Simulation Conf., pp. 121-130.

Digital Library

Google Scholar

[40]

Schlesinger, et al. 1979. Terminology for Model Credibility, Simulation, 32, 3~ pp. 103-104.

Crossref

Google Scholar

[41]

Schruben, L. W. 1980. Establishing the Credibility of Simulations, Simulation, 34, 3, pp. 101-105.

Crossref

Google Scholar

[42]

Shannon, R. E. 1975. Systems Simulation: The Art and the Science, Prentice-Hall.

Google Scholar

[43]

Whitner, R. B. and O. Balci. 1989. Guidelines for Selecting and Using Simulation Model Verification Techniques, Proc. of 1989 Winter Simulation Conf., Washington, D.C., pp. 559-568.

Digital Library

Google Scholar

[44]

Wood, D. O. 1986. MIT Model Analysis Program: What We Have Learned About Policy Model Review, Proc. of the 1986 Winter Simulation Conf., Washington, D.C., pp. 248-252.

Digital Library

Google Scholar

[45]

Zeigler, B. P. 1976. Theory of Modelling and Simulation, John Wiley and Sons, Inc., New York.

Digital Library

Google Scholar

Cited By

View all

Hua ELazarova-Molnar SFrancis D(2022)Validation of Digital TwinsProceedings of the Winter Simulation Conference10.5555/3586210.3586454(2900-2911)Online publication date: 11-Dec-2022
https://dl.acm.org/doi/10.5555/3586210.3586454
Krishnan PSmith ARopella GDutta LKennedy RHunt C(2022)Utilizing virtual experiments to increase understanding of discrepancies involving in vitro-to-in vivo predictions of hepatic clearancePLOS ONE10.1371/journal.pone.026977517:7(e0269775)Online publication date: 22-Jul-2022
https://doi.org/10.1371/journal.pone.0269775
Michael Griffel LToba APaudel RLin YHartley DLangholtz M(2022)A multi-criteria land suitability assessment of field allocation decisions for switchgrassEcological Indicators10.1016/j.ecolind.2022.108617136(108617)Online publication date: Mar-2022
https://doi.org/10.1016/j.ecolind.2022.108617
Show More Cited By

Index Terms

Validation and verification of simulation models
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation
2. General and reference
  1. Document types
    1. Surveys and overviews

Recommendations

Verification, validation, and accreditation of simulation models
Applied system simulation

This chapter discusses the role of verification and validation in determining simulation correctness and establishing the credibility that should be given to simulation results. The primary function of verification and validation is to reduce the risk ...
Verification and validation (V&V) of BOM-based HLA simulation system
SCSC '08: Proceedings of the 2008 Summer Computer Simulation Conference

One of the aims of HLA (high level architecture) is taking full advantage of interoperability and reuse for federation, but the reusability is limited in the HLA simulation system developed by traditional method, and the development efficiency is lower.
...
Verification, Validation and Accreditation of HLA-based Military Modeling and Simulation
ICEICE '12: Proceedings of the 2012 Second International Conference on Electric Information and Control Engineering - Volume 02

Increasingly, Modeling and Simulations (M&S) based High Level Architecture (HLA) are being exploited as an enabling technology to support tactical, operational and strategic objectives and shape decision-making within the military domain. In this paper ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

WSC '99: Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future - Volume 1

December 1999

925 pages

ISBN:0780357809

DOI:10.1145/324138

Editors:
Phillip A. Farrington
Univ. of Alabama in Huntsville, Huntsville
,
Harriet Black Nembhard
Univ. of Wisconsin—Madison, Madison
,
David T. Sturrock
Systems Modeling, Sewickley, PA
,
Gerald W. Evans
Univ. of Louisville, Louisville, KY

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

WSC99

Sponsor:

WSC99: Winter Simulation Conference 1999

December 5 - 8, 1999

Arizona, Phoenix, USA

Acceptance Rates

WSC '99 Paper Acceptance Rate 139 of 206 submissions, 67%;

Overall Acceptance Rate 3,413 of 5,075 submissions, 67%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

85
Total Citations
View Citations
865
Total Downloads

Downloads (Last 12 months)148
Downloads (Last 6 weeks)4

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hua ELazarova-Molnar SFrancis D(2022)Validation of Digital TwinsProceedings of the Winter Simulation Conference10.5555/3586210.3586454(2900-2911)Online publication date: 11-Dec-2022
https://dl.acm.org/doi/10.5555/3586210.3586454
Krishnan PSmith ARopella GDutta LKennedy RHunt C(2022)Utilizing virtual experiments to increase understanding of discrepancies involving in vitro-to-in vivo predictions of hepatic clearancePLOS ONE10.1371/journal.pone.026977517:7(e0269775)Online publication date: 22-Jul-2022
https://doi.org/10.1371/journal.pone.0269775
Michael Griffel LToba APaudel RLin YHartley DLangholtz M(2022)A multi-criteria land suitability assessment of field allocation decisions for switchgrassEcological Indicators10.1016/j.ecolind.2022.108617136(108617)Online publication date: Mar-2022
https://doi.org/10.1016/j.ecolind.2022.108617
Ramachandran RKularathna AMatsuda HTakagi K(2021)Information flow to increase support for tidal energy development in remote islands of a developing country: agent-based simulation of information flow in Flores Timur Regency, IndonesiaEnergy, Sustainability and Society10.1186/s13705-021-00302-811:1Online publication date: 21-Jul-2021
https://doi.org/10.1186/s13705-021-00302-8
Gee IFaust KWebber M(2021)A framework for determining energy use in rural food delivery services: capturing system interdependencies through an agent-based discrete-event approachEnvironmental Research: Infrastructure and Sustainability10.1088/2634-4505/ac2b101:3(035002)Online publication date: 9-Nov-2021
https://doi.org/10.1088/2634-4505/ac2b10
de França BAli N(2020)The Role of Simulation-Based Studies in Software Engineering ResearchContemporary Empirical Methods in Software Engineering10.1007/978-3-030-32489-6_10(263-287)Online publication date: 28-Aug-2020
https://doi.org/10.1007/978-3-030-32489-6_10
Lucio-Alonso MMendoza-González RLuna-García HMaldonado-Morales ZRodríguez-Díaz MLuna-Rosas FFardoun HPérez SHassan Ade la Guia E(2019)A first version of design guidelines for virtual environments to support physical rehabilitationProceedings of the 5th Workshop on ICTs for improving Patients Rehabilitation Research Techniques10.1145/3364138.3364171(157-161)Online publication date: 11-Sep-2019
https://dl.acm.org/doi/10.1145/3364138.3364171
Chan TMihm JSosa M(2018)On Styles in Product DesignManagement Science10.1287/mnsc.2016.265364:3(1230-1249)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1287/mnsc.2016.2653
Salvadori S(2018)Uncertainty Quantification in CFD: The Matrix of KnowledgeUncertainty Quantification in Computational Fluid Dynamics and Aircraft Engines10.1007/978-3-319-92943-9_2(33-66)Online publication date: 22-Jun-2018
https://doi.org/10.1007/978-3-319-92943-9_2
Zhang XZou LHuschka TChick S(2016)Simulation metamodeling in the presence of model inadequacyProceedings of the 2016 Winter Simulation Conference10.5555/3042094.3042178(566-577)Online publication date: 11-Dec-2016
https://dl.acm.org/doi/10.5555/3042094.3042178
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Verification, validation, and accreditation of simulation models

Verification and validation (V&V) of BOM-based HLA simulation system

Verification, Validation and Accreditation of HLA-based Military Modeling and Simulation