A methodological framework for the validation of predictive simulations
European Journal of Operational ResearchPublished 1 July 2000
Doug Fraedrich, Allen J. Goldberg
Citations47
SJR quartileQ1
SJR score2.24
SNIP2.62
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A methodological framework for the validation of predictive simulations that synthesizes concepts from the fields of Conventional Model Verification and Validation, Testing of Scientific Theories, Design of Experiments, Error/Sensitivity, and Statistical Exploratory Data Analysis is presented.
Abstract
This paper presents a methodological framework for the validation of predictive simulations that synthesizes concepts from the fields of Conventional Model Verification and Validation, Testing of Scientific Theories, Design of Experiments, Error/Sensitivity, and Statistical Exploratory Data Analysis. This framework presents validation as a five-phase process that starts with the often overlooked phase `Is the simulation subject to validation?'. The remaining phases are: a priori tests, design and execution of experiment, comparison with predictions, and lastly simulation improvement.
Keywords
Decision Sciences
An Introduction to the Bootstrap
39,744 Citations1994Bradley Efron, Robert Tibshirani
Cambridge University Press eBooksFalsification and the Methodology of Scientific Research Programmes
4,344 Citations1970И. Лакатос
TechnometricsOptimum Experimental Designs
1,465 Citations1993Robert E. Wheeler, Anthony C. Atkinson +1 more
This book discusses experiments with both qualitative and quantitative factors, and the choice of a model and criteria for a good experiment, as well as the analysis of experiments.
European Journal of Operational ResearchVerification and validation of simulation models
712 Citations1995J.P.C. Kleijnen
This paper surveys verification and validation of models, especially simulation models in operations research, and discusses general good programming practice (such as modular programming), and checking intermediate simulation outputs through tracing and statistical testing per module.
Error and the Growth of Experimental Knowledge
699 Citations1996Deborah G. Mayo
Springer texts in statisticsBasic Principles of Structural Equation Modeling
579 Citations1996Ralph O. Mueller
Management ScienceVerification of Computer Simulation Models
429 Citations1967Thomas H. Naylor, J. Michael Finger
The problem of validating computer simulation models of industrial systems has received only limited attention in the management science literature, so the writings of economists who have been concerned with testing the validity of economic models are considered.
SIMULATIONTerminology for model credibility
409 Citations1979
The standard set of terminology herein described was compiled by the SCS Technical Committee on Model Credibility as a report to the general membership.
System Dynamics ReviewPhilosophical roots of model validation: Two paradigms
269 Citations1990Yaman Barlas, Stanley R. Carpenter
It is shown that relativist philosophy is consistent with the system dynamics paradigm and the practical implications of the two philosophies of science for system dynamics modelers and their critics are discussed.
European Journal of Operational ResearchSearching for important factors in simulation models with many factors: Sequential bifurcation
236 Citations1997B.W.M. Bettonvil, J.P.C. Kleijnen
The screening problem by a novel technique called ‘sequential bifurcation’, which identifies some factors as being important that the ecological experts initially thought to be unimportant.
Journal of the Franklin InstituteScientific method: Optimizing applied research decisions
232 Citations1962
Medical Entomology and ZoologyMeasurement Errors: Theory and Practice
123 Citations1994Semyon G. Rabinovich
General knowledge about measurements measuring-instruments and their characteristics random and systematic errors statistical methods of observation results processing direct measurements indirect measurements measurements in closed series composing measurement results calculation of errors of measuring instruments and systems simple calibration problems.
Winter Simulation ConferenceA tutorial on verification and validation of simulation models (1984)
84 Citations1984Robert G. Sargent
Journal of Theoretical BiologySensitivity analysis and validation of simulation models
65 Citations1974Donald R. Miller
European Journal of Operational ResearchRevisiting the issue of model validation in OR: An epistemological view
56 Citations1993Richard Déry, Maurice Landry +1 more
System Dynamics ReviewEfficient methods for sensitivity analysis
49 Citations1995Barry Clemson, Yongming Tang +2 more
Winter Simulation ConferenceTests for the verification and validation of computer simulation models
39 Citations1981Robert E. Shannon
This paper discusses the quantitative as well as qualitative tests which can be run in trying to convince the user of a simulation model that the results are valid.
Statistical ScienceOMEGA (Online Multivariate Exploratory Graphical Analysis): Routine Searching for Structure
23 Citations1990Claus Weihs, Heinz Schmidli
A strategy for online multivariate exploratory graphical analysis is presented and illustrated, motivated by the need for a routine procedure for searching for structure in multivariate data sets arising in the context of a major pharmaceutical, dyestuffs and agrochemical company.