Sensitivity analysis and related analyses: A review of some statistical techniques
- 1 April 1997
- journal article
- review article
- Published by Taylor & Francis in Journal of Statistical Computation and Simulation
- Vol. 57 (1-4) , 111-142
- https://doi.org/10.1080/00949659708811805
Abstract
This paper reviews five related types of analysis, namely (i) sensitivity or what-if analysis, (ii) uncertainty or risk analysis, (iii) screening, (iv) validation, and (v) optimization. The main questions are: when should which type of analysis be applied; which statistical techniques may then be used? This paper claims that the proper sequence to follow in the evaluation of simulation models is as follows. 1) Validation, in which the availability of data on the real system determines which type of statistical technique to use for validation. 2) Screening: in the simulation‘s pilot phase the really important inputs can be identified through a novel technique, called sequential bifurcation, which uses aggregation and sequential experimentation. 3) Sensitivity analysis: the really important inputs should be subjected to a more detailed analysis, which includes interactions between these inputs; relevant statistical techniques are design of experiments (DOE) and regression analysis. 4) Uncertainty analysis: the important environmental inputs may have values that are not precisely known, so the uncertainties of the model outputs that result from the uncertainties in these model inputs should be quantified; relevant techniques are the Monte Carlo method and Latin hypercube sampling. 5) Optimization: the policy variables should be controlled; a relevant technique is Response Surface Methodology (RSM), which combines DOE, regression analysis, and steepest-ascent hill-climbing. The recommended sequence implies that sensitivity analysis procede uncertainty analysis. Several case studies for each phase are briefly discussed in this paper.Keywords
This publication has 40 references indexed in Scilit:
- PrefaceExpert Systems with Applications, 1995
- Sensitivity and uncertainty analysis of Markov-reward modelsIEEE Transactions on Reliability, 1995
- Calculation of reactor accident safety goalsReliability Engineering & System Safety, 1993
- Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposalReliability Engineering & System Safety, 1993
- Optimization of multivariate simulation output models using a group screening methodComputers & Industrial Engineering, 1990
- Design and Analysis of Computer ExperimentsStatistical Science, 1989
- Two-stage factor screening procedures using multiple grouping assignmentsCommunications in Statistics - Theory and Methods, 1987
- Response to Robert G. EasterlingTechnometrics, 1986
- Discussion of Downing, Gardner, and Hoffman (1985)Technometrics, 1986
- Multi‐variable experimentation and simulation modelsNaval Research Logistics Quarterly, 1962