Active Nonlinear Tests (ANTs) of Complex Simulation Models
- 1 June 1998
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 44 (6) , 820-830
- https://doi.org/10.1287/mnsc.44.6.820
Abstract
Simulation models are becoming increasingly common in the analysis of critical scientific, policy, and management issues. Such models provide a way to analyze complex systems characterized by both large parameter spaces and nonlinear interactions. Unfortunately, these same characteristics make understanding such models using traditional testing techniques extremely difficult. Here we show how a model's structure and robustness can be validated via a simple, automatic, nonlinear search algorithm designed to actively “break” the model's implications. Using the active nonlinear tests (ANTs) developed here, one can easily probe for key weaknesses in a simulation's structure, and thereby begin to improve and refine its design. We demonstrate ANTs by testing a well-known model of global dynamics (World3), and show how this technique can be used to uncover small, but powerful, nonlinear effects that may highlight vulnerabilities in the original model.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Exploratory Modeling for Policy AnalysisOperations Research, 1993
- A Unified View of the IPA, SF, and LR Gradient Estimation TechniquesManagement Science, 1990
- UncertaintyPublished by Cambridge University Press (CUP) ,1990
- The Annealing AlgorithmPublished by Springer Nature ,1989
- An Investigation of Uncertainty and Sensitivity Analysis Techniques for Computer ModelsRisk Analysis, 1988
- The debate on World Dynamics: A response to NordhausPolicy Sciences, 1974