Estimating the number of undetected errors: Bayesian model selection
- 27 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Sometimes complex software systems fail because of faults introduced in the requirements and design stages of the development process. To improve the reliability of a software, several reviewers inspect documents related to requirements and design. Some faults are detected in this process but often a few remain undetected until the software is developed. Ebrahimi (1997) developed frequentist methods to estimate the number of faults which are nor discovered. Later, Basu and Ebrahimi and Basu developed different Bayesian models. These different Bayesian models yield different estimates of the number of undetected errors. It was further found that changes in the prior parameters often result in measurable changes in the estimates of undetected errors. The authors address the issue of model selection among these different models. They advocate two model selection methods. The first method uses marginal likelihood and Bayes factor whereas the second method is based on cross-validated likelihood. These methods are illustrated in the software review data of AT&T 5 ESS switches.Keywords
This publication has 7 references indexed in Scilit:
- BAYESIAN ESTIMATION OF THE NUMBER OF UNDETECTED ERRORS WHEN BOTH REVIEWERS AND ERRORS ARE HETEROGENEOUSPublished by World Scientific Pub Co Pte Ltd ,1998
- On the statistical analysis of the number of errors remaining in a software design document after inspectionIEEE Transactions on Software Engineering, 1997
- Marginal Likelihood from the Gibbs OutputJournal of the American Statistical Association, 1995
- Bayes FactorsJournal of the American Statistical Association, 1995
- Assessing software designs using capture-recapture methodsIEEE Transactions on Software Engineering, 1993
- Capture-Recapture Estimation Via Gibbs SamplingBiometrika, 1992
- Estimation of the Size of a Closed Population when Capture Probabilities vary Among AnimalsBiometrika, 1978