Improving test suites via operational abstraction
- 1 January 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
This paper presents the operational difference technique for generating, augmenting, and minimizing test suites. The technique is analogous to structural code coverage techniques, but it operates in the semantic domain of program properties rather than the syntactic domain of program text. The operational difference technique automatically selects test cases; it assumes only the existence of a source of test cases. The technique dynamically generates operational abstractions (which describe observed behavior and are syntactically identical to formal specifications)from test suite executions. Test suites can be generated by adding cases until the operational abstraction stops changing. The resulting test suites are as small, and detect as many faults, as suites with 100% branch coverage, and are better at detecting certain common faults. This paper also presents the area and stacking techniques for comparing test suite generation strategies; these techniques avoid bias due to test suite size.Keywords
This publication has 32 references indexed in Scilit:
- An empirical study of regression test selection techniquesACM Transactions on Software Engineering and Methodology, 2001
- Erratum Correction to: Evaluating Testing Methods by Delivered ReliabilityIEEE Transactions on Software Engineering, 1999
- Empirical studies of a safe regression test selection techniqueIEEE Transactions on Software Engineering, 1998
- Evaluating testing methods by delivered reliability [software]IEEE Transactions on Software Engineering, 1998
- Software unit test coverage and adequacyACM Computing Surveys, 1997
- GENERATING TEST CASES FROM FORMAL SPECIFICATIONSINCOSE International Symposium, 1996
- Approaches to specification-based testingPublished by Association for Computing Machinery (ACM) ,1989
- Probable correctness theoryInformation Processing Letters, 1987
- Correction to "toward a theory of test data selection"IEEE Transactions on Software Engineering, 1975
- Toward a theory of test data selectionIEEE Transactions on Software Engineering, 1975