An empirical study of regression test selection techniques
Top Cited Papers
- 1 April 2001
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 10 (2) , 184-208
- https://doi.org/10.1145/367008.367020
Abstract
Regression testing is the process of validating modified software to detect whether new errors have been introduced into previously tested code and to provide confidence that modifications are correct. Since regression testing is an expensive process, researchers have proposed regression test selection techniques as a way to reduce some of this expense. These techniques attempt to reduce costs by selecting and running only a subset of the test cases in a program's existing test suite. Although there have been some analytical and empirical evaluations of individual techniques, to our knowledge only one comparative study, focusing on one aspect of two of these techniques, has been reported in the literature. We conducted an experiment to examine the relative costs and benefits of several regression test selection techniques. The experiment examined five techniques for reusing test cases, focusing on their relative ablilities to reduce regression testing effort and uncover faults in modified programs. Our results highlight several differences between the techiques, and expose essential trade-offs that should be considered when choosing a technique for practical application.Keywords
This publication has 11 references indexed in Scilit:
- Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteriaPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- TESTTUBE: a system for selective regression testingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Empirical studies of a safe regression test selection techniqueIEEE Transactions on Software Engineering, 1998
- A safe, efficient regression test selection techniqueACM Transactions on Software Engineering and Methodology, 1997
- Using coverage information to predict the cost-effectiveness of regression testing strategiesIEEE Transactions on Software Engineering, 1997
- Pythia: A regression test selection tool based on textual differencingPublished by Springer Nature ,1997
- Analyzing regression test selection techniquesIEEE Transactions on Software Engineering, 1996
- Techniques for selective revalidationIEEE Software, 1990
- Automatic generation of test scripts from formal test specificationsPublished by Association for Computing Machinery (ACM) ,1989
- The category-partition method for specifying and generating fuctional testsCommunications of the ACM, 1988