An important question in software testing is whether it is reasonable to ap
ply coverage-based criteria as a filter to reduce the size of a test set. A
n empirical study was conducted using a test set minimization technique to
explore the effect of reducing the size of a test set, while keeping block
coverage constant, on the fault detection strength of the resulting minimiz
ed test set. Two types of test sets were examined. For those with respect t
o a fixed size, no test case screening was conducted during the generation,
whereas for those with respect to a fixed coverage, each subsequent test c
ase had to improve the overall coverage in order to be included. The study
reveals that regardless of how a test set is generated, with or without any
test case screening, block minimized test sets have a size/effectiveness a
dvantage, in terms of a significant reduction in test set size and with alm
ost the same fault detection effectiveness, over the original non-minimized
test sets. (C) 1999 Elsevier Science Inc. All rights reserved.