Knowledge-based systems' validation: when to stop running test cases

One of the unsettled problems in knowledge engineering and, particularly, i n the held of validation is to determine when the validation process of a k nowledge-based system is complete. Some hints are given in the literature, but little, if any, work has been done on how to address this problem from an analytical viewpoint. In this paper, the validation field is briefly sur veyed, and we take a look at what the validation process should consist of. Then, an analytical model is proposed for obtaining the optimum number of test cases for validating the knowledge-based system under study. This math ematical model takes into account the v-type (knowledge-based system classe d according to the validation process) defined in this paper, the expected degree of confidence in the validation process and previous results from si milar knowledge-based system validation processes. It should be mentioned h ere that a theoretical result is given to solve eminently practical problem , a rare occurrence in the held of artificial intelligence as a whole and e specially in knowledge engineering. (C) 1999 Academic Press.