PRUDENT EXPERT-SYSTEMS WITH CREDENTIALS - MANAGING THE EXPERTISE OF DECISION-SUPPORT SYSTEMS

'Black box' expert systems (ES) are mistrusted by clinicians. Errors g enerated by medical ES are also a significant cause for concern. We re port new ES properties - prudence and credentials - that improve error management and underpin a new approach for improving the credibility of ES for clinical users. Prudent ES modify their output according to past experience. For a knowledge base built from 1610 cases, feature e xception prudence (FEP) detected all interpretation errors (100% sensi tivity for error detection). Although the false positive rate for FEP was high (47%), the 100% sensitivity meant that the 53% of cases that did not produce flags could be exempted from human validation. As more cases are processed, fewer cases should need human validation. Featur e recognition prudence (FRP), a property of ripple down rules (RDR), p roposed the correct alternative conclusion in 14% of incorrectly inter preted cases. Human expert validation of the flagged cases enabled con text-sensitive credentials (accuracy, incidence and specificity of a g iven conclusion) to accumulate. Credentials should enable the user to judge the credibility of the ES output. An error management strategy b ased on credentialled, prudent ES should reduce the impact of error in the clinical environment. The empowerment of clinicians to critically evaluate ES credibility may facilitate greater confidence in, and acc eptance of, ES by clinicians.