Pattern discovery by residual analysis and recursive partitioning

Authors
Citation
T. Chau et Akc. Wong, Pattern discovery by residual analysis and recursive partitioning, IEEE KNOWL, 11(6), 1999, pp. 833-852
Citations number
48
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING
ISSN journal
10414347 → ACNP
Volume
11
Issue
6
Year of publication
1999
Pages
833 - 852
Database
ISI
SICI code
1041-4347(199911/12)11:6<833:PDBRAA>2.0.ZU;2-P
Abstract
In this paper, a novel method of pattern discovery is proposed. It is based on the theoretical formulation of a contingency table of events. Using res idual analysis and recursive partitioning, statistically significant events are identified in a data set. These events constitute the important inform ation contained in the data set and are easily interpretable as simple rule s, contour plots, or parallel axes plots. In addition, an informative proba bilistic description of the data is automatically furnished by the discover y process. Following a theoretical formulation, experiments with real and s imulated data will demonstrate the ability to discover subtle patterns amid noise, the invariance to changes of scale, cluster detection, and discover y of multidimensional patterns. It is shown that the pattern discovery meth od offers the advantages of easy interpretation, rapid training, and tolera nce to noncentralized noise.