An apparent simplicity appearing in pattern classification problems

An apparent simplicity appearing in the classification problems is describe d in order to assert the importance of the feature selection. If we assume that the sample size is finite, then, by increasing the number of features used to describe each sample pattern, we can improve the interclass disting uishability. On the other hand, increasing the number of features reduces t he generality of class descriptions. Therefore, the enhanced distinguishabi lity may be an apparent simplicity appearing in the interclass structure. W e illustrate theoretically and experimentally the existence of the trade-of f between the interclass distinguishability and the generality of class des criptions. (C) 2000 Pattern Recognition Society. Published by Elsevier Scie nce Ltd. All rights reserved.