Constructing optimal fuzzy models using statistical information criteria

Theoretical studies have shown that fuzzy models are capable of approximati ng any continuous function on a compact domain to any degree of accuracy. H owever, good performance in approximation does not necessarily assure good performance in prediction or control. A fuzzy model with a large number of fuzzy rules may have a low accuracy of estimation for the unknown parameter s. This is especially true when only limited sample data are available in b uilding the model. Further, such a model often encounters the risk of overf itting the data and thus has a poor ability of generalization. A trade-off is thus required in building a fuzzy model: on the one hand, the number of fuzzy rules must be sufficient to provide the discriminating capability req uired for the given application; on the other hand, the number of fuzzy rul es must be "parsimonious" to guarantee a reasonable accuracy of parameter e stimation and a good ability of generalizing to unknown patterns. In this p aper we apply statistical information criteria for achieving such a trade-o ff. In particular, we combine these criteria with an SVD (singular value de composition) based fuzzy rule selection method to choose the optimal number of fuzzy rules and construct the "best" fuzzy model. The role of these cri teria in fuzzy modeling is discussed and their practical applicability is i llustrated using a nonlinear system modeling example.