On system identification of complex systems from finite data

System identification deals with computation of mathematical models from an a priori chosen model-class, for an unknown system from finite noisy data, The popular maximum-likelihood principle is based on picking a model from a chosen model-parameterization that maximizes the likelihood of the data. Most other principles including set-membership identification can be though t of as extensions of this principle in so far as the concept of choosing a model to fit the data is concerned. Although these principles have been ex tremely successful in addressing several problems in identification and con trol, they have not been completely effective in addressing the question of identification in the context of uncertainty in the model class/parameteri zation. We introduce a new principle for identification in this paper. The principle is based on choosing a model from the model-parameterization whic h best approximates the unknown real system belonging to a more complex spa ce of systems which do not lend themselves to a finite-parameterization. Th e principle is particularly effective for robust control as it leads to a p recise notion of parametric and nonparametric error and the identification problem can he equivalently perceived as that of robust convergence of the parameters in the Face of unmodeled errors. The main difficulty in its appl ication stems from the interplay of noise and unmodeled dynamics and requir es developing novel two-step algorithms that amount to annihilation of the unmodeled error followed by averaging out the noise. The principle contribu tions of the paper are in establishing: 1) robust convergence for a large c lass of systems, topologies, and unmodeled errors; 2) sample path based fin ite-time polynomial rate of convergence; and 3) annihilation-correlation al gorithms, for linearly parameterized model structures, thus, illustrating s ignificant improvements over prediction-error and set-membership approaches .