MUTUAL INFORMATION, FISHER INFORMATION, AND POPULATION CODING

Authors
Citation
N. Brunel et Jp. Nadal, MUTUAL INFORMATION, FISHER INFORMATION, AND POPULATION CODING, Neural computation, 10(7), 1998, pp. 1731-1757
Citations number
27
Categorie Soggetti
Computer Science Artificial Intelligence","Computer Science Artificial Intelligence
Journal title
ISSN journal
08997667
Volume
10
Issue
7
Year of publication
1998
Pages
1731 - 1757
Database
ISI
SICI code
0899-7667(1998)10:7<1731:MIFIAP>2.0.ZU;2-I
Abstract
In the context of parameter estimation and model selection, it is only quite recently that a direct link between the Fisher information and information-theoretic quantities has been exhibited. We give an interp retation of this link within the standard framework of information the ory. We show that in the context of population coding, the mutual info rmation between the activity of a large array of neurons and a stimulu s to which the neurons are tuned is naturally related to the Fisher in formation. In the light of this result, we consider the optimization o f the tuning curves parameters in the case of neurons responding to a stimulus represented by an angular variable.