How to measure the information gained from one symbol

Citation
Mr. Deweese et M. Meister, How to measure the information gained from one symbol, NETWORK-COM, 10(4), 1999, pp. 325-340
Citations number
33
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
NETWORK-COMPUTATION IN NEURAL SYSTEMS
ISSN journal
0954898X → ACNP
Volume
10
Issue
4
Year of publication
1999
Pages
325 - 340
Database
ISI
SICI code
0954-898X(199911)10:4<325:HTMTIG>2.0.ZU;2-7
Abstract
Information theory provides a powerful framework to analyse how neurons rep resent sensory stimuli or other behavioural variables. A recurring question regards the amount of information conveyed by a specific neuronal response . Here we show that the commonly used definition for this quantity has a se rious flaw: the information accumulated during subsequent observations of n eural activity fails to combine additively. Additivity is a highly desirabl e property, both on theoretical grounds and for the practical purpose of an alysing population codes. We propose an alternative measure for the informa tion per observation and prove that this is the only definition that satisf ies additivity. The old and the new definitions measure very different aspe cts of the neural code, which is illustrated with visual responses from a m otion-sensitive neuron in the primate cortex. Our analysis allows additiona l interpretation of several published results, which suggests that the neur ons studied are operating far from their information capacity.