Local asymptotic coding and the minimum description length

Citation
Dp. Foster et Ra. Stine, Local asymptotic coding and the minimum description length, IEEE INFO T, 45(4), 1999, pp. 1289-1293
Citations number
9
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
45
Issue
4
Year of publication
1999
Pages
1289 - 1293
Database
ISI
SICI code
0018-9448(199905)45:4<1289:LACATM>2.0.ZU;2-Q
Abstract
Local asymptotic arguments imply that parameter selection via the minimum d escription length (MDL) resembles a traditional hypothesis test, A common a pproximation for MDL estimates the cost of adding a parameter at about (1/2 )log n bits for a model fit to n observations, While accurate for parameter s which are large on a standardized scale, this approximation overstates th e parameter cost near zero, We find that encoding the parameter produces a shorter description length when the corresponding estimator is about two st andard errors away from zero, as in a traditional statistical hypothesis te st.