Universality in polytope phase transitions and message passing algorithms

Citation
Bayati, Mohsen et al., Universality in polytope phase transitions and message passing algorithms, Annals of applied probability , 25(2), 2015, pp. 753-822
ISSN journal
10505164
Volume
25
Issue
2
Year of publication
2015
Pages
753 - 822
Database
ACNP
SICI code
Abstract
We consider a class of nonlinear mappings FA,N in RN indexed by symmetric random matrices A.RN.N with independent entries. Within spin glass theory, special cases of these mappings correspond to iterating the TAP equations and were studied by Bolthausen [Comm. Math. Phys. 325 (2014) 333.366]. Within information theory, they are known as .approximate message passing. algorithms. We study the high-dimensional (large N ) behavior of the iterates of F for polynomial functions F, and prove that it is universal; that is, it depends only on the first two moments of the entries of A, under a sub-Gaussian tail condition. As an application, we prove the universality of a certain phase transition arising in polytope geometry and compressed sensing. This solves, for a broad class of random projections, a conjecture by David Donoho and Jared Tanner.