Can recent innovations in harmonic analysis 'explain' key findings in natural image statistics?

Citation
Dl. Donoho et Ag. Flesia, Can recent innovations in harmonic analysis 'explain' key findings in natural image statistics?, NETWORK-COM, 12(3), 2001, pp. 371-393
Citations number
34
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
NETWORK-COMPUTATION IN NEURAL SYSTEMS
ISSN journal
0954898X → ACNP
Volume
12
Issue
3
Year of publication
2001
Pages
371 - 393
Database
ISI
SICI code
0954-898X(200108)12:3<371:CRIIHA>2.0.ZU;2-R
Abstract
Recently, applied mathematicians have been pursuing the goal of sparse codi ng of certain mathematical models of images with edges. They have found by mathematical analysis that, instead of wavelets and Fourier methods, sparse coding leads towards new systems: ridgelets and curvelets. These new syste ms have elements distributed across a range of scales and locations, but al so orientations. In fact they have highly direction-specific elements and e xhibit increasing numbers of distinct directions as we go to successively f iner scales. Meanwhile, researchers in natural scene statistics (NSS) have been attempti ng to find sparse codes for natural images. The new systems they have found by computational optimization have elements distributed across a range of scales and locations, but also orientations. The new systems are certainly unlike wavelet and Gabor systems, on the one hand because of the multi-orie ntation and on the other hand because of the multi-scale nature. There is a certain degree of visual resemblance between the findings in the two fields, which suggests the hypothesis that certain important findings in the NSS literature might possibly be explained by the slogan: edges are the dominant features in images, and curvelets are the right tool for repre senting edges. We consider here certain empirical consequences of this hypothesis, looking at key findings of the NSS literature and conducting studies of curvelet a nd ridgelet transforms on synthetic and real images, to see if the results are consistent with predictions from this slogan. Our first experiment measures the nonGaussianity of Fourier, wavelet, ridge let and curvelet coefficients over a database of synthetic and photographic images. Empirically the curvelet coefficients exhibit noticeably higher ku rtosis than wavelet, ridgelet, or Fourier coefficients. This is consistent with the hypothesis. Our second experiment studies the inter-scale correlation of wavelet coeffi cient energies at the same location. We describe a simple experiment showin g that presence of edges explains these correlations. We also develop a cru de nonlinear 'partial correlation' by considering the correlation between w avelet parents and children after a few curvelet coefficients are removed. When we kill the few biggest coefficients of the curvelet transform, much o f the correlation between wavelet subbands disappears-consistent with the h ypothesis. We suggest implications for future discussions about NSS.