Wavelet Shrinkage: Asymptopia?
- 1 July 1995
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 57 (2) , 301-337
- https://doi.org/10.1111/j.2517-6161.1995.tb02032.x
Abstract
Much recent effort has sought asymptotically minimax methods for recovering infinite dimensional objects—curves, densities, spectral densities, images—from noisy data. A now rich and complex body of work develops nearly or exactly minimax estimators for an array of interesting problems. Unfortunately, the results have rarely moved into practice, for a variety of reasons—among them being similarity to known methods, computational intractability and lack of spatial adaptivity. We discuss a method for curve estimation based on n noisy data: translate the empirical wavelet coefficients towards the origin by an amount √(2 log n)σ/√n. The proposal differs from those in current use, is computationally practical and is spatially adaptive; it thus avoids several of the previous objections. Further, the method is nearly minimax both for a wide variety of loss functions—pointwise error, global error measured in Lp‐norms, pointwise and global error in estimation of derivatives—and for a wide range of smoothness classes, including standard Holder and Sobolev classes, and bounded variation. This is a much broader near optimality than anything previously proposed: we draw loose parallels with near optimality in robustness and also with the broad near eigenfunction properties of wavelets themselves. Finally, the theory underlying the method is interesting, as it exploits a correspondence between statistical questions and questions of optimal recovery and information‐based complexity.Keywords
This publication has 39 references indexed in Scilit:
- Adapting to Unknown Smoothness via Wavelet ShrinkageJournal of the American Statistical Association, 1995
- Asymptotic minimax risk for sup-norm loss: Solution via optimal recoveryProbability Theory and Related Fields, 1994
- Locally Adaptive Bandwidth Choice for Kernel Regression EstimatorsJournal of the American Statistical Association, 1993
- The Grenader Estimator: A Nonasymptotic ApproachThe Annals of Statistics, 1989
- Flexible Parsimonious Smoothing and Additive ModelingTechnometrics, 1989
- One-Sided Inference about Functionals of a DensityThe Annals of Statistics, 1988
- Ondelettes et bases hilbertiennesRevista Matemática Iberoamericana, 1986
- Density Estimation and Bump-Hunting by the Penalized Likelihood Method Exemplified by Scattering and Meteorite DataJournal of the American Statistical Association, 1980
- Variable Kernel Estimates of Multivariate DensitiesTechnometrics, 1977
- Minimax Estimates of the Mean of a Normal Distribution with Known VarianceThe Annals of Mathematical Statistics, 1950