General empirical Bayes wavelet methods and exactly adaptive minimax estimation
Open Access
- 1 February 2005
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 33 (1) , 54-100
- https://doi.org/10.1214/009053604000000995
Abstract
In many statistical problems, stochastic signals can be represented as a sequence of noisy wavelet coefficients. In this paper, we develop general empirical Bayes methods for the estimation of true signal. Our estimators approximate certain oracle separable rules and achieve adaptation to ideal risks and exact minimax risks in broad collections of classes of signals. In particular, our estimators are uniformly adaptive to the minimum risk of separable estimators and the exact minimax risks simultaneously in Besov balls of all smoothness and shape indices, and they are uniformly superefficient in convergence rates in all compact sets in Besov spaces with a finite secondary shape parameter. Furthermore, in classes nested between Besov balls of the same smoothness index, our estimators dominate threshold and James-Stein estimators within an infinitesimal fraction of the minimax risks. More general block empirical Bayes estimators are developed. Both white noise with drift and nonparametric regression are considered.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- Sharp adaptation for inverse problems with random noiseProbability Theory and Related Fields, 2002
- Asymptotic equivalence for nonparametric generalized linear modelsProbability Theory and Related Fields, 1998
- Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectorsThe Annals of Statistics, 1997
- Adapting to Unknown Smoothness via Wavelet ShrinkageJournal of the American Statistical Association, 1995
- Formulae for Mean Integrated Squared Error of Nonlinear Wavelet-Based Density EstimatorsThe Annals of Statistics, 1995
- Minimax risk overl p -balls forl p -errorProbability Theory and Related Fields, 1994
- The Use of Polynomial Splines and Their Tensor Products in Multivariate Function EstimationThe Annals of Statistics, 1994
- Flexible Parsimonious Smoothing and Additive ModelingTechnometrics, 1989
- Estimation of the Mean of a Multivariate Normal DistributionThe Annals of Statistics, 1981
- Stein's Estimation Rule and its Competitors—An Empirical Bayes ApproachJournal of the American Statistical Association, 1973