Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
Top Cited Papers
Open Access
- 1 August 2004
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 32 (4) , 1594-1649
- https://doi.org/10.1214/009053604000000030
Abstract
An empirical Bayes approach to the estimation of possibly sparse sequences observed in Gaussian white noise is set out and investigated. The prior considered is a mixture of an atom of probability at zero and a heavy-tailed density \gamma, with the mixing weight chosen by marginal maximum likelihood, in the hope of adapting between sparse and dense sequences. If estimation is then carried out using the posterior median, this is a random thresholding procedure. Other thresholding rules employing the same threshold can also be used. Probability bounds on the threshold chosen by the marginal maximum likelihood approach lead to overall risk bounds over classes of signal sequences of length n, allowing for sparsity of various kinds and degrees. The signal classes considered are ``nearly black'' sequences where only a proportion \eta is allowed to be nonzero, and sequences with normalized \ell_p norm bounded by \eta, for \eta >0 and 01. Simulations show excellent performance.Comment: Published by the Institute of Mathematical Statistics (http://www.imstat.org) in the Annals of Statistics (http://www.imstat.org/aos/) at http://dx.doi.org/10.1214/00905360400000003Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Adapting to unknown sparsity by controlling the false discovery rateThe Annals of Statistics, 2006
- Empirical Bayes selection of wavelet thresholdsThe Annals of Statistics, 2005
- General empirical Bayes wavelet methods and exactly adaptive minimax estimationThe Annals of Statistics, 2005
- Calibration and empirical Bayes variable selectionBiometrika, 2000
- Wavelet decomposition approaches to statistical inverse problemsBiometrika, 1998
- Adapting to Unknown Smoothness via Wavelet ShrinkageJournal of the American Statistical Association, 1995
- Minimax risk overl p -balls forl p -errorProbability Theory and Related Fields, 1994
- Convergence of Stochastic ProcessesPublished by Springer Nature ,1984
- Variation Diminishing Transformations: A Direct Approach to Total Positivity and its Statistical ApplicationsJournal of the American Statistical Association, 1981
- Estimation of the Mean of a Multivariate Normal DistributionThe Annals of Statistics, 1981