Review Papers: Recent Developments in Nonparametric Density Estimation
- 1 March 1991
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 86 (413) , 205-224
- https://doi.org/10.1080/01621459.1991.10475021
Abstract
Advances in computation and the fast and cheap computational facilities now available to statisticians have had a significant impact upon statistical research, and especially the development of nonparametric data analysis procedures. In particular, theoretical and applied research on nonparametric density estimation has had a noticeable influence on related topics, such as nonparametric regression, nonparametric discrimination, and nonparametric pattern recognition. This article reviews recent developments in nonparametric density estimation and includes topics that have been omitted from review articles and books on the subject. The early density estimation methods, such as the histogram, kernel estimators, and orthogonal series estimators are still very popular, and recent research on them is described. Different types of restricted maximum likelihood density estimators, including order-restricted estimators, maximum penalized likelihood estimators, and sieve estimators, are discussed, where restrictions are imposed upon the class of densities or on the form of the likelihood function. Nonparametric density estimators that are data-adaptive and lead to locally smoothed estimators are also discussed; these include variable partition histograms, estimators based on statistically equivalent blocks, nearest-neighbor estimators, variable kernel estimators, and adaptive kernel estimators. For the multivariate case, extensions of methods of univariate density estimation are usually straightforward but can be computationally expensive. A method of multivariate density estimation that did not spring from a univariate generalization is described, namely, projection pursuit density estimation, in which both dimensionality reduction and density estimation can be pursued at the same time. Finally, some areas of related research are mentioned, such as nonparametric estimation of functionals of a density, robust parametric estimation, semiparametric models, and density estimation for censored and incomplete data, directional and spherical data, and density estimation for dependent sequences of observations.Keywords
This publication has 184 references indexed in Scilit:
- Biased and Unbiased Cross-Validation in Density EstimationJournal of the American Statistical Association, 1987
- Minimum Hellinger Distance Estimation for the Analysis of Count DataJournal of the American Statistical Association, 1987
- The Selection of Terms in an Orthogonal Series Density EstimatorJournal of the American Statistical Association, 1986
- Minimum Hellinger Distance Estimation for Multivariate Location and CovarianceJournal of the American Statistical Association, 1986
- A Smooth Nonparametric Estimator of a Quantile FunctionJournal of the American Statistical Association, 1985
- Frequency Polygons: Theory and ApplicationJournal of the American Statistical Association, 1985
- Discrimination with Polychotomous Predictor Variables Using Orthogonal FunctionsJournal of the American Statistical Association, 1985
- Efficiency of a Kernel Density Estimator under an Autoregressive Dependence ModelJournal of the American Statistical Association, 1984
- On optimal and data-based histogramsBiometrika, 1979
- A Comparison of Some Multivariate Discrimination ProceduresJournal of the American Statistical Association, 1972