Weighted Local Regression and Kernel Methods for Nonparametric Curve Fitting
- 1 March 1987
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 82 (397) , 231-238
- https://doi.org/10.1080/01621459.1987.10478425
Abstract
Weighted local regression, a popular technique for smoothing scatterplots, is shown to be asymptotically equivalent to certain kernel smoothers. Since both methods are local weighted averages of the data, it is proved that in the fixed design regression model, given a weighted local regression procedure with any weight function, there is a corresponding kernel method such that the quotients of weights distributed by both methods tend uniformly to 1 as the number of observations increases to infinity. It is demonstrated by examples that in some instances the weights are nearly the same for both methods, even for small samples. The asymptotic equivalence allows the derivation of the leading terms of the mean squared error and of the local limit distribution for weighted local regression. Further, a close correspondence is found between the orders of the polynomial to be locally fitted in weighted local regression and the order (number of vanishing moments) of the kernel employed in the kernel smoother and between the shapes of the kernel and the weight function.Keywords
This publication has 13 references indexed in Scilit:
- Bandwidth Choice for Nonparametric RegressionThe Annals of Statistics, 1984
- Optimal designs for nonparametric kernel regressionStatistics & Probability Letters, 1984
- Spline Smoothing: The Equivalent Variable Kernel MethodThe Annals of Statistics, 1984
- Smooth Optimum Kernel Estimators of Densities, Regression Curves and ModesThe Annals of Statistics, 1984
- Boundary modification for kernel regressionCommunications in Statistics - Theory and Methods, 1984
- Robust Locally Weighted Regression and Smoothing ScatterplotsJournal of the American Statistical Association, 1979
- Contributions to the Theory of Nonparametric Regression, with Application to System IdentificationThe Annals of Statistics, 1979
- A Concept of Positive Dependence for Exchangeable Random VariablesThe Annals of Statistics, 1977
- Designs for Regression Problems with Correlated Errors IIIThe Annals of Mathematical Statistics, 1970
- Non-Parametric Estimation of a Multivariate Probability DensityTheory of Probability and Its Applications, 1969