Data Adaptive Ridging in Local Polynomial Regression
- 1 June 2000
- journal article
- research article
- Published by Taylor & Francis in Journal of Computational and Graphical Statistics
- Vol. 9 (2) , 338-360
- https://doi.org/10.1080/10618600.2000.10474884
Abstract
When estimating a regression function or its derivatives, local polynomials are an attractive choice due to their flexibility and asymptotic performance. Seifert and Gasser proposed ridging of local polynomials to overcome problems with variance for random design while retaining their advantages. In this article we present a data-independent rule of thumb and a data-adaptive spatial choice of the ridge parameter in local linear regression. In a framework of penalized local least squares regression, the methods are generalized to higher order polynomials, to estimation of derivatives, and to multivariate designs. The main message is that ridging is a powerful tool for improving the performance of local polynomials. A rule of thumb offers drastic improvements; data-adaptive ridging brings further but modest gains in mean square error.Keywords
This publication has 8 references indexed in Scilit:
- On the role of the shrinkage parameter in local linear smoothingProbability Theory and Related Fields, 1997
- Finite-Sample Variance of Local Polynomials: Analysis and SolutionsJournal of the American Statistical Association, 1996
- Smoothing by Local Regression: Principles and MethodsPublished by Springer Nature ,1996
- An Effective Bandwidth Selector for Local Least Squares RegressionJournal of the American Statistical Association, 1995
- Adaptive Order Polynomial Fitting: Bandwidth Robustification and Bias ReductionJournal of Computational and Graphical Statistics, 1995
- Fast Algorithms for Nonparametric Curve EstimationJournal of Computational and Graphical Statistics, 1994
- Local Linear Regression Smoothers and Their Minimax EfficienciesThe Annals of Statistics, 1993
- Residual variance and residual pattern in nonlinear regressionBiometrika, 1986