Model reference adaptive systems applied to regression analyses
- 1 September 1981
- journal article
- Published by Wiley in Statistica Neerlandica
- Vol. 35 (3) , 129-155
- https://doi.org/10.1111/j.1467-9574.1981.tb00723.x
Abstract
The adaptive estimation procedure of model reference adaptive systems is modified and applied to linear models. In general the principle can be used for almost any time series model. Because of the recursive nature of the resulting estimator, it is computationally appealing, especially when a time series is considered as a flow of data. In addition, the estimator turns out to have certain statistical optimality properties.In the linear regression setting, Ridge estimators turn out to constitute a subclass of the adaptive estimators considered, whereas for unknown measurement variance, the resulting estimators are related to James‐Stkintype estimators, and have better properties than the latter. The estimator is shown to be strongly consistent and to converge in law to a normal variate under the standard assumptions of linear models. Further it is shown to be admissible and minimax in restricted parameter spaces. The connection between Kalmanfilters and the classical least‐squares estimator is also pointed out.Keywords
This publication has 18 references indexed in Scilit:
- Minimax Adaptive Generalized Ridge Regression EstimatorsJournal of the American Statistical Association, 1978
- A minimax property of the Kalman filterInternational Journal of Control, 1977
- Unbiased recursive identification using model reference adaptive techniquesIEEE Transactions on Automatic Control, 1976
- Families of Minimax Estimators of the Mean of a Multivariate Normal DistributionThe Annals of Statistics, 1976
- Improved inference in linear models with additional informationMathematische Operationsforschung und Statistik, 1975
- A minimax linear estimator for linear parameters under restrictions in form of inequalitiesMathematische Operationsforschung und Statistik, 1975
- Linear Statistical Inference and its ApplicationsPublished by Wiley ,1973
- A Note on Multiple-Choice ItemsJournal of the American Statistical Association, 1972
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960