James-Stein state filtering algorithms
- 1 September 1998
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 46 (9) , 2431-2447
- https://doi.org/10.1109/78.709532
Abstract
In 1961, James and Stein discovered a remarkable estimator that dominates the maximum-likelihood estimate of the mean of a p-variate normal distribution, provided the dimension p is greater than two. This paper extends the James-Stein estimator and highlights the benefits of applying these extensions to adaptive signal processing problems. The main contribution of this paper is the derivation of the James-Stein state filter (JSSF), which is a robust version of the Kalman filter. The JSSF is designed for situations where the parameters of the state-space evolution model are not known with any certainty. In deriving the JSSF, we derive several other results. We first derive a James-Stein estimator for estimating the regression parameter in a linear regression. A recursive implementation, which we call the James-Stein recursive least squares (JS-RLS) algorithm, is derived. The resulting estimate, although biased, has a smaller mean-square error than the traditional RLS algorithm. Finally, several heuristic algorithms are presented, including a James-Stein version of the Yule-Walker equations for AR parameter estimation.Keywords
This publication has 22 references indexed in Scilit:
- A multi-agent approach to unit commitment problemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Estimation of multiple target trajectories with time varying amplitudesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robust Kalman filtering for uncertain discrete-time systemsIEEE Transactions on Automatic Control, 1994
- An Introduction to Signal Detection and EstimationPublished by Springer Nature ,1994
- The nonlinear MMSE filter for partially observed systems driven by non-Gaussian white noise, with applications to failure estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1984
- Theory of Point EstimationPublished by Springer Nature ,1983
- Results on the filtering problem for linear systems with non-Gaussian initial conditionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1982
- Approximate non-Gaussian filtering with linear state and observation relationsIEEE Transactions on Automatic Control, 1975
- On the sampling distribution of improved estimators for coefficients in linear regressionJournal of Econometrics, 1974
- Stein's Estimation Rule and Its Competitors--An Empirical Bayes ApproachJournal of the American Statistical Association, 1973