Optimal simultaneous state estimation and parameter identification in linear discrete-time systems
- 1 December 1970
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The topic of this paper is the simultaneous estimation of state and parameters in linear discrete-time dynamic systems. The system is subject to a known arbitrary input (control), a random input (additive driving noise) and the output observation is also contaminated by noise. The noises are Gaussian, zero-mean, independent and with known variances. The problem is formulated under the assumption that the system parameters are unknown constants. Previous works in the literature treated this problem assuming that each parameter can take values over a finite set with known a priori probabilities. The proposed scheme yields the maximum a posteriori and maximum likelihood estimates for the system's state and parameters, respectively. They are obtained by solving the likelihood equations-a system of nonlinear equations with the state and parameters as unknowns. Use is made of the fact that the dynamical system considered is linear and the problem is separated into two interconnected linear problems: one for the state, the other for the parameters. The solution is obtained by iterating between two systems of linear equations. The estimation technique presented is optimal in the following sense: no approximations are involved and the estimates of the parameters converge to the true values at the fastest possible rate, as given by the Cram r-Rao lower bound, i.e. they are asympotically efficient. This is proved, using a theorem which states that, under certain general conditions, the maximum likelihood estimate with dependent observations is consistent and asymptotically efficient. The problem of uniqueness of the solution is discussed for the case of a scalar unknown parameter. Use is made of a theorem due to Perlman, generalized for the case of dependent observations. Due to the fact that the estimation-identification is done in the presence of input and output noise and an arbitrary known input, the procedure can be considered an on-line technique. Since estimates are available after each measurement, this estimationidentification procedure is suited for use in the adaptive control of unknown (or partially known) linear plants.Keywords
This publication has 18 references indexed in Scilit:
- On Certain Convergence Questions in System IdentificationSIAM Journal on Control, 1970
- Maximum likelihood identification of stochastic linear systemsIEEE Transactions on Automatic Control, 1970
- Optimal Estimation in the Presence of Unknown ParametersIEEE Transactions on Systems Science and Cybernetics, 1969
- An innovations approach to least-squares estimation--Part II: Linear smoothing in additive white noiseIEEE Transactions on Automatic Control, 1968
- Optimal adaptive estimation of sampled stochastic processesIEEE Transactions on Automatic Control, 1965
- Estimation of a system pulse transfer function in the presence of noiseIEEE Transactions on Automatic Control, 1964
- On the estimation of state variables and parameters for noisy dynamic systemsIEEE Transactions on Automatic Control, 1964
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951
- Note on the Consistency of the Maximum Likelihood EstimateThe Annals of Mathematical Statistics, 1949