Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculations
- 1 December 1974
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 19 (6) , 774-783
- https://doi.org/10.1109/tac.1974.1100714
Abstract
This paper discusses numerical aspects of computing maximum likelihood estimates for linear dynamical systems in state-vector form. Different gradient-based nonlinear programming methods are discussed in a unified framework and their applicability to maximum likelihood estimation is examined. The problems due to singular Hessian or singular information matrix that are common in practice are discussed in detail and methods for their solution are proposed. New results on the calculation of state sensitivity functions via reduced order models are given. Several methods for speeding convergence and reducing computation time are also discussed.Keywords
This publication has 20 references indexed in Scilit:
- Maximum likelihood identification of Gaussian autoregressive moving average modelsBiometrika, 1973
- The Differentiation of Pseudo-Inverses and Nonlinear Least Squares Problems Whose Variables SeparateSIAM Journal on Numerical Analysis, 1973
- Sensitivity functions for multi-input linear time-invariant systems—II. Minimal-order models†International Journal of Control, 1972
- Recent advances in unconstrained optimizationMathematical Programming, 1971
- Comparison of Gradient Methods for the Solution of Nonlinear Parameter Estimation ProblemsSIAM Journal on Numerical Analysis, 1970
- Generation of sensitivity functions for linear systems using low-order modelsIEEE Transactions on Automatic Control, 1969
- A Newton-Raphson method for the solution of systems of equationsJournal of Mathematical Analysis and Applications, 1966
- An Algorithm for Least-Squares Estimation of Nonlinear ParametersJournal of the Society for Industrial and Applied Mathematics, 1963
- On the Fitting of Multivariate Autoregressions, and the Approximate Canonical Factorization of a Spectral Density MatrixBiometrika, 1963
- A method for the solution of certain non-linear problems in least squaresQuarterly of Applied Mathematics, 1944