Performance analysis of parameter estimation algorithms based on high‐order moments
- 1 September 1989
- journal article
- research article
- Published by Wiley in International Journal of Adaptive Control and Signal Processing
- Vol. 3 (3) , 191-229
- https://doi.org/10.1002/acs.4480030302
Abstract
Recently, there has been a considerable interest in parametric estimation of non‐Gaussian processes, based on high‐order moments. Several researchers have proposed algorithms for estimating the parameters of AR, MA and ARMA processes, based on the third‐order and fourth‐order cumulants. These algorithms are capable of handling non‐minimum phase processes, and some of them provide a good trade‐off between computational complexity and statistical efficiency.This paper presents some results about the performance of algorithms based on high‐order moments. A general lower bound is derived for the variance of estimates based on high‐order sample moments. This bound, which is shown to be asymptotically tight, is neither the Cramer‐Rao bound nor a trivial extension thereof. The performance of weighted least squares estimates of the type recently proposed in the literature is investigated. An expression for the variance of such estimates is derived and the existence of an optimal weight matrix is proven. The general formulae are specialized to MA and ARMA processes and used to analyse the performance of some algorithms in detail. The analytic results are verified by Monte Carlo simulations for some specific test cases.A by‐product of this paper is the derivation of asymptotic formulae for the variances and covariances of the sample third‐order moments of a certain class of processes.Keywords
This publication has 15 references indexed in Scilit:
- Adaptive IIR algorithms based on high-order statisticsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- Order reduction of SISO nonminimum-phase stochastic systemsIEEE Transactions on Automatic Control, 1986
- Bounds on the accuracy of Gaussian ARMA parameter estimation methods based on sample covariancesIEEE Transactions on Automatic Control, 1986
- Optimal instrumental variable estimates of the AR parameters of an ARMA processIEEE Transactions on Automatic Control, 1985
- Bispectrum estimation: A parametric approachIEEE Transactions on Acoustics, Speech, and Signal Processing, 1985
- Information tradeoffs in using the sample autocorrelation function in ARMA parameter estimationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1984
- The overdetermined recursive instrumental variable methodIEEE Transactions on Automatic Control, 1984
- Instrumental variable methods for ARMA spectral estimationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1983
- Deconvolution and Estimation of Transfer Function Phase and Coefficients for Nongaussian Linear ProcessesThe Annals of Statistics, 1982
- High performance spectral estimation--A new ARMA methodIEEE Transactions on Acoustics, Speech, and Signal Processing, 1980