Embedding nonnegative definite Toeplitz matrices in nonnegative definite circulant matrices, with application to covariance estimation
- 1 January 1989
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 35 (6) , 1206-1212
- https://doi.org/10.1109/18.45276
Abstract
The class of nonnegative definite Toeplitz matrices that can be embedded in nonnegative definite circulant matrices of a larger size is characterized. An equivalent characterization in terms of the spectrum of the underlying process is also presented, together with the corresponding extremal processes. It is shown that a given finite-duration sequence ρ can be extended to be the covariance of a periodic stationary processes whenever the Toeplitz matrix R generated by this sequence is strictly positive definite. The sequence ρ=1, cos α, cos 2α with (α/π) irrational, which has a unique nonperiodic extension as a covariance sequence, demonstrates that the strictness is needed. A simple constructive proof supplies a bound on the abovementioned period in terms of the minimal eigenvalue of R. It also yields, under the same conditions, an extension of ρ to covariances that eventually decay to zero. For the maximum-likelihood estimate of the covariance of a stationary Gaussian process, the extension length required for using the estimate-maximize iterative algorithm is determinedKeywords
This publication has 8 references indexed in Scilit:
- On the existence of positive-definite maximum-likelihood estimates of structured covariance matricesIEEE Transactions on Information Theory, 1988
- The role of likelihood and entropy in incomplete-data problems: Applications to estimating point-process intensities and toeplitz constrained covariancesProceedings of the IEEE, 1987
- The relation between maximum likelihood estimation of structured covariance matrices and periodogramsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1986
- Stability of Methods for Solving Toeplitz Systems of EquationsSIAM Journal on Scientific and Statistical Computing, 1985
- A fast algorithm for solving a Toeplitz system of equationsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1985
- On the Convergence Properties of the EM AlgorithmThe Annals of Statistics, 1983
- Estimation of structured covariance matricesProceedings of the IEEE, 1982
- Spectrum analysis—A modern perspectiveProceedings of the IEEE, 1981