Hidden Markov processes
Top Cited Papers
- 7 August 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 48 (6) , 1518-1569
- https://doi.org/10.1109/tit.2002.1003838
Abstract
An overview of statistical and information-theoretic aspects of hidden Markov processes (HMPs) is presented. An HMP is a discrete-time finite-state homogeneous Markov chain observed through a discrete-time memoryless invariant channel. In recent years, the work of Baum and Petrie (1966) on finite-state finite-alphabet HMPs was expanded to HMPs with finite as well as continuous state spaces and a general alphabet. In particular, statistical properties and ergodic theorems for relative entropy densities of HMPs were developed. Consistency and asymptotic normality of the maximum-likelihood (ML) parameter estimator were proved under some mild conditions. Similar results were established for switching autoregressive processes. These processes generalize HMPs. New algorithms were developed for estimating the state, parameter, and order of an HMP, for universal coding and classification of HMPs, and for universal decoding of hidden Markov channels. These and other related topics are reviewed.Keywords
This publication has 280 references indexed in Scilit:
- Estimating the Order of Hidden Markov ModelsStatistics, 1995
- Hidden Markov Models in Computational BiologyJournal of Molecular Biology, 1994
- Hidden Markov models for fault detection in dynamic systemsPattern Recognition, 1994
- Parameter estimation for Markov modulated poisson processesCommunications in Statistics. Stochastic Models, 1994
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- CommentJournal of the American Statistical Association, 1987
- Markov Channels are Asymptotically Mean StationarySIAM Journal on Mathematical Analysis, 1981
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974
- Growth transformations for functions on manifoldsPacific Journal of Mathematics, 1968