Training continuous density hidden Markov models in association with self-organizing maps and LVQ
- 2 January 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The authors propose a novel initialization method for continuous observation density hidden Markov models (CDHMMs) that is based on self-organizing maps (SOMs) and learning vector quantization (LVQ). The framework is to transcribe speech into phoneme sequences using CDHMMs as phoneme models. When numerous mixtures of, for example, Gaussian density functions are used to model the observation distributions of CDHMMs, good initial values are necessary in order for the Baum-Welch estimation to converge satisfactorily. The authors have experimented with constructing rapidly good initial values by SOMs, and with enhancing the discriminatory power of the phoneme models by adaptively training the state output distributions by using the LVQ algorithm. Experiments indicate that an improvement to the pure Baum-Welch and the segmentation K-means procedures can be obtained using the proposed method.Keywords
This publication has 8 references indexed in Scilit:
- Unified techniques for vector quantization and hidden Markov modeling using semi-continuous modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Links between Markov models and multilayer perceptronsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1990
- The self-organizing mapProceedings of the IEEE, 1990
- Context-independent phonetic hidden Markov models for speaker-independent continuous speech recognitionIEEE Transactions on Acoustics, Speech, and Signal Processing, 1990
- The segmental K-means algorithm for estimating parameters of hidden Markov modelsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1990
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Maximum-Likelihood Estimation for Mixture Multivariate Stochastic Observations of Markov ChainsAT&T Technical Journal, 1985
- Maximum likelihood estimation for multivariate observations of Markov sourcesIEEE Transactions on Information Theory, 1982