The expectation-maximization algorithm
- 1 November 1996
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Magazine
- Vol. 13 (6) , 47-60
- https://doi.org/10.1109/79.543975
Abstract
A common task in signal processing is the estimation of the parameters of a probability distribution function. Perhaps the most frequently encountered estimation problem is the estimation of the mean of a signal in noise. In many parameter estimation problems the situation is more complicated because direct access to the data necessary to estimate the parameters is impossible, or some of the data are missing. Such difficulties arise when an outcome is a result of an accumulation of simpler outcomes, or when outcomes are clumped together, for example, in a binning or histogram operation. There may also be data dropouts or clustering in such a way that the number of underlying data points is unknown (censoring and/or truncation). The EM (expectation-maximization) algorithm is ideally suited to problems of this sort, in that it produces maximum-likelihood (ML) estimates of parameters when there is a many-to-one mapping from an underlying distribution to the distribution governing the observation. The EM algorithm is presented at a level suitable for signal processing practitioners who have had some exposure to estimation theory.Keywords
This publication has 36 references indexed in Scilit:
- Time-delay estimation for filtered Poisson processes using an EM-type algorithmIEEE Transactions on Signal Processing, 1994
- Iterative and sequential algorithms for multisensor signal enhancementIEEE Transactions on Signal Processing, 1994
- Parameter Estimation and Extraction of Helicopter Signals Observed with a Wide-Band InterferenceIEEE Transactions on Signal Processing, 1993
- Recent advances in active noise controlAIAA Journal, 1991
- Expectation–maximization algorithm for regression, deconvolution and smoothing of shot‐noise limited dataJournal of Chemometrics, 1991
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Maximum likelihood noise cancellation using the EM algorithmIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- The cascade EM algorithmProceedings of the IEEE, 1988
- On the Convergence Properties of the EM AlgorithmThe Annals of Statistics, 1983
- Computation of channel capacity and rate-distortion functionsIEEE Transactions on Information Theory, 1972