The em algorithm for the quasi-likelihood regression model
- 1 January 1995
- journal article
- research article
- Published by Taylor & Francis in Communications in Statistics - Theory and Methods
- Vol. 24 (6) , 1403-1430
- https://doi.org/10.1080/03610929508831562
Abstract
The objective of this paper is to present a method which can accommodate certain types of missing data by using the quasi-likelihood function for the complete data. This method can be useful when we can make first and second moment assumptions only; in addition, it can be helpful when the EM algorithm applied to the actual likelihood becomes overly complicated. First we derive a loss function for the observed data using an exponential family density which has the same mean and variance structure of the complete data. This loss function is the counterpart of the quasi-deviance for the observed data. Then the loss function is minimized using the EM algorithm. The use of the EM algorithm guarantees a decrease in the loss function at every iteration. When the observed data can be expressed as a deterministic linear transformation of the complete data, or when data are missing completely at random, the proposed method yields consistent estimators. Examples are given for overdispersed polytomous data, linear random effects models, and linear regression with missing covariates. Simulation results for the linear regression model with missing covariates show that the proposed estimates are more efficient than estimates based on completely observed units, even when outcomes are bimodal or skewed.Keywords
This publication has 12 references indexed in Scilit:
- Using EM to Obtain Asymptotic Variance-Covariance Matrices: The SEM AlgorithmJournal of the American Statistical Association, 1991
- On the efficiency of quasi-likelihood estimationBiometrika, 1987
- Exponential Dispersion ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1987
- Multilevel mixed linear model analysis using iterative generalized least squaresBiometrika, 1986
- On the Convergence Properties of the EM AlgorithmThe Annals of Statistics, 1983
- Quasi-Likelihood FunctionsThe Annals of Statistics, 1983
- Finding the Observed Information Matrix When Using the EM AlgorithmJournal of the Royal Statistical Society Series B: Statistical Methodology, 1982
- Estimation in Covariance Components ModelsJournal of the American Statistical Association, 1981
- Linear regression with censored dataBiometrika, 1979
- Asymptotic relations between the likelihood estimating function and the maximum likelihood estimatorAnnals of the Institute of Statistical Mathematics, 1973