Likelihood inference in exponential families and directions of recession
Open Access
- 1 January 2009
- journal article
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 3 (none) , 259-289
- https://doi.org/10.1214/08-ejs349
Abstract
When in a full exponential family the maximum likelihood estimate (MLE) does not exist, the MLE may exist in the Barndorff-Nielsen completion of the family. We propose a practical algorithm for finding the MLE in the completion based on repeated linear programming using the R contributed package rcdd and illustrate it with two generalized linear model examples. When the MLE for the null hypothesis lies in the completion, likelihood ratio tests of model comparison are almost unchanged from the usual case. Only the degrees of freedom need to be adjusted. When the MLE lies in the completion, confidence intervals are changed much more from the usual case. The MLE of the natural parameter can be thought of as having gone to infinity in a certain direction, which we call a generic direction of recession. We propose a new one-sided confidence interval which says how close to infinity the natural parameter may be. This maps to one-sided confidence intervals for mean values showing how close to the boundary of their support they may be.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- The Elements of Statistical LearningPublished by Springer Nature ,2009
- On the geometry of discrete exponential families with application to exponential random graph modelsElectronic Journal of Statistics, 2009
- Likelihood inference in exponential families and directions of recessionElectronic Journal of Statistics, 2009
- Unifying Life‐History Analyses for Inference of Fitness and Population GrowthThe American Naturalist, 2008
- Aster models for life history analysisBiometrika, 2007
- Fuzzy and Randomized Confidence Intervals and P-ValuesStatistical Science, 2005
- Categorical Data AnalysisPublished by Wiley ,2002
- Constrained Monte Carlo Maximum Likelihood for Dependent DataJournal of the Royal Statistical Society Series B: Statistical Methodology, 1992
- Fundamentals of statistical exponential families with applications in statistical decision theoryPublished by Institute of Mathematical Statistics ,1986