PValues for Composite Null Models
- 1 December 2000
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 95 (452) , 1127-1142
- https://doi.org/10.1080/01621459.2000.10474309
Abstract
The problem of investigating compatibility of an assumed model with the data is investigated in the situation when the assumed model has unknown parameters. The most frequently used measures of compatibility are p values, based on statistics T for which large values are deemed to indicate incompatibility of the data and the model. When the null model has unknown parameters, p values are not uniquely defined. The proposals for computing a p value in such a situation include the plug-in and similar p values on the frequentist side, and the predictive and posterior predictive p values on the Bayesian side. We propose two alternatives, the conditional predictive p value and the partial posterior predictive p value, and indicate their advantages from both Bayesian and frequentist perspectives.Keywords
This publication has 24 references indexed in Scilit:
- Unified frequentist and Bayesian testing of a precise hypothesisStatistical Science, 1997
- Asymptotic behaviour of the posterior predictive p-valueCommunications in Statistics - Theory and Methods, 1997
- Estimating statistical hypothesesStatistics & Probability Letters, 1995
- A Unified Conditional Frequentist and Bayesian Test for Fixed and Sequential Simple Hypothesis TestingThe Annals of Statistics, 1994
- P Values Maximized Over a Confidence Set for the Nuisance ParameterJournal of the American Statistical Association, 1994
- A Survey of Exact Inference for Contingency TablesStatistical Science, 1992
- Lower Bounds on Bayes Factors for Multinomial Distributions, with Application to Chi-Squared Tests of FitThe Annals of Statistics, 1990
- Testing Precise HypothesesStatistical Science, 1987
- Testing a Point Null Hypothesis: The Irreconcilability ofPValues and EvidenceJournal of the American Statistical Association, 1987
- Sampling and Bayes' Inference in Scientific Modelling and RobustnessJournal of the Royal Statistical Society. Series A (General), 1980