Could Fisher, Jeffreys and Neyman Have Agreed on Testing?
Top Cited Papers
Open Access
- 1 February 2003
- journal article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 18 (1) , 1-32
- https://doi.org/10.1214/ss/1056397485
Abstract
Ronald Fisher advocated testing using p-values, Harold Jeffreys proposed use of objective posterior probabilities of hypotheses and Jerzy Neyman recommended testing with fixed error probabilities. Each was quite critical of the other approaches. Most troubling for statistics and science is that the three approaches can lead to quite different practical conclusions. This article focuses on discussion of the conditional frequentist approach to testing, which is argued to provide the basis for a methodological unification of the approaches of Fisher, Jeffreys and Neyman. The idea is to follow Fisher in using p-values to define the "strength of evidence" in data and to follow his approach of conditioning on strength of evidence; then follow Neyman by computing Type I and Type II error probabilities, but do so conditional on the strength of evidence in the data. The resulting conditional frequentist error probabilities equal the objective posterior probabilities of the hypotheses advocated by Jeffreys.Keywords
This publication has 51 references indexed in Scilit:
- PValues for Composite Null ModelsJournal of the American Statistical Association, 2000
- Default Bayes Factors for Nonnested Hypothesis TestingJournal of the American Statistical Association, 1999
- On the Generalization of the Likelihood Function and the Likelihood PrincipleJournal of the American Statistical Association, 1996
- A Unified Conditional Frequentist and Bayesian Test for Fixed and Sequential Simple Hypothesis TestingThe Annals of Statistics, 1994
- The Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?Journal of the American Statistical Association, 1993
- The Bayes/Non-Bayes Compromise: A Brief ReviewJournal of the American Statistical Association, 1992
- Reconciling Bayesian and Frequentist Evidence in the One-Sided Testing ProblemJournal of the American Statistical Association, 1987
- On the Elimination of Nuisance ParametersJournal of the American Statistical Association, 1977
- P-values: Interpretation and MethodologyThe American Statistician, 1975
- Significance Tests in Parallel and in SeriesJournal of the American Statistical Association, 1958