The Incompleteness of Probability Models and the Resultant Implications for Theories of Statistical Inference

Publisher Website
Google Scholar
Abstract
It is argued that statistical testing has been overvalued because it is perceived as an optimal, objective, algorithmic method of testing hypotheses. Researchers need to be made aware of the subjective nature of statistical inference in order not to make too much of it. Examples are given of aspects of data that are ignored in the computation of p values but are relevant to their interpretation. These include the fit of the chance distribution, the presence of influential points, the possibilities for post hoc selectivity, the presence of expected and unexpected trends in the data, and the amount of sampling variability that is present. Researchers should be taught that although probabilistic reasoning is a deductive process, making inferences from data is not. There is always potentially relevant information available over and above that which has been taken account of by any p value. Indeed, it is noted that a probability can never characterize all the uncertainty regarding an event because of problems ...

This publication has 34 references indexed in Scilit: