Comparison of some two sample means tests by simulation

1 January 1976

journal article
research article
Published by Taylor & Francis in Communications in Statistics - Simulation and Computation

Vol. 5 (1) , 23-32
https://doi.org/10.1080/03610917608812004

Abstract

The usual t-test for testing that two samples come from a common normal population cannot be used to test H₀: μ₁ = μ₂ for two samples drawn respectively from normal populations if . Many solutions to this problem, known as the two sample or Fisher-Behrens problem after Fisher's (1935b) solution, have been advanced and we examine here the Aspin-Welch (AW) solution and the distribution free Wilcoxon-Mann-Whitney (WMW) test, which latter is commonly, but incorrectly, taught and used as an approximate solution to the problem. It is shown here in a simulation context that the AW test is a highly acceptable practical procedure while the WMW test is definitely not. Some results on testing means when samples are drawn from non-normal populations are also discussed.

Keywords

This publication has 15 references indexed in Scilit:

Probabilities of the Type I Errors of the Welch Tests for the Behrens-Fisher Problem
Journal of the American Statistical Association, 1971
Some two-sample tests when the variances are unequal: a simulation study
Biometrika, 1967
Use of the Wilcoxon Statistic for a Generalized Behrens-Fisher Problem
The Annals of Mathematical Statistics, 1963
On studentized non-parametric multi-sample location tests
Annals of the Institute of Statistical Mathematics, 1962
Sampling studies on the behrens-fisher problem
Metrika, 1961
Further critical values for the two-means problem
Biometrika, 1956
TABLES FOR USE IN COMPARISONS WHOSE ACCURACY INVOLVES TWO VARIANCES, SEPARATELY ESTIMATED
Biometrika, 1949
On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other
The Annals of Mathematical Statistics, 1947
Significance Tests Which May be Applied to Samples from Any Populations
Journal of the Royal Statistical Society Series B: Statistical Methodology, 1937
THE FIDUCIAL ARGUMENT IN STATISTICAL INFERENCE
Annals of Eugenics, 1935