Estimating psychometric functions in forced-choice situations: Significant biases found in threshold and slope estimations when small samples are used
- 1 September 1989
- journal article
- research article
- Published by Springer Nature in Perception & Psychophysics
- Vol. 46 (5) , 434-442
- https://doi.org/10.3758/bf03210858
Abstract
When a theoretical psychometric function is fitted to experimental data (as in the obtaining of a psychophysical threshold), maximum-likelihood or probit methods are generally used. In the present paper, the behavior of these curve-fitting methods is studied for the special case of forced-choice experiments, in which the probability of a subject''s making a correct response by chance is not zero. A mathematical investigation of the variance of the threshold and slope estimators shows, that, in this case, the accuracy of the methoids is much worse, and their sensitivity to the way data are sampled is greater, than in the case in which chance level is zero. Further, Monte Carlo simulations show that, in practical situations in which only a finite number of observations are made, the mean threshold and slope estimates are significantly biased. The amount of bias depends on the curve-fitting method and on the range of intensity values, but it is always greater in forced-choice situations than when chance level is zero.This publication has 9 references indexed in Scilit:
- Observations on maximum-likelihood and Bayesian methods of forced-choice sequential threshold estimationPerception & Psychophysics, 1986
- Statistical properties of forced-choice psychometric functions: Implications of probit analysisPerception & Psychophysics, 1985
- Computation of psychophysical thresholds using the probit techniqueBehavior Research Methods, 1983
- Quest: A Bayesian adaptive psychometric methodPerception & Psychophysics, 1983
- Hybrid adaptive procedure for estimation of psychometric functionsThe Journal of the Acoustical Society of America, 1981
- APE: Adaptive probit estimation of psychometric functionsCurrent Psychological Reviews, 1981
- Estimates on probability functions: A more virulent PESTPerception & Psychophysics, 1978
- SEQUENTIAL ESTIMATION OF POINTS ON A PSYCHOMETRIC FUNCTIONBritish Journal of Mathematical and Statistical Psychology, 1965
- Maximum Likelihood and Minimum | chi 2 Estimates of the Logistic FunctionJournal of the American Statistical Association, 1955