Eualuating Physicians' Probabilistic Judgments
- 1 December 1988
- journal article
- Published by SAGE Publications in Medical Decision Making
- Vol. 8 (4) , 233-240
- https://doi.org/10.1177/0272989x8800800403
Abstract
Physicians increasingly are challenged to make probabilistic judgments quantitatively. Their ability to make such judgments may be directly linked to the quality of care they provide. Many methods are available to evaluate these judgments. Graphic means of assessment include the calibration curve, covariance graph, and receiver operating characteristic (ROC) curve. Statistical tools can measure the significance of departures from ideal calibration, and measure the area under ROC curve. Modeling the calibration curve using linear or logistic regression provides another method to assess probabilistic judgments, although these may be limited by failure of the data to meet the model's assumptions. Scoring rules provide indices of overall judgmental performance, although their reliability is difficult to gauge for small sample sizes. Decompositions of scoring rules separate judgmental performance into functional components. The authors provide preliminary guidelines for choosing methods for specific research in this area. Key Words: medical judgments; probabilistic judgments; ROC curves; calibration; models. (Med Decis Making 8:233-240, 1988)Keywords
This publication has 53 references indexed in Scilit:
- Consistency in interpretation of probabilistic phrasesPublished by Elsevier ,2004
- Analyzing the accuracy of probability judgments for multiple events: An extension of the covariance decompositionOrganizational Behavior and Human Decision Processes, 1988
- Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment methodOrganizational Behavior and Human Decision Processes, 1987
- Facing uncertainty in the game of bridge: A calibration studyOrganizational Behavior and Human Decision Processes, 1987
- Decision AnalysisNew England Journal of Medicine, 1987
- How Medical Professionals Evaluate Expressions of ProbabilityNew England Journal of Medicine, 1986
- A signal detection framework for the evaluation of probabilistic forecastsOrganizational Behavior and Human Decision Processes, 1985
- Basic principles of ROC analysisSeminars in Nuclear Medicine, 1978
- The Evaluation of Clinical PredictionsNew England Journal of Medicine, 1977
- Cognitive Processes and the Assessment of Subjective Probability DistributionsJournal of the American Statistical Association, 1975