Accuracy of Hospital Report Cards Based on Administrative Data
- 5 May 2006
- journal article
- Published by Wiley in Health Services Research
- Vol. 41 (4p1) , 1413-1437
- https://doi.org/10.1111/j.1475-6773.2006.00554.x
Abstract
Context. Many of the publicly available health quality report cards are based on administrative data. ICD-9-CM codes in administrative data are not date stamped to distinguish between medical conditions present at the time of hospital admission and complications, which occur after hospital admission. Treating complications as preexisting conditions gives poor-performing hospitals “credit” for their complications and may cause some hospitals that are delivering low-quality care to be misclassified as average- or high-performing hospitals. Objective. To determine whether hospital quality assessment based on administrative data is impacted by the inclusion of condition present at admission (CPAA) modifiers in administrative data as a date stamp indicator. Design, Setting, and Patients. Retrospective cohort study based on 648,866 inpatient admissions between 1998 and 2000 for coronary artery bypass graft (CABG) surgery, coronary angioplasty (PTCA), carotid endarterectomy (CEA), abdominal aortic aneurysm (AAA) repair, total hip replacement (THR), acute MI (AMI), and stroke using the California State Inpatient Database which includes CPAA modifiers. Hierarchical logistic regression was used to create separate condition-specific risk adjustment models. For each study population, one model was constructed using only secondary diagnoses present at admission based on the CPAA modifier: “date stamp” model. The second model was constructed using all secondary diagnoses, ignoring the information present in the CPAA modifier: the “no date stamp model.” Hospital quality was assessed separately using the “date stamp” and the “no date stamp” risk-adjustment models. Results. Forty percent of the CABG hospitals, 33 percent of the PTCA hospitals, 40 percent of the THR hospitals, and 33 percent of the AMI hospitals identified as low-performance hospitals by the “date stamp” models were not classified as low-performance hospitals by the “no date stamp” models. Fifty percent of the CABG hospitals, 33 percent of the PTCA hospitals, 50 percent of the CEA hospitals, and 36 percent of the AMI hospitals identified as low-performance hospitals by the “no date stamp” models were not identified as low-performance hospitals by the “date stamp” models. The inclusion of the CPAA modifier had a minor impact on hospital quality assessment for AAA repair, stroke, and CEA. Conclusion. This study supports the hypothesis that the use of routine administrative data without date stamp information to construct hospital quality report cards may result in the mis-identification of hospital quality outliers. However, the CPAA modifier will need to be further validated before date stamped administrative data can be used as the basis for health quality report cards.Keywords
This publication has 30 references indexed in Scilit:
- Does Date Stamping ICD‐9‐CM Codes Increase the Value of Clinical Information in Administrative Data?Health Services Research, 2005
- A Research Agenda For Bridging The ‘Quality Chasm’Health Affairs, 2003
- Forecasting the Nursing Home PopulationMedical Care, 2003
- Keeping Quality On The Policy AgendaHealth Affairs, 2001
- Pennsylvania'sFocus on Heart Attack— Grading the ScorecardNew England Journal of Medicine, 1998
- The risks of risk adjustmentJAMA, 1997
- The Origins of the Quality-of-Care DebateNew England Journal of Medicine, 1996
- Confidence interval estimates of an index of quality performance based on logistic regression modelsStatistics in Medicine, 1995
- Regression Using Fractional Polynomials of Continuous Covariates: Parsimonious Parametric ModellingJournal of the Royal Statistical Society Series C: Applied Statistics, 1994
- Accuracy in recorded diagnosesPublished by American Medical Association (AMA) ,1992