Assessment of the Validity and Reliability of Three Systems of Medical Record Screening for Quality of Care Assessment

Publisher Website
Google Scholar
Abstract
The authors compared the validity and reliability of three methods of medical record screening for detecting problems with quality of care of patients undergoing cardiovascular procedures: (1) the Uniform Clinical Data Set System (UCDSS), a software-based system developed by the Health Care Financing Administration (HCFA), (2) the HCFA generic screens, and (3) the Harvard Medical Practice Study (HMPS) screening criteria. A random sample of 451 medical records of inpatients who underwent cardiovascular procedures were screened by trained nurses and were also examined by physicians masked to screening results. Physicians' judgment provided a reference standard for validity assessment of screening applied by nurses. Agreement between pairs of physician reviews about the quality of care was fair or slight (Kappa The UCDSS computerized screens brought about substantial improvements in reliability of medical record screening, but needed to reduce its false-positive rate and to increase efficiency before it is used. From the perspective of continuous quality improvement, the UCDSS computerized algorithms provided a starting point to developing disease-specific patterns of practice to guide interventions.