The California Hospital Outcomes Project: Using Administrative Data to Compare Hospital Performance
The Joint Commission Journal on Quality ImprovementPublished 1 December 1995
Patrick S. Romano, Andra Zach, Harold S. Luft, Julie Rainwater, Linda L Remy, David Campa
Citations60
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A validation study is undertaken to explore whether differences in coding, unmeasured risk factors, or processes of care explain the reported differences in risk-adjusted outcome rates.
Abstract
Letters submitted for 168 hospitals in response to the 1993 report demonstrated that hospitals had studied and used project results to evaluate their coding practices and quality of care. Media coverage of the 1993 report was balanced but sometimes critical of OSHPD's failure to identify "worse" hospitals. In response to providers' concerns, OSHPD has undertaken a validation study to explore whether differences in coding, unmeasured risk factors, or processes of care explain the reported differences in risk-adjusted outcome rates.
Keywords
Health ProfessionsEconomics, Econometrics and Finance
BiometricsThe Measurement of Observer Agreement for Categorical Data
78,934 Citations1977J. Richard Landis, Gary G. Koch
A general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies is presented and tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interob server agreement are developed as generalized kappa-type statistics.
RadiologyThe meaning and use of the area under a receiver operating characteristic (ROC) curve.
21,812 Citations1982J A Hanley, Barbara J. McNeil
A representation and interpretation of the area under a receiver operating characteristic (ROC) curve obtained by the "rating" method, or by mathematical predictions based on patient characteristics, is presented and it is shown that in such a setting the area represents the probability that a randomly chosen diseased subject is (correctly) rated or ranked with greater suspicion than a random chosen non-diseased subject.
CHEST JournalThe APACHE III Prognostic System
3,482 Citations1991William A. Knaus, Douglas P. Wagner +9 more
The overall predictive accuracy of the first-day APACHE III equation was such that, within 24 h ofICU admission, 95 percent of ICU admissions could be given a risk estimate for hospital death that was within 3 percent of that actually observed.
Annals of Internal MedicineVariations in Mortality and Length of Stay in Intensive Care Units
552 Citations1993William A. Knaus, Douglas P. Wagner +2 more
The ability to evaluate ICU performance using risk-adjusted in-hospital mortality rates and length of ICU stay and the nature and relative importance of these factors and the extent of the remaining variation in outcome performance after such adjustment are explored.
Medical CareBias in the Coding of Hospital Discharge Data and Its Implications for Quality Assessment
354 Citations1994Patrick S. Romano, David Mark
Tions are underreported when patients die, for two possible reasons: coders identify all relevant diagnoses but the chronic codes are discarded when abstracts are truncated to
JAMAMeasuring Quality of Care With Explicit Process Criteria Before and After Implementation of the DRG-Based Prospective Payment System
294 Citations1990Katherine L. Kahn
Developed explicit process criteria and scales for Medicare patients hospitalized with congestive heart failure, myocardial infarction, pneumonia, cerebrovascular accident, and hip fracture resulted in lower mortality rates 30 days after admission.
JAMAAssessing Hospital-Associated Deaths From Discharge Data
222 Citations1988Stephen F. Jencks
It is concluded that inpatient death rates depend on length-of-stay patterns and give a biased picture of mortality.
Medical CareHow Accurate are Hospital Discharge Data for Evaluating Effectiveness of Care?
185 Citations1993Jesse Green, Neil Wintfeld
Statistics in MedicineConfidence interval estimates of an index of quality performance based on logistic regression models
177 Citations1995David W. Hosmer, Stanley Lemeshow
This paper considers an index of hospital quality performance defined as the ratio of the observed number deaths to the number predicted by a fitted logistic regression model and proposes parametric as well as bootstrap-based confidence intervals.
PubMedUsing administrative data to screen hospitals for high complication rates.
171 Citations1994Lisa I. Iezzoni, Jennifer Daley +6 more
Using 1988 California discharge data to identify hospitals with higher-than-expected rates of complications in six adult, medical-surgical patient populations, relative hospital complication rates generally were correlated across clinical areas, although correlations were lower between medical and surgical case types.
JAMAChanges in Quality of Care for Five Diseases Measured by Implicit Review, 1981 to 1986
160 Citations1990Lisa V. Rubenstein
Except for discharge planning processes, the quality of hospital care has continued to improve for Medicare patients despite, or because of, the introduction of the prospective payment system with its accompanying professional review organization review.
PubMedMeasuring outcomes of hospital care using multiple risk-adjusted indexes.
102 Citations1991Susan DesHarnais, Laurence F. McMahon +1 more
The findings suggest that consumers, payers, and policymakers cannot simply choose one hospitalwide measure, such as the mortality rate, to validly represent a hospital's performance: those hospitals with high rankings on their mortality rates do not necessarily rank high on their readmission rates or complication rates.
PubMedValidating risk-adjusted mortality as an indicator for quality of care.
95 Citations1993James W. Thomas, J J Holloway +1 more
It is concluded that before inferences about hospital quality are made using any risk-adjusted mortality indicator, the validity of the quality/outcome relationship must be established explicitly for that measure.
Medical CareMeasuring the Effectiveness of Perinatal Medical Care
92 Citations1979Ronald L. Williams
An outcome-based index of the effectiveness of perinatal care was empirically tested using 3,441,448 linked birth-death records and revealed that the mortality ratio was significantly lower in larger delivery services, in urban hospitals, in hospitals performing above-average numbers of cesarean sections in those recording Apgar scores, and in hospitals having higher specialist-to-generalist ratios.
PubMedPredicted probabilities of hospital death as a measure of admission severity of illness.
75 Citations1993P M Steen, A C Brewster +3 more
A new method for assessing hospital admission severity of illness based on disease-specific models (logistic regression) of the probability of in-hospital mortality is evaluated.
PubMedComments on HCFA hospital death rate statistical outliers. Health Care Financing Administration.
71 Citations1987Blumberg Ms
In March 1986, the Health Care Financing Administration released ten lists of death-rate "outlier" hospitals, one for all 1984 Medicare discharges and nine for specific DRGs, where a total of 1,222 hospitals had unfavorable residuals, while only 8 were favorable.
Medical CarePredicting In-Hospital Survival of Myocardial Infarction
59 Citations1990Farrokh Alemi, Janet C. Rice +1 more
Comparison of relative accuracy of the indices showed that all indices were more accurate than PIMI and, for medically treated patients, CSI wasMore accurate than MDGRP, CDS, APACHE II, and IHDI.
Annals of Internal MedicineComparing Hospital Mortality in Adult Patients with Pneumonia: A Case Study of Statistical Methods in a Managed Care Program
50 Citations1995A. Russell Localio, Bruce H. Hamory +4 more
This work examines one attempt to compare hospitals based on their observed mortality, made in 1992 by consultants to a managed care program for a large corporation to determine which of the hospitals serving the corporation's employees in central Pennsylvania delivered better quality of care as reflected in part by fewer in-hospital deaths in 1989 and 1990.
PubMedMeasuring hospital mortality rates: are 30-day data enough? Ischemic Heart Disease Patient Outcomes Research Team.
46 Citations1995Deborah W. Garnick, Elizabeth R. DeLong +1 more
Comparing 30-day and 180-day postadmission hospital mortality rates for all Medicare patients and those in three categories of cardiac care finds evidence that hospital performance on one condition is related to performance on the other conditions, but that the correlation is much weaker in the 31-180-day interval than in the 0-30-day period.
PubMedThe effect of alternative case-mix adjustments on mortality differences between municipal and voluntary hospitals in New York City.
43 Citations1994Martin F. Shapiro, Rolla Edward Park +2 more
Estimates of mortality differences between New York City municipal and voluntary hospitals are substantially affected by which secondary diagnoses are used in case-mix adjustment.
PubMedEncrypting personal identifiers.
30 Citations1994E Meux
The method of encrypting the social security number (SSN) into a Record Linkage Number (RLN) is described, which can be described, evaluated, and adapted for use by other researchers without compromising confidentiality of the RLNs resulting from the method.
PubMedCalculating the probability of rare events: why settle for an approximation?
26 Citations1993Harold S. Luft, B W Brown
Calculating the probability of observing a small number of events using standard approaches may result in substantial errors, and the availability of a simple and inexpensive method of calculating these probabilities exactly can avoid these errors.