How best to measure surgical quality? comparison of the Agency for Healthcare Research and Quality Patient Safety Indicators (AHRQ-PSI) and the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) postoperative adverse events at a single institution
SurgeryPublished 29 August 2011
Robert R. Cima, Kandace A. Lackore, Sharon Nehring, Stephen D. Cassivi, John H. Donohue, Claude Deschamps
Citations195
SJR quartileQ1
SJR score1.09
SNIP1.16
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The AHRQ-PSI as applied to postoperative patients is a poor measure of quality performance and the ACS-NSQIP as a validated, risk-adjusted, clinically derived data methodology to compare observed to expected outcomes after a wide variety of operations is compared.
Abstract
AHRQ-PSI algorithms identified less than a third of the ACS-NSQIP clinically important adverse events. Furthermore, the AHRQ-PSI identified a large number of events with no corresponding clinically important adverse outcomes. The sensitivity of the AHRQ-PSI for detecting clinically relevant adverse events identified by the ACS-NSQIP varied widely. The AHRQ-PSI as applied to postoperative patients is a poor measure of quality performance.
Keywords
MedicineHealth Professions
National Academies Press eBooksTo Err Is Human
14,096 Citations2000Institute of Medicine
A process for the preparation of prostaglandins which are known pharmaceutically active compounds and then R alpha , R omega -cyclopentenoids is described.
Annals of SurgeryThe Department of Veterans Affairs' NSQIP
1,520 Citations1998Shukri F. Khuri, Jennifer Daley +16 more
Reliable, valid information on patient presurgical risk factors, process of care during surgery, and 30-day morbidity and mortality rates is available for all major surgical procedures in the 123 VAMCs performing surgery in the Veterans Health Administration.
Journal of the American College of SurgeonsToward Robust Information: Data Quality and Inter-Rater Reliability in the American College of Surgeons National Surgical Quality Improvement Program
1,270 Citations2009Mira Shiloach, Stanley K. Frencher +7 more
Audit results show that data have been reliable since the program's inception and that reliability has improved every year, and Estimated kappa values suggest substantial or almost perfect agreement for most variables.
Annals of Internal MedicineAssessing Quality Using Administrative Data
974 Citations1997Lisa I. Iezzoni
State and regional efforts to assess the quality of health care often start with administrative data, which are a by-product of administering health services, enrolling members into health insurance plans, and reimbursing for health care services.
Annals of Internal MedicineDiscordance of Databases Designed for Claims Payment versus Clinical Information Systems: Implications for Outcomes Research
633 Citations1993James G. Jollis, Marek Ancukiewicz +4 more
This study examined the suitability of billing data compared with clinical data (prospectively collected for cardiology research and patient care) for use in clinical outcomes research and found that billing data is limited by the unstructured way in which they are collected.
New England Journal of MedicineAccuracy of Diagnostic Coding for Medicare Patients under the Prospective-Payment System
494 Citations1988David C. Hsia, W. Mark Krushat +3 more
It is concluded that "creep" does occur in the coding of DRGs, resulting in overpayment to hospitals for patients covered by Medicare, and a statistically significant 61.7 percent of coding errors favored the hospital.
Journal of the American Medical Informatics AssociationAccuracy of Data in Computer-based Patient Records
389 Citations1997William R. Hogan, Michael M. Wagner
It is concluded that knowledge of data accuracy in CPRs is not commensurate with its importance and further studies are needed, and methodological guidelines for studying accuracy are proposed that address shortcomings of the current literature.
The American Journal of SurgeryDesign and statistical methodology of the National Surgical Quality Improvement Program: why is it what it is?
281 Citations2009William G. Henderson, Jennifer Daley
The philosophy and principles of the National Surgical Quality Improvement Program are reviewed and how the design and statistical methods that were chosen for the program are explained.
Journal of the American College of SurgeonsIdentifying Patient Preoperative Risk Factors and Postoperative Adverse Events in Administrative Databases: Results From The Department of Veterans Affairs National Surgical Quality Improvement Program
262 Citations2002William R. Best, Shukri F. Khuri +5 more
Sensitivity and positive predictive value of administrative data in comparison to NSQIP data were poor, and it is not recommended that administrative data should be substituted for NSQip data methods.
Medical CareDoes Clinical Evidence Support ICD-9-CM Diagnosis Coding of Complications?
244 Citations2000Ellen P. McCarthy, Lisa I. Iezzoni +7 more
Clinical evidence supported most postoperative acute myocardial infarction diagnoses, but fewer than 60% of other diagnoses had confirmatory clinical evidence by explicit clinical criteria, raising questions about whether the clinical conditions represented by ICD-9-CM codes used by the Complications Screening Program were in fact always present.
Medical CareCan Administrative Data Be Used to Compare Postoperative Complication Rates Across Hospitals?
237 Citations2002Patrick S. Romano, Benjamin Chan +2 more
ICD-9-CM complications were underreported among diskectomy patients, especially at hospitals with low risk-adjusted complication rates, and the validity of using coded complications to compare provider performance is questionable.
Journal of the American College of SurgeonsValidating Risk-Adjusted Surgical Outcomes: Site Visit Assessment of Process and Structure1
235 Citations1997Jennifer Daley, Maureen G. Forbes +6 more
Significant differences in several dimensions of process and structure of the delivery of surgical care are associated with differences in risk-adjusted surgical morbidity and mortality rates among 44 Veterans Affairs Medical Centers.
Journal of the American College of SurgeonsAssessment of the Reliability of Data Collected for the Department of Veterans Affairs National Surgical Quality Improvement Program
234 Citations2007Chester L. Davis, J. Rush Pierce +8 more
This sample of medical centers shows adherence to criteria in selecting cases for the NSQIP database, for reporting deaths, and for collecting patient risk variables.
Health Services ResearchValidity of Selected AHRQ Patient Safety Indicators Based on VA National Surgical Quality Improvement Program Data
161 Citations2008Patrick S. Romano, Hillary J. Mull +7 more
Examination of AHRQ Patient Safety Indicators using clinical data from the Veterans Health Administration's National Surgical Quality Improvement Program found "Postoperative respiratory failure" and "postoperative wound dehiscence" exhibited significant increases in sensitivity after modifications.
Journal of Public HealthAssessment of the reproducibility of clinical coding in routinely collected hospital activitydata: a study in two hospitals
158 Citations1998J. H. Dixon, Colin Sanderson +4 more
The full clinical codes in NHS hospital episode statistics (HES) data should be treated with caution, particularly for asthma and fractured femur, where reliability of the first three characters is much higher than for some specific conditions such as asthma.
International Journal of Medical InformaticsQuestions on validity of International Classification of Diseases-coded diagnoses
92 Citations1999György Surján
A general framework of the coding process is given and the main reasons of the errors are the physician's errors in the primary documentation, the insufficient knowledge of the encoders, the internal inconsistency of the ICD, and some psychological factors.
Journal of the American Medical Informatics AssociationAssessing Data Quality: From Concordance, through Correctness and Completeness, to Valid Manipulatable Representations
78 Citations2000Patrícia Flatley Brennan, William W. Stead
The papers by Stein et al.1 and Aronsky and Haug2 address the quality of the data found in clinical record systems and the need for equivalence in recommendations based on the clinical record, regardless of which form they are taken.
Annals of SurgeryPositive Predictive Value of the AHRQ Accidental Puncture or Laceration Patient Safety Indicator
74 Citations2009Garth H. Utter, Patricia Zrelak +5 more
Although PSI 15 is highly predictive of APL from a coding perspective, the indicator is less predictive ofAPL that could be considered clinically important.
International Journal for Quality in Health CareValidating risk-adjusted surgical outcomes: chart review of process of care
44 Citations2001James O. Gibbs
The patient-level findings suggest that the risk-adjustment models are useful for screening adverse outcome cases for quality of care review, and the absence of a relationship between most of the measures of process of care and risk-adjusted outcomes may be due to an insensitivity of chart reviews to hospital-level differences inquality of care.
Medical CareImpact of Diagnosis-Timing Indicators on Measures of Safety, Comorbidity, and Case Mix Groupings From Administrative Data Sources
37 Citations2007James M. Naessens, Claudia Campbell +3 more
Many patient safety indicators do not reliably identify adverse hospital events, especially when applied to academic referral centers, and conditions recorded after admission have minimal impact on comorbidity and severity measures or on Medicare reimbursement.
Obstetrics and GynecologyProspective Study of Coding Practices for Cesarean Deliveries
16 Citations2009Nancy C. Chescheir, Laura Meints
Documenting providers, coders, and institutions should exercise caution in the use of DRG codes, procedure codes, and ICD-9 codes for cesarean deliveries, because of the difficulty of the coding process and judgments that need to be made by the coders in assigning the codes.