Do physicians know when their diagnoses are correct?
Journal of General Internal MedicinePublished 1 April 2005Open access
Charles P. Friedman, Guido Gatti, Timothy M. Franz, Gwendolyn C. Murphy, Fredric M. Wolf, Paul S. Heckerling
Citations191
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This study explores the alignment between physicians’ confidence in their diagnoses and the “correctness” of these diagnoses, as a function of clinical experience, and whether subjects were prone to over- or underconfidence.
Abstract
Even experienced clinicians may be unaware of the correctness of their diagnoses at the time they make them. Medical decision support systems, and other interventions designed to reduce medical errors, cannot rely exclusively on clinicians' perceptions of their needs for such support.
Keywords
MedicineHealth ProfessionsNursing
BiometricsThe Measurement of Observer Agreement for Categorical Data
78,934 Citations1977J. Richard Landis, Gary G. Koch
A general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies is presented and tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interob server agreement are developed as generalized kappa-type statistics.
ScienceJudgment under Uncertainty: Heuristics and Biases
28,003 Citations1974Amos Tversky, Daniel Kahneman
Three heuristics that are employed in making judgements under uncertainty are described: representativeness, availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development.
Judgment under Uncertainty: Heuristics and Biases
23,088 Citations1975Amos Tversky, Daniel Kahneman
BiometrikaLongitudinal data analysis using generalized linear models
18,123 Citations1986Kung‐Yee Liang, Scott L. Zeger
National Academies Press eBooksTo Err Is Human
14,096 Citations2000Institute of Medicine
A process for the preparation of prostaglandins which are known pharmaceutically active compounds and then R alpha , R omega -cyclopentenoids is described.
Journal of the American Statistical AssociationGeneralized Linear Models (2nd ed.).
4,940 Citations1993Terry M. Therneau, Peter McCullagh +1 more
A class of statistical models that generalizes classical linear models-extending them to include many other models useful in statistical analysis, of particular interest for statisticians in medicine, biology, agriculture, social science, and engineering.
To Err Is Human : Building A Safer Health System
2,849 Citations2000Kohn, Linda T., Corrigan, Janet +1 more
PubMedEffects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review.
1,690 Citations1998Dereck L. Hunt, R. Brian Haynes +2 more
The CDSSs can enhance clinical performance for drug dosing, preventive care, and other aspects of medical care, but not convincingly for diagnosis.
Organizational Behavior and Human PerformanceDo those who know more also know more about how much they know?
1,086 Citations1977Sarah Lichtenstein, Baruch Fischhoff
New England Journal of MedicineA Computer-Assisted Management Program for Antibiotics and Other Antiinfective Agents
1,062 Citations1998R. Scott Evans, Stanley L. Pestotnik +6 more
A computerized antiinfectives-management program linked to computer-based patient records that can assist physicians in the use of antiinfective agents and improve the quality of care and reduce costs is developed.
PubMedSystems analysis of adverse drug events. ADE Prevention Study Group.
633 Citations1995L L Leape, David W. Bates +8 more
Journal of the American Medical Informatics AssociationMedical Diagnostic Decision Support Systems--Past, Present, And Future: A Threaded Bibliography and Brief Commentary
453 Citations1994Randolph A. Miller
International Journal of Medical InformaticsThe Regenstrief Medical Record System: a quarter century experience
400 Citations1999Clement J. McDonald, J. Marc Overhage +19 more
The RMRS data model, file structures and architecture, as well as recent necessary changes to these are described as the authors coordinate a collaborative effort among all major Indianapolis hospital systems, improving patient care by capturing city-wide laboratory and encounter data.
Journal of Experimental Psychology Human Perception & PerformancePhysicians' use of probabilistic information in a real clinical setting.
343 Citations1981Jay Christensen-Szalanski, James B. Bushyhead
Physicians overestimated the patients' probability of pneumonia but were sensitive to relative differences in the predictive value of symptoms when present and absent, and appeared to use base-rate information correctly when making clinical judgments.
Springer series in statisticsGeneralized Linear Models
286 Citations1992J. A. Nelder, R. W. M. Wedderburn
JAMAEnhancement of Clinicians' Diagnostic Reasoning by Computer-Based Consultation
216 Citations1999Charles P. Friedman, Arthur S. Elstein +7 more
The idea that "hands-on" use of diagnostic DSSs can influence diagnostic reasoning of clinicians is supported, and the larger effect for students suggests a possible educational role for these systems.
Medical Decision MakingPhysicians' Estimates of the Probability of Myocardial Infarction in Emergency Boom Patients with chest Pain
144 Citations1986William M. Tierney, John F. Fitzgerald +5 more
To evaluate the ability of emergency room physicians to estimate the probability of myocardial infarction in patients with acute chest pain, historical, physical, and electrocardiographic information was gathered from 492 patients at the time of their presentation.
Annals of Internal MedicineError in Medicine: What Have We Learned?
125 Citations2000David W. Bates, Atul A. Gawande
There has been a transformation in thinking and research about medical error and injury, much of which has used information from other industries, and the single focus of both the medical profession and the medicolegal system has been on individual culpability for error.
Academic Medicine“Just-in-time” clinical information
119 Citations1997H C Chueh, G. Octo Barnett
The authors discuss traditional modes of managing clinical information, and then describe how a new, just-in-time model may be developed and implemented, and the challenges posed by the implementation of such an information-access model.
PubMedSupporting infobuttons with terminological knowledge.
110 Citations1997James J. Cimino, Gai Elhanan +1 more
The kinds of knowledge in the MED, including literal attributes, hierarchical links and other semantic links, are described, and how this knowledge is used in system integration is described.
Academic Medicine“A world of knowledge at your fingertips”
52 Citations1999William Hersh
Medical knowledge resources are increasingly available in electronic form, particularly on the World Wide Web, but they are not well integrated into clinical practice, prove difficult to find specific information in, and contain content of varying quality.
Studies in health technology and informaticsAre Clinicians Correct When They Believe They are Correct? Implications for Medical Decision Support
41 Citations2001Charles P. Friedman, Guido Gatti +4 more
The results indicate that medical decision support systems cannot rely exclusively on clinicians' perceptions of their information needs, as such perceptions will frequently be incorrect.
PubMedClinical event monitoring at the University of Pittsburgh.
20 Citations1997Michael M. Wagner, Marvin C. Pankaskie +5 more
The experience deploying CLEM, the clinical event monitor at the University of Pittsburgh is described, with emphasis on issues related to event detection, scalability, what topics were suitable for asynchronous decision support, and overlap of efforts of other groups at the institution attempting to improve quality and lower cost of care.
The Relationship between Diagnostic Accuracy and Confidence in Medical Students.
13 Citations1993Doug Mann
Evaluating individuals on "adjusted resolution," which provides an index of the ability to sort correct and incorrect diagnoses into different confidence levels, reveals a curvilinear relationship between diagnostic metacognition (adjusted resolution) and accuracy.
Methods of Information in MedicineBuilding an Expert Critiquing System: ESSENTIAL-ATTENDING
9 Citations1986Philip L. Miller
E-ATTENDING is currently designed to help implement a class ofcritiquing systems in a subset of possible critiquing domains and can be augmented in various ways by interested users to accommodate critiqued domains with more complexity.
Methods of Information in MedicineBuilding an Expert Critiquing System: ESSENTIAL-ATTENDING
8 Citations1986Perry L. Miller
E-ATTENDING is currently designed to help implement a class ofcritiquing systems in a subset of possible critiquing domains and can be augmented in various ways by interested users to accommodate critiqued domains with more complexity.