Performance of Four Computer-Based Diagnostic Systems
New England Journal of MedicinePublished 23 June 1994
Eta S. Berner, George D. Webster, Alwyn A. Shugerman, James R. Jackson, James Algina, Alfred L. Baker
Citations326
SJR quartileQ1
SJR score19.08
SNIP13.47
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A profile of the strengths and limitations of the diagnostic capabilities of four internal medicine diagnostic systems: Dxplain, Iliad, Meditel, and QMR is provided.
Abstract
The results provide a profile of the strengths and limitations of these computer programs. The programs should be used by physicians who can identify and use the relevant information and ignore the irrelevant information that can be produced.
Keywords
Computer ScienceMedicineHealth Professions
JAMAUsers' guides to the medical literature
2,981 Citations1993Gordon Guyatt
A 55-year-old man who had his serum cholesterol level measured at a shopping mall 2 months ago has an elevated cholesterol level, but before deciding on a treatment recommendation, you elect to find out just how big a reduction in the risk of CHD this patient could expect from a cholesterollowering diet or drug therapy.
New England Journal of Medicine<i>Internist-I</i>, an Experimental Computer-Based Diagnostic Consultant for General Internal Medicine
1,103 Citations1982Randolph A. Miller, Harry E. Pople +1 more
It is demonstrated that the present form of the INTERNIST-I program is not sufficiently reliable for clinical applications and specific deficiencies that must be overcome include the program’s inability to reason anatomically or temporally, its inability to construct differential diagnoses spanning multiple problem areas, and its occasional attribution of findings to improper causes.
Educational ResearcherPartners in Cognition: Extending Human Intelligence with Intelligent Technologies
891 Citations1991Gavriel Salomon, David N. Perkins +1 more
This work examines how technologies, particularly computer technologies that aid in cognitive processing, can support intellectual performance and enrich individuals' minds and offers two views, one emphasizing mainly the upgraded performance in a person-machine system of partnership, the other emphasizing more the educationally valued cognitive residue that can result.
Journal of the American Statistical AssociationModified Sequentially Rejective Multiple Test Procedures
759 Citations1986Juliet Popper Shaffer
Journal of the American Medical Informatics AssociationMedical Diagnostic Decision Support Systems--Past, Present, And Future: A Threaded Bibliography and Brief Commentary
453 Citations1994Randolph A. Miller
JAMADXplain. An evolving diagnostic decision-support system
386 Citations1987G. Octo Barnett
A key element in the distribution of DXplain is the planned collaboration with its physician-users whose comments, criticisms, and suggestions will play an important role in modifying and enhancing the knowledge base.
JAMAComputer Programs to Support Clinical Decision Making
324 Citations1987Edward H. Shortliffe
The current status of computer-based medical decision support, the goals of system developers, the reasons for slow progress since the field began almost 30 years ago, and the logistical and scientific challenges that lie ahead are summarized.
PubMedProbabilistic diagnosis using a reformulation of the INTERNIST-1/QMR knowledge base. I. The probabilistic model and inference algorithms.
296 Citations1991Michael Shwe, Blackford Middleton +5 more
Annals of Internal MedicineMedical Informatics: Computer Applications in Health Care.
232 Citations1991Edward H. Shortliffe
PubMedThe INTERNIST-1/QUICK MEDICAL REFERENCE project--status report.
192 Citations1986Randolph A. Miller, Melissa McNeil +3 more
A preliminary study indicates that QMR's case-analysis capabilities are of potential benefit in most patients in internal medicine admitted for diagnostic evaluation, and has not been evaluated formally as an information tool for practicing physicians.
Journal of the American Statistical AssociationModified Sequentially Rejective Multiple Test Procedures
168 Citations1986Juliet Popper Shaffer
Artificial Intelligence in MedicineThe adolescence of AI in Medicine: Will the field come of age in the '90s?
152 Citations1993Edward H. Shortliffe
Effective fielding of AIM systems will be dependent on the development of integrated environments for communication and computing that allow merging of knowledge-based tools with other patient data-management and information-retrieval applications.
New England Journal of MedicineArtificial Intelligence in Medicine
144 Citations1987William B. Schwartz, Ramesh S. Patil +1 more
The story behind unfulfilled expectations of computer-aided diagnosis is instructive and offers hope for the future.
Annals of Internal MedicineA Computer-Assisted Medical Diagnostic Consultation Service
123 Citations1989Richard Bankowitz, Melissa A. McNeil +4 more
Computer-aided diagnostic consultation, when provided by physicians familiar with the limitations of the system and capable of overriding inappropriate suggestions, was both accurate and educationally helpful in most cases.
Archives of Family MedicineComputerized patient records in primary care. Their role in mediating guideline-driven physician behavior change
105 Citations1995Robert B. Elson
A synthesis of relevant research from the domains of practice guidelines and medical informatics strongly suggests that the operational support provided by computerized patient record systems will have a major impact on physician compliance with practice guidelines.
Methods of Information in MedicineProbabilistic Diagnosis Using a Reformulation of the INTERNIST-1/QMR Knowledge Base
105 Citations1991A. M. Shwe, E. D. Heckerman +5 more
A probabilistic reformulation of the Quick Medical Reference (QMR) system is developed, and an evaluation of the Probabilistic QMR is reported on, which compares the performance of QMR to that of the probabilists system on cases abstracted from continuing medical education materials from Scientific American Medicine.
Methods of Information in MedicineIliad: Moving Medical Decision-Making into New Frontiers
86 Citations1989H. R. Warner
The essence of medical education should evolve around the training of would-be clinicians in the difficult art of diagnostic decisionmaking, according to the author.
Knowledge Coupling: New Premises and New Tools for Medical Care and Education
82 Citations1991Lawrence L. Weed
New England Journal of MedicineA Report Card on Computer-Assisted Diagnosis -- The Grade: C
80 Citations1994Jerome P. Kassirer
This issue of the Journal contains a comparison of four commercially available computer programs designed to diagnose diseases that internists might encounter, finding that all the programs performed equally well.
BMJGuidelines, enthusiasms, uncertainty, and the limits to purchasing
76 Citations1995Martin McKee, Aileen Clarke
The challenges of balancing the desire for protocol based uniformity with the needs of individual patients are examined, the extent to which existing purchasing structures can support this process is explored, and whether such moves will actually lead to reduced costs are questioned.
The Journal of Medicine and Philosophy A Forum for Bioethics and Philosophy of MedicineWhy the Standard View is Standard: People, Not Machines, Understand Patients' Problems
74 Citations1990Randolph A. Miller
This commentary explains why the Standard View should remain standard and why recent progress in computer-based diagnosis has been encouraging enough to consider the concept of "human-assisted computer diagnosis".
New England Journal of MedicineThe Computer as a Consultant
73 Citations1971Louis M. Sherwood, Edith E. Parris +1 more
A computer program designed to help physicians manage patients with electrolyte and acid–base disorders directs a dialogue during which the physician supplies clinical and laboratory information.
Computers and medicineComputer-Assisted Medical Decision Making
69 Citations1985James A. Reggia, Stanley Tuhrim
Knowledge Coupling
62 Citations1991Lawrence L. Weed
The volume explores the methods of structuring and using medical knowledge and medical records that enables implementation of new premises and sets forth a specific approach to use of the computer.
BiometricsSample Sizes in the Multivariate Analysis of Repeated Measurements
62 Citations1986Edward F. Vonesh, M. Anthony Schork
Determination of sample sizes for comparing two or more treatments in repeated measurements experiments is considered, with particular emphasis placed on applications wherein the error variance-covariance matrix is arbitrary positive-definite.
New England Journal of MedicineThe Computer and Clinical Judgment
58 Citations1982G. Octo Barnett
For a number of years it has been predicted that the use of computer technology would result in radical changes in the storage and retrieval of medical data, but changes have for the most part been limited to the support of such administrative functions in hospitals as admissions and discharge tracking and census activities.
Computers and Biomedical ResearchINTERNIST-I properties: Representing common sense and good medical practice in a computerized medical knowledge base
46 Citations1985Fred E. Masarie, Randolph A. Miller +1 more
This paper reviews the implementation and significance of properties in the INTERNIST-I knowledge representation scheme and finds that properties substantially influence the behavior of the INTERnist-I diagnostic program during case analyses.
Computers and Biomedical ResearchQUICK (QUick Index to Caduceus Knowledge): Using the Internist-1/Caduceus knowledge base as an electronic textbook of medicine
42 Citations1985Michael B. First, Lynn J. Soffer +1 more
Using the INTERNIST-I knowledge base as an electronic textbook expands the project's intended audience by providing clinical support for a broad group of diagnostic problems.
Computer Methods and Programs in BiomedicineAn approach to evaluating the accuracy of DXplain
40 Citations1991Mitchell J. Feldman, G. Octo Barnett
Preliminary results on a trial evaluation of 46 cases indicate that DXplain, on average, did well in agreeing with the consensus and Agreement was achieved both in regard to the specific diagnoses listed in the ddx and the degree to which the diseases were felt to be supported by the case findings.
MedicineComputer-Assisted Adult Medical Diagnosis
38 Citations1990Herbert S. Waxman, William E. Worley
It is concluded that, in appropriately selected cases, the accuracy and efficiency of physician diagnosis can be enhanced with computer assistance, and the risk of overlooking the correct diagnoses can be reduced.
American journal of diseases of childrenImpact of a System of Computer-Assisted Diagnosis
34 Citations1975Jerry R. Wexler
In a university hospital setting, computer-assisted diagnosis may be most beneficial for patients whose conditions have not been diagnosed within 48 hours of admission.
PubMedEffect of a computer-assisted general medicine diagnostic consultation service on housestaff diagnostic strategy.
34 Citations1989Richard Bankowitz, Melissa McNeil +2 more
Artificial Intelligence in MedicineTowards computer-assisted maintenance of medical knowledge bases
33 Citations1990Dario A. Giuse, Nunzia Bettinsoli Giuse +1 more
A set of tools currently under development at the Section of Medical Informatics of the University of Pittsburgh which incorporate both computer-based tools which assist experts in entering knowledge into the knowledge base are described.
Journal of Medical SystemsEvaluating RECONSIDER
32 Citations1985Stuart J. Nelson, Marsden S. Blois +6 more
RECONSIDER, a computer program designed to perform as a diagnostic prompting aid, was evaluated for its ability to include the correct diagnosis in an ordered computed list of candidate diseases.
Methods of Information in MedicineEffect of a Computer-Assisted General Medicine Diagnostic Consultation Service on Housestaff Diagnostic Strategy
27 Citations1989Richard Bankowitz, M. McNeil +2 more
Quick Medical Reference is a microcomputer-based decision sup´port system designed to provide diagnostic assistance in the field of internal medicine and is rated as helpful educationally and helpful with respect to management in 81 % of the cases.
Computers and Biomedical ResearchPerformance of a diagnostic system (Iliad) as a tool for quality assurance
26 Citations1992Lee Min Lau, Homer R. Warner
The use of an expert diagnostic system, Iliad, to detect quality problems arising from diagnostic errors, and there was none for which the same quality problem was detected by the two procedures, therefore the two review procedures were complementary.
Archives of Pediatrics and Adolescent MedicineComputer-Assisted Diagnosis
26 Citations1974Phillip T. Swender
A computerized system of diagnosis (MEDITEL) was evaluated for its ability to consider a correct diagnosis in cases in which the correct diagnosis was not considered in the original differential diagnosis by physicians involved in the patient's care.
Archives of Pediatrics and Adolescent MedicineComputer-Assisted Diagnosis in Pediatrics
25 Citations1974Lewis A. Barness
A comprehensive computer-assisted diagnosis system of acquired and congenital pediatric diseases has been developed and, using patient information available at the time of the initial history and physical examination, the system included the correct diagnosis as part of a differential diagnosis in 90% of the cases.
International Journal of Bio-Medical ComputingComputer-aided decision support in clinical medicine
23 Citations1989F T de Dombal
Evidence is adduced to suggest that the computer can provide decision support and do so without transgressing professional, ethical or legal boundaries, and it is suggested that the most valuable facet of current systems is the discipline and precision in data collection they impose upon practicing doctors.
Medical InformaticsThe effect of incomplete knowledge on the diagnoses of a computer consultant system
19 Citations1991Paul S. Heckerling, Arthur S. Elstein +2 more
Gaps in the knowledge bases of diagnostic decision support systems could potentially lead systems to reach diagnoses that are implausible to physicians, and Iliad was studied, a computer consultant system that generates differential diagnosis across the domain of internal medicine.
PubMedA method for assessing the impact of a computer-based decision support system on health care outcomes.
18 Citations1992Richard Bankowitz, Judith R. Lave +1 more
Methods of Information in MedicineProblem Area Formation as an Element of Computer Aided Diagnosis: A Comparison of Two Strategies Within Quick Medical Reference (QMR)
18 Citations1991Lewis E. Berman, RA Miller
A comparison of the problem areas generated by the INTERNIST-I partitioning algorithm, the QMR homology function, and expert clinicians finds the correlation to be poor and discusses another method of problem area formation which might better mimic a human clinician and provide an alternative approach in diagnostic computer-aided decision making.
PubMed CentralMedical Information Management: The MEDAS Approach.
17 Citations1990David Trace, Martha Evens +2 more
The proposed comprehensive medical information system includes a recognized, tested medical expert system (MEDAS) combined with modules that address physician needs for an automated medical record, test selection capability, severity assessment, evaluation techniques, treatment protocols and reference to the medical literature.
The American Journal of MedicineMedical informatics: An introduction to computer technology in medicine
15 Citations1988Arthur W. DeTore
Access and effective management of medical information have become increasingly important in the practice of medicine today and it is important that these applications become integrated with existing medical information systems and that physicians take a leading role in developing and maintaining these systems.
Methods of Information in MedicineA Method for Assessing the Impact of a Computer-Based Decision Support System on Health Care Outcomes
14 Citations1992J. R. Lave, M. A. McNeil +1 more
The hypothesis that the introduction of a medical decision support system into clinical practice could potentially lead to more efficient use of diagnostic information, and therefore lead to a reduction in overall laboratory use and cost of care is tested.
PubMed CentralEvaluating the Utility of Available Differential Diagnosis Systems.
14 Citations1988Jeffrey Hammersley, Kathleen A. Cooney
It is found that these systems use fundamentally different approaches to the problem of differential diagnosis which produces significant differences in their speed and in the usability of their differential lists.
PubMed CentralUser Variability in Abstracting and Entering Printed Case Histories with QUICK MEDICAL REFERENCE (QMR).
14 Citations1987Richard Bankowitz, Barry H. Blumenfeld +8 more
The variability in abstracting and entering printed case histories into the Quick Medical Reference (QMR) diagnostic computer program was explored and greater variability was encountered in entering negative findings than in entering positive ones.
Archives of Pediatrics and Adolescent MedicineComputer-Assisted Pediatric Diagnosis
11 Citations1975John S. O'Shea
A system for computer aid to diagnosis was tested on 90 children hospitalized with systemic illness and discharged with a final diagnosis and was accurate in listing the diagnosis in at least 85% of the patients.
PubMed CentralA Statistical Evaluation of the Diagnostic Performance of MEDAS-The Medical Emergency Decision Assistance System.
8 Citations1990D. Christine Georgakis, David Trace +2 more
A new methodology for evaluating the diagnostic accuracy and the predictive capacity of a medical expert system is proposed, adapted to the medical domain measures that have been used in the social sciences to examine the performance of human experts in the decision making process.
PubMedA prospective analysis of inter-rater agreement between a physician and a physician's assistant in selecting QMR vocabulary terms.
3 Citations1991Richard Bankowitz, Joy Miller +1 more
A cohort of 19 hospital inpatients was prospectively identified to serve as a test set to determine the agreement between a physician and a physician's assistant in selecting and entering Quick Medical Reference vocabulary terms for use in QMR case analysis mode.
Europe PMC (PubMed Central)LectureTek: The Complete Source for Locating CME Meetings
3 Citations1993Janice Contini