Assessing the impact of clinical information‐retrieval technology in a family practice residency
Journal of Evaluation in Clinical PracticePublished 30 November 2005
Roland Grad, Pierre Pluye, Yuejing Meng, B. Segal, Robyn Tamblyn
Citations32
SJR quartileQ2
SJR score0.80
SNIP0.97
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A method to evaluate evidence-based sources of information, by systematically assessing the impact of searches for clinical information in everyday practice, permits systematic and comparative assessment of impact associated with distinct categories of information.
Abstract
RATIONALE AND OBJECTIVE: Evidence-based sources of information do not integrate self-assessment tools to assess the impact of a users' search for clinical information. We present a method to evaluate evidence-based sources of information, by systematically assessing the impact of searches for clinical information in everyday practice. METHODS: We integrated an information management tool (InfoRetriever 2003) with an educational intervention in a cohort of 26 family medicine residents. An electronic impact assessment scale was used by these doctors to report the perceived impact of each item of information (each hit) retrieved on hand-held computer. We compared the types of impact associated with hits in two distinct categories: clinical decision support systems (CDSS) vs. clinical information-retrieval technology (CIRT). Information hits in CDSS were defined as any hit in the following InfoRetriever databases: Clinical Prediction Rules, History and Physical Exam diagnostic calculator and Diagnostic Test calculator. CIRT information hits were defined as any hit in: Abstracts of Cochrane Reviews, InfoPOEMs, evidence-based practice guideline summaries and the Griffith's 5 Minute Clinical Consult. RESULTS: The impact assessment questionnaire was linked to 5160 information hits. 4946 impact assessment questionnaires were answered (95.9%), and 2495 contained reports of impact (48.4%). Reports of positive impact on doctors were most frequently in the areas of learning and practice improvement. In comparison to CDSS, CIRT hits were more frequently associated with learning and recall. CDSS hits were more frequently associated with reports of practice improvement. CONCLUSIONS: Our new method permits systematic and comparative assessment of impact associated with distinct categories of information.
Keywords
MedicineHealth Professions
Annals of Internal MedicineInformation Needs in Office Practice: Are They Being Met?
863 Citations1985David G. Covell, GWEN C. UMAN +1 more
The self-reported information needs of 47 physicians during a half day of typical office practice were studied, and physicians raised 269 questions about patient management, related to all medical specialties and were highly specific to the individual patient's problem.
International Journal for Quality in Health CareEvidence of self-report bias in assessing adherence to guidelines
655 Citations1999Alyce S. Adams, Stephen B. Soumerai +2 more
Although self-reports may provide information regarding clinicians' knowledge of guideline recommendations, they are subject to bias and should not be used as the sole measure of guideline adherence.
Annals of Internal MedicineOnline Access to MEDLINE in Clinical Settings
294 Citations1990R. Brian Haynes, K. Ann McKibbon +4 more
Self-service access to the medical literature database, MEDLINE, into clinical settings is feasible with brief training and affects clinical decisions, however, inexperienced searchers miss many relevant citations and search inefficiently.
PubMedBecoming an information master: a guidebook to the medical information jungle.
217 Citations1994Allen F. Shaughnessy, D C Slawson +1 more
Armed with this guide, clinicians can find the most appropriate source of information, evaluate it quickly, and apply it confidently in their efforts to provide the best care for their patients.
PubMedUse of MEDLINE by physicians for clinical problem solving.
168 Citations1993D. A. B. Lindberg, E R Siegel +3 more
Psychology Press eBooksReal-Time Self-Report of Momentary States in the Natural Environment: Computerized Ecological Momentary Assessment
167 Citations1999Saul Shiffman
PubMedIn search of evidence: family practitioners' use of the Internet for clinical information.
157 Citations2002Rowena Cullen
Pupils urgently need training in searching and evaluating information on the Internet and in identifying and applying evidence-based information.
PubMedCan primary care physicians' questions be answered using the medical journal literature?
156 Citations1994Paul Gorman, Joan S. Ash +1 more
If the results can be generalized, and the time and cost of performing searches can be reduced, increased use of the journal literature could significantly improve the extent to which primary care physicians' information needs are met.
Journal of the American Medical Informatics AssociationClinician Use of a Palmtop Drug Reference Guide
154 Citations2002Jennifer M. Rothschild
Self-reported perceptions by responding clinicians endorse improved access to drug information and improved practice efficiency associated with the use of handheld devices as wireless communication becomes more ubiquitous and as more applications become available.
Academic MedicineEffect of online literature searching on length of stay and patient care costs
142 Citations1994M S Klein, Faith VanToll Ross +2 more
Of the test-case patients (for whom MEDLINE searches were conducted during hospitalization), those whose searches were Conducted earlier had statistically significantly lower costs, charges, and lengths of stay than those whose searched were conducted later.
BMJRandomised controlled trial of clinical decision support tools to improve learning of evidence based medicine in medical students
133 Citations2003GM Leung, Janice M Johnston +5 more
Rapid and convenient access to valid and relevant evidence on a portable computing device can improve learning in evidence based medicine, increase current and future use of evidence, and boost students' confidence in clinical decision making.
Journal of Epidemiology & Community HealthBasic concepts in medical informatics
127 Citations2002Jeremy C Wyatt, J L Y Liu
This glossary defines terms used in the comparatively young science of medical informatics and is hoped that it will be of interest to both novices and professionals in the field.
Journal of the American Medical Informatics AssociationDo Clinicians Use Online Evidence to Support Patient Care? A Study of 55,000 Clinicians
126 Citations2003Johanna Westbrook
Clinicians' online evidence use increases with patient admissions, supporting the hypothesis that clinicians' use of evidence is related to direct patient care and patterns of evidence use and clinicians' self-reports also support this hypothesis.
Critical CareHandheld computers in critical care
92 Citations2001Stephen E. Lapinsky, Jason Weshler +4 more
The introduction of handheld computers for managing patient data and accessing medical reference information, in an academic intensive-care unit (ICU), was well received despite differences in users' familiarity with the devices.
JAMAUse of MEDLINE by Physicians for Clinical Problem Solving
83 Citations1993Donald A. B. Lindberg
To understand the ways in which computer-mediated searching of the biomedical literature affects patient care and other professional activities, the National Library of Medicine's MEDLINE database "makes a difference" in what physicians do when confronted with a medical problem requiring new or additional information.
Journal of the American Medical Informatics AssociationComparative Impact of Guidelines, Clinical Data, and Decision Support on Prescribing Decisions: An Interactive Web Experiment with Simulated Cases
77 Citations2003Vitali Sintchenko, Enrico Coiera +2 more
In measuring the impact of decision support systems, both their effectiveness in improving decisions and their likely rate of adoption in the clinical environment need to be considered.
BMJJust in time information for clinicians: a questionnaire evaluation of the ATTRACT project
71 Citations2001Jon Brassey, Glyn Elwyn +2 more
ATTRACT was created in 1997 to provide rapid, evidence based summaries to clinical queries and the questions received include “Do decongestants help in people with eustachian tube dysfunction?” and “What are the risks of flying while pregnant?’.
Journal of Evaluation in Clinical PracticeHow information retrieval technology may impact on physician practice: an organizational case study in family medicine
62 Citations2004Pierre Pluye, Roland Grad
This study suggests a new basis for evaluating the impact of information retrieval technology in daily clinical practice and encourages policy-makers to develop, and physicians to use, this technology.
PubMedUse of on-line evidence-based resources at the point of care.
61 Citations2003Kendra Schwartz, Justin Northrup +4 more
Practical physicians inexperienced in the use of on-line evidence-based resources answered a proportion of their clinical questions that was comparable to reports of more-experienced searchers; however, the time required to find answers limits the practical use of these databases during patient care time.
Journal of Continuing Education in the Health ProfessionsInformation mastery: Integrating continuing medical education with the information needs of clinicians
59 Citations2003Mark H. Ebell, Allen F. Shaughnessy
Continuing medical education suggests that physicians will learn best when learning is in the context of patient care, answers their questions, does not take too much time, and is directly applicable to their work.
Journal of Continuing Education in the Health ProfessionsPractice-based learning and improvement
57 Citations2003Donald E. Moore, Floyd C. Pennington
Seven issues associated with PBLI are described and questions for reflections are posed, as continuing medical education (CME) planners consider working with P BLI.
PubMedA clinical informaticist to support primary care decision making.
55 Citations2001Deborah Swinglehurst, M. Pierce +1 more
The clinical informaticist service increased access to evidence for busy clinicians and Satisfaction was high among users and clinicians stated that changes in practice would occur, however, uptake of the service was lower than expected.
The Joint Commission Journal on Quality ImprovementA Web-Based Diabetes Care Management Support System
54 Citations2001Ann M. Baker, Jennifer Elston Lafata +3 more
Computerized systems of clinical practice guidelines, patient registries, and performance feedback may help improve the rate of routine testing among patients with diabetes.
Academic MedicineA Web-based Compendium of Clinical Questions and Medical Evidence to Educate Internal Medicine Residents
52 Citations2003Steven D. Crowley, Thomas Owens +5 more
The use of an evidence-based critical appraisal resource led residents to engage the medical literature on behalf of their patients and influenced approximately half of their patient-care decisions.
PubMedClinical medical librarian impact on patient care: a one-year analysis.
51 Citations1992Robert J. Veenstra
It appears that CMLs can continue to provide information that has a strong impact on patient care, despite the availability of an end-user local MEDLINE system.
Pharmacotherapy The Journal of Human Pharmacology and Drug TherapyDrug‐Information Software for Palm Operating System Personal Digital Assistants: Breadth, Clinical Dependability, and Ease of Use
43 Citations2002Shelly J. Enders, Jason M. Enders +1 more
The breadth, clinical dependability, and ease of use of drug‐information software programs for personal digital assistants that incorporate the Palm operating system are examined.
The Medical Journal of AustraliaFeasibility of an evidence‐based literature search service for general practitioners
43 Citations2001Chris Del Mar, Chris Silagy +7 more
To test the feasibility of an evidence‐based clinical literature search service to help answer general practitioners' (GPs) clinical questions, a large number of patients using this service had never heard of it.
PubMedTeaching evidence-based medical care: description and evaluation.
40 Citations2001Roland Grad, Ann C. Macaulay +1 more
First-year family practice residents who completed a seminar series have reported increased skill at blending consideration of a clinical problem with the use of secondary sources of information to access evidence to support their health care decisions.
BMJ Quality & SafetyA clinical informaticist to support primary care decision making
40 Citations2001Deborah Swinglehurst, M Pierce +1 more
PubMedInternet use amongst New Zealand general practitioners.
32 Citations2000J Eberhart-Phillips, K Hall +6 more
Internet use among New Zealand doctors and patients is widespread, and is likely to have significant impact on medical practice now and in the future.
The Medical Journal of AustraliaProviding evidence‐based answers to clinical questions A pilot information service for general practitioners
31 Citations1999John A. Hayward, Susan Wearne +4 more
To pilot a clinical information service for general practitioners to help doctors and nurses better understand each other's patients and formulate treatment plans.
PubMedPrimary care guidelines on consultation practices: the effectiveness of computerized versus paper-based versions. A cluster randomized controlled trial among newly qualified primary care physicians.
31 Citations2002Jukkapekka Jousimaa, Marjukka Mākelä +3 more
PubMedOnline access to MEDLINE in clinical settings: impact of user fees.
29 Citations1991R. Brian Haynes, M F Ramsden +2 more
Imposing user charges for online searching in clinical settings after a period of free use adversely affects searching quantity, but not quality, and MEDLINE providers should consider whether user fees will undermine its benefits.
International Journal of Technology Assessment in Health CarePhysicians' Patterns of Using a Computerized Collection of Guidelines for Primary Care
18 Citations1998Jukkapekka Jousimaa, Ilkka Kunnamo +1 more
The Physician's Desk Reference and Database is a Finnish collection of computerized primary care guidelines and a function producing a log file of all searches was added to the program for this study.
Journal of Medical SystemsTerminological Problems in Information Retrieval
18 Citations2003Yuri Kagolovsky, Jochen R. Moehr
Journal of Continuing Education in the Health ProfessionsPractice-based learning and improvement: A dream that can become a reality
17 Citations2003Phil R. Manning
Methods of data collection must be simplified, the delivery of point-of-care information and reminders must become more automatic, and physicians must develop skills to make the discussion of practice data acceptable, stimulating, and not unduly punitive.
PubMedAn information retrieval service to support clinical decision-making at the point of care.
16 Citations1999Frank Sullivan, M. Gardner +1 more
The extent to which information retrieval could support primary care consultations is examined by examining the impact of the new technology at different stages of the consultation.
PubMedUse of the PDQ system in a clinical setting.
13 Citations1990J J Angier, Shevaun Beck +1 more
Results indicate that access to PDQ on an oncology unit provides an excellent educational and clinical resource.
Academic MedicineElectronic Procedure Logs
11 Citations2002David Topps, Doug Hall
Focus-group feedback from the residents has shown that the rich data in the logbook's reference component improved its usefulness and popularity as an educational tool, and the evidence indicates the need to implement central data collection and backup right from the outset.
Information Processing & ManagementA longitudinal study of database-assisted problem solving
8 Citations2000Barbara M. Wildemuth, Charles P. Friedman +2 more
There was a marginally significant interaction between interface style and assessment occasion, suggesting that performance with the direct manipulation interface was less affected by variation in the students’ personal knowledge than performance in the form-filling interface.
PubMedPapers of two former Medical Library Association presidents cataloged in Philadelphia.
8 Citations2002Mark H. Ebell, David C. Slawson +1 more
The authors thank David Howse for his thorough and favorable review of InfoRetriever in the January 2002 issue of Journal of the Medical Library Association and hope that others will also take the opportunity to review the software.
PubMedStudent and faculty performance in clinical simulations with access to a searchable information resource.
4 Citations1999Vijoy A. Abraham, Charles P. Friedman +4 more
The idea that students with database access in a clinical simulation environment can perform at a higher level than their counterparts who lack access to such information is supported, reflecting favorably on the use of information resources in training environments.