Research Opportunities in Simulation‐based Medical Education Using Deliberate Practice
Academic Emergency MedicinePublished 23 September 2008Open access
William C. McGaghie
Citations88
SJR quartileQ1
SJR score1.23
SNIP1.30
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The article proceeds to report six lessons learned from a research legacy in simulation-based medical education (SBME), and listing and amplifying 10 DP research opportunities in academic EM.
Abstract
There are many opportunities for the academic emergency medicine (EM) community to engage in simulation-based educational research using deliberate practice (DP). This article begins by defining and giving examples of two key concepts: deliberate practice and mastery learning. The article proceeds to report six lessons learned from a research legacy in simulation-based medical education (SBME). It concludes by listing and amplifying 10 DP research opportunities in academic EM. A coda states that the research agenda is rich and ambitious and should focus on the goal of educating superb, expert clinicians.
Keywords
Medicine
Experimental and quasi-experimental designs for generalized causal inference
13,404 Citations2010William R. Shadish, Thomas D. Cook +1 more
Psychological ReviewThe role of deliberate practice in the acquisition of expert performance.
8,820 Citations1993K. Anders Ericsson, Ralf Krampe +1 more
A theoretical framework is proposed that explains expert performance in terms of acquired characteristics resulting from extended deliberate practice and that limits the role of innate (inherited) characteristics to general levels of activity and emotionality.
Review of General PsychologyConfirmation Bias: A Ubiquitous Phenomenon in Many Guises
7,107 Citations1998Raymond S. Nickerson
Medical TeacherFeatures and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review
3,860 Citations2005S. Barry Issenberg, William C. McGaghie +3 more
While research in this field needs improvement in terms of rigor and quality, high-fidelity medical simulations are educationally effective and simulation-based education complements medical education in patient care settings.
ScienceThe Increasing Dominance of Teams in Production of Knowledge
3,621 Citations2007Stefan Wuchty, Benjamin F. Jones +1 more
Academic MedicineDeliberate Practice and the Acquisition and Maintenance of Expert Performance in Medicine and Related Domains
2,945 Citations2004K. Anders Ericsson
This article proposes an alternative framework to account for individual differences in attained professional development, as well as many aspects of age-related decline, based on the assumption that acquisition of expert performance requires engagement in deliberate practice and that continued deliberate practice is necessary for maintenance of many types of professional performance.
Annals of SurgeryVirtual Reality Training Improves Operating Room Performance
2,776 Citations2002Neal E. Seymour, Anthony G. Gallagher +5 more
Proceedings of the National Academy of SciencesGroups of diverse problem solvers can outperform groups of high-ability problem solvers
2,064 Citations2004Lu Hong, Scott E. Page
It is found that when selecting a problem-solving team from a diverse population of intelligent agents, a team of randomly selected agents outperforms a team comprised of the best-performing agents.
American PsychologistExpert performance: Its structure and acquisition.
1,993 Citations1994K. Anders Ericsson, Neil Charness
Small Group ResearchIs there a “Big Five” in Teamwork?
1,856 Citations2005Eduardo Salas, Dana E. Sims +1 more
Cambridge University Press eBooksThe Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance
1,561 Citations2006K. Anders Ericsson
Medical EducationValidity: on the meaningful interpretation of assessment data
1,408 Citations2003Steven M. Downing
Five sources – content, response process, internal structure, relationship to other variables and consequences – are noted by the Standards for Educational and Psychological Testing as fruitful areas to seek validity evidence.
Measurement and Assessment in Teaching
1,289 Citations1994Robert L. Linn, Norman E. Gronlund
Journal of Applied Behavior Analysis“GOOD‐BYE, TEACHER …”<sup>1</sup>
1,124 Citations1968Fred S. Keller
Academic MedicineSelf-Assessment in the Health Professions: A Reformulation and Research Agenda
930 Citations2005Kevin W. Eva, Glenn Regehr
A large number of studies of self-assessment ability in medical education, health professional education, and professions educat have identified self-Assessment as a vital aspect of professional self-regulation.
JAMASimulation Technology for Health Care Professional Skills Training and Assessment
915 Citations1999S. Barry Issenberg
Some benefits of simulation technology include improvements in certain surgical technical skills, in cardiovascular examination skills, and in acquisition and retention of knowledge compared with traditional lectures.
Medical EducationReliability: on the reproducibility of assessment data
716 Citations2004Steven M. Downing
This presentation explains how assessment data, like other scientific experimental data, must be reproducible in order to be meaningfully interpreted.
CHEST JournalSimulation-Based Education Improves Quality of Care During Cardiac Arrest Team Responses at an Academic Teaching Hospital
675 Citations2007Diane B. Wayne, Aashish Didwania +4 more
Human PerformanceFactors That Influence Skill Decay and Retention: A Quantitative Review and Analysis
620 Citations1998Winfred Arthur, Winston Bennett +2 more
Academic MedicineA review of the validity and accuracy of self-assessments in health professions training
532 Citations1991Michael J. Gordon
The validity of self-assessed performance was found to be low to moderate and did not improve with time in conventional health professions training programs, but effective training to improve validity and accuracy is available and feasible.
Local economic and employment developmentEvaluating Training Programs
495 Citations2005Randall W. Eberts, Christopher J. O’Leary
Journal of Occupational and Organizational PsychologyRater training for performance appraisal: A quantitative review
447 Citations1994David J. Woehr, Allen I. Huffcutt
Journal of General Internal MedicineMastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice
422 Citations2006Diane B. Wayne, John Butter +5 more
A curriculum featuring deliberate practice dramatically increased the skills of residents in ACLS scenarios and illustrate outcome-based medical education that is now prominent in accreditation reform of residency education.
Journal of Hospital MedicineUse of simulation‐based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit
403 Citations2009Jeffrey H. Barsuk, William C. McGaghie +3 more
Simulation-based mastery learning increased residents' skills in simulated CVC insertion, decreased the number of needle passes when performing actual procedures, and increased resident self-confidence.
Teaching and Learning in MedicineSPECIAL ARTICLE: Cognitive, Social and Environmental Sources of Bias in Clinical Performance Ratings
390 Citations2003Reed G. Williams, Debra L. Klamen +1 more
Clinical performance evaluation systems should assure broad, systematic sampling of clinical situations, and keep rating instruments short, to establish the meaning of ratings in the manner used to set normal limits for clinical diagnostic investigations.
Teaching and Learning in MedicineSimulation-Based Training of Internal Medicine Residents in Advanced Cardiac Life Support Protocols: A Randomized Trial
336 Citations2005Diane B. Wayne, John Butter +6 more
A randomized trial with wait-list controls using a medical simulator to assess baseline proficiency in ACLS and determine the impact of an intervention on skill development, which improved significantly after simulator training.
Medical EducationEffect of practice on standardised learning outcomes in simulation‐based medical education
324 Citations2006William C. McGaghie, S. Barry Issenberg +2 more
This report synthesises a subset of 31 journal articles on high‐fidelity simulation‐based medical education containing 32 research studies drawn from a larger qualitative review published previously to hypothesise an association between hours of practice in simulation‐ based medical education and standardised learning outcomes measured as weighted effect sizes.
Annals of SurgeryLaparoscopic Skills Are Improved With LapMentor??? Training
288 Citations2006Pamela Andreatta, Derek T. Woodrum +5 more
This study demonstrates that prior training on the LapMentor™ laparoscopic simulator leads to improved resident performance of basic skills in the animate operating room environment, and provides evidence that LapMentingor™ training may lead to improved operating room performance.
The American Journal of GastroenterologyComputer Simulator Training Enhances the Competency of Gastroenterology Fellows at Colonoscopy: Results of a Pilot Study
277 Citations2004Robert E. Sedlack, Joseph C. Kolars
Simulator-trained fellows outperformed traditionally trained fellows during their initial 15 colonoscopies in all performance aspects except “insertion time” (pp < 0.05), and CBCS-enhanced training may allow faculty to be more efficient with their colonoscopy practice.
Journal of Hospital MedicineMastery learning of thoracentesis skills by internal medicine residents using simulation technology and deliberate practice
277 Citations2008Diane B. Wayne, Jeffrey H. Barsuk +3 more
A curriculum featuring deliberate practice dramatically increased the skills of residents in thoracentesis and illustrates a feasible and reliable mechanism to achieve procedural competency.
Review of Educational ResearchHaptics in Education: Exploring an Untapped Sensory Modality
250 Citations2006James Minogue, M. Gail Jones
A baseline review of the role of touch in cognition and learning is examined and the research investigating the efficacy of the haptic augmentation of instruction is explored.
CHEST JournalLessons for Continuing Medical Education From Simulation Research in Undergraduate and Graduate Medical Education
242 Citations2009William C. McGaghie, Viva J. Siddall +2 more
This article reviews and evaluates evidence from studies on simulation technology in undergraduate and graduate medical education and addresses its implications for continuing medical education (CME).
Academic MedicineA Longitudinal Study of Internal Medicine Residents??? Retention of Advanced Cardiac Life Support Skills
226 Citations2006Diane B. Wayne, Viva J. Siddall +5 more
Use of a simulation-based educational program enabled us to achieve and maintain high levels of resident performance in simulated ACLS events and shown that simulation technology can be a useful adjunct in high-quality ACLS education.
Teaching and Learning in MedicineRESEARCH METHODOLOGY: Procedures for Establishing Defensible Absolute Passing Scores on Performance Examinations in Health Professions Education
220 Citations2005Steven M. Downing, Ara Tekian +1 more
Step-by-step instructions with worked examples for 5 absolute standard-setting methods that can be used to establish acceptable passing scores for performance examinations such as Objective Structured Clinical Examinations or standardized patient encounters are provided.
Gastrointestinal EndoscopyMulticenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy
217 Citations2006Jonathan Cohen, Seth A. Cohen +18 more
Fellows who underwent GI Mentor training performed significantly better during the early phase of real colonoscopy training, and a mixed-effects model demonstrated a higher objective competence overall in the simulator group.
Critical Care MedicineAchieving house staff competence in emergency airway management: Results of a teaching program using a computerized patient simulator*
193 Citations2004Paul H. Mayo, Janel E. Hackney +3 more
Individualized training of medical interns using a computer-controlled patient simulator is an effective means of achieving and measuring competence in initial airway management skills and appears to be transferable to the bedside of real patients.
Obstetrics and GynecologyManagement of Shoulder Dystocia
178 Citations2007Joanna F. Crofts, Christine Bartlett +4 more
Overall, training resulted in a sustained improvement in performance and those who were proficient before initial training performed best at follow-up, but skill retention was also good in those who learned to deliver during initial training.
Cambridge University Press eBooksExpertise in Medicine and Surgery
174 Citations2006Geoff Norman, Kevin W. Eva +2 more
The Annals of Thoracic SurgeryBronchoscopy simulator effectively prepares junior residents to competently perform basic clinical bronchoscopy
163 Citations2004Matthew G. Blum, Thomas W. Powers +1 more
One hour of training with the bronchoscopic simulator effectively taught residents basic bronchoscopy and familiarity with airway anatomy as the evaluator maintained the pace of the examination using verbal and physical assistance.
Simulation in Healthcare The Journal of the Society for Simulation in HealthcareThe Scope of Simulation-based Healthcare Education
160 Citations2006S. Barry Issenberg
This work aims to move beyond reporting on the potential role of simulation or how it compares to other more traditional (yet often unproven) methods of training, and focus instead on the most effective use of simulation for healthcare education.
Medical EducationDoes ultrasound training boost Year 1 medical student competence and confidence when learning abdominal examination?
152 Citations2007John Butter, Thomas Grant +5 more
This study evaluates the added value of ultrasound training when Year 1 medical students learn abdominal examination and finds engaging, effective tools to help students acquire competence and confidence in abdominal examination techniques.
Histoire urbaineCultures de production, de distribution et de consommation en milieu urbain en Angleterre, 1100-1350
146 Citations2006Derek Keene
Academic Emergency MedicineThe Use of Simulation in Emergency Medicine: A Research Agenda
144 Citations2007William F. Bond, Richard L. Lammers +6 more
The authors present here the consensus document from the task force regarding suggested areas for research, including opportunities to study reflective experiential learning, behavioral and team training, procedural simulation, computer screen-based simulation, and special topics in emergency medicine.
Quality & QuantityEvaluation in Design-Oriented Research
136 Citations2005Piet Verschuren, R.J.M. Hårtog
In this article, evaluation methodology and research methodology as a systematic input in the process of designing is introduced.
Teaching and Learning in MedicineEffectiveness of a Cardiology Review Course for Internal Medicine Residents Using Simulation Technology and Deliberate Practice
135 Citations2002S. Barry Issenberg, William C. McGaghie +5 more
Educational interventions using simulation technology that engage learners in deliberate practice of clinical skills produce large improvements in a relatively short time, with little faculty involvement.
Cambridge University Press eBooksSimulation for Performance and Training
103 Citations2006Paul Ward, A. Mark Williams +1 more
Simulation in its many guises may offer an excellent compromise to reproducing the “real-world” demands faced by actual domain experts.
Journal of the American Medical Informatics AssociationDevelopment and Validation of Assessment Measures for a Newly Developed Physical Examination Simulator
80 Citations2002Carla M. Pugh, Patricia Youngblood
Results show the new assessment measures provide an objective, reliable, and valid method of assessing students' physical examination techniques on the pelvic exam simulator.
Academic MedicineComparison of Two Standard-setting Methods for Advanced Cardiac Life Support Training
78 Citations2005Diane B. Wayne, Monica J. Fudala +5 more
Investigation of historical ACLS performance data from medical residents shows the MPSs derived in this study would yield higher-than-expected failure rates, which is a necessary step toward the creation of mastery learning educational programs.
Medical TeacherGraduating internal medicine residents’ self-assessment and performance of advanced cardiac life support skills
74 Citations2006Diane B. Wayne, John Butter +5 more
Self-assessment of performance by graduating internal medicine residents was not accurate in this study and the use of self-assessments to document resident competence in procedures such as ACLS is not a proxy for objective evaluation.
Academic MedicineDevelopment and Evaluation of a Simulation-Based Pediatric Emergency Medicine Curriculum
65 Citations2009Mark Adler, John A. Vozenilek +8 more
A one-day, simulation-based pediatric EM curriculum produced limited results, and focused, frequent, and effortful instructional interventions are necessary to achieve substantial performance improvements.
American Journal of Preventive MedicineDevelopment of a measure of attitude toward nutrition in patient care
59 Citations2001William C. McGaghie
Systematic attitude scale development increases the likelihood that the resulting measures will produce useful, trustworthy data and presents evidence about scale reliability and the absence of response bias that endorses the trustworthiness of data from the measure.
Springer international handbooks of educationCombining Tests and Setting Standards
50 Citations2002John J. Norcini, Robin A. Guille
This chapter begins with definitions of scores and standards, and describes norm-referenced score interpretation, domain- Referenced Score Interpretation, relative Standards, and absolute standards.
Academic MedicineDo Baseline Data Influence Standard Setting for a Clinical Skills Examination?
36 Citations2007Diane B. Wayne, Jeffrey H. Barsuk +2 more
Standard setting is a critical component of CSEs and an expert panel’s judgments about two central venous catheter insertion performance checklists resulted in lenient and stringent MPSs, respectively.
Academic MedicineThe Impact of Judge Selection on Standard Setting for a Patient Survey of Physician Communication Skills
30 Citations2008Diane B. Wayne, Elaine Cohen +2 more
Judge expertise and background dramatically influenced MPSs for a patient survey of physician communication skills, and patients and communication experts were most stringent in their MPS decisions.
Oxford University Press eBooksIntroduction to Brunswikian Theory and Method
28 Citations2009William M. Goldstein
Elsevier eBooksFundamentals of Educational Research Using Clinical Simulation
4 Citations2008William C. McGahie, Carla M. Pugh +1 more
The chapter aims to present a framework and a set of tools for current and future health science educational researchers who plan to conduct studies about new and innovative educational technologies.