Role of Simulation in US Physician Licensure and Certification
Mount Sinai Journal of Medicine A Journal of Translational and Personalized MedicinePublished 1 January 2012
Adam I. Levine, Andrew D. Schwartz, Ethan O. Bryson, Samuel DeMaria
Citations68
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Simulation enables assessment of physician competencies in real time and represents the next step in physician certification in the modern age of healthcare.
Abstract
The evolution of simulation from an educational tool to an emerging evaluative tool has been rapid. Physician certification has a long history and serves an important role in assuring that practicing physicians are competent and capable of providing a high level of safe care to patients. Traditional assessment methods have relied mostly on multiple-choice exams or continuing medical education exercises. These methods may not be adequate to assess all competencies necessary for excellence in medical practice. Simulation enables assessment of physician competencies in real time and represents the next step in physician certification in the modern age of healthcare.
Keywords
Medicine
Mount Sinai Journal of Medicine A Journal of Translational and Personalized MedicineThe Utility of Simulation in Medical Education: What Is the Evidence?
1,201 Citations2009Yasuharu Okuda, Ethan O. Bryson +5 more
Multiple studies have demonstrated the effectiveness of simulation in the teaching of basic science and clinical knowledge, procedural skills, teamwork, and communication as well as assessment at the undergraduate and graduate medical education levels.
Archives of Internal MedicineThe Doctor-Patient Relationship and Malpractice
753 Citations1994Howard Beckman
In this sample of 45 plaintiffs' depositions selected randomly from 67 depositions made available from settled malpractice suits filed between 1985 and 1987 against a large metropolitan medical center, the decision to litigate was often associated with a perceived lack of caring and/or collaboration in the delivery of health care.
Simulation & GamingSimulation-Based Training in Anesthesia Crisis Resource Management (ACRM): A Decade of Experience
738 Citations2001David M. Gaba, Steven K. Howard +3 more
A simulation-based curriculum for anesthesiology based on principles of CRM in aviation, which has been adopted at major health care institutions around the world and extended to a wide variety of other health care domains that involve complexity and dynamism.
PubMedAnesthesia crisis resource management training: teaching anesthesiologists to handle critical incidents.
702 Citations1992Steven K. Howard, David M. Gaba +3 more
The LancetWhy do people sue doctors? A study of patients and relatives taking legal action
692 Citations1994Charles Vincent, Andrew Phillips +1 more
Patients taking legal action wanted greater honesty, an appreciation of the severity of the trauma they had suffered, and assurances that lessons had been learnt from their experiences, and a no-fault compensation system, however well intended, would not address all patients' concerns.
CHEST JournalSimulation-Based Education Improves Quality of Care During Cardiac Arrest Team Responses at an Academic Teaching Hospital
675 Citations2007Diane B. Wayne, Aashish Didwania +4 more
Postgraduate Medical JournalA brief history of the development of mannequin simulators for clinical education and training
579 Citations2004Jeffrey B. Cooper, Viviany R. Taqueti
The development of mannequin simulators used for education, training, and research is reviewed, tracing the motivations, evolution to commercial availability, and efforts toward assessment of efficacy of those for teaching cardiopulmonary resuscitation, cardiology skills, anaesthesia clinical skills, and crisis management.
Journal of General Internal MedicineSimulation Technology for Skills Training and Competency Assessment in Medical Education
498 Citations2007Ross J. Scalese, Vivian Obeso +1 more
For decision makers in medical education, this article aims to broaden awareness of the significant potential of these new technologies for improving physician training and assessment, with a resultant positive impact on patient safety and health care outcomes.
AnesthesiologyA Comprehensive Anesthesia Simulation Environment
484 Citations1988David M. Gaba, Abe DeAnda
An anesthesia simulation environment that provides a re-creation of the anesthesiologist's task environment in a real operating room is described and it is suggested that anesthesia simulation can be accomplished at nominal expense and has major potential for training, continuing education, certification, and research.
Plastic & Reconstructive SurgeryThe American Board of Medical Specialties
466 Citations2013R. Barrett Noone
The gradual development of subspecialty societies to recognize groups of individuals with such interests eventually led to increased subspecialization, which raised concerns in plastic surgery about the erosion of the core of the specialty, resulting in a significant challenge faced by the Board at the end of the twentieth century.
Journal of General Internal MedicineMastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice
422 Citations2006Diane B. Wayne, John Butter +5 more
A curriculum featuring deliberate practice dramatically increased the skills of residents in ACLS scenarios and illustrate outcome-based medical education that is now prominent in accreditation reform of residency education.
Medical TeacherPatient safety and simulation-based medical education
319 Citations2000Stephen D. Small Amitai Ziv
Simulation offers ethical benefits, increased precision and relevance of training and competency assessment, and new methods of teaching error management and safety culture, which are being joined by newer approaches enabled by improved technology.
Journal of Clinical AnesthesiaAnesthesia crisis resource management: Real-life simulation training in operating room crises
315 Citations1995Robert S. Holzman, Jeffrey B. Cooper +4 more
Medical Entomology and ZoologyCrisis Management in Anesthesiology
309 Citations1993David M. Gaba, Kevin J. Fish +2 more
This book presents fundamental principles of Dynamic Decision Making in Anesthesia, as well as specific principles of Anesthesia Crisis Resource Management, for teachers and students new to the subject.
Academic MedicineA Longitudinal Study of Internal Medicine Residents??? Retention of Advanced Cardiac Life Support Skills
226 Citations2006Diane B. Wayne, Viva J. Siddall +5 more
Use of a simulation-based educational program enabled us to achieve and maintain high levels of resident performance in simulated ACLS events and shown that simulation technology can be a useful adjunct in high-quality ACLS education.
Medical EducationAdding emotional stressors to training in simulated cardiopulmonary arrest enhances participant performance
225 Citations2010Samuel DeMaria, Ethan O. Bryson +5 more
JAMAApproval of Virtual Reality Training for Carotid Stenting
215 Citations2004Anthony G. Gallagher, Christopher U. Cates
The challenge of training physicians for performance of endovascular procedures has been brought to the forefront because of the rapidly expanding application of carotid stenting for treatment of carOTid artery stenosis into the broader medical marketplace.
Academic MedicineShortcomings in the evaluation of studentsʼ clinical skills and behaviors in medical school
203 Citations1999D G Kassebaum, Robert H. Eaglen
Too many medical schools still fail to employ evaluation methods that specifically assess students' achievement of the skills and behaviors they need to learn to practice medicine, explaining why accreditors are paying closer attention to how well schools provide measured assurances that students learn what the faculties set out to teach.
AnesthesiologyEvaluation of Anesthesia Residents Using Mannequin-based Simulation
198 Citations2002Howard A. Schwid, G. Alec Rooke +7 more
Evaluation of anesthesia residents using mannequin-based simulators shows promise, adding a new dimension to current assessment methods, and further improvements are necessary in the simulation scenarios and grading criteria before manne Quin-based simulation is used for accreditation purposes.
ResuscitationSkill acquisition and retention in automated external defibrillator (AED) use and CPR by lay responders: a prospective study
188 Citations2003Malcolm Woollard, Richard Whitfield +5 more
Although this course was judged to be effective in teaching delivery of counter-shocks, the need was identified for more emphasis on positioning of electrodes, pre-shock safety checks, airway opening, ventilation volume, checking for signs of a circulation, hand positioning, and depth and rate of chest compressions.
Medical TeacherSimulation and new learning technologies
181 Citations2001S. Barry Issenberg, Michael S. Gordon +3 more
Evidence-based outcomes must show these systems to be effective instruments for teaching and assessment, and medical educators must be willing to effect change in medical education to ensure the appropriate use of these systems in the next millennium.
Fundamentals in Laparoscopic Surgery
168 Citations2020
Academic Emergency MedicineAssessing the ACGME General Competencies: General Considerations and Assessment Methods
148 Citations2002Susan R. Swing
Outcome assessment will provide evidence of residency program educational effectiveness and information to guide improvement and the development and implementations of assessment methods appropriate to evaluate the performance of residents in each of the core competencies.
Anesthesia & AnalgesiaTesting Internal Consistency and Construct Validity During Evaluation of Performance in a Patient Simulator
140 Citations1998J. Hugh Devitt, Matt M. Kurrek +5 more
Critical Care MedicineFrom Resusci-Anne to Sim-Man: The evolution of simulators in medicine
127 Citations2004Åke Grenvik, John Schaefer
Simulators were introduced in education as a tool to make advanced training standardized, less expensive, and without danger to those involved, but several decades passed before this form of training became accepted in medicine.
Academic MedicinePsychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills
117 Citations1996Devra Cohen, Jerry A. Colliver +3 more
The study suggests that SP ratings may be more efficient and more reliable than SP checklists for assessing interpersonal and communication skills, and demonstrates that global ratings by SPs (or by expert physician observers) can provide a basis for SP-test construction.
Academic Emergency MedicineAssessing the ACGME General Competencies: General Considerations and Assessment Methods
105 Citations2002Susan R. Swing
Simulation in Healthcare The Journal of the Society for Simulation in HealthcareThe Effect of High-Fidelity Simulation on Educational Outcomes in an Advanced Cardiovascular Life Support Course
103 Citations2009David L. Rodgers, Samuel Securro +1 more
Examination of the use of high-fidelity versus low-f fidelity simulation in the context of an AHA ACLS course determined subjects’ educational outcomes as judged by expert raters reviewing videos of subjects performing a simulated cardiac arrest event immediately after the conclusion of the course.
PubMedThe retention of advanced cardiac life support knowledge among registered nurses.
83 Citations1996D S O'Steen, Carolyn C. Kee +1 more
Recommendations for inservice educators include reconstructing the ways in which ACLS courses are taught, conducting mock mega code scenarios every 6 months, constructing megacode scenarios that reflect the reality of practice, and routinely conducting refresher courses based on problems identified in a particular group.
BMJ Quality & SafetySimulations in the United States Medical Licensing ExaminationTM (USMLETM)
81 Citations2004Gerard F. Dillon
There has been an evolution of assessment formats intended to improve the measurement of knowledge and skills, including the recent development of computer based patient simulations and clinical skills assessments.
Canadian Journal of Anesthesia/Journal canadien d anesthésieTesting the raters: inter-rater reliability of standardized anaesthesia simulator performance
80 Citations1997J. Hugh Devitt, Matt M. Kurrek +5 more
If observers witnessing the same event in an anaesthesia simulator would agree on their rating of anaesthetist performance was investigated to determine if it could be used for scoring of performance.
The American Journal of CardiologyCardiology patient simulator
77 Citations1974Michael Gordon
The animated manikin and its teaching aids, with emphasis on patient simulation, may help meet two major needs: to produce more and better trained physicians in less time and at less cost, and to provide an objective method to measure the clinical competency of physician-students in patient-oriented examinations.
BMJ Quality & SafetySimulations in the United States Medical Licensing ExaminationTM (USMLETM)
68 Citations2004Gerard F. Dillon
Journal of Critical CareStandardized patients: The “other” simulation
62 Citations2008Adam I. Levine, Mark H. Swartz
This article discusses this simulation modality via a historic review, its current application in competency assessment, and its use in anesthesiology education and evaluation, and concludes with a "how to guide" to facilitate those considering including standardized patient simulations into their anesthesia training or simulation curriculum.
Anesthesia & AnalgesiaThe Use of a Human Patient Simulator in the Evaluation of and Development of a Remedial Prescription for an Anesthesiologist with Lapsed Medical Skills
56 Citations2002Meg A. Rosenblatt, Kenneth J. Abrams
Academic MedicineIncorporating Simulation Technology in a Canadian Internal Medicine Specialty Examination: A Descriptive Report
50 Citations2005Rose Hatala, Barry O. Kassen +3 more
The authors report on the development and implementation of physical examination stations that combine simulation technology in the form of digitized cardiac auscultation videos with an SP assessment for the 2003 Royal College of Physicians and Surgeons of Canada's Comprehensive Objective Examination in Internal Medicine.
Academic MedicineThe Introduction of Computer-based Case Simulations into the United States Medical Licensing Examination
44 Citations2002Gerard F. Dillon, Stephen G. Clyman +2 more
The relevant issues are introduced, some pertinent research findings are described, and next steps for research are identified.
JAMAMedical Competence and Performance Assessment
35 Citations1991Donald G. Langsley
There is a call for competence evaluations that will also examine practice performance as recertification moves toward an evaluation of practice, and tests of clinical skills using standardized patients for live or electronic simulations are developed.
Simulation in Healthcare The Journal of the Society for Simulation in HealthcareComputer-Delivered Patient Simulations in the United States Medical Licensing Examination (USMLE)
33 Citations2009Gerard F. Dillon, Brian E. Clauser
The inclusion of computer-simulated patients in the United States Medical Licensing Examination has allowed a significant expansion in ways to assess examinees on their diagnostic decision making and therapeutic intervention skills and on developing and implementing a reasonable patient management plan.
Surgical Clinics of North AmericaThe Role of Simulation in Certification
32 Citations2010Jo Buyske
The role of simulation in certification by the American Board of Surgery is in flux and development of additional simulation measures is desirable, but standards, validation, accessibility, and affordability all need to be addressed.
Journal of Clinical AnesthesiaTo define a specialty: A brief history of the American Board of Anesthesiology's first written examination
32 Citations1992Douglas R. Bacon, Mark J. Lema
The initial written examination of the American Board of Anesthesiology, a division of theAmerican Board of Surgery, was given on March 28, 1939, and has double significance, as the physicians being tested were among the first physician-anesthetists to exploit the newly created path to recognition as specialists in the science and art of anesthesia by the American medical hierarchy.
Academic MedicineAn Examination of the Contribution of Computer-based Case Simulations to the USMLE Step 3 Examination
31 Citations2002Brian E. Clauser, Melissa J. Margolis +1 more
The purpose of the present research was to assess the validity of that belief by examining the relationship between the scores produced by CCSs and those produced with MCQs and to examine the extent to which the addition of CCS improves measurement of the proficiency of interest.
Academic Emergency MedicineSimulation Center Accreditation and Programmatic Benchmarks: A Review for Emergency Medicine
29 Citations2010Rosemarie Fernandez, Ernest Wang +7 more
This article outlines currently existing and proposed accreditation models and identifies components that support best practices and describes three general programmatic models to better understand how simulation training can be operationalized in EM.
Journal of Critical CareThe American Society of Anesthesiologists' national endorsement program for simulation centers
29 Citations2008Randolph H. Steadman
The development of this accreditation process for simulation programs to ensure that practicing anesthesiologists and their patients benefit from innovative, experiential training that has the potential to improve care and foster a higher level of patient safety is discussed.
Medical EducationCardiology patient simulator and computer‐assisted instruction technologies in bedside teaching
29 Citations1990Ayesha Sajid, Gordon A. Ewy +6 more
A cardiology patient simulator (HARVEY) and an accompanying computer‐based interactive laserdisk system provide medical students, house officers and other health professionals with the opportunity to encounter a wide variety of clinical problems for learning and assessment.
Medical EducationThe performance of foreign medical graduates on the National Board of Medical Examiners (NBME) standardized patient examination prototype: a collaborative study of the NBME and the educational Commission for Foreign Medical Graduates (ECFMG)
29 Citations1999Bendavid, Klass +7 more
The purpose of the study was to explore foreign medical graduates’ performance on a clinical skills (SPX) examination.
International Anesthesiology ClinicsThe Current Status of Simulation in the Maintenance of Certification in Anesthesia
28 Citations2010Christopher Gallagher, Jonathan M. Tan
A historic look at simulation in anesthesia, the progression of policy changes leading to simulation being incorporated into MOCA, and compare the state of anesthesia simulation with how the authors' surgical practices are changing are addressed.
Journal of Clinical AnesthesiaSimulation-based Maintenance of Certification in Anesthesiology (MOCA) course optimization: use of multi-modality educational activities
27 Citations2012Adam I. Levine, Brigid C. Flynn +2 more
Of the course structure and content is described as a potentially useful template that would emphasize multimodality simulation-based activities that optimize diplomate education and satisfaction, while economizing faculty requirements.
Journal of Clinical AnesthesiaThe use of multi-modality simulation in the retraining of the physician for medical licensure
27 Citations2010Samuel DeMaria, Adam I. Levine +1 more
The use of simulation for both retraining and evaluation of a physician for medical licensure is presented.
VascularTraining in Carotid Artery Stenting: Do Carotid Simulation Systems Really Help?
24 Citations2006David L. Dawson
Early experience has shown that simulation is well accepted by trainees, performance on simulators improves with training and practice, and simulation prior to first performing endovascular procedures can improve clinical performance.
Academic MedicineTHE CONTINUED STUDY OF STANDARDIZED PATIENTS IN ASSESSMENT
21 Citations1998Jerry A. Colliver, Mark H. Swartz +4 more
Journal of Gastrointestinal SurgeryThe Critical Role of Accreditation in Establishing the ACS Education Institutes to Advance Patient Safety Through Simulation
14 Citations2007Kathleen A. Johnson, Ajit K. Sachdeva +1 more
The rationale for the development of an accreditation program for Educational Institutes by the American College of Surgeons is reviewed and advice as to how to start the accreditation process is provided.
Academic MedicineUsing clinician ratings to model score weights for a computer-based clinical-simulation examination
14 Citations1993Brian E. Clauser, Raja Subhiyah +5 more
The Journal of the American Board of Family MedicineComputer-based Testing in Family Practice Certification and Recertification
11 Citations2003Michael D. Hagen, Walton Sumner +3 more
A computer simulation system is developed that uses Bayesian belief networks to model patient characteristics and comorbid condition interactions and will include simulations in the certification and recertification examination process in 2004.