Teaching and Assessing Surgical Competency in Ophthalmology Training Programs
Ophthalmic surgery, lasers & imaging retinaPublished 1 January 2006
Thomas A. Oetting, Andrew G. Lee, Hilary A. Beaver, A. Tim Johnson, H. Culver Boldt, Richard Olson
Citations38
SJR quartileQ2
SJR score0.49
SNIP0.48
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An implementation matrix for teaching and assessing surgical competence might be useful for local compliance with the ACGME mandate.
Abstract
<H4>BACKGROUND AND OBJECTIVE</H4> <P> The Accreditation Council for Graduate Medical Education (ACGME) has mandated implementation of six new competencies in resident training in the United States. An implementation strategy is proposed to teach and assess cataract surgical competence. </P> <H4>PATIENTS AND METHODS</H4> <P> An intradepartmental Task Force for the ACGME competencies reviewed the literature for assessment tools to develop an implementation matrix for assessing surgical competence. </P> <H4>RESULTS</H4> <P> “Good practices” (gleaned from the literature) were adapted for the institution’s needs and tested, including (1) written and explicit goals or objectives for each stage of training; (2) substitution of a criterion-referenced (Dreyfus model) scoring rubric for a norm-referenced, peer-benchmarked global evaluation; (3) use of formative rather than summative feedback; (4) incorporation of deliberate practice (Ericsson model); and (5) portfolio-based documentation of sentinel event markers and remediation. </P> <H4>CONCLUSION </H4> <P>An implementation matrix for teaching and assessing surgical competence might be useful for local compliance with the ACGME mandate. </P> <P>[<CITE>Ophthalmic Surg Lasers Imaging</CITE> 2006;37:384-393.] </P> <H4>AUTHORS</H4> <P>From the Departments of Ophthalmology (TAO, AGL, HAB, ATJ, HCB, RO, KC), Neurology (AGL), Neurosurgery (AGL), and Otolaryngology (KC), University of Iowa Hospital and Clinics and University of Iowa Carver College of Medicine; and the Veterans Affairs Medical Center (TAO), Iowa City, Iowa. </P> <P>Accepted for publication May 24, 2006. </P> <P>Supported in part by an unrestricted grant from Research to Prevent Blindness, Inc., New York, New York. </P> <P>Presented in part at the annual meeting of the American Academy of Ophthalmology, Chicago, Illinois, October 14-19, 2005; and the American Society of Cataract and Refractive Surgery, San Francisco, California, March 22, 2006. </P> <P>Address reprint requests to Andrew G. Lee, MD, Department of Ophthalmology, University of Iowa Hospitals and Clinics, 200 Hawkins Drive PFP, Iowa City, IA 52242. </P>
Keywords
Medicine
Psychological ReviewThe role of deliberate practice in the acquisition of expert performance.
8,820 Citations1993K. Anders Ericsson, Ralf Krampe +1 more
A theoretical framework is proposed that explains expert performance in terms of acquired characteristics resulting from extended deliberate practice and that limits the role of innate (inherited) characteristics to general levels of activity and emotionality.
The American Journal of SurgeryTesting technical skill via an innovative “bench station” examination
1,043 Citations1997Richard K. Reznick, Glenn Regehr +3 more
The OSATS demonstrates high reliability and construct validity, suggesting that it can effectively measure residents' technical ability outside the operating room using bench model simulations.
The American Journal of SurgeryThe financial impact of teaching surgical residents in the operating room
801 Citations1999Matthew Bridges, Daniel L. Diamond
The annual cost of training surgical residents in the operating room is $53 million, which suggests the need for digital skills, selection criteria, the development of training curriculum and resource facilities, the pre-operating room need for suturing and stapling techniques, and perhaps the acquisition of virtual surgery training modules.
Academic MedicineComparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination
721 Citations1998Glenn Regehr, Helen MacRae +2 more
Global rating scales scored by experts showed higher inter-station reliability, better construct validity, and better concurrent validity than did checklists, suggesting that global rating scales administered by experts are a more appropriate summative measure when assessing candidates on performance-based examinations.
BMJObjective assessment of technical skills in surgery
653 Citations2003Krishna Moorthy, Yaron Munz +2 more
The research in this field in the past decade is reviewed to explore all the available methods, establish their validity and reliability, and examine the possibility of using these methods on the basis of the available evidence.
Bulletin of Science Technology & SocietyUsing the Dreyfus Model of Skill Acquisition to Describe and Interpret Skill Acquisition and Clinical Judgment in Nursing Practice and Education
574 Citations2004Patricia Benner
The usefulness of the Dreyfus model for understanding the learning needs and styles of learning at different levels of skill acquisition is demonstrated.
The American Journal of SurgeryTeaching and testing technical skills
546 Citations1993Richard K. Reznick
A methodologic framework for skill acquisition, adapted from the educational psychology literature, is discussed and five methods of assessing technical skills are presented.
Journal of the American College of SurgeonsThe Use of Electromagnetic Motion Tracking Analysis To Objectively Measure Open Surgical Skill in The Laboratory-Based Model
420 Citations2001Vivek Datta, Sean Mackay +2 more
Findings suggest that hand motion analysis may be an effective objective measure of dexterity in open surgical simulation.
BMJAssessing operative skill
356 Citations1999Ara Darzi, Samuel G. Smith +1 more
Pressure is mounting for surgeons to demonstrate that they can operate well, maintain their performance, and deliver acceptable results, but a large number of failures are needed before statistical significance is reached.
BMJVirtual reality in surgery
325 Citations2001R F McCloy, Richard Stone
This review describes the application of virtual reality and robotics to surgical training and planning and the execution of procedures in theatre and discusses the near term future of this new technology.
The American Journal of SurgeryThe relationship between motion analysis and surgical technical assessments
277 Citations2002Vivek Datta, Avril Chang +2 more
There is a strong correlation between hand motion analysis using ICSAD and OSATS global rating assessments in this model and structured checklists were not an accurate predictor of experience.
The American Journal of SurgeryWhat do master surgeons think of surgical competence and revalidation?
183 Citations2001A. Cuschieri, Nader Francis +2 more
Both selection and assessment of surgical trainees require changes and standardization and revalidation is necessary, concern was expressed on the reliability and validity of existing and proposed systems.
Interpreting International Journal of Research and Practice in InterpretingExpertise in interpreting
181 Citations2000K. Anders Ericsson
JAMACompetence Is a Habit
168 Citations2002David C. Leach
An inclusive definition of competence is proposed: the habitual and judicious use of communication, knowledge, technical skills, clinical reasoning, emotions, values, and reflection in daily practice for the benefit of the individual and the community being served.
BMJSurgeon specific mortality in adult cardiac surgery: comparison between crude and risk stratified data
142 Citations2003B Bridgewater, Anthony D Grayson +7 more
It is possible to collect risk stratified data on all patients undergoing coronary bypass surgery and for most the predicted mortality is low and a comparison of death rates that is stratified by risk and based on low risk cases is recommended as the national benchmark for assessing consultant specific performance.
SurgeryEvaluating surgical competency with the American Board of Surgery In-Training Examination, skill testing, and intraoperative assessment
134 Citations2000Daniel J. Scott, R. James Valentine +5 more
The ABSITE measures knowledge but does not correlate with technical skill or operative performance, and there may be a role for both skill testing and intraoperative assessment in the evaluation of surgical competency.
SurgeryRelationship between skill and outcome in the laboratory-based model
133 Citations2002Vivek Datta, Mirren Mandalia +4 more
There is a significant correlation between objective measures of manual dexterity and the outcome measures in this model, which suggests that the outcome of a procedure can be predicted by measuring surgical skill.
American Journal of Obstetrics and GynecologySurgical skills assessment: A blinded examination of obstetrics and gynecology residents
132 Citations2002Barbara A. Goff, Peter E. Nielsen +5 more
OSATS administered in either a blinded or unblinded fashion can assess residents' surgical skills with a high degree of reliability and validity and provides further evidence that OSATS can be used to establish surgical competence.
Surgical EndoscopyMotion analysis
131 Citations2001Samuel G. Smith, Jared Torkington +3 more
Motion analysis provides useful data for the assessment of laparoscopic dexterity, and the porcine liver model is a valid simulation of the real procedure.
The American Journal of SurgeryEvaluating the effectiveness of a 2-year curriculum in a surgical skills center
124 Citations2003Dimitri J Anastakis, Kyle R. Wanzel +8 more
The OSATS results failed to support the hypothesis that training on a core procedure in a single session during a SSCC would have an appreciable and sustained effect after 2 years, and self-reported process-oriented evaluations support the utility of the SSCC.
Surgical EndoscopyMetrics for objective Assessment
120 Citations2003Richard M. Satava, A. Cuschieri +1 more
A workshop was conducted to provide a foundation for communication and a standardization of definitions, measurements, and criteria to ensure the ability to communicate among educators, education researchers, responsible training bodies, and credentialing boards.
OphthalmologyObjective Assessment of Skills in Intraocular Surgery (OASIS)
120 Citations2005Sandra Lora Cremers, Joseph B. Ciolino +2 more
The OASIS evaluation form and database will be a valuable tool for assessing ophthalmology residents' surgical skills at other residency programs as well and can be used to assess, objectively, surgical events and surgical skill.
OphthalmologyGlobal Rating Assessment of Skills in Intraocular Surgery (GRASIS)
117 Citations2005Sandra Lora Cremers, Andrea Lora +1 more
A tool complementary to the Objective Assessment of Skills in Intraocular Surgery (OASIS) to assess residents' surgical competence is presented, believing it will be a valuable tool in conjunction with the OASIS evaluation form for assessing ophthalmologyResidents' surgical skills at other residency programs as well.
The American Journal of SurgeryUsing operative outcome to assess technical skill
98 Citations2000David Szalay, Helen MacRae +2 more
Analysis of the operative end product and time to completion offer efficient alternatives to on-line examiner scoring for bench model examinations of technical competence.
The American Journal of SurgeryThe challenge of objective assessment of surgical skill
97 Citations2001Ara Darzi, Vivek Datta +1 more
Technical performance in surgery has come under increased scrutiny in recent years, not least due to several highly publicized cases where it has been suggested that poor outcomes were the result of inadequate technical skill.
The European Journal of SurgeryAssessment of Technical Surgical Skills
73 Citations2002Teodor Grantcharov, Linda Bardram +2 more
Objective assessment of technical surgical skills is possible and reliable and valid methods are available and there are good reasons to implement evaluation programmes as a part of surgical education.
The American Journal of SurgeryObjective assessment of endoscopic knot quality
72 Citations1997George B. Hanna, Tim G. Frank +1 more
An objective method for assessing the quality of surgical knots for use in endoscopic surgery and provides a reliable assessment of knot security and reflects the strength and degree of tightening of the knot.
Survey of OphthalmologyThe New competencies and their impact on resident training in ophthalmology
71 Citations2003Andrew G. Lee
The forces that have shaped the development of the new competencies in residency training are reviewed; the specific Accreditation Council for Graduate Medical Education competencies are defined; the tools that might be used to measure them are described; and an implementation plan for ophthalmology is summarized.
PubMedThe performance of master surgeons on the Advanced Dundee Endoscopic Psychomotor Tester: contrast validity study.
64 Citations2002Nader Francis, George B. Hanna +1 more
The ADEPT system has contrast validity because master surgeons completed the tasks more accurately without sacrificing execution time.
Minimally Invasive Therapy & Allied TechnologiesMotion analysis in the training and assessment of minimally invasive surgery
58 Citations2003Krishna Moorthy, Y. Munz +3 more
A motion analysis system, Imperial College Surgical Assessment Device (ICSAD) has undergone validation studies and is sensitive in discriminating surgeons according to their experience, and can be used for credentialing in laparoscopic surgery.
American Journal of Obstetrics and GynecologyObjective structured assessment of technical skills for episiotomy repair
53 Citations2003Peter E. Nielsen, Lisa M. Foglia +2 more
Episiotomy OSATS that used task-specific and global checklists provide a reliable and valid method of assessing resident skills in this anatomic model, and performance correlates with resident year level of training.
OphthalmologyThe impact of the new competencies on resident education in ophthalmology
48 Citations2004Andrew G. Lee, Nick Volpe
The Accreditation Council for Graduate Medical Education has identified new specific core competencies designed to cross specialty lines to assure public confidence and to promote excellence in the medical educational system.
BDJAssessing competence in surgical dentistry
42 Citations2001A. Evans
The paper reviews what is meant by competence and how it is assessed, with particular emphasis on practical and technical skills and concludes that the assessment of competence is a valuable tool in its own right and a means of demonstrating to the public the continuing commitment of the profession to the highest possible standards.
BMJJunior surgeons are becoming deskilled as result of Calman proposals
28 Citations1997F.D. Skidmore
Digestive SurgeryDifferences between Experts and Trainees in the Motion Pattern of the Dominant Upper Limb during Intracorporeal Endoscopic Knotting
24 Citations2000Tarek A. Emam, George B. Hanna +2 more
The better task performance by expert surgeons is associated with controlled rapid manipulations and a wider range of movement at the shoulder joint of the dominant upper limb.
The American Journal of SurgeryA pilot experience with competency-based clinical skills assessment in a surgical clerkship
21 Citations1994Gary L. Dunnington, Kelly Wright +1 more
PE skills, PW skills, and PPI skills improve only with orientation to expectations and feedback, correlate poorly with fund of knowledge assessment, and are best assessed with precise measurement, which avoids the halo effect of overall evaluation that occurs with subjective rating forms.