Improving in-training evaluation programs
Journal of General Internal MedicinePublished 1 May 1998Open access
Jeffrey Turnbull, Jean Gray, John MacFadyen
Citations100
SJR quartileQ1
SJR score1.99
SNIP1.71
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The ongoing assessment of residents (ITE) as they participate in patient care is the best opportunity to evaluate many essential practice behaviors and to provide meaningful formative and summative information.
Keywords
MedicineHealth Professions
Academic MedicineThe assessment of clinical skills/competence/performance
4,764 Citations1990George E. Miller
JAMAUse of Peer Ratings to Evaluate Physician Performance
351 Citations1993Paul G. Ramsey
Using a shorter version of the questionnaire used in this study, peer ratings provide a practical method to assess clinical performance in areas such as humanistic qualities and communication skills that are difficult to assess with other measures.
Medical EducationPitfalls in the pursuit of objectivity: issues of reliability
282 Citations1991Cees van der Vleuten, Geoff Norman +1 more
A consistent shift can be noticed in which subjective measures are being replaced by objective measurement methods, and the issue of the presumed superiority of objective measures is addressed in two successive papers.
Evaluation & the Health ProfessionsThe Assessment of Professional Competence
268 Citations1992Michael T. Kane
Medical EducationPitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability
168 Citations1991Geoff Norman, Cees van der Vleuten +1 more
A survey of several studies indicated that objectified methods are not intrinsically more reliable than subjective measures.
Medical EducationAssessing clinical competence at the undergraduate level
114 Citations1992David Newble
The conclusion is reached that the quality of many current assessments could be improved and to do so will require a multi-format approach using both the practice and examination settings.
Academic MedicineEvaluation of the noncognitive professional traits of medical students
86 Citations1993Sharon T. Phelan, S S Obenshain +1 more
Evaluating students' noncognitive professional attributes at the University of New Mexico School of Medicine can complement systems that evaluate academic performance and help an institution assure not only the cognitive competence of its graduates, but the competence of their professional behaviors as well.
Journal of General Internal MedicineA questionnaire for patients’ evaluations of their physicians’ humanistic behaviors
76 Citations1993Michael J. Weaver, Cathy L. Ow +2 more
There is good correlation between the PHBQ and patient satisfaction, which supports the validity of thePHBQ, and the relative lack of agreement between patients and attending physicians suggests different observations, criteria, or standards.
Journal of General Internal MedicineDo ratings on the american board of internal medicine resident evaluation form detect differences in clinical competence?
75 Citations1994Richard J. Haber, Andrew L. Avins
R ratings on the ABIM Resident Evaluation Form detect global differences among residents in clinical competence in the expected direction based on type of training program and performance on theABIM certification examination, but fail to differentiate among the nine evaluated dimensions of clinical care.
Journal of General Internal MedicineThe feasibility and value of using patient satisfaction ratings to evaluate internal medicine residents
74 Citations1994Robyn Tamblyn, S. Benaroya +4 more
Medical EducationAssessment of competence in technical clinical skills of general practitioners
66 Citations1995J. Jansen, Lisa Tan +4 more
Although performance‐based testing is obviously the best method to assess proficiency in hands‐on skills, a written test can serve as a reasonable alternative, particularly for screening and research purposes.
Academic MedicineValidity of three clinical performance assessments of internal medicine clerks
62 Citations1995Alan L. Hull, Sally Hodder +5 more
The reliability of the OSCE must be improved, the CEF ratings must be redesigned to further discriminate among the specific traits assessed, and additional methods to assess personal characteristics must be instituted.
Medical EducationClinical competence of interns
60 Citations1995Isobel Rolfe, J Andren +11 more
Data showed that graduates from the problem-based medical school were rated significantly better than their peers with respect to their interpersonal relationships, 'reliability' and 'self-directed learning', and interns from one of the two traditional NSW medical schools had significantly higher ratings on 'teaching', 'diagnostic skills" and 'understanding of basic mechanisms.
Journal of General Internal MedicineA new rating form for use by nurses in assessing residents’ humanistic behavior
56 Citations1991Paula S. Butterfield, Ernest L. Mazzaferri
JAMAAssessing clinical performance. Where do we stand and what might we expect?
56 Citations1995W. Dale Dauphinée
One reason for the shift is the realization that variation in candidates' differential results on many clinical assessment instruments may be due more to content or case specificity than to inherent methods' biases or errors.
Medical EducationDimensionality, internal consistency and interrater reliability of clinical performance ratings
48 Citations1987Bruce R. Maxim, T. E. Dielman
A total of 6444 ratings of the financial performance of 424 third‐ and fourth‐year medical students were made by house officers and attending teachers during 12 separate internal medicine rotations based on 13 behaviourally anchored rating scales.
Academic MedicineThe triple-jump examination as an assessment tool in the problem-based medical curriculum at the University of Hawaii
47 Citations1993Roger M. Smith
That the administrators' subjective scores for all problems were comparable not only suggests that the administrators were able to adjust for problem variability but also reinforces the appropriateness of using subjective assessments for the TJ examination.
Medical EducationFormative assessment: a student perspective
42 Citations1994David A. Hill, Ana I. Guinea +1 more
This study was carried out to obtain a student perspective of the place of formative assessment in the curriculum and found the SSA assessment was regarded as the preferred modality to reinforce previous teaching and test problem‐solving skills.
PubMedDemand-side medical education: educating future physicians for Ontario.
40 Citations1993V R Neufeld, R F Maudsley +6 more
The project's five objectives are to define the health needs and expectations of the public as they relate to the training of physicians, prepare the educators of future physicians, assess medical students' competencies, support related curricular innovations and develop ongoing leadership in medical education.
Academic MedicineFunctional and dysfunctional characteristics of the prevailing model of clinical evaluation systems in North American medical schools
36 Citations1992D. Daniel Hunt
Seventeen symptoms that can be signs of system errors are identified and it is recommended that schools having these symptoms review their clinical evaluation systems to ensure effective and efficient monitoring of clinical students.
Journal of the Association of American Medical CollegesAging Research and Education Centers in the United States
35 Citations1997Ann Steinecke, Amy E. Ciok
It is hoped that those who work in geriatrics and gerontology in academic medicine will develop a comprehensive system for collecting, updating, and disseminating complete information about the work being done on aging.
JAMAAssessing Clinical Performance
35 Citations1995W. Dale Dauphinée
During the past decade the field of clinical assessment has demonstrated a clear move away from dependence on pencil and paper tests and the multiple-choice format as measures of predicting clinical competence to assessing what physicians do in the real world of practice.
Academic MedicineComparing checklists and databases with physiciansʼ ratings as measures of studentsʼ history and physical-examination skills
34 Citations1995Helen MacRae, Nu Viet Vu +4 more
The checklist scores correlated strongly with the physicians' ratings of history and physical-examination skills, providing some evidence of validity for their use.
Academic MedicineNurses as evaluators of the humanistic behavior of internal medicine residents
34 Citations1987Paula S. Butterfield, Ernest L. Mazzaferri +1 more
Academic MedicinePositive effects of a clinical performance assessment program
32 Citations1991Paula L. Stillman, Heather-Lyn Haley +2 more
Although it is difficult to claim cause and effect, it is clear that since the inception of this exercise, the faculty have made a conscious effort to improve students' clinical skills by providing increased observation and feedback.
Academic MedicineEvaluating the competence of physicians in practice
31 Citations1993David B. Nash, Leona E. Markson +2 more
The authors argue for the need to inform physicians-in-training about the types of evaluation to which they will be subjected over the courses of their careers, and advocate increased collaboration between leaders in the academic setting and those spearheading these new programs for assessment of physician performance.
Journal of General Internal MedicineThe use of nurses to evaluate houseofficers’ humanistic behavior
30 Citations1990Craig Kaplan, Robert M. Centor
Nurses can provide information about humanistic behavior that will allow program directors to discriminate among different levels of houseofficer behavior, and these ratings are affected by gender and by the type of unit from which they are obtained.
Academic MedicineAccuracy of Surgery Clerkship Performance Raters
16 Citations1991Martha Regan-Smith, John H. Littlefield +5 more
Medical EducationA comparison between students in problem‐based and traditional curricula at the same medical school: preparing for the NBME Part I
14 Citations1993Boyd Richards, L. D. CARIAGA
Students in the problem‐based curriculum tended to study many more hours for Part I than did students in the traditional curriculum, especially during their second year, and rate textbooks and the PreTest Series as more valuable than did their peers in theTraditional curriculum.
Academic MedicineAssessing the value of student case write-ups and write-up evaluations
14 Citations1989Peter J. McLeod
There was broad agreement among the students and directors that case write-ups and their evaluations are useful for learning, but there were major concerns about the variability of the criteria and standards for evaluation.
Medical TeacherThe use of patients as student evaluators
12 Citations1990Yaakov Henkin, Miriam Friedman +3 more
It is pointed out that tutors do not assign sufficient importance to the student-patient relationship in the global clerkship score, and patients appeared to be poor discriminators in evaluating medical students.
Academic MedicineDevelopment of a Basic Test of Geriatric Medicine
4 Citations1991Susan C. McMillan, Bruce Robinson
Medical TeacherFaculty evaluation of student performance: a step toward improving the process
1 Citations1992Connie M. Parenti, Ilene Harris
It is suggested that certain aspects of performance be given more consideration when designing curricula, providing student feedback, and assigning grades for medicine clerkships and that medical educators engage faculty and housestaff in the formal discussion of issues surrounding evaluation.