Assessment of clinical competence
The LancetPublished 1 March 2001
Val Wass, Cees van der Vleuten, John Shatzer, Roger Jones
Citations1,011
SJR quartileQ1
SJR score12.11
SNIP22.72
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The goal of assessment in medical education remains the development of reliable measurements of student performance which, as well as having predictive value for subsequent clinical competence, also have a formative, educational role.
Abstract
Tests of clinical competence, which allow decisions to be made about medical qualification and fitness to practise, must be designed with respect to key issues including blueprinting, validity, reliability, and standard setting, as well as clarity about their formative or summative function. Multiple choice questions, essays, and oral examinations could be used to test factual recall and applied knowledge, but more sophisticated methods are needed to assess clincial performance, including directly observed long and short cases, objective structured clinical examinations, and the use of standardised patients. The goal of assessment in medical education remains the development of reliable measurements of student performance which, as well as having predictive value for subsequent clinical competence, also have a formative, educational role.
Keywords
Medicine
Academic MedicineThe assessment of clinical skills/competence/performance
4,764 Citations1990George E. Miller
Academic MedicineComparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination
721 Citations1998Glenn Regehr, Helen MacRae +2 more
Global rating scales scored by experts showed higher inter-station reliability, better construct validity, and better concurrent validity than did checklists, suggesting that global rating scales administered by experts are a more appropriate summative measure when assessing candidates on performance-based examinations.
Teaching and Learning in MedicineAssessment of clinical skills with standardized patients: State of the art
574 Citations1990Cees van der Vleuten, David B. Swanson
This article provides a comprehensive review of large‐scale studies of the psychometric characteristics of SP‐based tests and indicates that the major source of measurement error is variation in examinee performance from station to station.
Educational ResearcherPerformance-Based Assessment: Lessons From the Health Professions
281 Citations1995David B. Swanson, Geoffrey R. Norman +1 more
Four performance-based assessment methods are used as examples: written clinical simulations (more commonly termed patient management problems), computer-based clinical simulations, oral examinations, and standardized patients (“live” simulations).
Medical EducationPsychometric characteristics of the objective structured clinical examination
232 Citations1988David Newble, David B. Swanson
Detailed psychometric analyses of OSCEs which were administered as part of a well‐established final‐ year examination are reported, showing generalizability theory guided investigation of test reliability.
Academic MedicineDeveloping key-feature problems and examinations to assess clinical decision-making skills
214 Citations1995Gordon Page, Georges Bordage +1 more
This problem format, with its focus on only the critical steps in problem resolution, and with its flexibility in question format and scoring keys, effectively addresses the psychometric considerations of content validity and test score reliability, and accommodates the complexity and configurations of actions often required in the resolution of clinical problems.
BMJValidity of final examinations in undergraduate medical training
204 Citations2000Cees van der Vleuten
There is a strong case for better continuous assessment during undergraduate training and less reliance on final examinations, as even with modern forms of assessment, final examinations are of questionable reliability and validity.
Medical EducationAssessment of general practitioners by video observation of communicative and medical performance in daily practice: issues of validity, reliability and feasibility
171 Citations1999R. Ram, Grol +4 more
To develop a video assessment method for General Practitioners by analysing issues of validity, reliability and feasibility of observation of videotaped regular consultations.
Teaching and Learning in MedicineExtended‐matching items: A practical alternative to free‐response questions
171 Citations1993Susan M. Case, David B. Swanson
Medical EducationStandardized or real patients to test clinical competence? The long case revisited
122 Citations2001Val Wass, Roger Jones +1 more
In undergraduate clinical examinations, the use of real patients as long cases is being replaced by objective structured clinical examinations (OSCEs) which use simulated scenarios, although there are no published psychometric data on long cases to support the move from real to simulated patients.
Medical EducationReliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competence
114 Citations1985John J. Norcini, David B. Swanson +2 more
Comparing the reliability, validity and efficiency of these item formats with particular focus on whether MCQs and PMPs measure different aspects of clinical competence indicates thatMCQs are more efficient, reliable and valid than PMPs.
BMJOral examinations---equal opportunities, ethnicity, and fairness in the MRCGP Commentary: Oral exams---get them right or don't bother
113 Citations2000Celia Roberts
Although this is a relatively small study, the methodologically exacting paper offers an example of the everyday practice of medical examinations writ large.
BMJThe Certification and Recertification of Doctors: Issues in the Assessment of Clinical Competence
113 Citations1994David Newble, Brian Jolly +1 more
Assessment of both postgraduate and undergraduate medical students should be valid, reliable, and fair, but unfortunately it is rarely any of these and never all.
Teaching and Learning in MedicineAssessment of Empathy in a Standardized-Patient Examination
95 Citations1998Jerry A. Colliver, Melanie S. Willis +3 more
To determine the extent to which 4th-year medical students were checked "empathic" by standardized patients on a performance-based examination, and to evaluate the psychometric properties of this simple empathy measure, to see whether empathy was related to clinical performance on history taking and physical examination.
BMJImproving oral examinations: selecting, training, and monitoring examiners for the MRCGP
80 Citations1995Richard Wakeford, Lesley Southgate +1 more
The selection, training, guidance, and monitoring arrangements that have been developed, to help other bodies to short circuit some years of experiment in connection with the oral component of the Royal College of General Practitioners' membership examination (MRCGP).
Medical EducationThe observed long‐case in clinical assessment
52 Citations1991David Newble
The traditional clinical viva has been retained only to make pass‐fail decisions on borderline students, but a modification of the viva so that each student undertook two long‐cases, each being observed by a pair of examiners seemed to ensue.
Teaching and Learning in MedicineReliability of performance on standardized patient cases: A comparison of consistency measures based on generalizability theory
48 Citations1989Jerry A. Colliver, Steven J. Verhulst +2 more
The findings showed considerable differences among the consistency measures, the number of cases needed to achieve the 0.80 reliability level, and the time required to administer the different measures.
Academic MedicineGlobal ratings of videotaped performance versus global ratings of actions recorded on checklists
33 Citations1999Mark H. Swartz, Jerry A. Colliver +4 more
The results raise serious questions about the viability of global ratings of checklists as an alternative to ratings of observed clinical performance as a criterion for standardized-patient assessment.
Medical EducationLongitudinal reliability of the Royal Australian College of General Practitioners Certification Examination
23 Citations1995Richard Hays, Cees van der Vleuten +2 more
Results indicate that the examination achieves acceptable overall reliability, although suggestions for changes to improve reliability are made, and an analysis of the reliability arid efficiency of the examinations is reported.
Medical TeacherComputerized case-based testing: A modern method to assess clinical decision making
21 Citations1996Lambert Schuwirth, Cees van der Vleuten +3 more
An assessment system that has been developed to focus on application of knowledge and its two major features are case-based testing and the use of multimedia and computer tools are described.
Teaching and Learning in MedicineGeneralizability of performance on different‐station‐length standardized patient cases
17 Citations1994John Shatzer, James L. Wardrop +2 more
Satisfactory psychometric properties may be obtained with 10‐min stations, realizing considerable savings in administration time and costs over longer station examinations, according to the results of two studies measuring examinee performance over different time intervals.
Medical EducationThe direct clinical examination: an alternative method for the assessment of clinical psychiatry skills in undergraduate medical students
16 Citations1994John Price, Gerard J. Byrne
It is demonstrated that the two examiners achieve satisfactory inter‐rater reliability both with respect to the mark awarded and the difficulty the patient presents and that, as one would wish, these two measures do not correlate.
Academic MedicineThe Patient Findings Questionnaire
14 Citations1999Reed G. Williams, Margaret A. McLaughlin +3 more
The PFQ and checklist yielded similar data acquisition scores and decisions at the item and test levels and replacement of the checklist with the PFQ should result in examinees' behaving in a way more consistent with recommended interviewing practices.
Academic MedicineA Course in Practical Nutrition for Medical Students
14 Citations1938Esther S. Nelson