The validity of general practitioners' self assessment of knowledge: cross sectional study

Doctors' perception of knowledge in areas of common practice is no indication of actual knowledge Continuing medical education and other professional development activities that rely on the doctors' self perception to assess their needs are likely to be seriously flawed.

Abstract

Abstract Objective : To determine whether general practitioners can make accurate self assessments of their knowledge in specific areas. Design : 67 general practitioners completed a self assessment of their level of knowledge over a variety of topics using a nine point semantic differential scale. An objective assessment of their knowledge was then made by administering true-false tests on two of the topics: thyroid disorders and non-insulin dependent diabetes. The study was repeated with another group of 60 general practitioners, using sexually transmitted diseases as the topic Setting : General practices in New Zealand. Subjects : Random sample of 67 general practitioners in Auckland. Main outcome measure : Test scores for self assessment and for actual knowledge. Results : Correlations between self assessments and test scores were poor for all three topics studied (r=0.19 for thyroid disorders, 0.21 for non-insulin dependent diabetes, 0.19 for sexually transmitted diseases). Conclusions : As general practitioners cannot accurately assess their own level of knowledge on a given topic, professional development programmes that rely on the doctors' self perceptions to assess their needs are likely to be seriously flawed. Key message Doctors' perception of knowledge in areas of common practice is no indication of actual knowledge Continuing medical education and other professional development activities that rely on the doctors' self perception to assess their needs are likely to be seriously flawed To make professional development activities more efficient and effective a more objective assessment of needs is necessary