Association Between Funding and Quality of Published Medical Education Research
JAMAPublished 4 September 2007
Darcy A. Reed, David A. Cook, Thomas J. Beckman, Rachel B. Levine, David E. Kern, Scott M. Wright
Citations905
SJR quartileQ1
SJR score5.35
SNIP10.71
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The quality of published medical education research is associated with study funding, and the MERSQI instrument is an effective instrument for measuring the quality of education research studies.
Abstract
The quality of published medical education research is associated with study funding.
Keywords
Decision SciencesMedicineHealth Professions
BiometricsThe Measurement of Observer Agreement for Categorical Data
78,934 Citations1977J. Richard Landis, Gary G. Koch
A general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies is presented and tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interob server agreement are developed as generalized kappa-type statistics.
Wiley series in probability and statisticsStatistical Methods for Rates and Proportions
18,048 Citations2003Joseph L. Fleiss, Bruce Levin +1 more
Scale development : theory and applications
14,735 Citations1991Robert F. DeVellis
BMC Medical Research MethodologyThe CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials
2,754 Citations2001David Moher, Kenneth F. Schulz +1 more
The revised CONSORT statement is intended to improve the reporting of an RCT, enabling readers to understand a trial's conduct and to assess the validity of its results.
American Journal of Public HealthImproving the Reporting Quality of Nonrandomized Evaluations of Behavioral and Public Health Interventions: The TREND Statement
2,575 Citations2004Don C. Des Jarlais, Cynthia M. Lyles +2 more
The initial version of the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement is presented, which emphasize the reporting of theories used and descriptions of intervention and comparison conditions, research design, and methods of adjusting for possible biases in evaluation studies that use nonrandomized designs.
JAMAThe CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized Trials
2,530 Citations2001David Moher
The revised CONSORT statement presented in this paper incorporates new evidence and addresses some criticisms of the original statement to improve the reporting of an RCT, enabling readers to understand a trial's conduct and to assess the validity of its results.
BMJPharmaceutical industry sponsorship and research outcome and quality: systematic review
2,163 Citations2003Joel Lexchin, Lisa A Bero +2 more
Investigating whether funding of drug studies by the pharmaceutical industry is associated with outcomes that are favourable to the funder and whether the methods of trials funded by pharmaceutical companies differ from the methods in trials with other sources of support found systematic bias favours products which are made by the company funding the research.
American Journal of Preventive MedicineCurrent methods of the U.S. Preventive Services Task Force
1,734 Citations2001Russell Harris, Mark Helfand +5 more
This paper summarizes the current methods of the third USPSTF, supported by the Agency for Healthcare Research and Quality and two of the AHRQ Evidence-based Practice Centers (EPCs), and examines a variety of methodologic issues and document work group progress in future communications.
The American Journal of MedicineCurrent Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application
1,727 Citations2006David A. Cook, Thomas J. Beckman
Increased attention to the systematic collection of validity evidence for scores from psychometric instruments will improve assessments in research, patient care, and education.
Medical EducationValidity: on the meaningful interpretation of assessment data
1,408 Citations2003Steven M. Downing
Five sources – content, response process, internal structure, relationship to other variables and consequences – are noted by the Standards for Educational and Psychological Testing as fruitful areas to seek validity evidence.
Evaluation of Training
914 Citations1993Martha Reeves
This book is a practical guide for those involved in training or personnel management and gives practical advice about calculating the costs and benefits of training and about how to structure an evaluation report.
PubMedSystems to rate the strength of scientific evidence.
852 Citations2002Suzanne L. West, Valerie King +5 more
Systematic approaches to assessing the strength of scientific evidence allow evaluation of either individual articles or entire bodies of research on a particular subject, for use in making evidence-based health-care decisions.
JAMAAssociation of Funding and Conclusions in Randomized Drug Trials
744 Citations2003Bodil Als‐Nielsen, Wendong Chen +2 more
Conclusions in trials funded by for-profit organizations may be more positive due to biased interpretation of trial results, and readers should carefully evaluate whether conclusions in randomized trials are supported by data.
The LancetThe uncertainty principle and industry-sponsored research
488 Citations2000Benjamin Djulbegović, M. Lacevic +6 more
The quality of 136 published randomised trials that focused on one disease category (multiple myeloma) and adherence to the uncertainty principle were examined, and the reported bias in research sponsored by the pharmaceutical industry may be a consequence of violations of that principle.
JAMARelative Citation Impact of Various Study Designs in the Health Sciences
479 Citations2005Nikolaos A. Patsopoulos
Medical TeacherBEME Guide No. 1: Best Evidence Medical Education
335 Citations1999R. M. Harden
Best evidence medical education (BEME) is the implementation, by teachers in their practice, of methods and approaches to education based on the best evidence available, taking into account a number of factors-the QUESTS dimensions.
Annals of Internal MedicineThe Quality of Drug Studies Published in Symposium Proceedings
333 Citations1996Mildred K. Cho, Lisa A. Bero
If symposia sponsored by drug companies are a growing source of information about drugs for pharmacists and physicians, assessing the quality of the articles in these symposium is important, and the methodologic quality and relevance of drug studies published in symposiums with those of studies that were published in Symphony that had other sponsors or in the peer-reviewed parent journals are compared.
Medical TeacherAppraising qualitative research articles in medicine and medical education
314 Citations2005Luc Côté, Jean Turgeon
A grid for the critical appraisal of qualitative research articles is described so that clinical teachers are in a better position to evaluate this type of research and to teach the critical appraisals of it.
JAMAAssociation of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
283 Citations2002Kirby P. Lee
High citation rates, impact factors, and circulation rates, and low manuscript acceptance rates and indexing on Brandon/Hill Library List appear to be predictive of higher methodological quality scores for journal articles.
New England Journal of MedicineA National Survey of Policies on Disclosure of Conflicts of Interest in Biomedical Research
228 Citations2000S. Van McCrary, Cheryl B. Anderson +5 more
There is substantial variation among policies on conflicts of interest at medical schools and other research institutions, and the fact that many scientific journals and funding agencies do not require disclosure of conflicts of interests suggests that the current standards may not be adequate to maintain a high level of scientific integrity.
Academic MedicineReasons Reviewers Reject and Accept Manuscripts
227 Citations2001Georges Bordage
While overstating the results and applying the wrong statistics can be fixed, other problems that the reviewers identified (ignoring the literature, designing poor studies, choosing inappropriate instruments, and writing poor manuscripts) are likely to be fatal flaws warranting rejection.
Advances in Health Sciences EducationResearch in Medical Education: Balancing Service and Science*
209 Citations2006Mathieu Albert, Brian Hodges +1 more
Two principal means for improving research are presented: intensifying collaboration between PhD’s and clinicians, and encouraging the diversification of perspectives brought to bear on research in medical education.
Academic MedicineA Call for Outcomes Research in Medical Education
205 Citations2004Frederick M. Chen, Howard Bauchner +1 more
There exists an opportunity to create a research agenda in medical education outcomes research that is multidisciplinary, broad based, and focused on patient-centered outcomes.
Journal of General Internal MedicineWhat is the validity evidence for assessments of clinical teaching?
194 Citations2005Thomas J. Beckman, David A. Cook +1 more
Content and Internal Structure evidence is well represented among published assessments of clinical teaching, and evidence for Relation to Other Variables, Consequences, and Response Process receive little attention, and future research should emphasize these categories.
The Medical Journal of AustraliaCounting on citations: a flawed way to measure quality
167 Citations2003Garry Walter, Karen Fisher +2 more
A system is introduced, which may be easily replicated, to identify the best articles published in a journal to improve the quality of scientific research.
Medical EducationAn outcomes research perspective on medical education: the predominance of trainee assessment and satisfaction
146 Citations2001Jay B. Prystowsky, Georges Bordage
A fundamental premise of medical education is that faculty should educate trainees, that is, students and residents, to provide high quality patient care, but there is little research on the effect of medicaleducation on patient outcomes.
JAMAEducational Epidemiology
132 Citations2004Patricia A. Carney, David W. Nierenberg +4 more
The creation of a comprehensive national network of educational epidemiologists could enhance collaboration and the development of a strong educational research foundation.
National Academies Press eBooksAdvancing Scientific Research in Education
125 Citations2004Lisa Towne
Academic MedicineTrends in Medical Education Research
123 Citations2004Glenn Regehr
The author suggests that community-level, programmatic lines of research are necessary to build knowledge and understanding of a domain and that, in the absence of such communal effort, the value of research is limited to the uncoordinated accrual of information.
HepatologyRandomized clinical trials in Hepatology: Predictors of quality
118 Citations1999Lise Lotte Kjaergard, Dimitrinka Nikolova +1 more
The main conclusions are that the quality of RCTs in Hepatology needs improvement and that the probability of high quality increased with the number of centers involved and external funding.
Medical TeacherMeasuring effectiveness for best evidence medical education: a discussion
115 Citations2001Clive Belfield, Hywel Thomas +3 more
From an analysis of over 300 abstracts the evidence shows that only limited research on healthcare outcomes has been undertaken, and there is considerable ambiguity over what constitutes an effectiveness measure.
JAMACosts and Funding for Published Medical Education Research
115 Citations2005Darcy A. Reed, David E. Kern +2 more
BMC Health Services ResearchFunding source, trial outcome and reporting quality: are they related? Results of a pilot study
106 Citations2002Tammy Clifford, Nicholas Barrowman +1 more
It is not known whether the absence of significant associations between funding source, trial outcome and reporting quality reflects a true absence of an association or is an artefact of inadequate statistical power, reliance on voluntary disclosure of funding information, a focus on trials recently published in the top medical journals, or some combination thereof.
Academic Emergency MedicineAcademic Health Centers: Leading Change in the 21st Century
104 Citations2004
BMJResearching the outcomes of educational interventions: a matter of design
103 Citations2002David Prideaux
According to the reviews the extent of knowledge gained by such measures as performance in licensing examinations is at best unclear, however, participants in problem based learning can expect small gains in clinical reasoning.
Academic MedicineThe Need for Evidence in Medical Education: The Development of Best Evidence Medical Education as an Opportunity to Inform, Guide, and Sustain Medical Education Research
98 Citations2004W. Dale Dauphinée, Sharon Wood-Dauphinée
The authors conclude that the very nature of being professional in today's social and fiscal context demands that medical educators provide evidence of effectiveness and efficiency of their programs while at the same time BEME and medical education research continue to grow and mature.
Medical EducationThe accountability of clinical education: its definition and assessment
88 Citations2000Elizabeth Murray, Larry D. Gruppen +3 more
Health care practitioners, the products of medical education programmes, must meet increasing standards of professionalism, and the culture of evidence‐based medicine demands an evaluation of the effect educational programmes have on health care and service delivery.
Academic MedicineFunding Medical Education Research: Opportunities and Issues
86 Citations2004Jan D. Carline
Medical educators must be advocates for the research support needed to move medical education research from a field with limited influence on practice to one that is able to connect sound insights and ideas with actual practices in education and improved patient health.
Academic MedicineA Pilot Randomized, Controlled Trial of a Longitudinal Residents-as-teachers Curriculum
82 Citations2003Elizabeth Morrison, Lloyd Rucker +5 more
Generalist residents randomly assigned to receive a 13-hour longitudinal residents-as-teachers curriculum consistently showed improved OSTE scores.
Medical EducationExperimental study design and grant writing in eight steps and 28 questions
80 Citations2003Georges Bordage, Beth Dawson
An eight‐step, 28‐question, iterative approach is proposed to help with the careful planning of experiments in order to maximise the researchers' chances of acceptance when submitting the study for funding and its results for publication.
Medical EducationEvidence‐based education: development of an instrument to critically appraise reports of educational interventions
72 Citations1999Jillian Morrison, Frank Sullivan +2 more
A checklist instrument for critically appraising reports of educational interventions is described and is described as an important tool for critical evaluation of educational literature by those involved in designing and developing educational interventions.
Academic MedicineA RIME Perspective on the Quality and Relevance of Current and Future Medical Education Research
69 Citations2004Judy A. Shea, Louise Arnold +1 more
The authors argue that the quality and relevance of current work can be enhanced when research is situated within a general framework and questions are asked that are based on literature and theory and push the field toward new knowledge.
BMJGuidelines for evaluating papers on educational interventions
68 Citations1999Education Group for Guidelines on Evaluation
Annals of Internal MedicineIdentifying, Appraising, and Implementing Medical Education Curricula: A Guide for Medical Educators
62 Citations2001Michael L. Green
A guide for educators who are trying to adapt established curricula to meet their program's needs, and an approach to critically appraising a curriculum document and applying this method to a published managed care curriculum are presented.
Medical EducationThe importance of clinical outcomes in medical education research
38 Citations2005Frederick M. Chen, Helen Burstin +1 more
Academic MedicineResearch in medical education
36 Citations1994Steven A. Wartman
It is critical that themedical education research community, along with educators, academic administrators, and health policymakers, join to develop strategies and set priorities to enable medical education research to guide the future of medical education in a time of change and increased accountability.
Academic MedicineRevisiting the Idea of a National Center for Health Professions Education Research
33 Citations2004Steven A. Wartman
The author suggests that a national center for health professions education research can be an effective mechanism for the study of many complex issues in health education and health care delivery for which the public desires accountability.
The American Journal of GastroenterologyFunding, disease area, and internal validity of hepatobiliary randomized clinical trials
30 Citations2002Lise Lotte Kjaergard, Christian Gluud
Irrespective of funding, the disease area was significantly associated with the methodological quality and sample size, and external funding and the Disease area are significant predictors of the internal validity of hepatobiliary randomized clinical trials.
Academic MedicineUsing Clinical Outcomes Data to Reform Medical Education
25 Citations2005Michael E. Whitcomb
JAMAGraduate Medical Education Research in the 21st Century and <EMPH TYPE="ITAL">JAMA</EMPH> On Call
25 Citations2004Joseph K. Lim
BMJResearching outcomes of educational interventions
5 Citations2002Carol Taylor Fitz‐Gibbon
The point of theory based evaluation is to see to what extent the theory is being implemented and if the predicted outcomes then follow, particularly useful as an interim measure of implementation when the outcomes cannot be measured until much later.