A meta-validation model for assessing the score-validity of student teaching evaluations
Quality & QuantityPublished 29 May 2007
Anthony J. Onwuegbuzie, Larry G. Daniel, Kathleen M. T. Collins
Citations95
SJR quartileQ1
SJR score0.87
SNIP1.85
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Teaching evaluations, Formative evaluation, Summative evaluation, Meta-validity model, Meta-validity analysis,
Keywords
PsychologySocial Sciences
Psychological BulletinConvergent and discriminant validation by the multitrait-multimethod matrix.
17,061 Citations1959Donald T. Campbell, Donald W. Fiske
This transmutability of the validation matrix argues for the comparisons within the heteromethod block as the most generally relevant validation data, and illustrates the potential interchangeability of trait and method components.
American PsychologistValidity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning.
3,776 Citations1995Samuel Messick
International Journal of Educational ResearchStudents' evaluations of University teaching: Research findings, methodological issues, and directions for future research
1,313 Citations1987Herbert W. Marsh
Journal of Personality and Social PsychologyHalf a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness.
979 Citations1993Nalini Ambady, Robert Rosenthal
Review of Educational ResearchStudent Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies
831 Citations1981Peter A. Cohen
American PsychologistNavigating student ratings of instruction.
449 Citations1997Sylvia d’Apollonia, Philip C. Abrami
American PsychologistGrading leniency is a removable contaminant of student ratings.
445 Citations1997Anthony G. Greenwald, Gerald M. Gillmore
This conclusion justifies use of a statistical correction to remove the unwanted inflation of ratings produced by lenient grading, and can profitably seek other inappropriate influences on ratings to identify more opportunities for validity-enhancing adjustments.
Research in Higher EducationEffectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings
368 Citations1980Peter A. Cohen
Meta-analytic methodology was applied to integrate findings from 22 comparisons of the effectiveness of student-rating feedback at the college level to find that feedback had a modest but significant effect on improving instruction.
American Educational Research JournalThe Use of Students’ Evaluations and an Individually Structured Intervention to Enhance University Teaching Effectiveness
311 Citations1993Herbert W. Marsh, Lawrence A. Roche
Research in Higher EducationThe association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies
304 Citations1989Kenneth A. Feldman
Research in Higher EducationCourse characteristics and college students' ratings of their teachers: What we know and what we don't
285 Citations1978Kenneth A. Feldman
Journal of Educational PsychologyEffects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
284 Citations2000Herbert W. Marsh, Lawrence A. Roche
American Educational Research JournalStudents’ Perceptions of Characteristics of Effective College Teachers: A Validity Study of a Teaching Evaluation Form Using a Mixed-Methods Analysis
283 Citations2007Anthony J. Onwuegbuzie, Ann E. Witcher +4 more
New Directions for Institutional ResearchStudent Ratings: Validity, Utility, and Controversy
279 Citations2001James A. Kulik
Research in Higher EducationClass size and college students' evaluations of teachers and courses: A closer look
256 Citations1984Kenneth A. Feldman
New Directions for Institutional ResearchLooking for Bias in All the Wrong Places: A Search for Truth or a Witch Hunt in Student Ratings of Instruction?
219 Citations2001Michael Theall, Jennifer Franklin
Typology of analytical and interpretational errors in quantitative and qualitative educational research
198 Citations2003Anthony J. Onwuegbuzie, Larry G. Daniel
A comprehensive review of the literature discussing various problems was conducted and common analytical and interpretational misconceptions are presented for data-analytic techniques representing each major member of the general linear model, including hierarchical linear modeling.
Measurement and Evaluation in Counseling and DevelopmentThe Impact of Midpoint Responses and Reverse Coding on Survey Data
192 Citations2001Gail H. Weems, Anthony J. Onwuegbuzie
The Journal of Higher EducationMultidimensional Students' Evaluations of Teaching Effectiveness
187 Citations1993Herbert W. Marsh, Michael Bailey
Assessment & Evaluation in Higher EducationStudent Perspectives on Teaching and its Evaluation
167 Citations2002Karin J. Spencer, Liora Pedhazur Schmelkin
The Journal of Higher EducationChanging Practices in Faculty Evaluation
156 Citations1985John A. Centra
Medical Entomology and ZoologyEvaluating Teaching Effectiveness: A Practical Guide
137 Citations1984Dale C. Brandenburg, Larry A. Braskamp +1 more
How to Use this Guidebook Defining Good Teaching Evaluating Teaching Some Considerations An Approach for Evaluating teaching Collecting Evaluative Information About Teaching.
Teaching in Higher EducationChanging the Agenda for Research into Students' Views about University Teaching: Four shortcomings of SRT research
132 Citations2003Angela R. Penny
Digital Commons - University of South Florida (University of South Florida)Academic Freedom, Tenure, and Student Evaluation of Faculty: Galloping Polls in the 21st Century.
128 Citations1997Robert E. Haskell
Journal of Educational PsychologyConstruct validity of measures of college teaching effectiveness.
117 Citations1985George S. Howard, Christine G. Conway +1 more
Research in Higher EducationThe significance of circumstances for college students' ratings of their teachers and courses
110 Citations1979Kenneth A. Feldman
Research in Higher EducationFaculty Perspectives on Course and Teacher Evaluations
108 Citations1997Liora Pedhazur Schmelkin, Karin J. Spencer +1 more
New Directions for Institutional ResearchHow Do Student Ratings Measure Up to a New Validity Framework?
105 Citations2001John C. Ory, Katherine E. Ryan
Sociology of EducationAn Assessment of Faculty Performance: Some Correlates Between Administrator, Colleague, Student and Self-Ratings
84 Citations1975Robert T. Blackburn, Mary Jo Clark
New Directions for Teaching and LearningTeaching Evaluation: Past, Present, and Future
77 Citations2000John C. Ory
Education Policy Analysis ArchivesAcademic Freedom, Tenure, and Student Evaluation of Faculty
75 Citations1997Robert E. Haskell
Research in Higher EducationA meta-analysis of course evaluation data and its use in the tenure decision
70 Citations1984L. W. McCallum
Assessment & Evaluation in Higher EducationAttitudes of Business Faculty Towards Two Methods of Collecting Teaching Evaluations: Paper vs. Online
63 Citations2002Curt J. Dommeyer, Paul Baum +2 more
Research in Higher EducationStudents' Course Selection: Differential Considerations for First and Last Course
58 Citations2001Elisha Babad
Research in Higher EducationEffect of instructor and class characteristics on students' class evaluations
48 Citations1990E. Gary Shapiro
The results support the view that nontraditional students react similar to traditional students in their evaluations of their classes and suggest the importance of time format as a factor affecting class evaluations.
Educational and Psychological MeasurementThe Relationship Between Student and Alumni Ratings of Teachers
44 Citations1974John A. Centra
Perceptual and Motor SkillsAttribution of Positive and Negative Characteristics of Instructors as a Function of Attractiveness and Sex of Instructor and Sex of Subject
42 Citations1979John P. Lombardo, Mary Ellen Tocci
Dumbing down : essays on the strip mining of American culture
35 Citations1996Katharine Washburn, John S. Thornton +1 more
Assessment & Evaluation in Higher EducationRating Teaching in the USA: probing the qualifications of student raters and novice teachers
19 Citations1996John F. Newport
The Journal of Experimental EducationUsing Generalizability Theory to Assess the Reliability of Student Ratings of Academic Advising
16 Citations1997Anji Sun, Michael J. Valiga +2 more
Teaching of PsychologyStudents' Ratings of Instruction: Standardized and Customized
7 Citations1990Peter S. Fernald