Constructive Criticisms of Methodological and Editorial Practices
The Journal of Experimental EducationPublished 1 January 2001
Thomas R. Knapp, Shlomo S. Sawilowsky
Citations46
SJR quartileQ1
SJR score1.10
SNIP1.64
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Abstract Thompson (1999a and elsewhere) has taken strong positions on a variety of methodological issues. In this article, the authors critique some of those positions and provide alternative views for each.
Keywords
Decision SciencesHealth Professions
Scandinavian Journal of StatisticsA Simple Sequentially Rejective Multiple Test Procedure
21,827 Citations1979Sture Holm
Journal of the American Statistical AssociationA Multiple Comparison Procedure for Comparing Several Treatments with a Control
5,902 Citations1955Charles W. Dunnett
Journal of the American Statistical AssociationMultiple Comparisons among Means
4,477 Citations1961Olive Jean Dunn
Journal of the American Statistical AssociationMeasurement, Design, and Analysis: An Integrated Approach.
4,066 Citations1992Sandra G. Funk, Elazar J. Pedhazur +1 more
American PsychologistStatistical methods in psychology journals: Guidelines and explanations.
2,773 Citations1999Leland Wilkinson, Task Force on Statistical Inference
Journal of Consulting and Clinical PsychologyTheoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology.
1,974 Citations1978Paul E. Meehl
Psychological Testing: Principles, Applications, and Issues
1,811 Citations1982Robert M. Kaplan
Educational and Psychological MeasurementPractical Significance: A Concept Whose Time Has Come
1,792 Citations1996Roger E. Kirk
BiometrikaA METHOD FOR JUDGING ALL CONTRASTS IN THE ANALYSIS OF VARIANCE<sup>*</sup>
1,709 Citations1953Henry Scheffé
Psychological BulletinThe unicorn, the normal curve, and other improbable creatures.
1,423 Citations1989Theodore Micceri
Journal of the American Statistical AssociationMeasurement and Evaluation in Psychology and Education.
1,236 Citations1961R. S., Robert L. Thorndike +1 more
Psychological InquiryAppraising and Amending Theories: The Strategy of Lakatosian Defense and Two Principles that Warrant It
686 Citations1990Paul E. Meehl
Psychological testing and assessment
606 Citations1976Lewis R. Aiken
The American StatisticianPublication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa
458 Citations1995T. D. Sterling, W. L. Rosenbaum +1 more
Evidence that published results of scientific investigations are not a representative sample of results of all scientific studies is presented and practice leading to publication bias have not changed over a period of 30 years is indicated.
Educational and Psychological MeasurementReliability Generalization: Exploring Variance in Measurement Error Affecting Score Reliability Across Studies
446 Citations1998Tammi Vacha‐Haase
Educational and Psychological MeasurementStepwise Regression and Stepwise Discriminant Analysis Need Not Apply here: A Guidelines Editorial
433 Citations1995Bruce Thompson
Three problems with stepwise applications are explored in some detail, including the fact that computer packages use incorrect degrees of freedom in their stepwise computations, resulting in artifactually greater likelihood of obtaining spurious statistical significance.
Psychological BulletinA more realistic look at the robustness and Type II error properties of the t test to departures from population normality.
385 Citations1992Shlomo S. Sawilowsky, R. Clifford Blair
Educational ResearcherAERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
343 Citations1996Bruce Thompson
Educational and Psychological MeasurementPsychometrics is Datametrics: the Test is not Reliable
342 Citations2000Bruce Thompson, Tammi Vacha‐Haase
The Journal of Experimental EducationThe Case Against Statistical Significance Testing, Revisited
323 Citations1993Ronald P. Carver
Educational and Psychological MeasurementThe Importance of Structure Coefficients in Regression Research
229 Citations1985Bruce Thompson, Gloria M. Borrello
Psychological MethodsThe appropriate use of null hypothesis testing.
213 Citations1996Robert W. Frick
Educational ResearcherResearch news and Comment: AERA Editorial Policies Regarding Statistical Significance Testing: Three Suggested Reforms
210 Citations1996Bruce Thompson
The logic of statistical significance testing is presented in an accessible manner; many people who use statistical tests might not place such a premium on the tests if these individuals understood what the tests really do, and what they do not do.
The Journal of Experimental EducationThe Use of Statistical Significance Tests in Research
184 Citations1993Bruce Thompson
Communication in Statistics- Theory and MethodsMultiple comparisons in model i one-way anova with unequal variances
173 Citations1977Ajit C. Tamhane
Journal of the Royal Statistical Society Series D (The Statistician)A Note on Misconceptions Concerning Prospective and Retrospective Power
122 Citations1998Bruno D. Zumbo, Anita M. Hubley
Journal of the American Statistical AssociationStatistical “Discoveries” and Effect-Size Estimation
108 Citations1989Branko Sorić
Developing and using classroom assessments
103 Citations1996Albert Oosterhof
This chapter discusses how to develop, develop, minister, and use score-based assessment techniques for assessing students, and how to use assessments and report results.
Educational ResearcherResearch news and Comment: Reflections on Statistical and Substantive Significance, With a Slice of Replication
80 Citations1997Daniel H. Robinson, Joel R. Levin
Educational and Psychological MeasurementPsychometrics versus Datametrics: Comment on Vacha-Haase’s “Reliability Generalization” Method and Some Epm Editorial Policies
69 Citations2000Shlomo S. Sawilowsky
Educational Psychology ReviewJournal Editorial Policies Regarding Statistical Significance Tests: Heat Is to Fire as p Is to Importance
66 Citations1999Bruce Thompson
Canadian Psychology/Psychologie canadienneSome myths concerning parametric and nonparametric tests.
62 Citations1993Michael A. Hunter, Richard B. May
The Journal of Experimental EducationStatistical Significance Testing From Three Perspectives
53 Citations1993Joel R. Levin
Designing tests for evaluating student achievement
46 Citations1989James S. Cangelosi
Journal of Educational StatisticsBehavioral Statistics Textbooks: Source of Myths and Misconceptions?
37 Citations1985James K. Brewer
Educational Psychology ReviewFurther Reflections on Hypothesis Testing and Editorial Policy for Primary Research Journals
36 Citations1999Joel R. Levin, Daniel H. Robinson
Journal of the American Statistical AssociationA Modification of the<i>T</i>-Method of Multiple Comparisons for a One-Way Layout with Unequal Variances
35 Citations1976Yosef Hochberg
Review of Educational Research(Re)Viewing a Review: A Case History of the <i>Review of Educational Research</i>
27 Citations1999Carl A. Grant, Elizabeth Graue
Psychological BulletinTips for writing (and reading) methodological articles.
27 Citations1995Scott E. Maxwell, David A. Cole
Educational and Psychological MeasurementAlphamax: A Program that Maximizes Coefficient Alpha by Selective Item Deletion
24 Citations1990Bruce Thompson
The Journal of Applied Behavioral ScienceThe Use of an Overall F Test to Control Type I Error Rates in Factorial Analyses of Variance: Limitations and Better Strategies
24 Citations1995Jeffrey D. Kromrey, Wendy B. Dickinson
Educational and Psychological MeasurementReliability: Rejoinder to Thompson and Vacha-Haase
22 Citations2000Shlomo S. Sawilowsky
Stepwise Regression and Stepwise Discriminant Analysis Need Not Apply.
18 Citations1995Bruce Thompson
ScholarWorks@BGSU (Bowling Green State University)The Use of Tests of Statistical Significance.
2 Citations1999Thomas R. Knapp