Statistical Techniques Employed in<i>AERJ</i>and<i>JCP</i>Articles from 1988 to 1997: A Methodological Review
The Journal of Experimental EducationPublished 1 January 2001
Kevin M. Kieffer, Robert J. Reese, Bruce Thompson
Citations90
SJR quartileQ1
SJR score1.10
SNIP1.64
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Abstract The authors of the present methodological review investigated the patterns of statistical usage and reporting practices in 756 articles published in the American Educational Research Journal (AERJ) and in the Journal of Counseling Psychology (JCP) over a 10-year period. First, some findings from other similar reviews are summarized. Second, the authors present a framework for characterizing selected research practices that emphasizes, in part, elements of the recent report of the American Psychological Association (APA) Task Force on Statistical Inference (Wilkinson & APA Task Force on Statistical Inference, 1999). Third, characterizations of 10 years of analytic practices in 2 journals are presented and evaluated within that framework. The article concludes with a discussion of the changes that may be necessary to improve the statistical state of affairs in behavioral research.
Keywords
PsychologyComputer ScienceMathematics
Psychological BulletinThe file drawer problem and tolerance for null results.
8,595 Citations1979Robert Rosenthal
Quantitative procedures for computing the tolerance for filed and future null results are reported and illustrated, and the implications are discussed.
Medical Entomology and ZoologyMultiple regression in behavioral research
4,886 Citations1973Fred N. Kerlinger, Elazar J. Pedhazur
Journal of the American Statistical AssociationMeasurement, Design, and Analysis: An Integrated Approach.
4,066 Citations1992Sandra G. Funk, Elazar J. Pedhazur +1 more
Multiple Regression in Behavioral Research: Explanation and Prediction
3,784 Citations1982Elazar J. Pedhazur
American PsychologistStatistical methods in psychology journals: Guidelines and explanations.
2,773 Citations1999Leland Wilkinson, Task Force on Statistical Inference
Reading and understanding multivariate statistics
2,248 Citations1995Laurence G. Grimm, Paul R. Yarnold
The most commonly used techniques are described in detail, such as multiple regression and correlation and path analysis.
Elsevier eBooksIntroduction to Robust Estimation and Hypothesis Testing
2,109 Citations2012Rand R. Wilcox
Multivariate Data Analysis
1,930 Citations2008
Educational and Psychological MeasurementPractical Significance: A Concept Whose Time Has Come
1,792 Citations1996Roger E. Kirk
Psychological BulletinThe unicorn, the normal curve, and other improbable creatures.
1,423 Citations1989Theodore Micceri
Choice Reviews OnlineReading and understanding more multivariate statistics
1,128 Citations2001
This work describes research questions for which the statistic is most appropriate, the underlying assumptions and rationale of the analysis, and the logic behind interpreting the results.
Psychological MethodsNull hypothesis significance testing: A review of an old and continuing controversy.
1,048 Citations2000Raymond S. Nickerson
The concluding opinion is that NHST is easily misunderstood and misused but that when applied with good judgment it can be an effective aid to the interpretation of experimental data.
Psychological BulletinMultivariate analysis versus multiple univariate analyses.
924 Citations1989Carl J. Huberty, John D. Morris
Psychological BulletinDo studies of statistical power have an effect on the power of studies?
750 Citations1989Peter Sedlmeier, Gerd Gigerenzer
Review of Educational ResearchStatistical Practices of Educational Researchers: An Analysis of their ANOVA, MANOVA, and ANCOVA Analyses
606 Citations1998H. J. Keselman, Carl J. Huberty +9 more
Encyclopedia of Statistics in Behavioral ScienceCanonical Correlation Analysis
468 Citations2005Bruce Thompson
Educational and Psychological MeasurementUse of Structure Coefficients in Published Multiple Regression Articles: β is not Enough
457 Citations2001Troy Courville, Bruce Thompson
Educational and Psychological MeasurementReliability Generalization: Exploring Variance in Measurement Error Affecting Score Reliability Across Studies
446 Citations1998Tammi Vacha‐Haase
Educational and Psychological MeasurementStepwise Regression and Stepwise Discriminant Analysis Need Not Apply here: A Guidelines Editorial
433 Citations1995Bruce Thompson
Three problems with stepwise applications are explored in some detail, including the fact that computer packages use incorrect degrees of freedom in their stepwise computations, resulting in artifactually greater likelihood of obtaining spurious statistical significance.
Canonical Correlation Analysis: Uses and Interpretation
403 Citations1984Bruce Thompson
Educational ResearcherAERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
343 Citations1996Bruce Thompson
Educational and Psychological MeasurementPsychometrics is Datametrics: the Test is not Reliable
342 Citations2000Bruce Thompson, Tammi Vacha‐Haase
American PsychologistHow many discoveries have been lost by ignoring modern statistical methods?
294 Citations1998Rand R. Wilcox
CirculationBiostatistics: how to detect, correct and prevent errors in the medical literature.
292 Citations1980Stanton A. Glantz
A few rules of thumb are presented to help readers identify questionable statistical analysis and estimate what the authors would have concluded had they used appropriate statistical methods.
The Journal of Experimental EducationEvaluating Results Using Corrected and Uncorrected Effect Size Estimates
265 Citations1993Patricia Snyder, Stephen Lawson
American PsychologistGraduate training in statistics, methodology, and measurement in psychology: A survey of PhD programs in North America.
238 Citations1990Leona S. Aiken, Stephen G. West +6 more
Educational and Psychological MeasurementThe Importance of Structure Coefficients in Regression Research
229 Citations1985Bruce Thompson, Gloria M. Borrello
Educational ResearcherResearch news and Comment: AERA Editorial Policies Regarding Statistical Significance Testing: Three Suggested Reforms
210 Citations1996Bruce Thompson
The logic of statistical significance testing is presented in an accessible manner; many people who use statistical tests might not place such a premium on the tests if these individuals understood what the tests really do, and what they do not do.
Multivariate Behavioral ResearchCanonical Correlation Analysis As A Special Case Of A Structural Relations Model
197 Citations1981Richard P. Bagozzi, Claes Fornell +1 more
This paper illustrates how problems of canonical correlation can be resolved by expressing canonical correlation as a special case of a linear structural relations model.
Serials ReviewEducational and psychological measurement
193 Citations1982George K. Cunningham, Linda Brownlee +2 more
Educational and Psychological MeasurementSample Compositions and Variabilities in Published Studies versus Those in Test Manuals: Validity of Score Reliability Inductions
187 Citations2000Tammi Vacha‐Haase, Lori R. Kogan +1 more
The Journal of Experimental EducationThe Use of Statistical Significance Tests in Research
184 Citations1993Bruce Thompson
Educational and Psychological MeasurementThe Importance of Structure Coefficients in Structural Equation Modeling Confirmatory Factor Analysis
180 Citations1997Bruce Thompson
Medical Entomology and ZoologyThe Program Evaluation Standards: How to Assess Evaluations of Educational Programs
164 Citations1994James R. Sanders
Introduction Applying the Standards The Standards Utility Standards Feasibility Standards Propriety Standards Accuracy Standards are applied.
Educational ResearcherStatistical Techniques in <i>AERJ</i> Articles, 1979–1983: The Preparation of Graduate Students to Read the Educational Research Literature
133 Citations1985Laura D. Goodwin, William L. Goodwin
Theory & PsychologyReporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect Size
126 Citations2000Tammi Vacha‐Haase, Johanna Nilsson +3 more
Theory & PsychologyIf Statistical Significance Tests are Broken/Misused, What Practices Should Supplement or Replace Them?
120 Citations1999Bruce Thompson
Educational ResearcherResearch Techniques in <i>AERJ</i> Articles: 1969 to 1978
103 Citations1980Victor L. Willson
Measurement and Evaluation in Counseling and DevelopmentWhy Multivariate Methods are Usually Vital
98 Citations1988Larry J. Fish
The Journal of Experimental EducationPractices Regarding Reporting of Reliability Coefficients: A Review of Three Journals
97 Citations1999Tammi Vacha‐Haase, Carin M. Ness +2 more
Journal of Counseling PsychologyTrends in reporting psychometric properties of scales used in counseling psychology research.
78 Citations1990Scott T. Meier, Susan R. Davis
Journal of Counseling & DevelopmentStatistical Significance and Reliability Analyses in Recent <i>Journal of Counseling & Development</i> Research Articles
77 Citations1998Bruce Thompson, Patricia Snyder
Educational Psychology ReviewJournal Editorial Policies Regarding Statistical Significance Tests: Heat Is to Fire as p Is to Importance
66 Citations1999Bruce Thompson
Educational and Psychological MeasurementHow Well Do Researchers Report their Measures? an Evaluation of Measurementin Published Educational Research
63 Citations1998Dale Whhtington
Statistics in Psychology: An Historical Perspective
56 Citations1989Michael Cowles
Measurement and Evaluation in Counseling and DevelopmentAn Introduction to Discriminant Analysis
56 Citations1989Carl J. Huberty, Richard M. Barton
PsychometrikaRobust Nonorthogonal Analyses Revisited: An Update Based on Trimmed Means
48 Citations1998H. J. Keselman, Rhonda K. Kowalchuk +1 more
Educational ResearcherLearning from Experience: History and Teacher Education
19 Citations1985Donald W. Warren
Journal of Learning DisabilitiesResearch Designs and Statistical Techniques Used in the <i>Journal of Learning Disabilities</i> , 1989--1993
17 Citations1996Julie P. Baumberger, Arthur W. Bangert
The study indicates that readers would need at least a strong conceptual understanding of basic and intermediate statistical procedures to interpret research reported in the Journal of Learning Disabilities.
Journal of Personality AssessmentStatistical Methods in Personality Assessment Research
14 Citations1997John A. Schinka, Leif LaLone +1 more
This article examines whether researchers in personality and personality assessment have taken advantage of new and evolving statistical procedures, and discusses the cost of using limited statistical methods and the possible reasons for the apparent reluctance to employ advanced statistical procedures.
A Review of Intraclass Correlation.
4 Citations2000Colleen Cook