Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals.
Psychological MethodsPublished 1 January 2006
Ken Kelley, Joseph R. Rausch
Citations118
SJR quartileQ1
SJR score4.92
SNIP3.61
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Methods for planning sample size (SS) for the standardized mean difference so that a narrow confidence interval (CI) can be obtained via the accuracy in parameter estimation (AIPE) approach are developed.
Abstract
Methods for planning sample size (SS) for the standardized mean difference so that a narrow confidence interval (CI) can be obtained via the accuracy in parameter estimation (AIPE) approach are developed. One method plans SS so that the expected width of the CI is sufficiently narrow. A modification adjusts the SS so that the obtained CI is no wider than desired with some specified degree of certainty (e.g., 99% certain the 95% CI will be no wider than omega). The rationale of the AIPE approach to SS planning is given, as is a discussion of the analytic approach to CI formation for the population standardized mean difference. Tables with values of necessary SS are provided. The freely available Methods for the Behavioral, Educational, and Social Sciences (K. Kelley, 2006a) R (R Development Core Team, 2006) software package easily implements the methods discussed.
Keywords
Agricultural and Biological SciencesDecision SciencesMathematics
Computers Environment and Urban SystemsStatistical power analysis for the behavioral sciences
65,645 Citations1990
An Introduction to the Bootstrap
39,744 Citations1994Bradley Efron, Robert Tibshirani
Journal of Educational StatisticsStatistical Methods for Meta-Analysis
10,479 Citations1988Stanley Wasserman, Larry V. Hedges +1 more
Journal of the American Statistical AssociationContinuous Univariate Distributions.
9,246 Citations1995Yasuhiro Omori, Norman L. Johnson +2 more
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
5,538 Citations2015Frank L. Schmidt, John E. Hunter
Journal of Educational StatisticsDistribution Theory for Glass's Estimator of Effect size and Related Estimators
4,883 Citations1981Larry V. Hedges
The American StatisticianSome Practical Guidelines for Effective Sample Size Determination
1,104 Citations2001Russell V. Lenth
Suggestions for successful and meaningful sample size determination are offered and criticism is made of some ill-advised shortcuts relating to power and sample size.
Philosophical Transactions of the Royal Society of London Series A Mathematical and Physical SciencesOutline of a Theory of Statistical Estimation Based on the Classical Theory of Probability
1,085 Citations1937Jerzy Neyman
PsychometrikaSample Size Requirements for Estimating Pearson, Kendall and Spearman Correlations
1,060 Citations2000Douglas G. Bonett, Thomas A. Wright
Psychological BulletinConsequences of prejudice against the null hypothesis.
1,054 Citations1975Anthony G. Greenwald
Contemporary Sociology A Journal of ReviewsDesign Sensitivity: Statistical Power for Experimental Research.
1,053 Citations1991Scott R. Eliason, Mark W. Lipsey
Psychological MethodsNull hypothesis significance testing: A review of an old and continuing controversy.
1,048 Citations2000Raymond S. Nickerson
The concluding opinion is that NHST is easily misunderstood and misused but that when applied with good judgment it can be an effective aid to the interpretation of experimental data.
Choice Reviews OnlineStatistical power analysis: a simple and general model for traditional and modern hypothesis tests
807 Citations1998
Effect sizes for research: A broad practical approach.
739 Citations2005Robert J. Grissom, John J. Kim
Psychological MethodsThe Persistence of Underpowered Studies in Psychological Research: Causes, Consequences, and Remedies.
654 Citations2004Scott E. Maxwell
Underpowered studies persist in the psychological literature and the effects on efforts to create a cumulative science are examined and the "curse of multiplicities" plays a central role.
Choice Reviews OnlineA Handbook for data analysis in the behavioral sciences: methodological issues
545 Citations1993
This book discusses methodological and statistical issues surrounding the development of Mathematical Models in Psychology, as well as some of the techniques used in Bayesian Statistics, a branch of statistics based on Bayesian inference.
Educational ResearcherWhat Future Quantitative Social Science Research Could Look Like: Confidence Intervals for Effect Sizes
543 Citations2002Bruce Thompson
Psychological MethodsBeyond the F Test: Effect Size Confidence Intervals and Tests of Close Fit in the Analysis of Variance and Contrast Analysis.
538 Citations2004James H. Steiger
Confidence interval methods for improving on the standard F tests in the balanced, completely between-subjects, fixed-effects analysis of variance are presented.
TechnometricsStatistical Intervals: A Guide for Practitioners
534 Citations1993Jason R. Jones, Gerald J. Hahn +1 more
Educational and Psychological MeasurementA Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions
514 Citations2001Geoff Cumming, Sue Finch
Psychological MethodsEvaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis statistical tests.
387 Citations2001Warren W. Tryon
An integrated, alternative inferential confidence interval approach to testing for statistical difference, equivalence, and indeterminacy that is algebraically equivalent to standard NHST procedures and therefore exacts the same evidential standard.
Psychological MethodsSample Size for Multiple Regression: Obtaining Regression Coefficients That Are Accurate, Not Simply Significant.
310 Citations2003Ken Kelley, Scott E. Maxwell
An approach to sample size planning for multiple regression is presented that emphasizes accuracy in parameter estimation (AIPE) by providing necessary sample sizes in order for the likely widths of confidence intervals to be sufficiently narrow.
Systematic BiologySignificance Tests for Coefficients of Variation and Variability Profiles
301 Citations1980Robert R. Sokal, Carlos A. Braumann
The expectations and variances of coefficients of variation under the assumption of normality are reviewed and the effects of appreciable departures from this assumption are examined.
Psychological MethodsAn Alternative to Cohen's Standardized Mean Difference Effect Size: A Robust Parameter and Confidence Interval in the Two Independent Groups Case.
278 Citations2005James Algina, H. J. Keselman +1 more
It is argued that a robust version of Cohen's effect size constructed by replacing population means with 20% trimmed means and the population standard deviation with the square root of a 20% Winsorized variance is a better measure of population separation than is Cohen’s effect size.
Educational and Psychological MeasurementCorrect Confidence Intervals for Various Regression Effect Sizes and Parameters: The Importance of Noncentral Distributions in Computing Intervals
270 Citations2001Michael Smithson
BiometrikaAPPLICATIONS OF THE NON-CENTRAL <i>t</i>-DISTRIBUTION
261 Citations1940Norman L. Johnson, B. L. Welch
American PsychologistRationality in psychological research: The good-enough principle.
212 Citations1985Ronald C. Serlin, Daniel K. Lapsley
Educational and Psychological MeasurementThe Effects of Nonnormal Distributions on Confidence Intervals Around the Standardized Mean Difference: Bootstrap and Parametric Confidence Intervals
186 Citations2004Ken Kelley
The American StatisticianHow Appropriate are Popular Sample Size Formulas?
148 Citations1989Lawrence L. Kupper, Kerry B. Hafner
Human Dimensions of WildlifeCommunicating Judgments About Practical Significance: Effect Size, Confidence Intervals and Odds Ratios
136 Citations2002Jerry J. Vaske
Psychological MethodsMeta-Analysis of Raw Mean Differences.
115 Citations2003Charles F. Bond, Wyndy L. Wiitala +1 more
This article presents a rationale for cumulating psychological effects in a raw metric and compares raw mean differences to standardized mean differences and statistical techniques for raw meta-analysis are described.
Evaluation & the Health ProfessionsObtaining Power or Obtaining Precision
78 Citations2003Ken Kelley, Scott E. Maxwell +1 more
The rationales of both approaches are delineated and two procedures are given for estimating the sample size from the AIPE perspective for a two-group mean comparison.
The American StatisticianSample Size Formulas for Normal Theory<i>T</i>Tests
49 Citations1981William C. Guenther
Multivariate Behavioral ResearchDetermining Sample Size for Accurate Estimation of the Squared Multiple Correlation Coefficient
42 Citations2000James Algina, Stephen Olejnik
A comparison of the sample sizes reported here with those needed to test the hypothesis of no relationship between the predictor and criterion variables demonstrates the need for researchers to consider the purpose of their research and what is to be reported when determining the sample size for the study.
BiometrikaThe moments of the non-central t-distribution
40 Citations1961David Hogben, R. S. Pinkham +1 more
Multivariate Behavioral ResearchSample Size Planning for the Squared Multiple Correlation Coefficient: Accuracy in Parameter Estimation via Narrow Confidence Intervals
35 Citations2008Ken Kelley
Methods of sample size planning are developed from the accuracy in parameter approach in the multiple regression context in order to obtain a sufficiently narrow confidence interval for the population squared multiple correlation coefficient when regressors are random.
American Psychological Association eBooksConsequences of prejudice against the null hypothesis.
25 Citations1992Anthony G. Greenwald