The Use of Predicted Confidence Intervals When Planning Experiments and the Misuse of Power When Interpreting Results

The problems with the framework of statistical power are elucidated in the course of explaining why post hoc estimates of power are of little help in interpreting results and why the focus of attention should be exclusively on confidence intervals.

Abstract

Although there is a growing understanding of the importance of statistical power considerations when designing studies and of the value of confidence intervals when interpreting data, confusion exists about the reverse arrangement: the role of confidence intervals in study design and of power in interpretation. Confidence intervals should play an important role when setting sample size, and power should play no role once the data have been collected, but exactly the opposite procedure is widely practiced. In this commentary, we present the reasons why the calculation of power after a study is over is inappropriate and how confidence intervals can be used during both study design and study interpretation.