A tutorial on using the paired t test for power calculations in repeated measures ANOVA with interactions

Benedikt Langenberg*, Markus Janczyk, Valentin Koob, Reinhold Kliegl, Axel Mayer

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

The a priori calculation of statistical power has become common practice in behavioral and social sciences to calculate the necessary sample size for detecting an expected effect size with a certain probability (i.e., power). In multi-factorial repeated measures ANOVA, these calculations can sometimes be cumbersome, especially for higher-order interactions. For designs that only involve factors with two levels each, the paired t test can be used for power calculations, but some pitfalls need to be avoided. In this tutorial, we provide practical advice on how to express main and interaction effects in repeated measures ANOVA as single difference variables. In particular, we demonstrate how to calculate the effect size Cohen’s d of this difference variable either based on means, variances, and covariances of conditions or by transforming ηp2 or ωp2 from the ANOVA framework into d. With the effect size correctly specified, we then show how to use the t test for sample size considerations by means of an empirical example. The relevant R code is provided in an online repository for all example calculations covered in this article.

Original languageEnglish
Pages (from-to)2467-2484
Number of pages18
JournalBehavior Research Methods
Volume55
Issue number5
DOIs
Publication statusPublished - Aug 2023
Externally publishedYes

Keywords

  • Effect sizes
  • Interactions
  • Power
  • Repeated measures ANOVA

Cite this