Meaningful change definitions: sample size planning for experimental intervention research

Stefan L. K. Gruijters*, Gjalt-Jorn Y. Peters

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Experimental tests of interventions need to have sufficient sample size to constitute a robust test of the intervention’s effectiveness with reasonable precision and power. To estimate the required sample size adequately, researchers are required to specify an effect size. But what effect size should be used to plan the required sample size? Various inroads into selecting the a priori effect size have been suggested in the literature—including using conventions, prior research, and theoretical or practical importance. In this paper, we first discuss problems with some of the proposed methods of selecting the effect size for study planning. We then lay out a method for intervention researchers that provides a way out of many of these problems. The proposed method requires setting a meaningful change definition, it is specifically suited for applied researchers interested in planning tests of intervention effectiveness. We provide a hands-on walk through of the method and provide easy-to-use R functions to implement it
Original languageEnglish
Pages (from-to)1-16
Number of pages16
JournalPsychology & Health
Volume37
Issue number1
Early online date19 Nov 2020
DOIs
Publication statusPublished - 7 Jan 2022

Keywords

  • Effect size
  • smallest effect size of interest
  • sample size planning
  • intervention research
  • meaningful change definitions
  • practical significance
  • STATISTICAL POWER
  • PSYCHOLOGICAL-RESEARCH
  • PARAMETER-ESTIMATION
  • HEALTH-STATUS
  • DIFFERENCE
  • ACCURACY
  • DISPLAY

Cite this