A robust and readily implementable method for the meta-analysis of response ratios with and without missing standard deviations

Shinichi Nakagawa*, Daniel W A Noble, Malgorzata Lagisz, Rebecca Spake, Wolfgang Viechtbauer, Alistair M Senior*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

The log response ratio, lnRR, is the most frequently used effect size statistic for meta-analysis in ecology. However, often missing standard deviations (SDs) prevent estimation of the sampling variance of lnRR. We propose new methods to deal with missing SDs via a weighted average coefficient of variation (CV) estimated from studies in the dataset that do report SDs. Across a suite of simulated conditions, we find that using the average CV to estimate sampling variances for all observations, regardless of missingness, performs with minimal bias. Surprisingly, even with missing SDs, this simple method outperforms the conventional approach (basing each effect size on its individual study-specific CV) with complete data. This is because the conventional method ultimately yields less precise estimates of the sampling variances than using the pooled CV from multiple studies. Our approach is broadly applicable and can be implemented in all meta-analyses of lnRR, regardless of 'missingness'.

Original languageEnglish
Pages (from-to)232-244
Number of pages13
JournalEcology Letters
Volume26
Issue number2
Early online date26 Dec 2022
DOIs
Publication statusPublished - Feb 2023

Cite this