Does Assessment Type Matter? A Measurement Invariance Analysis of Online and Paper and Pencil Assessment of the Community Assessment of Psychic Experiences (CAPE)

Marloes Vleeschouwer*, Chris D. Schubart, Cecile Henquet, Inez Myin-Germeys, Willemijn A. van Gastel, Manon H. J. Hillegers, Jim J. van Os, Marco P. M. Boks, Eske M. Derks

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Background: The psychometric properties of an online test are not necessarily identical to its paper and pencil original. The aim of this study is to test whether the factor structure of the Community Assessment of Psychic Experiences (CAPE) is measurement invariant with respect to online vs. paper and pencil assessment. Method: The factor structure of CAPE items assessed by paper and pencil (N = 796) was compared with the factor structure of CAPE items assessed by the Internet (N = 21,590) using formal tests for Measurement Invariance (MI). The effect size was calculated by estimating the Signed Item Difference in the Sample (SIDS) index and the Signed Test Difference in the Sample (STDS) for a hypothetical subject who scores 2 standard deviations above average on the latent dimensions. Results: The more restricted Metric Invariance model showed a significantly worse fit compared to the less restricted Configural Invariance model (chi(2)(23) = 152.75, p
Original languageEnglish
Article numbere84011
JournalPLOS ONE
Volume9
Issue number1
DOIs
Publication statusPublished - 22 Jan 2014

Cite this