Demonstrating the reliability of transdiagnostic mHealth Routine Outcome Monitoring in mental health services using experience sampling technology

Simone J. W. Verhagen; Julienne A. Berben; Carsten Leue; Anne Marsman; Philippe A. E. G. Delespaul; Jim van Os; Richel Lousberg

doi:10.1371/journal.pone.0186294

Demonstrating the reliability of transdiagnostic mHealth Routine Outcome Monitoring in mental health services using experience sampling technology

Simone J. W. Verhagen^*, Julienne A. Berben, Carsten Leue, Anne Marsman, Philippe A. E. G. Delespaul, Jim van Os, Richel Lousberg

^*Corresponding author for this work

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

Background

Routine Outcome Monitoring (ROM) should provide a dynamic, within-treatment forward feedback loop to guide individual treatment decisions across diagnostic categories. It has been suggested that the Experience Sampling Method (ESM), capturing the film of daily life adaptive processes, offers a flexible, personalised and transdiagnostic feedback system for monitoring and adapting treatment strategies. This is the first study that uses an ESM application (the PsyMate (TM)) as a routine mobile-ROM (mROM) tool in an ambulatory mental health setting.

Objective

To demonstrate adequate psychometric properties of the PsyMate (TM) app assessing both symptom severity levels as well as daily life functioning.

Method

In a transdiagnostic sample of 64 outpatients, an mROM protocol (ESM for 6 days, at 10 semi-random moments a day) and a standard ROM instrument (HADS) were administered at baseline and at three-month follow-up. We measured positive affect (PA), negative affect (NA), quality of sleep, positive social interaction, activity-related stress, tiredness, and feeling unwell.

Results

Subjects completed 53% of the measurements at baseline (N = 64) and 48% at follow-up (N = 29). Factor analysis and subsequent reliability analysis of PA and NA confirmed the two constructs. Significant and meaningful correlations were found between PA, NA and HADS scores (ranging from r = .4 to r = .7). Multilevel analyses yielded significant change scores for all measures.

Conclusion

The ESM-based, transdiagnostic mROM tool can be used reliably in clinical settings: it shows adequate psychometric properties, as well as concurrent validity and sensitivity to change over time with respect to relevant ROM constructs. Person-tailored items can be added. In addition, mROM offers added value over standard symptom-based ROM, as it provides information on adaptive functioning in the daily environment of patients.

Original language	English
Article number	0186294
Number of pages	14
Journal	PLOS ONE
Volume	12
Issue number	10
DOIs	https://doi.org/10.1371/journal.pone.0186294
Publication status	Published - 12 Oct 2017

Keywords

DAILY-LIFE
HOSPITAL ANXIETY
DEPRESSION SCALE
INDIVIDUALS
QUALITY

Access to Document

10.1371/journal.pone.0186294Licence: CC BY

Cite this

@article{3d59ec1fa3504b518a15d54a64fe8551,

title = "Demonstrating the reliability of transdiagnostic mHealth Routine Outcome Monitoring in mental health services using experience sampling technology",

abstract = "BackgroundRoutine Outcome Monitoring (ROM) should provide a dynamic, within-treatment forward feedback loop to guide individual treatment decisions across diagnostic categories. It has been suggested that the Experience Sampling Method (ESM), capturing the film of daily life adaptive processes, offers a flexible, personalised and transdiagnostic feedback system for monitoring and adapting treatment strategies. This is the first study that uses an ESM application (the PsyMate (TM)) as a routine mobile-ROM (mROM) tool in an ambulatory mental health setting.ObjectiveTo demonstrate adequate psychometric properties of the PsyMate (TM) app assessing both symptom severity levels as well as daily life functioning.MethodIn a transdiagnostic sample of 64 outpatients, an mROM protocol (ESM for 6 days, at 10 semi-random moments a day) and a standard ROM instrument (HADS) were administered at baseline and at three-month follow-up. We measured positive affect (PA), negative affect (NA), quality of sleep, positive social interaction, activity-related stress, tiredness, and feeling unwell.ResultsSubjects completed 53% of the measurements at baseline (N = 64) and 48% at follow-up (N = 29). Factor analysis and subsequent reliability analysis of PA and NA confirmed the two constructs. Significant and meaningful correlations were found between PA, NA and HADS scores (ranging from r = .4 to r = .7). Multilevel analyses yielded significant change scores for all measures.ConclusionThe ESM-based, transdiagnostic mROM tool can be used reliably in clinical settings: it shows adequate psychometric properties, as well as concurrent validity and sensitivity to change over time with respect to relevant ROM constructs. Person-tailored items can be added. In addition, mROM offers added value over standard symptom-based ROM, as it provides information on adaptive functioning in the daily environment of patients.",

keywords = "DAILY-LIFE, HOSPITAL ANXIETY, DEPRESSION SCALE, INDIVIDUALS, QUALITY",

author = "Verhagen, {Simone J. W.} and Berben, {Julienne A.} and Carsten Leue and Anne Marsman and Delespaul, {Philippe A. E. G.} and {van Os}, Jim and Richel Lousberg",

year = "2017",

month = oct,

day = "12",

doi = "10.1371/journal.pone.0186294",

language = "English",

volume = "12",

journal = "PLOS ONE",

issn = "1932-6203",

publisher = "Public Library of Science",

number = "10",

}

TY - JOUR

T1 - Demonstrating the reliability of transdiagnostic mHealth Routine Outcome Monitoring in mental health services using experience sampling technology

AU - Verhagen, Simone J. W.

AU - Berben, Julienne A.

AU - Leue, Carsten

AU - Marsman, Anne

AU - Delespaul, Philippe A. E. G.

AU - van Os, Jim

AU - Lousberg, Richel

PY - 2017/10/12

Y1 - 2017/10/12

N2 - BackgroundRoutine Outcome Monitoring (ROM) should provide a dynamic, within-treatment forward feedback loop to guide individual treatment decisions across diagnostic categories. It has been suggested that the Experience Sampling Method (ESM), capturing the film of daily life adaptive processes, offers a flexible, personalised and transdiagnostic feedback system for monitoring and adapting treatment strategies. This is the first study that uses an ESM application (the PsyMate (TM)) as a routine mobile-ROM (mROM) tool in an ambulatory mental health setting.ObjectiveTo demonstrate adequate psychometric properties of the PsyMate (TM) app assessing both symptom severity levels as well as daily life functioning.MethodIn a transdiagnostic sample of 64 outpatients, an mROM protocol (ESM for 6 days, at 10 semi-random moments a day) and a standard ROM instrument (HADS) were administered at baseline and at three-month follow-up. We measured positive affect (PA), negative affect (NA), quality of sleep, positive social interaction, activity-related stress, tiredness, and feeling unwell.ResultsSubjects completed 53% of the measurements at baseline (N = 64) and 48% at follow-up (N = 29). Factor analysis and subsequent reliability analysis of PA and NA confirmed the two constructs. Significant and meaningful correlations were found between PA, NA and HADS scores (ranging from r = .4 to r = .7). Multilevel analyses yielded significant change scores for all measures.ConclusionThe ESM-based, transdiagnostic mROM tool can be used reliably in clinical settings: it shows adequate psychometric properties, as well as concurrent validity and sensitivity to change over time with respect to relevant ROM constructs. Person-tailored items can be added. In addition, mROM offers added value over standard symptom-based ROM, as it provides information on adaptive functioning in the daily environment of patients.

AB - BackgroundRoutine Outcome Monitoring (ROM) should provide a dynamic, within-treatment forward feedback loop to guide individual treatment decisions across diagnostic categories. It has been suggested that the Experience Sampling Method (ESM), capturing the film of daily life adaptive processes, offers a flexible, personalised and transdiagnostic feedback system for monitoring and adapting treatment strategies. This is the first study that uses an ESM application (the PsyMate (TM)) as a routine mobile-ROM (mROM) tool in an ambulatory mental health setting.ObjectiveTo demonstrate adequate psychometric properties of the PsyMate (TM) app assessing both symptom severity levels as well as daily life functioning.MethodIn a transdiagnostic sample of 64 outpatients, an mROM protocol (ESM for 6 days, at 10 semi-random moments a day) and a standard ROM instrument (HADS) were administered at baseline and at three-month follow-up. We measured positive affect (PA), negative affect (NA), quality of sleep, positive social interaction, activity-related stress, tiredness, and feeling unwell.ResultsSubjects completed 53% of the measurements at baseline (N = 64) and 48% at follow-up (N = 29). Factor analysis and subsequent reliability analysis of PA and NA confirmed the two constructs. Significant and meaningful correlations were found between PA, NA and HADS scores (ranging from r = .4 to r = .7). Multilevel analyses yielded significant change scores for all measures.ConclusionThe ESM-based, transdiagnostic mROM tool can be used reliably in clinical settings: it shows adequate psychometric properties, as well as concurrent validity and sensitivity to change over time with respect to relevant ROM constructs. Person-tailored items can be added. In addition, mROM offers added value over standard symptom-based ROM, as it provides information on adaptive functioning in the daily environment of patients.

KW - DAILY-LIFE

KW - HOSPITAL ANXIETY

KW - DEPRESSION SCALE

KW - INDIVIDUALS

KW - QUALITY

U2 - 10.1371/journal.pone.0186294

DO - 10.1371/journal.pone.0186294

M3 - Article

C2 - 29023568

SN - 1932-6203

VL - 12

JO - PLOS ONE

JF - PLOS ONE

IS - 10

M1 - 0186294

ER -

Demonstrating the reliability of transdiagnostic mHealth Routine Outcome Monitoring in mental health services using experience sampling technology

Abstract

Keywords

Access to Document

Fingerprint

Cite this