Control condition design and implementation features in controlled trials

a meta-analysis of trials evaluating psychotherapy for depression

David C. Mohr*, Joyce Ho, Tae L. Hart, Kelly G. Baron, Mark Berendsen, Victoria Beckner, Xuan Cai, Pim Cuijpers, Bonnie Spring, Sarah W. Kinsinger, Kerstin E. Schroder, Jenna Duffecy

*Corresponding author for this work

Research output: Contribution to journalReview article

34 Citations (Scopus)

Abstract

Abstract: Control conditions are the primary methodology used to reduce threats to internal validity in randomized controlled trials (RCTs). This meta-analysis examined the effects of control arm design and implementation on outcomes in RCTs examining psychological treatments for depression. A search of MEDLINE, PsycINFO, and EMBASE identified all RCTs evaluating psychological treatments for depression published through June 2009. Data were analyzed using mixed-effects models. One hundred twenty-five trials were identified yielding 188 comparisons. Outcomes varied significantly depending control condition design (p < 0.0001). Significantly smaller effect sizes were seen when control arms used manualization (p = 0.006), therapist training (p = 0.002), therapist supervision (p = 0.009), and treatment fidelity monitoring (p = 0.003). There were no significant effects for differences in therapist experience, level of expertise in the treatment delivered, or nesting vs. crossing therapists in treatment arms. These findings demonstrate the substantial effect that decisions regarding control arm definition and implementation can have on RCT outcomes.

Original languageEnglish (US)
Pages (from-to)407-423
Number of pages17
JournalTranslational behavioral medicine
Volume4
Issue number4
DOIs
StatePublished - Jan 1 2014

Fingerprint

Psychotherapy
Meta-Analysis
Randomized Controlled Trials
Depression
Psychology
MEDLINE

Keywords

  • Control conditions
  • Depression
  • Meta-analysis
  • Methodology
  • Randomized controlled trial design

ASJC Scopus subject areas

  • Applied Psychology
  • Behavioral Neuroscience

Cite this

Mohr, David C. ; Ho, Joyce ; Hart, Tae L. ; Baron, Kelly G. ; Berendsen, Mark ; Beckner, Victoria ; Cai, Xuan ; Cuijpers, Pim ; Spring, Bonnie ; Kinsinger, Sarah W. ; Schroder, Kerstin E. ; Duffecy, Jenna. / Control condition design and implementation features in controlled trials : a meta-analysis of trials evaluating psychotherapy for depression. In: Translational behavioral medicine. 2014 ; Vol. 4, No. 4. pp. 407-423.
@article{ebc49553a25f4189890b3a301501d1ce,
title = "Control condition design and implementation features in controlled trials: a meta-analysis of trials evaluating psychotherapy for depression",
abstract = "Abstract: Control conditions are the primary methodology used to reduce threats to internal validity in randomized controlled trials (RCTs). This meta-analysis examined the effects of control arm design and implementation on outcomes in RCTs examining psychological treatments for depression. A search of MEDLINE, PsycINFO, and EMBASE identified all RCTs evaluating psychological treatments for depression published through June 2009. Data were analyzed using mixed-effects models. One hundred twenty-five trials were identified yielding 188 comparisons. Outcomes varied significantly depending control condition design (p < 0.0001). Significantly smaller effect sizes were seen when control arms used manualization (p = 0.006), therapist training (p = 0.002), therapist supervision (p = 0.009), and treatment fidelity monitoring (p = 0.003). There were no significant effects for differences in therapist experience, level of expertise in the treatment delivered, or nesting vs. crossing therapists in treatment arms. These findings demonstrate the substantial effect that decisions regarding control arm definition and implementation can have on RCT outcomes.",
keywords = "Control conditions, Depression, Meta-analysis, Methodology, Randomized controlled trial design",
author = "Mohr, {David C.} and Joyce Ho and Hart, {Tae L.} and Baron, {Kelly G.} and Mark Berendsen and Victoria Beckner and Xuan Cai and Pim Cuijpers and Bonnie Spring and Kinsinger, {Sarah W.} and Schroder, {Kerstin E.} and Jenna Duffecy",
year = "2014",
month = "1",
day = "1",
doi = "10.1007/s13142-014-0262-3",
language = "English (US)",
volume = "4",
pages = "407--423",
journal = "Translational Behavioral Medicine",
issn = "1869-6716",
publisher = "Springer Publishing Company",
number = "4",

}

Control condition design and implementation features in controlled trials : a meta-analysis of trials evaluating psychotherapy for depression. / Mohr, David C.; Ho, Joyce; Hart, Tae L.; Baron, Kelly G.; Berendsen, Mark; Beckner, Victoria; Cai, Xuan; Cuijpers, Pim; Spring, Bonnie; Kinsinger, Sarah W.; Schroder, Kerstin E.; Duffecy, Jenna.

In: Translational behavioral medicine, Vol. 4, No. 4, 01.01.2014, p. 407-423.

Research output: Contribution to journalReview article

TY - JOUR

T1 - Control condition design and implementation features in controlled trials

T2 - a meta-analysis of trials evaluating psychotherapy for depression

AU - Mohr, David C.

AU - Ho, Joyce

AU - Hart, Tae L.

AU - Baron, Kelly G.

AU - Berendsen, Mark

AU - Beckner, Victoria

AU - Cai, Xuan

AU - Cuijpers, Pim

AU - Spring, Bonnie

AU - Kinsinger, Sarah W.

AU - Schroder, Kerstin E.

AU - Duffecy, Jenna

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Abstract: Control conditions are the primary methodology used to reduce threats to internal validity in randomized controlled trials (RCTs). This meta-analysis examined the effects of control arm design and implementation on outcomes in RCTs examining psychological treatments for depression. A search of MEDLINE, PsycINFO, and EMBASE identified all RCTs evaluating psychological treatments for depression published through June 2009. Data were analyzed using mixed-effects models. One hundred twenty-five trials were identified yielding 188 comparisons. Outcomes varied significantly depending control condition design (p < 0.0001). Significantly smaller effect sizes were seen when control arms used manualization (p = 0.006), therapist training (p = 0.002), therapist supervision (p = 0.009), and treatment fidelity monitoring (p = 0.003). There were no significant effects for differences in therapist experience, level of expertise in the treatment delivered, or nesting vs. crossing therapists in treatment arms. These findings demonstrate the substantial effect that decisions regarding control arm definition and implementation can have on RCT outcomes.

AB - Abstract: Control conditions are the primary methodology used to reduce threats to internal validity in randomized controlled trials (RCTs). This meta-analysis examined the effects of control arm design and implementation on outcomes in RCTs examining psychological treatments for depression. A search of MEDLINE, PsycINFO, and EMBASE identified all RCTs evaluating psychological treatments for depression published through June 2009. Data were analyzed using mixed-effects models. One hundred twenty-five trials were identified yielding 188 comparisons. Outcomes varied significantly depending control condition design (p < 0.0001). Significantly smaller effect sizes were seen when control arms used manualization (p = 0.006), therapist training (p = 0.002), therapist supervision (p = 0.009), and treatment fidelity monitoring (p = 0.003). There were no significant effects for differences in therapist experience, level of expertise in the treatment delivered, or nesting vs. crossing therapists in treatment arms. These findings demonstrate the substantial effect that decisions regarding control arm definition and implementation can have on RCT outcomes.

KW - Control conditions

KW - Depression

KW - Meta-analysis

KW - Methodology

KW - Randomized controlled trial design

UR - http://www.scopus.com/inward/record.url?scp=84920624871&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84920624871&partnerID=8YFLogxK

U2 - 10.1007/s13142-014-0262-3

DO - 10.1007/s13142-014-0262-3

M3 - Review article

VL - 4

SP - 407

EP - 423

JO - Translational Behavioral Medicine

JF - Translational Behavioral Medicine

SN - 1869-6716

IS - 4

ER -