Indirect effects of fidelity to the family check-up on changes in parenting and early childhood problem behaviors

Justin D. Smith*, Thomas J. Dishion, Daniel S. Shaw, Melvin N. Wilson

*Corresponding author for this work

Research output: Contribution to journalArticle

37 Citations (Scopus)

Abstract

Objective: This study examines observations of client in-session engagement and fidelity of implementation to the Family Check-Up (FCU) as they relate to improvements in caregivers' positive behavior support (PBS) and children's problem behavior in the context of a randomized prevention trial. The psychometric properties of fidelity scores obtained with a new rating system are also explored. Method: The FCU feedback sessions of 79 families with children with elevated problem behavior scores at age 2 were coded by trained raters of fidelity, who used an observational coding system developed specifically for this intervention model. Results: Path analysis indicated that fidelity to the FCU results in greater caregiver engagement in the feedback session, which directly predicts improvements in caregivers' PBS 1 year later (β = 0.06, 95% CI [.007,.129]). Similarly, engagement and PBS directly predict reductions in children's problem behavior measured 2 years later (β =-0.24, 95% CI [-.664,-.019]). Conclusions: These results suggest fidelity within the context of this randomized intervention trial. Ratings of fidelity to the FCU covary with observed improvements in parenting and children's problem behavior in early childhood. Overall reliability of the fidelity scores was found to be acceptable, but some single-item reliability estimates were low, suggesting revisions to the rating system might be needed. Accurately assessing fidelity and understanding its relationship to change during intervention studies is an underdeveloped area of research and has revealed some inconsistent findings. Our results shed light on the mixed conclusions of previous studies, suggesting that future research ought to assess the role of intervening variable effects, such as observed engagement.

Original languageEnglish (US)
Pages (from-to)962-974
Number of pages13
JournalJournal of Consulting and Clinical Psychology
Volume81
Issue number6
DOIs
StatePublished - Dec 2013

Fingerprint

Parenting
Child Behavior
Caregivers
Psychometrics
Problem Behavior
Research

ASJC Scopus subject areas

  • Clinical Psychology
  • Psychiatry and Mental health

Cite this

@article{b3f349ad9a6440dfac501ba2a99e2dc3,
title = "Indirect effects of fidelity to the family check-up on changes in parenting and early childhood problem behaviors",
abstract = "Objective: This study examines observations of client in-session engagement and fidelity of implementation to the Family Check-Up (FCU) as they relate to improvements in caregivers' positive behavior support (PBS) and children's problem behavior in the context of a randomized prevention trial. The psychometric properties of fidelity scores obtained with a new rating system are also explored. Method: The FCU feedback sessions of 79 families with children with elevated problem behavior scores at age 2 were coded by trained raters of fidelity, who used an observational coding system developed specifically for this intervention model. Results: Path analysis indicated that fidelity to the FCU results in greater caregiver engagement in the feedback session, which directly predicts improvements in caregivers' PBS 1 year later (β = 0.06, 95{\%} CI [.007,.129]). Similarly, engagement and PBS directly predict reductions in children's problem behavior measured 2 years later (β =-0.24, 95{\%} CI [-.664,-.019]). Conclusions: These results suggest fidelity within the context of this randomized intervention trial. Ratings of fidelity to the FCU covary with observed improvements in parenting and children's problem behavior in early childhood. Overall reliability of the fidelity scores was found to be acceptable, but some single-item reliability estimates were low, suggesting revisions to the rating system might be needed. Accurately assessing fidelity and understanding its relationship to change during intervention studies is an underdeveloped area of research and has revealed some inconsistent findings. Our results shed light on the mixed conclusions of previous studies, suggesting that future research ought to assess the role of intervening variable effects, such as observed engagement.",
author = "Smith, {Justin D.} and Dishion, {Thomas J.} and Shaw, {Daniel S.} and Wilson, {Melvin N.}",
year = "2013",
month = "12",
doi = "10.1037/a0033950",
language = "English (US)",
volume = "81",
pages = "962--974",
journal = "Journal of Consulting and Clinical Psychology",
issn = "0022-006X",
publisher = "American Psychological Association Inc.",
number = "6",

}

Indirect effects of fidelity to the family check-up on changes in parenting and early childhood problem behaviors. / Smith, Justin D.; Dishion, Thomas J.; Shaw, Daniel S.; Wilson, Melvin N.

In: Journal of Consulting and Clinical Psychology, Vol. 81, No. 6, 12.2013, p. 962-974.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Indirect effects of fidelity to the family check-up on changes in parenting and early childhood problem behaviors

AU - Smith, Justin D.

AU - Dishion, Thomas J.

AU - Shaw, Daniel S.

AU - Wilson, Melvin N.

PY - 2013/12

Y1 - 2013/12

N2 - Objective: This study examines observations of client in-session engagement and fidelity of implementation to the Family Check-Up (FCU) as they relate to improvements in caregivers' positive behavior support (PBS) and children's problem behavior in the context of a randomized prevention trial. The psychometric properties of fidelity scores obtained with a new rating system are also explored. Method: The FCU feedback sessions of 79 families with children with elevated problem behavior scores at age 2 were coded by trained raters of fidelity, who used an observational coding system developed specifically for this intervention model. Results: Path analysis indicated that fidelity to the FCU results in greater caregiver engagement in the feedback session, which directly predicts improvements in caregivers' PBS 1 year later (β = 0.06, 95% CI [.007,.129]). Similarly, engagement and PBS directly predict reductions in children's problem behavior measured 2 years later (β =-0.24, 95% CI [-.664,-.019]). Conclusions: These results suggest fidelity within the context of this randomized intervention trial. Ratings of fidelity to the FCU covary with observed improvements in parenting and children's problem behavior in early childhood. Overall reliability of the fidelity scores was found to be acceptable, but some single-item reliability estimates were low, suggesting revisions to the rating system might be needed. Accurately assessing fidelity and understanding its relationship to change during intervention studies is an underdeveloped area of research and has revealed some inconsistent findings. Our results shed light on the mixed conclusions of previous studies, suggesting that future research ought to assess the role of intervening variable effects, such as observed engagement.

AB - Objective: This study examines observations of client in-session engagement and fidelity of implementation to the Family Check-Up (FCU) as they relate to improvements in caregivers' positive behavior support (PBS) and children's problem behavior in the context of a randomized prevention trial. The psychometric properties of fidelity scores obtained with a new rating system are also explored. Method: The FCU feedback sessions of 79 families with children with elevated problem behavior scores at age 2 were coded by trained raters of fidelity, who used an observational coding system developed specifically for this intervention model. Results: Path analysis indicated that fidelity to the FCU results in greater caregiver engagement in the feedback session, which directly predicts improvements in caregivers' PBS 1 year later (β = 0.06, 95% CI [.007,.129]). Similarly, engagement and PBS directly predict reductions in children's problem behavior measured 2 years later (β =-0.24, 95% CI [-.664,-.019]). Conclusions: These results suggest fidelity within the context of this randomized intervention trial. Ratings of fidelity to the FCU covary with observed improvements in parenting and children's problem behavior in early childhood. Overall reliability of the fidelity scores was found to be acceptable, but some single-item reliability estimates were low, suggesting revisions to the rating system might be needed. Accurately assessing fidelity and understanding its relationship to change during intervention studies is an underdeveloped area of research and has revealed some inconsistent findings. Our results shed light on the mixed conclusions of previous studies, suggesting that future research ought to assess the role of intervening variable effects, such as observed engagement.

UR - http://www.scopus.com/inward/record.url?scp=84889021078&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84889021078&partnerID=8YFLogxK

U2 - 10.1037/a0033950

DO - 10.1037/a0033950

M3 - Article

C2 - 23895087

AN - SCOPUS:84889021078

VL - 81

SP - 962

EP - 974

JO - Journal of Consulting and Clinical Psychology

JF - Journal of Consulting and Clinical Psychology

SN - 0022-006X

IS - 6

ER -