Refining Parent SMART: User feedback to optimize a multi-modal intervention

Sara Jennifer Becker; Hannah Shiller; Yiqing Fan; Emily DiBartolo; Miranda B. Olson; Elizabeth Casline; Clarisa Wijaya; Sarah Helseth; Lourah M. Kelly

doi:10.1016/j.josat.2024.209405

Refining Parent SMART: User feedback to optimize a multi-modal intervention

Sara Jennifer Becker^*, Hannah Shiller, Yiqing Fan, Emily DiBartolo, Miranda B. Olson, Elizabeth Casline, Clarisa Wijaya, Sarah Helseth, Lourah M. Kelly

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

Abstract

Introduction: The continuing care period following residential substance use treatment is a time when adolescents are at especially high risk for relapse, yet few families engage in traditional office-based care. Parent SMART (Substance Misuse among Adolescents in Residential Treatment) is a multi-component continuing care intervention for parents that combines three digital health technologies – an “off the shelf” online parenting program, daily phone notifications, and an online parent networking forum – with support from a parent coach. The current study solicited both qualitative and quantitative user feedback about Parent SMART to ensure responsivity to user preferences, refinement, and continuous improvement of the intervention. Methods: Exit interviews were conducted with 30 parents who received Parent SMART, which includes (1) a parent networking forum; (2) daily text messages reminders of skills, (3) an “off-the-shelf” online parenting program; and (4) in-person or telehealth parent coaching sessions. The study collected qualitative feedback using semi-structured interviews and obtained quantitative feedback via a series of ratings of each Parent SMART component on a 5-point Likert scale administered at each follow-up assessment. Results: Quantitative feedback suggest that parents rated all four elements of Parent SMART as easy to use. Qualitative feedback revealed that parents valued several aspects of Parent SMART including the brevity and structure of the intervention elements, the reminders to use parenting skills, and the sense of social connectedness fostered by different components. Recommended refinements included a number of strategies to enhance personalization and ease of navigation. Conclusions: Parent feedback informed enhancements to the Parent SMART intervention prior to implementation in a larger, ongoing pragmatic effectiveness trial. The current study serves as a model for applying a staged person-centered approach and eliciting both quantitative and qualitative feedback to refine digital health technologies.

Original language	English (US)
Article number	209405
Journal	Journal of Substance Use and Addiction Treatment
Volume	166
DOIs	https://doi.org/10.1016/j.josat.2024.209405
State	Published - Nov 2024

Funding

Funding for data collection, analysis, and refinement of the Parent SMART intervention was provided by two grants awarded to the first author, Dr. Sara Becker, by the National Institute of Drug Abuse ( R34DA039289 , R37DA052918 ). The views and opinions contained within this manuscript do not necessarily reflect those of the funder and should not be construed as such. The funder had no involvement in the study design, data collection, analysis and interpretation, the writing of this report, or the decision to submit this article for publication.

Keywords

Continuing care
Digital health
User feedback
User-centered design

ASJC Scopus subject areas

Medicine (miscellaneous)
Psychiatry and Mental health
Phychiatric Mental Health

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1016/j.josat.2024.209405

Cite this

@article{9313854758cd447887d98fdbc799c2ab,

title = "Refining Parent SMART: User feedback to optimize a multi-modal intervention",

abstract = "Introduction: The continuing care period following residential substance use treatment is a time when adolescents are at especially high risk for relapse, yet few families engage in traditional office-based care. Parent SMART (Substance Misuse among Adolescents in Residential Treatment) is a multi-component continuing care intervention for parents that combines three digital health technologies – an “off the shelf” online parenting program, daily phone notifications, and an online parent networking forum – with support from a parent coach. The current study solicited both qualitative and quantitative user feedback about Parent SMART to ensure responsivity to user preferences, refinement, and continuous improvement of the intervention. Methods: Exit interviews were conducted with 30 parents who received Parent SMART, which includes (1) a parent networking forum; (2) daily text messages reminders of skills, (3) an “off-the-shelf” online parenting program; and (4) in-person or telehealth parent coaching sessions. The study collected qualitative feedback using semi-structured interviews and obtained quantitative feedback via a series of ratings of each Parent SMART component on a 5-point Likert scale administered at each follow-up assessment. Results: Quantitative feedback suggest that parents rated all four elements of Parent SMART as easy to use. Qualitative feedback revealed that parents valued several aspects of Parent SMART including the brevity and structure of the intervention elements, the reminders to use parenting skills, and the sense of social connectedness fostered by different components. Recommended refinements included a number of strategies to enhance personalization and ease of navigation. Conclusions: Parent feedback informed enhancements to the Parent SMART intervention prior to implementation in a larger, ongoing pragmatic effectiveness trial. The current study serves as a model for applying a staged person-centered approach and eliciting both quantitative and qualitative feedback to refine digital health technologies.",

keywords = "Continuing care, Digital health, User feedback, User-centered design",

author = "Becker, {Sara Jennifer} and Hannah Shiller and Yiqing Fan and Emily DiBartolo and Olson, {Miranda B.} and Elizabeth Casline and Clarisa Wijaya and Sarah Helseth and Kelly, {Lourah M.}",

note = "Publisher Copyright: {\textcopyright} 2024 Elsevier Inc.",

year = "2024",

month = nov,

doi = "10.1016/j.josat.2024.209405",

language = "English (US)",

volume = "166",

journal = "Journal of Substance Use and Addiction Treatment",

issn = "2949-8767",

publisher = "Elsevier Inc.",

}

TY - JOUR

T1 - Refining Parent SMART

T2 - User feedback to optimize a multi-modal intervention

AU - Becker, Sara Jennifer

AU - Shiller, Hannah

AU - Fan, Yiqing

AU - DiBartolo, Emily

AU - Olson, Miranda B.

AU - Casline, Elizabeth

AU - Wijaya, Clarisa

AU - Helseth, Sarah

AU - Kelly, Lourah M.

PY - 2024/11

Y1 - 2024/11

N2 - Introduction: The continuing care period following residential substance use treatment is a time when adolescents are at especially high risk for relapse, yet few families engage in traditional office-based care. Parent SMART (Substance Misuse among Adolescents in Residential Treatment) is a multi-component continuing care intervention for parents that combines three digital health technologies – an “off the shelf” online parenting program, daily phone notifications, and an online parent networking forum – with support from a parent coach. The current study solicited both qualitative and quantitative user feedback about Parent SMART to ensure responsivity to user preferences, refinement, and continuous improvement of the intervention. Methods: Exit interviews were conducted with 30 parents who received Parent SMART, which includes (1) a parent networking forum; (2) daily text messages reminders of skills, (3) an “off-the-shelf” online parenting program; and (4) in-person or telehealth parent coaching sessions. The study collected qualitative feedback using semi-structured interviews and obtained quantitative feedback via a series of ratings of each Parent SMART component on a 5-point Likert scale administered at each follow-up assessment. Results: Quantitative feedback suggest that parents rated all four elements of Parent SMART as easy to use. Qualitative feedback revealed that parents valued several aspects of Parent SMART including the brevity and structure of the intervention elements, the reminders to use parenting skills, and the sense of social connectedness fostered by different components. Recommended refinements included a number of strategies to enhance personalization and ease of navigation. Conclusions: Parent feedback informed enhancements to the Parent SMART intervention prior to implementation in a larger, ongoing pragmatic effectiveness trial. The current study serves as a model for applying a staged person-centered approach and eliciting both quantitative and qualitative feedback to refine digital health technologies.

AB - Introduction: The continuing care period following residential substance use treatment is a time when adolescents are at especially high risk for relapse, yet few families engage in traditional office-based care. Parent SMART (Substance Misuse among Adolescents in Residential Treatment) is a multi-component continuing care intervention for parents that combines three digital health technologies – an “off the shelf” online parenting program, daily phone notifications, and an online parent networking forum – with support from a parent coach. The current study solicited both qualitative and quantitative user feedback about Parent SMART to ensure responsivity to user preferences, refinement, and continuous improvement of the intervention. Methods: Exit interviews were conducted with 30 parents who received Parent SMART, which includes (1) a parent networking forum; (2) daily text messages reminders of skills, (3) an “off-the-shelf” online parenting program; and (4) in-person or telehealth parent coaching sessions. The study collected qualitative feedback using semi-structured interviews and obtained quantitative feedback via a series of ratings of each Parent SMART component on a 5-point Likert scale administered at each follow-up assessment. Results: Quantitative feedback suggest that parents rated all four elements of Parent SMART as easy to use. Qualitative feedback revealed that parents valued several aspects of Parent SMART including the brevity and structure of the intervention elements, the reminders to use parenting skills, and the sense of social connectedness fostered by different components. Recommended refinements included a number of strategies to enhance personalization and ease of navigation. Conclusions: Parent feedback informed enhancements to the Parent SMART intervention prior to implementation in a larger, ongoing pragmatic effectiveness trial. The current study serves as a model for applying a staged person-centered approach and eliciting both quantitative and qualitative feedback to refine digital health technologies.

KW - Continuing care

KW - Digital health

KW - User feedback

KW - User-centered design

UR - http://www.scopus.com/inward/record.url?scp=85203654944&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85203654944&partnerID=8YFLogxK

U2 - 10.1016/j.josat.2024.209405

DO - 10.1016/j.josat.2024.209405

M3 - Article

C2 - 38772445

AN - SCOPUS:85203654944

SN - 2949-8767

VL - 166

JO - Journal of Substance Use and Addiction Treatment

JF - Journal of Substance Use and Addiction Treatment

M1 - 209405

ER -

Refining Parent SMART: User feedback to optimize a multi-modal intervention

Abstract

Funding

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this