Quantitative approaches for the evaluation of implementation research studies

Justin D. Smith*, Mohamed Hasan

*Corresponding author for this work

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Implementation research necessitates a shift from clinical trial methods in both the conduct of the study and in the way that it is evaluated given the focus on the impact of implementation strategies. That is, the methods or techniques to support the adoption and delivery of a clinical or preventive intervention, program, or policy. As strategies target one or more levels within the service delivery system, evaluating their impact needs to follow suit. This article discusses the methods and practices involved in quantitative evaluations of implementation research studies. We focus on evaluation methods that characterize and quantify the overall impacts of an implementation strategy on various outcomes. This article discusses available measurement methods for common quantitative implementation outcomes involved in such an evaluation—adoption, fidelity, implementation cost, reach, and sustainment—and the sources of such data for these metrics using established taxonomies and frameworks. Last, we present an example of a quantitative evaluation from an ongoing randomized rollout implementation trial of the Collaborative Care Model for depression management in a large primary healthcare system.

Original languageEnglish (US)
Article number112521
JournalPsychiatry Research
Volume283
DOIs
StatePublished - Jan 2020

Fingerprint

Preventive Health Services
Information Storage and Retrieval
Primary Health Care
Clinical Trials
Delivery of Health Care
Costs and Cost Analysis
Research

Keywords

  • Implementation measurement
  • Implementation research
  • Summative evaluation

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Biological Psychiatry

Cite this

@article{ae4f1335ee904902949da1ca6a3916d4,
title = "Quantitative approaches for the evaluation of implementation research studies",
abstract = "Implementation research necessitates a shift from clinical trial methods in both the conduct of the study and in the way that it is evaluated given the focus on the impact of implementation strategies. That is, the methods or techniques to support the adoption and delivery of a clinical or preventive intervention, program, or policy. As strategies target one or more levels within the service delivery system, evaluating their impact needs to follow suit. This article discusses the methods and practices involved in quantitative evaluations of implementation research studies. We focus on evaluation methods that characterize and quantify the overall impacts of an implementation strategy on various outcomes. This article discusses available measurement methods for common quantitative implementation outcomes involved in such an evaluation—adoption, fidelity, implementation cost, reach, and sustainment—and the sources of such data for these metrics using established taxonomies and frameworks. Last, we present an example of a quantitative evaluation from an ongoing randomized rollout implementation trial of the Collaborative Care Model for depression management in a large primary healthcare system.",
keywords = "Implementation measurement, Implementation research, Summative evaluation",
author = "Smith, {Justin D.} and Mohamed Hasan",
year = "2020",
month = "1",
doi = "10.1016/j.psychres.2019.112521",
language = "English (US)",
volume = "283",
journal = "Psychiatry Research",
issn = "0165-1781",
publisher = "Elsevier Ireland Ltd",

}

Quantitative approaches for the evaluation of implementation research studies. / Smith, Justin D.; Hasan, Mohamed.

In: Psychiatry Research, Vol. 283, 112521, 01.2020.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Quantitative approaches for the evaluation of implementation research studies

AU - Smith, Justin D.

AU - Hasan, Mohamed

PY - 2020/1

Y1 - 2020/1

N2 - Implementation research necessitates a shift from clinical trial methods in both the conduct of the study and in the way that it is evaluated given the focus on the impact of implementation strategies. That is, the methods or techniques to support the adoption and delivery of a clinical or preventive intervention, program, or policy. As strategies target one or more levels within the service delivery system, evaluating their impact needs to follow suit. This article discusses the methods and practices involved in quantitative evaluations of implementation research studies. We focus on evaluation methods that characterize and quantify the overall impacts of an implementation strategy on various outcomes. This article discusses available measurement methods for common quantitative implementation outcomes involved in such an evaluation—adoption, fidelity, implementation cost, reach, and sustainment—and the sources of such data for these metrics using established taxonomies and frameworks. Last, we present an example of a quantitative evaluation from an ongoing randomized rollout implementation trial of the Collaborative Care Model for depression management in a large primary healthcare system.

AB - Implementation research necessitates a shift from clinical trial methods in both the conduct of the study and in the way that it is evaluated given the focus on the impact of implementation strategies. That is, the methods or techniques to support the adoption and delivery of a clinical or preventive intervention, program, or policy. As strategies target one or more levels within the service delivery system, evaluating their impact needs to follow suit. This article discusses the methods and practices involved in quantitative evaluations of implementation research studies. We focus on evaluation methods that characterize and quantify the overall impacts of an implementation strategy on various outcomes. This article discusses available measurement methods for common quantitative implementation outcomes involved in such an evaluation—adoption, fidelity, implementation cost, reach, and sustainment—and the sources of such data for these metrics using established taxonomies and frameworks. Last, we present an example of a quantitative evaluation from an ongoing randomized rollout implementation trial of the Collaborative Care Model for depression management in a large primary healthcare system.

KW - Implementation measurement

KW - Implementation research

KW - Summative evaluation

UR - http://www.scopus.com/inward/record.url?scp=85071358005&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071358005&partnerID=8YFLogxK

U2 - 10.1016/j.psychres.2019.112521

DO - 10.1016/j.psychres.2019.112521

M3 - Article

C2 - 31473029

AN - SCOPUS:85071358005

VL - 283

JO - Psychiatry Research

JF - Psychiatry Research

SN - 0165-1781

M1 - 112521

ER -