Mixing methods in randomized controlled trials (RCTs): Validation, contextualization, triangulation, and control

James P. Spillane; Amber Stitziel Pareja; Lisa Dorner; Carol Barnes; Henry May; Jason Huff; Eric Camburn

doi:10.1007/s11092-009-9089-8

Mixing methods in randomized controlled trials (RCTs): Validation, contextualization, triangulation, and control

James P. Spillane, Amber Stitziel Pareja, Lisa Dorner, Carol Barnes, Henry May, Jason Huff, Eric Camburn

School of Education and Social Policy

Research output: Contribution to journal › Article › peer-review

24 Scopus citations

Abstract

In this paper we described how we mixed research approaches in a Randomized Control Trial (RCT) of a school principal professional development program. Using examples from our study we illustrate how combining qualitative and quantitative data can address some key challenges from validating instruments and measures of mediator variables to examining how contextual factors interact with the treatment. Describing how we transformed our qualitative and quantitative data, we consider how mixing methods enabled us to deal with the two core RCT challenges of random assignment and treatment control critical. Our account offers insights into ways of maximizing the potential of mixing research methods in RCTs.

Original language	English (US)
Pages (from-to)	5-28
Number of pages	24
Journal	Educational Assessment, Evaluation and Accountability
Volume	22
Issue number	1
DOIs	https://doi.org/10.1007/s11092-009-9089-8
State	Published - Mar 2010

Keywords

Mixed methods
Randomized controlled trials

ASJC Scopus subject areas

Education
Organizational Behavior and Human Resource Management

Access to Document

10.1007/s11092-009-9089-8

Fingerprint Dive into the research topics of 'Mixing methods in randomized controlled trials (RCTs): Validation, contextualization, triangulation, and control'. Together they form a unique fingerprint.

Cite this

@article{80321451bbc74924bb77e4c2b163f730,

title = "Mixing methods in randomized controlled trials (RCTs): Validation, contextualization, triangulation, and control",

abstract = "In this paper we described how we mixed research approaches in a Randomized Control Trial (RCT) of a school principal professional development program. Using examples from our study we illustrate how combining qualitative and quantitative data can address some key challenges from validating instruments and measures of mediator variables to examining how contextual factors interact with the treatment. Describing how we transformed our qualitative and quantitative data, we consider how mixing methods enabled us to deal with the two core RCT challenges of random assignment and treatment control critical. Our account offers insights into ways of maximizing the potential of mixing research methods in RCTs.",

keywords = "Mixed methods, Randomized controlled trials",

author = "Spillane, {James P.} and Pareja, {Amber Stitziel} and Lisa Dorner and Carol Barnes and Henry May and Jason Huff and Eric Camburn",

note = "Funding Information: An earlier version of this paper was presented at the Annual Meeting of the American Educational Research Association, Chicago April 9th – 13th, 2007. The research was supported through a grant from the U.S. Department of Education{\textquoteright}s Institute of Education Sciences and the Distributed Leadership Studies supported by a grant from the National Science Foundation (Grant # EHR – 0412510). We also thank James Pustejovsky, Beth Sanders, and Jimmy Sebastian for their research assistance at various stages of the work. Please direct any correspondence regarding this paper to Jim Spillane – j-spillane@northwestern.edu. J.P.Spillane(*).A.S.Pareja.L.Dorner Northwestern University, 2120 Campus Drive, Annenberg Hall 208, Evanston, IL 60208, USA e-mail: j-spillane@northwestern.edu",

year = "2010",

month = mar,

doi = "10.1007/s11092-009-9089-8",

language = "English (US)",

volume = "22",

pages = "5--28",

journal = "Educational Assessment, Evaluation and Accountability",

issn = "1874-8597",

publisher = "Springer Netherlands",

number = "1",

}

Mixing methods in randomized controlled trials (RCTs) : Validation, contextualization, triangulation, and control. / Spillane, James P.; Pareja, Amber Stitziel; Dorner, Lisa; Barnes, Carol; May, Henry; Huff, Jason; Camburn, Eric.

In: Educational Assessment, Evaluation and Accountability, Vol. 22, No. 1, 03.2010, p. 5-28.

Research output: Contribution to journal › Article › peer-review

TY - JOUR

T1 - Mixing methods in randomized controlled trials (RCTs)

T2 - Validation, contextualization, triangulation, and control

AU - Spillane, James P.

AU - Pareja, Amber Stitziel

AU - Dorner, Lisa

AU - Barnes, Carol

AU - May, Henry

AU - Huff, Jason

AU - Camburn, Eric

N1 - Funding Information: An earlier version of this paper was presented at the Annual Meeting of the American Educational Research Association, Chicago April 9th – 13th, 2007. The research was supported through a grant from the U.S. Department of Education’s Institute of Education Sciences and the Distributed Leadership Studies supported by a grant from the National Science Foundation (Grant # EHR – 0412510). We also thank James Pustejovsky, Beth Sanders, and Jimmy Sebastian for their research assistance at various stages of the work. Please direct any correspondence regarding this paper to Jim Spillane – j-spillane@northwestern.edu. J.P.Spillane(*).A.S.Pareja.L.Dorner Northwestern University, 2120 Campus Drive, Annenberg Hall 208, Evanston, IL 60208, USA e-mail: j-spillane@northwestern.edu

PY - 2010/3

Y1 - 2010/3

N2 - In this paper we described how we mixed research approaches in a Randomized Control Trial (RCT) of a school principal professional development program. Using examples from our study we illustrate how combining qualitative and quantitative data can address some key challenges from validating instruments and measures of mediator variables to examining how contextual factors interact with the treatment. Describing how we transformed our qualitative and quantitative data, we consider how mixing methods enabled us to deal with the two core RCT challenges of random assignment and treatment control critical. Our account offers insights into ways of maximizing the potential of mixing research methods in RCTs.

AB - In this paper we described how we mixed research approaches in a Randomized Control Trial (RCT) of a school principal professional development program. Using examples from our study we illustrate how combining qualitative and quantitative data can address some key challenges from validating instruments and measures of mediator variables to examining how contextual factors interact with the treatment. Describing how we transformed our qualitative and quantitative data, we consider how mixing methods enabled us to deal with the two core RCT challenges of random assignment and treatment control critical. Our account offers insights into ways of maximizing the potential of mixing research methods in RCTs.

KW - Mixed methods

KW - Randomized controlled trials

UR - http://www.scopus.com/inward/record.url?scp=77649272091&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77649272091&partnerID=8YFLogxK

U2 - 10.1007/s11092-009-9089-8

DO - 10.1007/s11092-009-9089-8

M3 - Article

AN - SCOPUS:77649272091

VL - 22

SP - 5

EP - 28

JO - Educational Assessment, Evaluation and Accountability

JF - Educational Assessment, Evaluation and Accountability

SN - 1874-8597

IS - 1

ER -

Mixing methods in randomized controlled trials (RCTs): Validation, contextualization, triangulation, and control

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this