TY - JOUR
T1 - Examining Factors Contributing to Variation in Effect Size Estimates of Teacher Outcomes from Studies of Science Teacher Professional Development
AU - Kowalski, Susan M.
AU - Taylor, Joseph A.
AU - Askinas, Karen M.
AU - Wang, Qian
AU - Zhang, Qi
AU - Maddix, William P.
AU - Tipton, Elizabeth
N1 - Publisher Copyright:
© 2020, © 2020 Taylor & Francis Group, LLC.
PY - 2020/7/2
Y1 - 2020/7/2
N2 - Developing and maintaining a high-quality science teaching corps has become increasingly urgent with standards that require students to move beyond mastering facts to reasoning and arguing from evidence. Effective professional development (PD) for science teachers enhances teacher outcomes and, in turn, enhances primary and secondary student outcomes. What constitutes effective PD? Although proposed features of effective PD have emerged, they have little empirical support. Even when impact studies of PD interventions are conducted, factors unrelated to PD design characteristics can influence effect size estimates. Can we statistically isolate PD design characteristics from factors unrelated to PD design that nevertheless influence effect size estimates? We conducted a meta-regression with robust variance estimation (RVE) of 162 science PD intervention studies. We investigated how effect size estimates for teacher outcomes vary by research design, study context, PD intervention characteristics, and outcomes of interest. Intensity and duration of PD, research design decisions, and researchers’ choice of outcomes of interest significantly influence effect size estimates.
AB - Developing and maintaining a high-quality science teaching corps has become increasingly urgent with standards that require students to move beyond mastering facts to reasoning and arguing from evidence. Effective professional development (PD) for science teachers enhances teacher outcomes and, in turn, enhances primary and secondary student outcomes. What constitutes effective PD? Although proposed features of effective PD have emerged, they have little empirical support. Even when impact studies of PD interventions are conducted, factors unrelated to PD design characteristics can influence effect size estimates. Can we statistically isolate PD design characteristics from factors unrelated to PD design that nevertheless influence effect size estimates? We conducted a meta-regression with robust variance estimation (RVE) of 162 science PD intervention studies. We investigated how effect size estimates for teacher outcomes vary by research design, study context, PD intervention characteristics, and outcomes of interest. Intensity and duration of PD, research design decisions, and researchers’ choice of outcomes of interest significantly influence effect size estimates.
KW - Science
KW - experimental and quasi-experimental
KW - meta-analysis
KW - professional development
KW - robust variance estimation
KW - teaching/teacher
UR - http://www.scopus.com/inward/record.url?scp=85082951673&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85082951673&partnerID=8YFLogxK
U2 - 10.1080/19345747.2020.1726538
DO - 10.1080/19345747.2020.1726538
M3 - Article
AN - SCOPUS:85082951673
SN - 1934-5747
VL - 13
SP - 430
EP - 458
JO - Journal of Research on Educational Effectiveness
JF - Journal of Research on Educational Effectiveness
IS - 3
ER -