Investigating Science Education Effect Sizes: Implications for Power Analyses and Programmatic Decisions

Joseph A. Taylor, Susan M. Kowalski, Joshua R. Polanin, Karen Askinas, Molly A.M. Stuhlsatz, Christopher D. Wilson, Elizabeth Tipton, Sandra Jo Wilson

Research output: Contribution to journalArticlepeer-review

20 Scopus citations

Abstract

A priori power analyses allow researchers to estimate the number of participants needed to detect the effects of an intervention. However, power analyses are only as valid as the parameter estimates used. One such parameter, the expected effect size, can vary greatly depending on several study characteristics, including the nature of the intervention, developer of the outcome measure, and age of the participants. Researchers should understand this variation when designing studies. Our meta-analysis examines the relationship between science education intervention effect sizes and a host of study characteristics, allowing primary researchers to access better estimates of effect sizes for a priori power analyses. The results of this meta-analysis also support programmatic decisions by setting realistic expectations about the typical magnitude of impacts for science education interventions.

Original languageEnglish (US)
JournalAERA Open
Volume4
Issue number3
DOIs
StatePublished - Jul 1 2018

Funding

We gratefully acknowledge assistance of Karen M. Askinas, S. Josh Carson, Lila Goldstein, Jeff Hoover, Brendan Martin, Alexandra Monzon, Jennifer Nichols, Ran Shi, and Jay Wade. We also acknowledge the assistance of Zhipeng Hou for his work on the power calculator. This research was supported by a grant from the National Science Foundation (1118555). The opinions are those of the authors and do not reflect the views of the National Science Foundation.

Keywords

  • effect size
  • meta-analysis
  • program evaluation
  • science education
  • statistics
  • student achievement

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology
  • Social Sciences (miscellaneous)

Fingerprint

Dive into the research topics of 'Investigating Science Education Effect Sizes: Implications for Power Analyses and Programmatic Decisions'. Together they form a unique fingerprint.

Cite this