Emergent principles for the design, implementation, and analysis of cluster-based experiments in social science

Research output: Contribution to journalArticlepeer-review

48 Scopus citations

Abstract

In experimentally designed research, many good reasons exist for assigning groups or clusters to treatments rather than individuals. This article discusses them. But cluster-level designs face some unique or exacerbated challenges. The article identifies them and offers some principles about them. One emphasizes how statistical power and sample size estimation depend on intraclass correlations, particularly after conditioning on the use of cluster-level covariates. Another stresses assigning experimental units at the lowest level of aggregation possible, provided this does not subtly change the research question. A third emphasizes the utility of minimizing and measuring interunit communication, though neither is easy to achieve. A fourth advises against experiments that are totally black box and so leave program implementation and process unstudied, though such study often makes the research process more salient. The last principle involves the utility of describing treatment heterogeneity and estimating its consequences, though causal conclusions about the heterogeneity will be less well warranted compared to conclusions about the intended treatment, every experiment's major focus.

Original languageEnglish (US)
Pages (from-to)176-198
Number of pages23
JournalAnnals of the American Academy of Political and Social Science
Volume599
DOIs
StatePublished - May 2005

Keywords

  • Allocation principle
  • Causal chain
  • Cluster level
  • Cluster random assignment
  • Interventions
  • Statistical power
  • Treatment contamination
  • Unit of assignment

ASJC Scopus subject areas

  • Sociology and Political Science
  • Social Sciences(all)

Fingerprint

Dive into the research topics of 'Emergent principles for the design, implementation, and analysis of cluster-based experiments in social science'. Together they form a unique fingerprint.

Cite this