The Failings of Conventional Mediation Analysis and a Design-Based Alternative

John G. Bullock, Donald P. Green*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Scholars routinely test mediation claims by using some form of measurement-of-mediation analysis whereby outcomes are regressed on treatments and mediators to assess direct and indirect effects. Indeed, it is rare for an issue of any leading journal of social or personality psychology not to include such an analysis. Statisticians have for decades criticized this method on the grounds that it relies on implausible assumptions, but these criticisms have been largely ignored. After presenting examples and simulations that dramatize the weaknesses of the measurement-of-mediation approach, we suggest that scholars instead use an approach that is rooted in experimental design. We propose implicit-mediation analysis, which adds and subtracts features of the treatment in ways that implicate some mediators and not others. We illustrate the approach with examples from recently published articles, explain the differences between the approach and other experimental approaches to mediation, and formalize the assumptions and statistical procedures that allow researchers to learn from experiments that encourage changes in mediators.

Original languageEnglish (US)
JournalAdvances in Methods and Practices in Psychological Science
Volume4
Issue number4
DOIs
StatePublished - 2021

Keywords

  • causal inference
  • experimental design
  • indirect effects
  • mediation
  • open materials

ASJC Scopus subject areas

  • Psychology(all)

Fingerprint

Dive into the research topics of 'The Failings of Conventional Mediation Analysis and a Design-Based Alternative'. Together they form a unique fingerprint.

Cite this