Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines

Susan Athey; Kristen Grabarz; Michael Luca; Nils Wernerfelt

doi:10.1073/pnas.2208110120

Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines

Susan Athey^*, Kristen Grabarz, Michael Luca, Nils Wernerfelt

^*Corresponding author for this work

Marketing

Research output: Contribution to journal › Article › peer-review

28 Scopus citations

Abstract

Public health organizations increasingly use social media advertising campaigns in pursuit of public health goals. In this paper, we evaluate the impact of about $40 million of social media advertisements that were run and experimentally tested on Facebook and Instagram, aimed at increasing COVID-19 vaccination rates in the first year of the vaccine roll-out. The 819 randomized experiments in our sample were run by 174 different public health organizations and collectively reached 2.1 billion individuals in 15 languages. We find that these campaigns are, on average, effective at influencing self-reported beliefs—shifting opinions close to 1% at baseline with a cost per influenced person of about $3.41. Combining this result with an estimate of the relationship between survey outcomes and vaccination rates derived from observational data yields an estimated cost per additional vaccination of about $5.68. There is further evidence that campaigns are especially effective at influencing users’ knowledge of how to get vaccines. Our results represent, to the best of our knowledge, the largest set of online public health interventions analyzed to date.

Original language	English (US)
Article number	e2208110120
Journal	Proceedings of the National Academy of Sciences of the United States of America
Volume	120
Issue number	5
DOIs	https://doi.org/10.1073/pnas.2208110120
State	Published - Jan 31 2023

Funding

Competing interest statement: The authors have organizational affiliations to disclose, K.G. is a part-time contractor through PRO Unlimited, a contracting agency used by Meta Platforms. N.W. is an employee of Meta Platforms. Yes, the authors have stock ownership to disclose, N.W. owns stock in Meta Platforms. Yes, the authors have research support to disclose, S.A. received funding from Meta Platforms for research projects related to public health. Yes, the authors have additional information to disclose, S.A. previously provided consulting services for Meta Platforms. This article is a PNAS Direct Submission.

Keywords

COVID-19 vaccine
meta-analysis
public health advertising
randomized experiment

ASJC Scopus subject areas

General

Access to Document

10.1073/pnas.2208110120

Cite this

@article{0603cce0036c49b79c77bdf0f36b390b,

title = "Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines",

abstract = "Public health organizations increasingly use social media advertising campaigns in pursuit of public health goals. In this paper, we evaluate the impact of about $40 million of social media advertisements that were run and experimentally tested on Facebook and Instagram, aimed at increasing COVID-19 vaccination rates in the first year of the vaccine roll-out. The 819 randomized experiments in our sample were run by 174 different public health organizations and collectively reached 2.1 billion individuals in 15 languages. We find that these campaigns are, on average, effective at influencing self-reported beliefs—shifting opinions close to 1% at baseline with a cost per influenced person of about $3.41. Combining this result with an estimate of the relationship between survey outcomes and vaccination rates derived from observational data yields an estimated cost per additional vaccination of about $5.68. There is further evidence that campaigns are especially effective at influencing users{\textquoteright} knowledge of how to get vaccines. Our results represent, to the best of our knowledge, the largest set of online public health interventions analyzed to date.",

keywords = "COVID-19 vaccine, meta-analysis, public health advertising, randomized experiment",

author = "Susan Athey and Kristen Grabarz and Michael Luca and Nils Wernerfelt",

note = "Funding Information: Competing interest statement: The authors have organizational affiliations to disclose, K.G. is a part-time contractor through PRO Unlimited, a contracting agency used by Meta Platforms. N.W. is an employee of Meta Platforms. Yes, the authors have stock ownership to disclose, N.W. owns stock in Meta Platforms. Yes, the authors have research support to disclose, S.A. received funding from Meta Platforms for research projects related to public health. Yes, the authors have additional information to disclose, S.A. previously provided consulting services for Meta Platforms. This article is a PNAS Direct Submission. Publisher Copyright: Copyright {\textcopyright} 2023 the Author(s). Published by PNAS.",

year = "2023",

month = jan,

day = "31",

doi = "10.1073/pnas.2208110120",

language = "English (US)",

volume = "120",

journal = "Proceedings of the National Academy of Sciences of the United States of America",

issn = "0027-8424",

publisher = "National Academy of Sciences",

number = "5",

}

Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines. / Athey, Susan; Grabarz, Kristen; Luca, Michael et al.
In: Proceedings of the National Academy of Sciences of the United States of America, Vol. 120, No. 5, e2208110120, 31.01.2023.

Research output: Contribution to journal › Article › peer-review

TY - JOUR

T1 - Digital public health interventions at scale

T2 - The impact of social media advertising on beliefs and outcomes related to COVID vaccines

AU - Athey, Susan

AU - Grabarz, Kristen

AU - Luca, Michael

AU - Wernerfelt, Nils

N1 - Funding Information: Competing interest statement: The authors have organizational affiliations to disclose, K.G. is a part-time contractor through PRO Unlimited, a contracting agency used by Meta Platforms. N.W. is an employee of Meta Platforms. Yes, the authors have stock ownership to disclose, N.W. owns stock in Meta Platforms. Yes, the authors have research support to disclose, S.A. received funding from Meta Platforms for research projects related to public health. Yes, the authors have additional information to disclose, S.A. previously provided consulting services for Meta Platforms. This article is a PNAS Direct Submission. Publisher Copyright: Copyright © 2023 the Author(s). Published by PNAS.

PY - 2023/1/31

Y1 - 2023/1/31

N2 - Public health organizations increasingly use social media advertising campaigns in pursuit of public health goals. In this paper, we evaluate the impact of about $40 million of social media advertisements that were run and experimentally tested on Facebook and Instagram, aimed at increasing COVID-19 vaccination rates in the first year of the vaccine roll-out. The 819 randomized experiments in our sample were run by 174 different public health organizations and collectively reached 2.1 billion individuals in 15 languages. We find that these campaigns are, on average, effective at influencing self-reported beliefs—shifting opinions close to 1% at baseline with a cost per influenced person of about $3.41. Combining this result with an estimate of the relationship between survey outcomes and vaccination rates derived from observational data yields an estimated cost per additional vaccination of about $5.68. There is further evidence that campaigns are especially effective at influencing users’ knowledge of how to get vaccines. Our results represent, to the best of our knowledge, the largest set of online public health interventions analyzed to date.

AB - Public health organizations increasingly use social media advertising campaigns in pursuit of public health goals. In this paper, we evaluate the impact of about $40 million of social media advertisements that were run and experimentally tested on Facebook and Instagram, aimed at increasing COVID-19 vaccination rates in the first year of the vaccine roll-out. The 819 randomized experiments in our sample were run by 174 different public health organizations and collectively reached 2.1 billion individuals in 15 languages. We find that these campaigns are, on average, effective at influencing self-reported beliefs—shifting opinions close to 1% at baseline with a cost per influenced person of about $3.41. Combining this result with an estimate of the relationship between survey outcomes and vaccination rates derived from observational data yields an estimated cost per additional vaccination of about $5.68. There is further evidence that campaigns are especially effective at influencing users’ knowledge of how to get vaccines. Our results represent, to the best of our knowledge, the largest set of online public health interventions analyzed to date.

KW - COVID-19 vaccine

KW - meta-analysis

KW - public health advertising

KW - randomized experiment

UR - http://www.scopus.com/inward/record.url?scp=85147046777&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85147046777&partnerID=8YFLogxK

U2 - 10.1073/pnas.2208110120

DO - 10.1073/pnas.2208110120

M3 - Article

C2 - 36701366

AN - SCOPUS:85147046777

SN - 0027-8424

VL - 120

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

IS - 5

M1 - e2208110120

ER -

Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines

Abstract

Funding

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this