The goldilocks challenge: Right-fit evidence for the social sector

Mary Kay Gugerty, Dean Spencer Karlan

Research output: Book/ReportBook

2 Citations (Scopus)

Abstract

Nonprofits, governments, and social enterprises face increasing pressure to prove that their programs are making a positive impact on the world. This focus on impact is positive: learning whether we are making a difference enhances our ability to effectively address pressing social problems, and is critical for wise stewardship of resources. However, measuring the impact of a program is not always possible, nor is impact evaluation always the right choice for every organization or program. Accurately assessing impact requires information about what would have happened had the program not occurred, and it can be difficult and costly (or even impossible) to gather that information. Yet actors in the social sector face stiff competition for funding, and competition often demands evidence of impact. Faced with this pressure, organizations often attempt to measure impact even when the accuracy is questionable or worse. The result? A lot of misleading data and rhetoric about what works. Moreover, in this pursuit, many organizations collect huge amounts of data that cannot be or are not put to good use for learning and program improvement. Bottom line: Impact is great to measure when you can. But not everyone can and should measure impact. What, then, should organizations do? The Goldilocks Challenge presents four key principles to help guide organizations of all sizes and types in building strong, “right-fit” data collection systems. Those principles-Credible, Actionable, Responsible, and Transportable, or “CART”-describe how organizations can build data systems that support learning and improvement and measure impact when the time is right.

Original languageEnglish (US)
PublisherOxford University Press
Number of pages302
ISBN (Electronic)9780199366088
DOIs
StatePublished - Jan 1 2018

Fingerprint

Rhetoric
Social enterprise
Pressing
Funding
Stewardship
Resources
Data collection
Impact evaluation
Social problems
Government

Keywords

  • Evaluation and learning (mel)
  • Evidence
  • Goldilocks
  • Impact evaluation
  • Monitoring
  • Monitoring and evaluation
  • Ngo
  • Nonprofit
  • Performance management
  • Social impact
  • Social sector

ASJC Scopus subject areas

  • Economics, Econometrics and Finance(all)
  • Business, Management and Accounting(all)

Cite this

Gugerty, Mary Kay ; Karlan, Dean Spencer. / The goldilocks challenge : Right-fit evidence for the social sector. Oxford University Press, 2018. 302 p.
@book{e7f8a564f359436a9afcc260d28791ab,
title = "The goldilocks challenge: Right-fit evidence for the social sector",
abstract = "Nonprofits, governments, and social enterprises face increasing pressure to prove that their programs are making a positive impact on the world. This focus on impact is positive: learning whether we are making a difference enhances our ability to effectively address pressing social problems, and is critical for wise stewardship of resources. However, measuring the impact of a program is not always possible, nor is impact evaluation always the right choice for every organization or program. Accurately assessing impact requires information about what would have happened had the program not occurred, and it can be difficult and costly (or even impossible) to gather that information. Yet actors in the social sector face stiff competition for funding, and competition often demands evidence of impact. Faced with this pressure, organizations often attempt to measure impact even when the accuracy is questionable or worse. The result? A lot of misleading data and rhetoric about what works. Moreover, in this pursuit, many organizations collect huge amounts of data that cannot be or are not put to good use for learning and program improvement. Bottom line: Impact is great to measure when you can. But not everyone can and should measure impact. What, then, should organizations do? The Goldilocks Challenge presents four key principles to help guide organizations of all sizes and types in building strong, “right-fit” data collection systems. Those principles-Credible, Actionable, Responsible, and Transportable, or “CART”-describe how organizations can build data systems that support learning and improvement and measure impact when the time is right.",
keywords = "Evaluation and learning (mel), Evidence, Goldilocks, Impact evaluation, Monitoring, Monitoring and evaluation, Ngo, Nonprofit, Performance management, Social impact, Social sector",
author = "Gugerty, {Mary Kay} and Karlan, {Dean Spencer}",
year = "2018",
month = "1",
day = "1",
doi = "10.1093/oso/9780199366088.001.0001",
language = "English (US)",
publisher = "Oxford University Press",
address = "United States",

}

The goldilocks challenge : Right-fit evidence for the social sector. / Gugerty, Mary Kay; Karlan, Dean Spencer.

Oxford University Press, 2018. 302 p.

Research output: Book/ReportBook

TY - BOOK

T1 - The goldilocks challenge

T2 - Right-fit evidence for the social sector

AU - Gugerty, Mary Kay

AU - Karlan, Dean Spencer

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Nonprofits, governments, and social enterprises face increasing pressure to prove that their programs are making a positive impact on the world. This focus on impact is positive: learning whether we are making a difference enhances our ability to effectively address pressing social problems, and is critical for wise stewardship of resources. However, measuring the impact of a program is not always possible, nor is impact evaluation always the right choice for every organization or program. Accurately assessing impact requires information about what would have happened had the program not occurred, and it can be difficult and costly (or even impossible) to gather that information. Yet actors in the social sector face stiff competition for funding, and competition often demands evidence of impact. Faced with this pressure, organizations often attempt to measure impact even when the accuracy is questionable or worse. The result? A lot of misleading data and rhetoric about what works. Moreover, in this pursuit, many organizations collect huge amounts of data that cannot be or are not put to good use for learning and program improvement. Bottom line: Impact is great to measure when you can. But not everyone can and should measure impact. What, then, should organizations do? The Goldilocks Challenge presents four key principles to help guide organizations of all sizes and types in building strong, “right-fit” data collection systems. Those principles-Credible, Actionable, Responsible, and Transportable, or “CART”-describe how organizations can build data systems that support learning and improvement and measure impact when the time is right.

AB - Nonprofits, governments, and social enterprises face increasing pressure to prove that their programs are making a positive impact on the world. This focus on impact is positive: learning whether we are making a difference enhances our ability to effectively address pressing social problems, and is critical for wise stewardship of resources. However, measuring the impact of a program is not always possible, nor is impact evaluation always the right choice for every organization or program. Accurately assessing impact requires information about what would have happened had the program not occurred, and it can be difficult and costly (or even impossible) to gather that information. Yet actors in the social sector face stiff competition for funding, and competition often demands evidence of impact. Faced with this pressure, organizations often attempt to measure impact even when the accuracy is questionable or worse. The result? A lot of misleading data and rhetoric about what works. Moreover, in this pursuit, many organizations collect huge amounts of data that cannot be or are not put to good use for learning and program improvement. Bottom line: Impact is great to measure when you can. But not everyone can and should measure impact. What, then, should organizations do? The Goldilocks Challenge presents four key principles to help guide organizations of all sizes and types in building strong, “right-fit” data collection systems. Those principles-Credible, Actionable, Responsible, and Transportable, or “CART”-describe how organizations can build data systems that support learning and improvement and measure impact when the time is right.

KW - Evaluation and learning (mel)

KW - Evidence

KW - Goldilocks

KW - Impact evaluation

KW - Monitoring

KW - Monitoring and evaluation

KW - Ngo

KW - Nonprofit

KW - Performance management

KW - Social impact

KW - Social sector

UR - http://www.scopus.com/inward/record.url?scp=85049013067&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049013067&partnerID=8YFLogxK

U2 - 10.1093/oso/9780199366088.001.0001

DO - 10.1093/oso/9780199366088.001.0001

M3 - Book

BT - The goldilocks challenge

PB - Oxford University Press

ER -