Fighting for Reliable Evidence
Publication Year: 2013
Published by: Russell Sage Foundation
Title Page, Copyright Page
Tables and Figures
About the Authors
Welfare policy in this country is unique among all areas of social policy in having had forty-five years of uninterrupted, large-scale random assignment studies that assessed the effectiveness of reform initiatives. This book tells the story of our participation in that history. It is not an impartial account. For most of these years, we were actors in the story. Judy helped to build and then...
Acknowledgements and Dedication
Many people over many years made this book possible. Some of them were responsible for the story itself, and the fact that it reports success in using experiments to test social policies; others directly supported our work on this volume. Those in the first category fill the pages of this book. They are the state and community officials and staff who, by participating in random assignment studies, let us redefine, expand on, and make a reality of Justice...
Chapter 1: Introduction: The Issue, the Method, and the Story in Brief
How can we know whether social programs do what they are designed to do? Can that question even be answered convincingly? A simple example illustrates the problem: The governor of a large midwestern state is under pressure. Welfare rolls are rising. Legislators are pushing for action. Armed with a report from a blue-ribbon panel, she recommends a new program with a catchy name: WoW, for...
Chapter 2: They Said It Couldn’t Be Done: The National Supported Work Demonstration
The Supported Work project started out as a small local program offering subsidized jobs to two hard-to-employ groups (former prisoners and former addicts) in a structured environment, followed by assistance in finding an unsubsidized job. The national Supported Work demonstration, the subject...
Chapter 3: Bridge to the 1980s: Implementing Random Assignment in Work Incentive Program Offices and Testing a Job Guarantee
This chapter tells the story of two initiatives that helped MDRC not only survive as an institution in the dramatically different policy and policy- research environment of the Reagan era but also continue using random assignment to learn more about program evaluation generally and the work-...
Chapter 4: Inventing a New Paradigm: The States as Laboratories
Political transitions can sound portentous but may bring little change. For our story, however, Ronald Reagan’s election in 1980 was a true revolution, marking a dramatic turning point in welfare policy, the role of the states, and the nature and origin of welfare research. Support for a welfare entitlement and for voluntary programs such as Supported Work yielded to the harsher language of mandates and obligations. Policy initiative shifted from Washington...
Chapter 5: The Reagan Revolution and Research Capacity Within the Department of Health and Human Services: From Near Destruction to New Growth
When Ronald Reagan won the presidency in 1980, the Department of Health and Human Services (HHS) had already played a substantial role in what was then the relatively brief history of social experiments. Although the first such experiments were initiated by the Office of Economic Opportunity, through...
Chapter 6: The Work/Welfare Demonstration: Lessons About Programs, Research, and Dissemination
The Work/Welfare demonstration was the major turning point in our story. If Supported Work and the WIN Labs put a toe in the real world, this project was an immersion. At the start, we at MDRC fretted over all of the prerequisites to success: recruiting the states, getting the money, gaining federal coop-...
Chapter 7: Waiver Evaluations: How Random Assignment Evaluation Came to Be the Standard for Approval
Throughout the first Reagan administration, the Department of Health and Human Services (HHS) applied the approval standard described in chapter 5 to section 1115 waiver applications: it approved waiver requests from states whose policy proposals were consistent with administration policy and denied those from states that wished to try anything different. Evaluation requirements were minimal, which was plainly permissible as a legal matter, given the...
Chapter 8: Expanding the Agenda: The Role of Basic Education
We have seen that real-world experiments proved feasible and credible; that most welfare-to-work programs were successful; that politicians and public officials listened and acted; that states could be willing partners; that a major foundation sparked these changes; and that several government agencies endorsed experiments as uniquely reliable. If welfare research had gone no further,...
Chapter 9: The JOBS Evaluation: Cumulative Evidence on Basic Education Versus Work First
Along with the Greater Avenues for Independence program (GAIN) evaluation (later, California’s JOBS program), the Job Opportunities and Basic Skills Training (JOBS) evaluation would profoundly alter the views of policy makers, program operators, and researchers about the effectiveness of alternative...
Chapter 10: Expanding the Agenda II: Three Experiments to Make Work Pay
With the welfare debate shifting rapidly toward the right in the early 1990s, work-for-your-grant (workfare) and related policies that had been denigrated as slavefare ten years earlier looked benign next to calls to end support. The tipping point came when the Democratic presidential candidate, Bill Clinton, made “ending welfare as we know it” and “making work pay” central parts of...
Chapter 11: The End of Our Story: Welfare Reform Recedes from the Spotlight of Random Assignment Program Evaluation
Both Judy and I have heard people say, even experts very familiar with the welfare evaluation field, that the rigor of the large body of welfare experiments was a result of the federal government’s use of its 1115 waiver demonstration authority to require an experimental evaluation in exchange for programmatic...
Chapter 12: Conclusion and Lessons
In the preceding chapters, we tell of our long struggle to show that a relatively untried technique—large-scale, random assignment experiments (the social policy analogue to clinical trials in medicine)—could be used to answer important questions about complex social programs. We also show that the results were considered singularly credible and, in part because of that, were...
CODA: Random Assignment Takes Center Stage
This book describes the struggle to promote randomized experiments as a campaign waged over many years, mostly by people outside the normal academic reward system. In recent years, this has changed, both in the United States and internationally, prompting me to ask a number of people (see the appendix) close to the past conflict or current transformation: How would...
NOTE ON SOURCES
Page Count: 593
Publication Year: 2013
MUSE Marc Record: Download for Fighting for Reliable Evidence