What we make of null and negative results from U.S. cash programs

Summary

  • Many U.S. studies show cash can have positive impacts, but some have found no impact or even negative impact
  • Null results can have many causes, while negative results can help us design better programs in the future
  • As U.S. cash research grows, we’ll know more about how best to deliver cash to Americans in need

Yolanda spent some of the monthly cash she receives through GiveDirectly’s program in Cook County, Illinois on a trip to the zoo with her grandson. “It felt good because that payment helps me be able to do those things,” she said. “So I don’t have to say to my grandson, ‘Oh, we can’t do that right now.’”

Nora in Georgia used some of her monthly GiveDirectly cash to move out of a mold-infested home. “This is such a miracle for me, and my kids,” she said. And Christopher said regarding our program with the City of Chicago: “It completely transformed my view of the government, not only in Chicago but nationally. It gave me an inkling of hope that things are happening.” 

These are powerful anecdotal testaments to the power of giving cash to low-income Americans. However, there is not as much hard, quantitative evidence on the impact as there is from developing countries. Below we review what this preliminary evidence is finding – including some null and negative results – and share our thoughts on how U.S. cash research should evolve.

We do not expect all cash studies to be positive

While there have been hundreds of randomized controlled trials studying the impact of direct cash, very few of these have taken place in the U.S. Most are from low- or low-middle-income countries like Kenya, where GiveDirectly started. 

As we consider the nascent state of U.S. cash research, it’s worth remembering that global cash studies sometimes have null (no significant results) or even negative (significant worsening) findings. 

This 2016 literature review of global cash programs found mostly positive impacts (blue bars in the chart below) across a variety of outcomes, especially monetary poverty, savings, and empowerment. But the review also found some studies had null results (gray bars) and a few had negative results (red bars):

This is all to say that direct cash is not a silver bullet, and it does not work equally well in every context. Research findings on cash in the U.S. tell a similar story.

Many U.S. studies show cash can have positive impacts 

To date, we’ve seen promising evidence that cash in the U.S. can have positive impacts on income volatility, financial well-being, employment, homelessness, child development, health, and education.

  • New findings indicate that receiving $1,000 of unconditional cash per month for three years can have several benefits for participants:
    • Increased spending on basic needs, and on support for others
    • Increased ability to pay for one’s own housing, and some participants reported that the cash helped them move out of toxic or abusive environments
    • Higher likelihood to make budgets and plan for future education
    • Increase in entrepreneurship, especially for recipients who identified as Black and/or female
    • Less drug and alcohol abuse, especially for male participants. 
    • Increased use of formal medical services
  • Studies on the Earned Income Tax Credit (EITC) and the Child Tax Credit (CTC) showed that increases in tax refunds from these programs may have lowered rates of reported child maltreatment, reduced food insecurity or missed rent, and improved mental health. 
  • Children in American Indian households that received extra cash through Eastern Cherokee casino payments were more likely to graduate high school and were less likely to commit minor crimes as young adults. 
  • 2023 research from Vancouver, British Columbia suggests that recipients experiencing homelessness who received a large cash transfer spent fewer days in shelters or on the street and saved hundreds of dollars more than control participants.
  • A recently published paper on the Baby’s First Years cash program found that mothers who received a higher cash transfer were more likely to read with their children and tell them stories than mothers who received a lower cash amount. The mothers who received more cash were also more likely to purchase books, toys, and clothing for their children. 
  • A 2022 study found that losing Supplemental Security Income (SSI) payments at age 18 significantly increased the likelihood that the former SSI recipient would be charged with a crime later in life. 

Some U.S. cash studies have found no impact

  • Our research on the impacts of a $1,000 transfer during the COVID-19 pandemic found that the transfers had little measurable effect on subjective well-being or material hardship. 
  • Another program responding to the COVID-19 pandemic gave Americans a one-time transfer of $500 or $2,000, and researchers found no evidence that more cash improved recipients’ financial or psychological well-being, cognitive capacity, or health. 
  • A study on a 3 year guaranteed income included some null results on health outcomes, as improvements in mental health and food security were insignificant after the first year of the program and there were no improvements to exercise, sleep, or other measures of physical health or to self-reported access to healthcare.
  • A study on cash received through Social Security benefits for families with infants in poor health found no impacts on long-term educational or earnings outcomes.
  • The study on Baby’s First Years did not find a significant change in mothers’ happiness and optimism or in children’s time spent in childcare as a result of participating in the program.
  • The Year 1 evaluation report of the Denver Basic Income Project, while finding some positive directional evidence on outcomes related to use of public services, housing, financial well-being, and leisure time, had mixed results when it came to mental and physical well-being.
    • They also did not find any significant differences between their control and treatment groups, which makes it difficult to say whether the cash alone was responsible for positive outcomes.
  • The aforementioned findings from OpenResearch included some null results on health outcomes:
    • Improvements in mental health and food security were insignificant after the first year of the program
    • No improvements to exercise, sleep, or other measures of physical health 
    • No improvements to self-reported access to health care

These null results can have many causes

Researchers for these U.S. studies offer a range of possible explanations for why cash does not always have a measurable impact:

  • Cash transfer amounts may be too small in the U.S. context to move the needle on key outcomes 
  • Studying heterogeneous populations who have different goals and outcomes can yield inconsistent results
  • Some studies may have insufficient statistical power to detect effects
  • Survey challenges, like response bias or attrition
  • High costs of conducting research over the course of a long-term study

More broadly, the flexibility of cash—one of its strengths—may also make it particularly difficult to study:

“Usually social intervention experimental studies evaluate interventions targeted at a very clear goal—does an educational program improve test scores? Does rental assistance improve housing security? Yet the flexibility of cash transfers allow recipients to allocate funds to a wide range of uses, and even spread a transfer over many different expenses
If beneficiaries spread their transfer over many different uses, this might mean we would not see an impact, and this poses a challenge, especially for untargeted, relatively small cash transfers.”

University of Michigan researchers

Negative results, while rare, are instructive in how to augment cash programs

Two studies that found cash in the U.S. can have a negative effect on recipients don’t necessarily indicate that cash is a harmful or ineffective tool for alleviating poverty. Rather, they point to the potential effectiveness that changes in program design can have.

A sampling of studies that found negative results provide important lessons for the design of cash transfer programs:

StudyNegative ResultLesson Learned
Employment Effects of a Guaranteed Income: Experimental Evidence from Two U.S. States (2024)Researchers found that receiving $1,000 of unconditional cash per month for three years caused total individual income to fall by about $1,500/year. This decrease in income excludes the transfers themselves and is in comparison to a control group who only received $50/month. They also found that participants in the larger cash group experienced less labor market participation and worked less overall.When the researchers included the transfer in income, total income is higher for the cash group. They suggest based on survey and demographic data that cash may have given participants the flexibility to take time away from work to do a variety of things, like spend time with their children or embark in more selective, time-intensive job searches. 
Cash Can Make Its Absence Felt: Randomizing Unconditional Cash Transfer Amounts in the U.S. (2022)Negative mental health effects associated with direct cash may have been due to the transfer size being too small to sufficiently meet participants’ needs. The researchers suggest that this made participants’ financial insecurity feel more salient and increased distress.This finding is not a wholesale condemnation of unconditional cash. Rather, it is an indication that larger one-time transfers, or smaller ones over a longer period, may be more effective in the U.S.
The Long-Term Effects of Cash Assistance (2018)Income maintenance programs of the 1960s in Seattle and Denver may have reduced recipients’ earnings and increased the likelihood that they would apply for disability benefits post-program. Researchers attributed this to a possible decrease in participants’ “human capital”, which may have caused them to get lower-paying, physically-taxing jobs after the programs ended.Cash may be more effective in the U.S. when it’s paired with optional efforts to support recipients, such as facilitated access to new educational and employment opportunities. The results also point to a broader issue that many jobs available to low-income Americans have low wages and poor labor protections, something direct cash alone can’t solve.

More broadly, one of the great attributes of cash – recipient choice – can itself fuel what researchers may frame as negative findings. For example, someone who receives unconditional cash may decide to work less (negative impact on employment and income) because they want to spend more time with their children. Another recipient may decide to forgo signing a lease (negative impact on housing) to pay down medical debt. However, it is not necessarily accurate to define these tradeoffs as negative outcomes. 

Despite the contradictions inherent to social science research, we ultimately won’t know with certainty what combinations of cash plus other interventions work best to alleviate poverty in the U.S. without more research.

As U.S. cash research grows, we’ll know more about how best to deliver cash to Americans in need

This is an exciting time for research on direct cash in the U.S. with several major studies currently underway. At GiveDirectly, we’ve launched three new programs with ambitious research components:

  • Rx Kids in Flint, Michigan, whose research will help us better understand the impacts of cash on mothers and babies
  • In Her Hands in Georgia, an innovative program that centers recipient preference in its design, and whose research will provide insight into how a total of $36k in cash payments over three years impacts Black women experiencing poverty
  • The Stability Investment for Family Housing, a state-funded program in Illinois, whose research will shed light on whether a large, one-time influx of cash ($9,500) can help families experiencing homelessness exit emergency shelter  

These studies will add to the growing body of direct cash research in the U.S. by helping us identify if, when, how, and for whom cash is most effective. Unlike guaranteed income programs where thousands of diverse participants receive a relatively small amount of cash monthly, programs targeted toward specific demographic or geographic groups can reduce heterogeneous findings and may show that cash can be powerful in the U.S.

Give to Americans in need

GiveDirectly will continue to deliver cash in the U.S., study cash against existing interventions, and prioritize recipient choice in the process

GiveDirectly delivers direct, unconditional cash because it upholds recipients’ dignity by allowing for flexibility, and the power and freedom  of choice. We have found evidence to suggest that recipients prefer cash to in-kind assistance after disasters for these reasons, and recipients routinely elect to enroll in cash programs even after they consider how participation may negatively impact other benefits programs. We should trust their preferences. 

We take limited null and negative research results (however they are defined) seriously. But we do not believe they are bellwethers for the end of cash in the U.S. These results will provide valuable insight into how we can better design future programs that avoid the pitfalls of previous efforts. It would be shortsighted to stop these efforts based on just a few null or negative findings.

GiveDirectly will also continue to deliver cash in the U.S. and study it against existing interventions. For example, there are fertile research opportunities in comparing direct cash against other non-cash government benefits through benchmarking studies. Rx Kids’ use of TANF funds and Illinois’ recent upswing in support for cash as a response to homelessness demonstrate that there is a political appetite for reassessing the effectiveness and bureaucratic efficiency of non-cash interventions. 

Continuing to deliver cash and study its effects in the U.S. are vital steps toward better understanding how to end poverty in the world’s wealthiest country. We have much more to learn and more good to do for low-income Americans.

What we make of null and negative results from U.S. cash programs

Story Statistics

2,345 Reads

80 Shares

320 Likes

Related Stories

2024-08-05

GiveDirectly pursues greater impact as Nick Allardice joins as President & CEO

Summary:

GiveDirectly has been a major player in scaling the use of unconditional cash transfers, helping build consensus among the international community that direct cash is a key component to tackling extreme poverty. Now, as we near $1 billion delivered, we’ve appointed Nick Allardice as President and CEO to lead this next phase of growth. 

GiveDirectly is currently running our most ambitious projects ever, part of a larger scale up to contribute to the U.N. sustainable development goal of eradicating extreme poverty worldwide by 2030. To achieve this goal, we aim to galvanize donors, institutions, and the broader public around direct cash, while advancing cash delivery through research and innovation.

Nick Allardice spent a decade at Change.org, where he scaled the global activism platform to over 400 million users and 1 billion actions. While there, he established and managed teams in 20 countries, enhancing Change.org’s international presence. He’s also advised prominent development organizations and tech companies on fundraising, team operations, and technology strategy.

For future updates on our work and impact, be sure you’re subscribed to our newsletter→

“I’ve admired and supported GiveDirectly for a decade,” Nick Allardice shared on his new appointment. “Unconditional cash transfers to people living in extreme poverty are profoundly powerful. Giving cash respects people’s dignity and agency to choose for themselves how best to improve their lives, and the academic evidence says that it’s amongst the most efficient, impactful, and scalable interventions out there. I couldn’t be more excited to work with the GiveDirectly team to scale this work further.” 

“We’re also immensely grateful for Samuel Mwale’s leadership over the past year as GiveDirectly has continued to grow our work globally,” shared GiveDirectly’s Board Chair Aly Jeddy. “We are thrilled to see Nick Allardice take the helm at GiveDirectly. Nick’s leadership and vision will be instrumental as GiveDirectly scales up its transformative work in delivering unconditional cash transfers. This innovative approach is making significant strides in the fight to eradicate extreme poverty, and we are excited about the impact that lies ahead.” 

“I am deeply grateful for the opportunity to have served as Interim President of GiveDirectly,” said Samuel Mwale. “It has been a privilege to witness firsthand the profound impact of unconditional cash transfers on the lives of people in extreme poverty. As I pass the baton to Nick Allardice, I am confident that his leadership will further our mission and expand our reach. Nick’s dedication and vision will undoubtedly help us continue to transform lives and advance the fight against extreme poverty.”

  1. Jones Chitete, the VDC Chairperson in Madzonga village, speaks to Nick Allardice about his community | Malawi
  2. Kevasi Charles speaks to Nick Allardice about how he plans to spend his upcoming $500 GiveDirectly transfer | Malawi
  3. Charles, a Rwandan refugee, speak to Nick Allardice about starting his new life in Nairobi | Kenya
  4. Nick Allardice and Corretah Sanga conversing with Ronald Christopher, a GiveDirectly recipient | Malawi
  5. Nick Allardice greeting a recipient, Elizabeth Isaac at Chimtolo Market | Malawi
  6. Jenala Yohane speaks to Nick Allardice about her vegetable business at Chimtolo Market | Malawi
  7. Gertrude telling Nick Allardice how she started a restaurant in Mathare settlement in Nairobi with her GiveDirectly cash | Kenya