Every nonprofit fundraiser has a version of this debate: do you lead with the human story, or lead with the data?
The instinct toward personal narrative is strong and well-supported by decades of communications research. People respond to faces, not figures, and abstract statistics rarely compel action the way individual stories do. But is this always true?
Charity: Water, one of the most recognized clean water nonprofits in the world, had two videos that embodied this tension. One told a data-driven story about the health consequences of dirty water while the other followed women and children whose daily lives were transformed by access to clean water nearby. Both were well-produced and emotionally resonant in their own way. But which one actually changed minds and moved donors?
We put both ads to the test.
The Case for Nonprofit Message Testing
Charity: Water's mission is urgent. 703 million people worldwide lack access to clean water, roughly 1 in 10 people globally. The people most affected are women and children, who bear the burden of water collection and face disproportionate health consequences from unsafe sources. Solving this problem requires not just donations, but donors who are convinced the problem is real, the organization is credible, and their dollars will make a difference.
That's a lot of persuasion work to do in a short video.
Rather than rely on gut instinct about which ad would perform better, we used Grow Progress's Rapid Message Testing tool to measure the actual persuasive impact of each ad on three things that matter most to a nonprofit like Charity: Water:
- Brand favorability: Do people have a more positive view of the organization after seeing the ad?
- Mission alignment: Do people agree that providing clean water meaningfully improves lives in developing nations?
- Donation intent: Would people direct more of their charitable giving toward a clean water cause?
How We Ran the Test
We recruited a nationally representative audience of over 1,200 U.S. adults and randomly assigned them to one of three groups. The first group watched "Waterborne Illnesses," a data-driven ad highlighting the health consequences of drinking polluted water. The second watched "An Endless Cycle Broken," a narrative-driven ad following the women and children whose lives improve with access to clean local water. The third group, the control, watched a placebo message unrelated to Charity: Water.
After watching their assigned video, all participants answered the same three questions.
This randomized controlled trial (RCT) approach (the same methodology used in medical research) is what separates message testing from a standard survey or A/B test. We're not measuring which message people prefer or which gets more clicks. We're measuring whether seeing the message caused a shift in belief or behavior. Results came back in under 24 hours.
What the Data Found
Both ads lifted brand favorability equally
Charity: Water started with a high baseline: 71% of people in the control group already had a favorable view of the organization. That's a tough starting point for any ad, since there's less room to grow. Despite that, both videos moved the needle: each raised brand favorability by 12 percentage points.
On this measure, there was no meaningful difference between them. Both ads reinforced why Charity: Water is a trusted, credible organization.
But "Waterborne Illnesses" won on mission and donations
Here's where the story gets more interesting. When it came to the two measures most tied to actual fundraising outcomes (whether people believed in the mission and whether they'd give), the data-driven ad outperformed the narrative one.
"Waterborne Illnesses" increased mission agreement by 5 percentage points, a statistically significant result. "An Endless Cycle Broken" moved the needle by only 1 point, which was not statistically significant.
On donation intent (measured by asking respondents how they'd allocate a hypothetical $100 across different causes), "Waterborne Illnesses" increased the share choosing to give $75 or more to clean water charities by 6 points. "An Endless Cycle Broken" moved it by just 2 points, again not significant.
The health-focused, data-grounded ad was doing something the human-centered narrative wasn't: it was convincing people this problem was worth their money.
Where It Gets More Complicated: Subgroup Findings
The toplines tell a useful story, but the subgroup breakdowns tell a more complete one, and this matters for how Charity: Water (or any nonprofit) should think about targeting.
Past donors vs. non-donors
People who had not donated to any charitable organization in the past year were significantly easier to persuade. Among this group, "Waterborne Illnesses" raised brand favorability by 18 points. Non-donors may simply be less anchored in their views about charitable giving, making them more open to being moved by a strong argument.
Among past donors, the people nonprofits most want to retain and upgrade, "Waterborne Illnesses" still outperformed on brand favorability (an 11-point lift vs. 6 points for the narrative ad). For mission alignment, the baseline among past donors was already so high (92% agreement in the control group) that neither ad could move it significantly. These audiences already believe; the challenge is getting them to give more, not convincing them the problem exists.
On donation intent among past donors, neither ad caused a statistically significant shift. This is a notable finding: even compelling video ads have limits with audiences who have already sorted themselves into charitable givers. Reaching them may require different tactics.
Income subgroups
The income breakdown produced the most striking finding of the test: among people in households earning over $100,000 per year, "An Endless Cycle Broken" actually decreased donation intent.
This pattern warrants further investigation. High earners who give regularly may be more skeptical of emotional appeals, viewing them as manipulative, or simply misaligned with how they evaluate charitable impact. That "Waterborne Illnesses" also had no significant effect on this segment suggests neither ad has found the right frame for this audience.
For lower- and middle-income households, "Waterborne Illnesses" held its advantage, producing statistically significant increases in donation intent for people earning under $50K and $50K–$99K annually.
What This Means for Nonprofit Communicators
The instinct toward narrative isn't wrong, but it is incomplete. For audiences who don't yet believe in the mission, a clear, evidence-based argument for why the problem matters may be more persuasive than an emotionally moving portrait of who it affects.
The subgroup data adds another layer: the same ad can produce opposite effects depending on who's watching. For high-income donors in particular, the narrative ad created backlash, something that would be invisible without rigorous testing. That's a costly blind spot for any nonprofit trying to cultivate major donors.
Charity: Water's "Waterborne Illnesses" was the cleaner winner across most audiences and measures. But the more important takeaway isn't which video won. It's that testing made it possible to know, rather than assume.
The Open Questions Worth Exploring
This test opened as many doors as it closed. What message would actually move high-income households? Are there specific emotional frames or values that resonate with past donors in ways that lift giving, not just favorability? Could a hybrid approach (health consequences shown through individual stories) outperform either ad on its own?
These are the questions nonprofit communicators should be asking, and they're answerable. Audience understanding research can surface the values and motivations of specific segments before you produce another ad. Message testing can tell you, quickly and rigorously, what actually works.
You don't have to guess.
Want to know which messages actually move your donors? Explore Grow Progress's Rapid Message Testing for more research and insights like these.