What Charity Watchdogs Do and Do Not Check

Published by Instant Press on behalf of Fight For A Living Wage.

A charity rating tells you whether an organization files its paperwork cleanly and spends within accepted norms. It does not tell you whether the program works. Those are different questions, and the second one is the reason most people look up a charity in the first place. Knowing which question a rating answers is the difference between using a watchdog well and trusting it to do work it never claimed to do.

What the main raters look at

Four organizations do most of the evaluating in the United States, and each draws its conclusions from a different base.

Charity Navigator scores nonprofits largely from data reported on Form 990, the annual return most exempt organizations file with the IRS, and has expanded over time into measures of governance, transparency, and in some cases reported outcomes. Candid, which absorbed GuideStar, operates less as a judge and more as a repository: it collects filings and self reported profiles and lets organizations earn transparency seals by disclosing more.

The BBB Wise Giving Alliance checks organizations against a published list of accountability standards covering board oversight, fundraising practices, and disclosure, and reports whether a charity meets them rather than issuing a score. CharityWatch does its own financial analysis, working from audited financial statements alongside the 990 and reaching conclusions that sometimes differ from ratio based scores.

All four are doing legitimate work. None of them is auditing whether a food program reduced hunger.

The Form 990 problem

Most ratings trace back to the Form 990, which the organization prepares itself. It is a public document and filing a false one carries consequences, so it is not fiction. It is also a tax return, built on categories the IRS defined for tax administration rather than for judging effectiveness.

Expense allocation is the clearest example. An organization decides how to split a staff salary between program, management, and fundraising when that employee does all three. Two honest nonprofits running identical operations can report meaningfully different program expense ratios because they drew those lines differently. A rating built on the ratio inherits the judgment call.

The 990 also arrives late. Filings become public months after a fiscal year closes, so a current rating often describes an organization as it stood a year or two ago. For a stable charity that hardly matters. For one that changed leadership or doubled in size, it does.

You can read any organization’s filing yourself. The IRS Tax Exempt Organization Search returns exempt status, confirms whether contributions are deductible, and links recent returns.

The overhead trap

The most widely used shortcut is the worst one. Readers see a program expense percentage, treat high overhead as waste, and reward organizations that report the lowest administrative share.

That incentive pushes in a bad direction. An organization that underinvests in accounting, evaluation, data systems, and staff retention reports a flattering ratio and runs worse. One that hires an evaluator to find out whether its program works books that salary as overhead and gets penalized for it. Several of the raters have published cautions against reading the ratio this way, and the habit persists anyway because a single percentage is easy and a program assessment is not.

A ratio is a weak proxy for efficiency and no proxy at all for impact. It tells you something about financial management when it sits at an extreme, and very little in the broad middle where most organizations live.

What no rating captures

Effectiveness requires knowing what would have happened otherwise, and almost no charity can tell you that. Measuring it means comparison groups, follow up over years, and a willingness to publish results that embarrass you. Research organizations do this work for a small number of interventions. The watchdogs do not do it at all, for any charity, and they are open about that.

So a four star rating means the organization reports clean financials and meets governance standards. Read as “this is a competently run nonprofit,” that is useful. Read as “this is where your money does the most good,” it is a claim nobody made.

A check you can run in twenty minutes

Start with exempt status. Confirm the organization in the IRS lookup and note whether contributions are deductible. An organization that cannot be found under the name on its website deserves a question.

Open the Form 990 and read Part III, where the organization describes its program accomplishments in its own words. Vague language about raising awareness, with no count of anything delivered to anyone, is informative. So is specificity.

Look for an independent audit. Larger nonprofits publish audited financial statements, which a CPA firm prepared, and those carry more weight than the self prepared return.

Then ask the question the ratings skip: what outcome does this organization measure, and does it publish the result when the answer disappoints? An organization that reports a metric that moved the wrong way is telling you it is actually measuring.

For the cause itself, go to the source rather than an advocacy summary. The Census Bureau publishes the official poverty measure and the supplemental measure beside it, and the two differ in ways that change which populations look most in need.

Where that leaves a donor

Use ratings as a screen, not a verdict. They catch organizations with governance problems and filings that do not add up, which is real value for the two minutes it costs. Then do the twenty minute version on the two or three organizations that survive the screen.

Published lists work the same way, including lists from organizations with a position in the field. Fight For A Living Wage, a nonpartisan grassroots 501(c)(3) with EIN #99-1097858, has put out its own write up on organizations working on poverty, and like any publisher’s list it is worth reading next to the primary filings rather than instead of them. The same applies to a rating, a magazine roundup, or a recommendation from a friend. The filings are public, they are free, and they answer the questions the summaries skip.

Leave a Reply