How to Choose a Program Evaluator
Most organizations start looking for a program evaluator at a hard moment. A funder wants proof of impact, a board wants to know whether a program works, or a leadership team senses that something is off but cannot yet name it. The stakes are real, the timeline is short, and the market is full of consultants who all promise clarity.
Choosing well is less about finding the most impressive resume than about finding a partner whose methods, ethics, and posture fit the decision you need to make. This guide explains what a program evaluator does, when to hire one, and the questions that separate a strong fit from an expensive disappointment.
What a program evaluator does
A program evaluator helps you answer a defined set of questions about a program: whether you deliver it as intended, what it produces, for whom, and under what conditions. Good evaluation is neither an audit nor cheerleading. It is a disciplined way to turn experience and data into insight you can act on.
The field holds this work to professional standards. The American Evaluation Association's Guiding Principles commit evaluators to five things: systematic inquiry, competence, integrity, respect for people, and the common good and equity (American Evaluation Association 2018). The Program Evaluation Standards organize quality around five more: utility, feasibility, propriety, accuracy, and accountability (Yarbrough et al. 2011). You need not memorize these, but a strong evaluator will recognize them and explain how their work reflects them.
What a program evaluator does not do is hand you a verdict stripped of context. The most useful evaluations treat the people inside a program as co-interpreters of what the data mean, not as data points to be counted and set aside.
When to hire one, and when not to
Hire an evaluator when the question justifies rigor: a funder requires credible evidence, a program is up for renewal or expansion, or a decision hinges on understanding what is really happening on the ground. External evaluation also earns its cost when you need independence, whether to satisfy a stakeholder or to see past your own assumptions.
Pause before you hire in a few cases. If you only need to track routine numbers, a good internal dashboard may serve better than an evaluation. If the program is new and still changing weekly, a lighter developmental approach may fit better than a formal outcomes study. And if leadership is not ready to act on hard findings, build that readiness first rather than commission a report that will sit unread.
Internal vs. external evaluators
Internal evaluators know your context intimately, cost less in direct dollars, and build lasting capacity on your team. Their trade-off is proximity: it is harder to question assumptions you share, and stakeholders may see internal findings as less independent.
External evaluators bring independence, specialized methods, and a fresh view. They can say what insiders cannot. Their trade-off is ramp-up time, higher direct cost, and the risk that an outsider misreads your context if they do not engage your people well.
Many strong evaluations are hybrids. An external partner supplies rigor and independence while working closely enough with your staff to keep the findings grounded, credible, and useful.
Six questions to ask before you hire
- How would you approach our questions? Listen for methods matched to your questions, not one technique applied to everyone. Strong evaluators combine quantitative and qualitative methods, e.g., surveys alongside interviews or focus groups, when the questions call for it.
- What standards and ethics guide your work? A credible answer names professional standards and takes a clear position on consent, confidentiality, and responsible data handling.
- How do you engage the people closest to the program? The best evaluations build shared understanding with staff and participants rather than study them from a distance.
- How do you handle equity in the data? Ask how they decide what to measure and whether they disaggregate results, so that an encouraging average does not hide a gap for the people who need the most support.
- How will you keep our data secure? Expect specifics: encrypted transfers, secure cloud analysis, controlled storage, and a policy that files never sit on personal devices.
- What will we receive, and when? Get clarity on deliverables, timeline, and how the findings become usable, not just a final document.
Green flags and red flags
Green flags: an evaluator who asks about the decision behind your request, adapts methods to your context, engages your stakeholders, states limitations plainly, and closes every finding with a clear "so what."
Red flags: a fixed template sold as a custom study, promises of uniformly positive results, vague answers on ethics or data security, no plan for stakeholder engagement, and reports that impress on delivery but leave you no clearer on what to do next.
What it costs, and what drives price
Evaluation prices vary widely because scope varies widely. The main drivers are the number and complexity of your questions, the methods involved, the amount of data collection, the number of sites and stakeholder groups, and the depth of reporting. A focused, single-question evaluation costs far less than a multi-site, mixed-methods study that runs across a full program year. Rather than shop on price alone, define the decision you need to make, then ask each candidate to scope to it. The right partner will help you right-size the work so the rigor matches the stakes.
A short readiness checklist
Before you send the first email, make sure you can answer these:
- What decision will this evaluation inform?
- Who are the stakeholders, and what will they need to trust the findings?
- What is our timeline, and is it realistic for the questions we are asking?
- Is leadership prepared to act on findings, including uncomfortable ones?
Clear answers mean you are ready to choose with confidence. Unclear answers are themselves the first and most valuable piece of work, and a good evaluator can help you find them.
Frequently asked questions
What is the difference between a program evaluator and an auditor? An auditor checks compliance against a fixed standard. A program evaluator investigates how a program works, what it produces, and for whom, in order to inform decisions and improvement.
Should we hire an internal or external evaluator? Choose internal for context and capacity building, external for independence and specialized methods. Many organizations get both through a hybrid arrangement in which an external partner works closely with internal staff.
How much does a program evaluation cost? It depends on the number and complexity of your questions, the methods used, the amount of data collection, and the number of sites and stakeholders. Define the decision you need to make first, then scope the evaluation to match.
How do we know an evaluator is credible? Look for grounding in professional standards, a clear ethics and data-security posture, methods matched to your questions, genuine stakeholder engagement, and findings that translate into action.
References
American Evaluation Association. 2018. "Guiding Principles for Evaluators." Washington, DC: American Evaluation Association. Retrieved June 30, 2026 (https://www.eval.org/About/Guiding-Principles).
Yarbrough, Donald B., Lyn M. Shulha, Rodney K. Hopson, and Flora A. Caruthers. 2011. The Program Evaluation Standards: A Guide for Evaluators and Evaluation Users. 3rd ed. Thousand Oaks, CA: Sage.
If you are weighing that choice now, learn more about our program evaluation work. Or talk to us about an evaluation.
