The Federal Evaluation ToolkitBETA

Program evaluation uses systematic data collection to help us understand whether programs, policies, or organizations are effective. This guide explains how program evaluation can contribute to improving program services. It provides a high-level, easy-to-read overview of program evaluation from start (planning and evaluation design) to finish (dissemination), and includes links to additional resources.

You may find yourself needing to make the case for evaluation to others in your agency. These PowerPoint "pitch decks" bring together several resources you can use and tailor to your own needs and agency context. Knowing that your audience(s) may vary, there are three different pitch decks that vary in length and level of detail: (1) 5-Minute Quick Pitch; (2) 10-Minute Presentation; and (3) 20-Minute Discussion. Each slide deck speaks to the value of evaluation and explains how it can improve decision-making. Check out the overview to learn more about how this resource can help you.

Conducting evaluation requires resources. This Q&A explains how to identify resource needs for an evaluation, describes resources that may be available, and discusses how to engage external experts to build staff capacity.

To create a realistic and appropriate program evaluation budget, it is important to think through key factors that drive evaluation costs. This guide presents five factors to consider, including program features, the evaluation’s goals, who will conduct it, how it will be carried out, and how findings will be shared, and includes a sample template that itemizes key costs to consider at both the team and staff levels. 

Use this worksheet to plan, draft, and finalize a strong evidence-building question. Broadly consider how the question relates to the purpose and relevance of the effort, types of evidence, methodology, and resources.

Evaluation questions guide the selection of your evaluation method, data collection tools, and data analyses. Use this checklist to convert your information needs into effective and appropriate evaluation questions and to assess their quality.

This slide show describes four steps to develop evaluation questions: create a logic model, define the evaluation purpose and scope, select the evaluation type, and produce evaluation questions. It includes exercises and templates for developing research questions for process, outcome, and impact evaluations.

Use this tool and discussion guide to identify strengths and gaps in your organization’s capacity to conduct research and evaluation, and set priorities to build capacity where needed. It includes self-assessment scales, a checklist, and questions to guide next steps. Check out the overview to learn more about how this resource can help you.

Use this checklist to assess your program’s readiness for a rigorous evaluation to measure impacts. It highlights elements that are needed to evaluate the impacts of a program, and helps the user consider organizational, program, and evaluation readiness. It may also be helpful for evaluation planning and communication.

Logic models are effective tools to assist in program planning, implementation, management, evaluation, and reporting. View this presentation to learn the key components of a logic model, how to develop a logic model and use it in the context of evaluation planning.

Initiating an evaluation requires several key decisions. This resource lays out critical questions you have to answer around evaluation purpose and scope, stakeholder relationships, connecting evaluation activities and outcomes, evaluation goals, and evaluation plan and timeline to optimize front-end decision-making, and includes a sample evaluator information worksheet.