CONTENTS

Table of Contents
Introduction

1. Evaluation and the Program Planning Process
2. Data Analysis, or "What Do You Mean by That?"
3. Special Challenges in Evaluating Prevention Programs

Supplements
Resources

Evaluation for the Unevaluated:
Program Evaluation 102

The Program Planning Process

Let's review the program planning process in a bit more detail. Evaluation fits in as steps in this larger process. The process looks like this:

You can see that you're always working to improve your program and to redefine needs and resources over time. Evaluation helps you see whether your program is operating the way it should and achieving its desired results.

Let's briefly review the program planning steps (more information is available in Achieving Outcomes:

1. Needs Assessment:
   • Define general substance abuse problem.
   • Identify targets for prevention and reduction.
   • Identify individual risk factors and assets.
   • Develop tentative theory of change.
2. Capacity Building:
   • Examine agency resources, skills.
   • Examine community resources and readiness.
   • Build collaboration.
3. Program Selection:
   • Determine domains of concentration (e.g., family, school, community).
   • Prioritize individual risks and assets.
   • Examine science-based options (e.g., model programs).
   • Explore fidelity/adaptation balance (e.g., how easily can the program be modified?).
   • Select "best fit" science-based option.
4. Implementation:
   • Develop logic models and action plans.
   • Use action plan to track process outcomes and differences between expected and actual intermediate outcomes.
   • Document and analyze intermediate outcomes. If less than expect, consult, adapt if indicated, and remeasure.
5. Evaluation:
   • Evaluate outcomes.
   • Improve program delivery.
   • Assess general impact.

Evaluation is the final step but it's a good idea to plan for your evaluation as you plan the program. For example, determine what types of data you'll need to collect. If you know you're going to measure changes in attitudes about substance use, you might want to include a survey with the program registration form.

Tip: Allow Time for Special Reviews

It's important to prepare an evaluation plan well in advance of beginning your evaluation, especially if a human subjects review or Institutional Review Board review is required by your agency when conducting research and evaluation activities.