CONTENTS

Table of Contents
Introduction

1. Evaluation and the Program Planning Process
2. Data Analysis, or "What Do You Mean by That?"
3. Special Challenges in Evaluating Prevention Programs

Supplements
Resources

Evaluation for the Unevaluated:
Program Evaluation 102

How Prevention Program Evaluation Differs From Other Evaluations

As if all the technical aspects of evaluation weren't enough! On top of collecting data, finding comparison groups, figuring out statistical analysis and reporting it, now we learn that the very nature of prevention poses unique challenges.

Before it all comes back to bite you, it's worth thinking about how prevention services differ from other services that typically get evaluated. It's slightly more complicated than the customer satisfaction card you get at Jiffy Lube.

Substance abuse prevention services are typically provided in three ways:

• Direct services. These services are actively provided to target populations. Cool After School's latchkey kids are the target population for prevention services.
• Indirect services. These services are often targeted to a whole community in the form of education, public service announcements, and media campaigns like "The More You Know."
• Institutional change activities. These seek to change the local environment to discourage substance use and abuse. Examples are sobriety checkpoints and enforcement of drinking age laws.

The Institute of Medicine has a useful framework for prevention activities based on target audience:

• Universal programs (e.g., mass media, school-based health curricula): Target the general population.
• Selective programs (e.g., mentoring programs aimed at children with school performance or behavioral problems): Target those at higher-than-average risk for substance abuse.
• Indicated programs (e.g., parenting programs for parents with substance abuse problems): Target those already using or engaged in other high-risk behaviors (such as delinquency) to prevent chronic use.

Regardless of the type of program, the key difference in evaluating prevention programs is that you are trying to determine what DID NOT occur. You are trying to measure a reduction in substance use and delayed onset before it happens. This can be tricky.

Comparison groups are essential in evaluating prevention programs, especially among young people.Add note re need for comparison groups.