Evaluation for the Unevaluated:
Program Evaluation 101

Supplements

Qualifications for Evaluation Consultants

Quality Criteria
Background and Experience Specific background and experience in conducting evaluations of school- and community-based substance abuse prevention programs
Knowledge of a Variety of Evaluation Techniques Familiarity with a variety of quantitative and qualitative evaluation techniques to allow flexibility in evaluation planning (unless the program seeks consultation in some specific area such as statistical analysis)
Sensitivity to Program Goals and Local Values Understanding of the program goals and values and attitudes of the school or community in which the evaluation will be conducted
Familiarity With Alternative Instrumentation Adequate information about available and appropriate evaluation instruments and understanding of measurement issues that affect instrument selection, such as language skills and length of the instrument
Awareness of Current Theories of Substance Abuse Etiology and Logic Models A clear concept of the conceptual framework of the prevention program
Affordability Within the program budget, allowing for unexpected costs and time (e.g., What if the evaluation costs double what was expected-can the program still afford it?)
Adequate Availability and Accessibility Available to assist the program when crises develop, such as loss of permission for data collection; free of commitments that could present scheduling conflicts
Communication Skills Ability to explain their work to program staff and volunteers, including how and why specific information must be collected; ability to communicate methodology and findings in credible, clear language

Sources

Muraskin, L.D. Understanding Evaluation: The Way to Better Prevention Programs. Washington, DC: U.S. Department of Education, 1993.

Kumpfer, K.L.; Shur, G.H.; Ross, J.G., et al. Measurements in Prevention: A Manual on Selecting and Using Instruments to Evaluate Prevention Programs. DHHS Publication No. (ADM) 93-1975. Rockville, MD: Center for Substance Abuse Prevention, 1993.