Evaluation for the Unevaluated:
Program Evaluation 101
Supplements
Qualifications for Evaluation Consultants
| Quality | Criteria |
|---|---|
| Background and Experience | Specific background and experience in conducting evaluations of school- and community-based substance abuse prevention programs |
| Knowledge of a Variety of Evaluation Techniques | Familiarity with a variety of quantitative and qualitative evaluation techniques to allow flexibility in evaluation planning (unless the program seeks consultation in some specific area such as statistical analysis) |
| Sensitivity to Program Goals and Local Values | Understanding of the program goals and values and attitudes of the school or community in which the evaluation will be conducted |
| Familiarity With Alternative Instrumentation | Adequate information about available and appropriate evaluation instruments and understanding of measurement issues that affect instrument selection, such as language skills and length of the instrument |
| Awareness of Current Theories of Substance Abuse Etiology and Logic Models | A clear concept of the conceptual framework of the prevention program |
| Affordability | Within the program budget, allowing for unexpected costs and time (e.g., What if the evaluation costs double what was expected-can the program still afford it?) |
| Adequate Availability and Accessibility | Available to assist the program when crises develop, such as loss of permission for data collection; free of commitments that could present scheduling conflicts |
| Communication Skills | Ability to explain their work to program staff and volunteers, including how and why specific information must be collected; ability to communicate methodology and findings in credible, clear language |
Sources
Muraskin, L.D. Understanding Evaluation: The Way to Better Prevention Programs. Washington, DC: U.S. Department of Education, 1993.
Kumpfer, K.L.; Shur, G.H.; Ross, J.G., et al. Measurements in Prevention: A Manual on Selecting and Using Instruments to Evaluate Prevention Programs. DHHS Publication No. (ADM) 93-1975. Rockville, MD: Center for Substance Abuse Prevention, 1993.








