Evaluation for the Unevaluated:
Program Evaluation 101
Supplements
Potential Responsibilities of Evaluators and Program Managers
Evaluator
- Develop an evaluation plan, in conjunction with program staff.
- Provide monthly or quarterly progress reports to staff (written or in person).
- Train project staff. Topics could include: Using evaluation instruments, information collection activities, participant/case selection for sampling purposes, and other activities
- Designing information collection instruments or selecting standardized instruments or inventories
- Implement information collection procedures, such as the following:
- Interview project staff.
- Interview coordinating/collaborating agency staff.
- Interview program participants.
- Conduct focus groups.
- Observe service delivery activities.
- Review participant case records.
- Develop database.
- Code, enter, and clean data.
- Analyze data.
- Establish and oversee procedures ensuring confidentiality during all phases of the evaluation.
- Write interim (quarterly, biannual, yearly) evaluation reports and the final evaluation report.
- Attend project staff meetings, advisory board or interagency coordinating committee meetings, and grantee meetings sponsored by the funding agency.
- Present findings at local and national meetings and conferences.
Program Manager
- Educate the outside evaluator about the program's operations and objectives, characteristics of the participant population, and the benefits that program staff expect from the evaluation. This may involve alerting evaluators to sensitive situations (e.g., the need to report suspected child abuse) they may encounter during the course of their evaluation activities.
- Provide feedback to the evaluator on whether instruments are appropriate for the target population and provide input during the evaluation plan phase.
- Keep the outside evaluator informed about changes in the program's operations.
- Specify information the evaluator should include in the report.
- Assist in interpreting evaluation findings.
- Provide information to all staff about the evaluation process.
- Monitor the evaluation contract and completion of work products, such as reports.
- Ensure that program staff are fulfilling their responsibilities, such as data collection.
- Supervise inhouse evaluation activities, such as completion of data collection instruments and data entry.
- Serve as a troubleshooter for the evaluation process, resolving problems or locating a higher level person in the agency who can help.
- Request a debriefing from the evaluator at various times during the evaluation and at its conclusion.








