Evaluation for the Unevaluated:
Program Evaluation 101

Module 4: Preparing for Your Evaluation - Page 5 of 13

Selecting an Evaluator

Jack called around like Jane suggested. He found Professor Whozit at the local university. He had experience and a Ph.D., so Jack was confident he'd do a good job. Jack learned the hard way that a degree isn't everything. Dr. Whozit's work habits left much to be desired.

Jack might have done better if he'd used some screening tools. Here's an adapted checklist from the W.K. Kellogg Foundation Evaluation Handbook to use in the screening process.

Checklist for Selecting an Evaluator
Evaluator Characteristics Well Qualified Not Well Qualified Cannot Determine
Formal Training (Consider major/minor, degree, specific courses in evaluation methodology, whether the potential evaluator has conducted applied research in a human service setting, etc.)      
Evaluation Experience (Consider items such as length of experience and relevance of experience.)      
Professional Orientation (Consider items such as philosophical and methodological orientations.)      
Previous Performance (What prior experience does she or he have in similar settings? Look at work samples or contact references.)      
Personal Styles and Characteristics (Consider qualities such as honesty, character, interpersonal communications skills, ability to resolve conflicts, and ability to work on a team.)      

SUMMARY

Based on the questions above, to what extent is the potential evaluator qualified and acceptable to conduct the evaluation?

     

In addition to the checklist, it's good to consult experts in the field and to check materials such as Qualifications for Evaluation Consultants and Areas of Evaluator Expertise.