Wading Through the Data Swamp:
Program Evaluation 201

Module 5: The t-Test of Difference Between Means - Page 11 of 24

Why This Information Does Not Tell Us All We Need To Know

After looking over the evaluator's report, which included this paired t-test information on inhalant use, Jack thought his program was a failure. But Jack did not know enough about statistics and evaluation to realize that the report might not accurately reflect his program's performance. Jack did not notice that the evaluator's report failed to include information about the comparison group regarding inhalant use.

Apparently, this was an oversight. Evaluators are human too. This example illustrates the importance of program staff being fully informed about what analyses need to be conducted.