Wading Through the Data Swamp:
Program Evaluation 201

Module 5: The t-Test of Difference Between Means - Page 15 of 24

Independent Samples t-Test for Posttest Data

Let's go through the t-test calculations to determine whether there is a statistically significant difference between the two means at posttest. (This is the last one. I promise! The "t" in t-test does not stand for "torture.")

Let's see if the changes we see in the graph below are meaningful.

graph comparing the average inhalant use in the past 30 days of the participant and comparison group

This compares the participants' mean to the comparison group's mean at posttest. It looks at different groups at the same time.

The only way to find out whether the means from the participant and comparison groups are statistically significant is to calculate an independent t-test for the posttest data. When you are doing statistical analyses for a program, you must have a comparison group. This allows you to ask, "Compared to what?"

For example, the participant group's inhalant use went down, compared to WHAT? Ideally, it would go down, compared to the comparison group's inhalant use.

A big grinning mouth.

Mary ran into a friend the other day who asked, "How's your husband?" Mary replied, "Compared to whom?"