Wading Through the Data Swamp:
Program Evaluation 201

Module 2: Subgroup Analysis - Page 10 of 12

How Can Jack Use This Statistical Information To Improve His Program?

Jack looking inquisitiveGirls can, of course, be very different from boys, especially at this age. Thinking about it, Jack realized a lot of time was spent playing sports and various games during the program. Jack designed the program with fun in mind. He did not want to bore the kids with things they do in school. He wanted the kids to enjoy themselves and learn important life skills at the same time.

Jack's approach seemed to work for the boys, but why not the girls? Maybe the sports and competitive games might not be that interesting to girls approaching or in their teen years. Girls in general, especially in this age group, have very different interests than boys.

After this discovery, Jack had a lot of questions, and I raised some more with him. These questions cannot always be answered from the data collected for the evaluation. However, asking them and trying to answer them can play an important role in improving his future programs.

Jack then started thinking about the structure of his program.

Jack has a lot to investigate.

A persons's finger with a string tied around it. - FYI

Jack also discovered, when looking at the raw data, that there were 30 girls but only 20 boys. So really, the two groups are not exactly comparable.

With the data adjusted to be comparable, we probably still would have the same outcomes (girls increasing use, boys decreasing use). However, the outcomes would not be as dramatic. So Jack should keep in mind that he may not have done as badly with the participants as he thought.