Wading Through the Data Swamp:
Program Evaluation 201
Table of Contents
Introduction
Module 1: Descriptive Statistics in Evaluation
- Objectives
- Background: Jack and the Bean Counters
- Research Designs
- Jack's Research Design
- Baseline Equivalence of the Cool After School Participants and Nonparticipants
- "Threats" to Research Designs
- The Evaluation Instruments
- Evaluator's Preliminary Report
- Research Question #1
- Distribution Shapes
- Descriptive Statistics
- Mean Marijuana Use
- Mean Alcohol Use
- The Danger of the Averages
- Standard Deviation for Marijuana Use
- Standard Deviation for Alcohol Use
- The 68-95-99.7 Percent Rule
- Normal Distribution Parameters Applet
- Lessons Learned: What Jack Should Have Asked His Evaluator
- How Can Jack Use This Statistical Information To Improve His Program?
- Module 1 Quiz
Module 2: Subgroup Analysis
- Objectives
- Introduction
- Reported Use of Marijuana
- Missing Data
- Analysis of Marijuana Use
- Subgroup Analysis
- Standard Deviation
- What Did Jack Learn From This Analysis?
- Lessons Learned: What Jack Should Have Asked His Evaluator
- How Can Jack Use This Statistical Information To Improve His Program?
- How Can Jack Use This Statistical Information To Promote the Results of His Program?
- Module 2 Quiz
Module 3: Variable - Are They Related?
- Objectives
- Background
- Variables - Are They Related?
- Hypotheses
- Research Questions
- Levels of Measurement
- What Is Chi-square?
- Contingency Tables
- Marijuana Use
- Chi-Square Calculations Continued for Marijuana Use (steps 7-10)
- Alcohol Use
- Chi-Square Calculations for Alcohol Use Continued (steps 7-10)
- Chi-Square Applet
- Lessons Learned: What Jack Should Have Asked His Evaluator
- What Did Jack Learn About His Program From These Analyses?
- How Can Jack Use This Statistical Information To Improve His Program?
- How Can Jack Use This Statistical Information To Better Promote His Program?
- Module 3 Quiz
Module 4: Correlation
- Objectives
- Background
- Comparing Means
- Attrition Versus Loss to Followup
- New Information: Change Scores and Participation
- How To Construct Scatter Plots
- How To Interpret Scatter Plots
- Linear Relationship
- Strength of the Relationship: Pearson's Correlation Coefficient
- What Do All the Numbers and Plots Mean?
- Adding Points to a Scatter Plot
- Lessons Learned: What Jack Should Have Asked His Evaluator
- What Did Jack Learn About His Program From These Analyses?
- How Can Jack Use This Statistical Information to Improve His Program?
- How Can Jack Use This Statistical Information To Better Promote His Program?
- Module 4 Quiz
Module 5: The t-Test of Difference Between Means
- Overview
- Objectives
- Background
- Comparing Means
- What Is the t-Test For?
- What Does the t-Test Assume?
- Paired t-Test or Independent t-Test?
- Mathematical Symbols
- Steps for Calculating a Paired Sample t-Test for Participant Pre- and Posttests
- Results for the Paired t-Test
- Why This Information Does Not Tell Us All We Need To Know
- Independent Samples t-Test for Pretest Data
- Steps for Calculating an Independent Samples t-Test for Pretest Data
- So, Are the Participants and Comparisons Comparable Regarding Inhalant Use?
- Independent Samples t-Test for Posttest Data
- Steps for Calculating an Independent Samples t-Test for Posttest Data
- The Results for the Independent t-Test at Posttest
- Practice with t-Tests
- Lessons Learned: What Jack Should Have Asked His Evaluator
- What Did Jack Learn About His Program From These Analyses?
- Other Statistical Possibilities
- How Can Jack Use This Statistical Information To Improve His Program?
- How Can Jack Use This Information To Better Promote His Program?
- Module 5 Quiz








