|
Sample Worksheet 5.1
Selecting an Evaluation Design: USAF Example
| Elements of Design Selection |
Yes |
No |
Will there be a comparison group?
- Will the comparison group be outside the
program?
- Will group members be compared to themselves?
- Will group members
be compared to those receiving services from an alternative but similar program?
- Will groups be divided based on amount of services received (i.e., measuring
"dose" effects)?
- Will participants be randomly assigned to
treatment vs. control groups?
|
|
|
Timing of Assessments
- Will there be a pretest?
- Will there be a posttest?
- Will there be measures taken during the program?
- Will measures be taken at
some specified point in the future?
- When?
|
|
|
|
Sample Worksheet 5.2
Projecting the Scope of the Evaluation: USAF Example
| Elements Related to Scope |
Number/percent |
Yes |
No |
Sample
- How many air bases will be used in the program?
- How many
participants are estimated per air base site?
- Estimated total number of
participants.
- What percentage of participants/air bases will be sampled?
- Total number of bases/participants in sample.
|
|
|
|
Resources
- Anticipated number of subjects?
- Anticipated number of air base
sites?
- Will it be necessary to develop new data collection instruments?
- Will data collection instruments require extensive pretesting?
- Will data need
extensive cleaning or coding?
- Are there sufficient resources for evaluation:
- personnel?
- finances?
- time?
|
|
|
|
|
|
