Justification for the Collection of Information for Local Evaluations as part of the Personal Responsibility Education Program (PREP): Promising Youth Programs (PYP)

PREIS Impact and Program Implementation

Evaluation Analysis Plan Template

PAPERWORK REDUCTION ACT OF 1995 (Pub. L. 104-13) STATEMENT OF PUBLIC BURDEN: Through this information collection, ACF is gathering information to inform the provision of programmatic and evaluation-related technical assistance. Public reporting burden for this collection of information is estimated to average 5 hours per grantee, per response, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. The OMB # is 0970-0531 and the expiration date is 07/31/2022. If you have any comments on this collection of information, please contact Juliette Henke at [email protected].

Impact and Program Implementation Evaluation Analysis Plan

for [Grantee Name] – [DATE]

The Evaluation of [Intervention Name] in [Geographic Area]

1. Impact Study Research Questions

This section presents the primary and secondary research questions that will be assessed in the impact evaluation of [Intervention Name].

a. Primary research questions

[Copy and paste text/Start writing here.]

b. Secondary research questions

[Copy and paste text/Start writing here.]

2. Impact Study Design

This section provides a brief description of the study design and the process for creating intervention and comparison groups.

[Copy and paste text/Start writing here.]

3. Program Implementation Analysis

This section lays out plans for analyzing implementation data for understanding and documenting program implementation.

[Copy and paste text/Start writing here.]

Table 1. Planned implementation analysis

Implementation element	Research question	Measure	Benchmark
[Your data here]

4. Impact Analysis

This section lays out plans for constructing outcomes, defining the analytic sample, assessing baseline equivalence, cleaning data and handling missing data, addressing potential crossover and contamination, and finally the analytic models for estimating program impacts and planned sensitivity analyses.

a. Data cleaning

[Copy and paste text/Start writing here.]

Table 2. Behavioral outcomes used for primary research questions

Outcome name	Source item(s)	Constructed measure	Timing of measure
[Your outcomes here]			[Your outcomes here]

Table 3. Outcomes used for secondary research questions

Outcome name	Source item(s)	Constructed measure	Timing of measure
[Your outcomes here]			[Your outcomes here]

b. Outcome measures

[Copy and paste text/Start writing here.]

c. Analytic sample(s)

[Copy and paste text/Start writing here.]

d. Assessment of baseline equivalence

[Copy and paste text/Start writing here.]

e. Condition crossover and contamination

[Copy and paste text/Start writing here.]

f. Analytic approach for primary research questions

[Copy and paste text/Start writing here.]

i. Model specification

[Copy and paste text/Start writing here.]

ii. Covariates

[Copy and paste text/Start writing here.]

Table 4. Covariates included in impact analyses

Covariate	Description of the covariate

iii. Adjustments for multiple comparisons

[Copy and paste text/Start writing here.]

iv. Sensitivity analyses

[Copy and paste text/Start writing here.]

g. Analytic approach for secondary research questions

[Copy and paste text/Start writing here.]

5. Additional planned analyses

[Copy and paste text/Start writing here.]