Justification for the Collection of Information for Local Evaluations as part of the Personal Responsibility Education Program (PREP): Promising Youth Programs (PYP) - MARCH 2020

Tribal PREP Implementation and Outcomes
Evaluation Analysis Plan Template

PAPERWORK REDUCTION ACT OF 1995 (Pub. L. 104-13) STATEMENT OF PUBLIC BURDEN: Through this information collection, ACF is gathering information to inform the provision of programmatic and evaluation-related technical assistance. Public reporting burden for this collection of information is estimated to average 5 hours per grantee, per response, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. The OMB # is 0970-0531 and the expiration date is 07/31/2022. If you have any comments on this collection of information, please contact Juliette Henke at [email protected].

Descriptive Analysis Plan for [Grantee Name] – [DATE]

The Evaluation of [Program Name(s)] in [Geographic Area] serving [Tribe(s)]

A. Implementation evaluation

This section describes the implementation analysis plan for the evaluation of [Program Name] in [Geographic Area] serving [Tribes].

1. Research questions

This section presents the research questions that will be addressed in the implementation evaluation.

[List implementation evaluation research questions]

Table 1. Research questions for each implementation element

Implementation element	Research question
Fidelity
Dosage
Quality
Engagement
Context

2. Program description

[Insert description of the intended program here. Note: copy these tables in section A.2 and B.2 as needed so that you can describe each program studied as part of your implementation study (section A) and outcome study (section B).]

Table 2. Description of intended activities for [Program]

Program activity	Curriculum and content	Dosage and schedule	Delivery

Table 3. Staff training and development to support activities for [Program]

Program activity	Education and initial training of staff	Ongoing training of staff

[If you implemented a program that is part of your process and implementation evaluation, but not part of your outcomes study, please describe that program here.]

3. Evaluation design

a. Sample formation

[Insert text on sample formation here]

b. Data sources

[Insert text on data sources here]

Table 4. Data sources for addressing the research questions

Implementation element	Research question	Data source	Timing/frequency of data collection	Party responsible for data collection
Fidelity
Dosage
Quality
Engagement
Context

[add rows as needed for other implementation elements]

c. Measurement

[Insert outcomes text here]

Table 5. Measures for addressing the research questions

Implementation element	Research question	Measures	Target
Fidelity
Dosage
Quality
Engagement
Context

[add rows as needed for other implementation elements]

4. Analysis methods

[Insert analysis methods text here]

a. Data preparation

[Insert analysis methods text here]

b. Analytic approach

[Insert analysis methods text here]

B. Youth outcomes evaluation

This section describes the outcomes analysis plan for the evaluation of [Program Name(s)] in [Geographic Area] serving [Tribe(s)].

1. Research questions

This section presents the research questions that will be addressed in the outcomes evaluation.

Table 6. Sources of data to address the research questions

Outcome	Research question

2. Program description

[List which program or programs described in Section A.2 are part of your outcomes evaluation, and for which samples.]

3. Evaluation design

a. Overview of design

[Insert brief description of design here]

b. Target population

[Insert target population text here]

c. Enrollment and consent process

[Insert description of the enrollment and consent process here]

d. Data collection

[Insert data collection text here]

Table 7. Sources of data to address the research questions

Research question to be addressed	Data source	Timing of data collection	Mode of data collection	Start and end date of data collection

e. Outcomes

[Insert outcomes text here]

Table 8. Outcomes used to answer the research questions

Outcome name	Source item	Constructed measure	Timing of measure

4. Analysis methods

[Insert analysis methods text here]

a. Data cleaning

[Insert text on data cleaning here]

b. Analytic sample

[Insert text on defining the analytic sample here]

c. Missing data

[Insert text on handling missing data here]

d. Analytic approach

[Insert text on analytic approaches here]

i. Model specification

[Insert text here.]

ii. Covariates

Table 9. Covariates included in outcomes analysis

Covariate	Description of covariate

iii. Non-response analysis

[Insert text here.]

iv. Subgroup analysis

Table 10. Subgroup analyses in outcomes analysis

Subgroup	Outcome		Description of deviation from full-sample analytic methods