PMAPS_SSA_updated 093021_clean

Personal Responsibility Education Program (PREP) Performance Measures and Adulthood Preparation Subjects (PMAPS)

OMB Information Collection Request

0970 - 0497

Supporting Statement

Part A

October 2021

Submitted By:

Office of Planning, Research, and Evaluation

Administration for Children and Families

U.S. Department of Health and Human Services

4^th Floor, Mary E. Switzer Building

330 C Street, SW

Washington, D.C. 20201

Project Officers: Caryn Blitz, Tia Brown

Part A

Executive Summary

• Type of Request: This Information Collection Request is to make revisions to the previously approved Participant Entry and Exit Surveys (Instruments #1 and #2) and Performance Reporting Data System forms (Instruments #3 and #4). ACF leadership recently undertook a review of the PREP participant entry (Instrument #1) and exit surveys (Instrument #2) to (1) ensure that all items directly align with legislation, (2) reduce the number of items that some grantees might consider sensitive, (3) reduce burden, and (4) improve clarity. This review resulted in requested changes to the surveys, which are also reflected in this request. In addition, ACF would like to reduce the number of pandemic-related measures in Instrument #3 and Instrument #4.

• Progress to Date: OMB originally approved the information collection in April 2017 and approved a request for a data collection extension in June 2020. In August 2020 and January 2021, OMB approved nonsubstantive change requests for Instrument #3 and Instrument #4 to add, and then revise, a set of measures to capture changes in PREP programming resulting from the COVID-19 pandemic. Data for the 2020-2021 reporting year will be submitted by grantees by mid-September 2021.

• Summary of changes requested: For a summary of requested changes, please see the nonsubstantive change memo: NonSubstantive Change Request – PREP PMAPS October 2021.

• Time Sensitivity: ACF requests approval by mid October 2021, so grantees can obtain any necessary school district or IRB approvals of the revised measures before beginning to use the revised surveys in January 2022.

A1. Necessity for Collection

The consequences of adolescent sexual activity remain a critical social and economic issue in the United States, shaping the lives of thousands of teens and their families every year. Despite declining births to teen mothers over the past 25 years, the teen birthrate in the United States remains higher than in other industrialized countries and varies widely across geographic regions and racial/ethnic groups (Martin et al., 2017). Further, adolescents and young adults account for half of all new sexually transmitted infection (STI) cases each year (Centers for Disease Control and Prevention, 2017). Sexual activity in youth is also related to engaging in other risk behaviors such as alcohol and substance use.

In March 2010, Congress authorized the Personal Responsibility Education Program (PREP) as part of the Patient Protection and Affordable Care Act (ACA). PREP provides grants to states, tribes and tribal communities, and community organizations to support evidence-based programs to reduce teen pregnancy and sexually transmitted infections (STIs). The programs are required to provide education on both abstinence and contraceptive use. The programs also offer information on adulthood preparation subjects such as healthy relationships, adolescent development, financial literacy, parent–child communication, education and employment skills, and healthy life skills. Grantees are encouraged to target their programming to high-risk populations—for example, youth in foster care, homeless youth, youth with HIV/AIDS, pregnant youth who are under 21 years of age, mothers who are under 21 years of age, and youth residing in geographic areas with high teen birth rates.

The Government Performance and Results Act (GPRA) Modernization Act of 2010 (Public Law 111-352) requires federal agencies to report annually on measures of program performance. It is essential that PREP grantees report the performance data described in this information collection request (ICR) to enable the Administration for Children and Families (ACF) to carry out its reporting requirements to Congress and the Office of Management and Budget (OMB). Further, collecting these data will allow grantees and ACF to report to other key stakeholders on PREP program design, implementation, and outcomes.

ACF has contracted with Mathematica to carry out the data collection activities described in this ICR.

A2. Purpose

Purpose and Use

This performance measures effort includes collection and analysis of performance measure data from State PREP (SPREP), Tribal PREP (TPREP), Competitive PREP (CPREP), and Personal Responsibility Education Innovative Strategies (PREIS) grantees. The purpose is to document how PREP-funded programs are operationalized in the field and assess program outcomes. ACF will use the performance measures data to continue to (1) track how grantees are allocating their PREP funds; (2) assess whether PREP objectives are being met (e.g., in terms of the populations served); and (3) help drive PREP programs toward continuous improvement of service delivery. In addition, ACF will use this information to fulfill reporting requirements to Congress and OMB concerning the PREP initiative. ACF will also continue to share grantee and provider level findings with each grantee to inform their own program improvement efforts.

The information collected is meant to contribute to the body of knowledge on ACF programs, including in the context of the COVID-19 pandemic. It is not intended to be used as the principal basis for a decision by a federal decision-maker, and is not expected to meet the threshold of influential or highly influential scientific information.

Research Questions or Tests

A major objective of the performance measures analysis is to construct, for grantees and ACF a picture of PREP implementation in the form of a basic set of statistics across all grantees. The information collected through the performance measures will answer questions for the overall PREP program, such as:

• What programs were implemented, and for how many youth?

• What are the characteristics of the populations served?

• To what extent were members of vulnerable populations served?

• How many youth participated in most program sessions or activities?

• How do participants feel about the programs, and how do they perceive its effect on them?

• How many entities are involved at the subrecipient level in delivering PREP programs?

• How do grantees allocate their resources?

• For which of the implemented program models are participants completing at least 75 percent of the program sessions?

• What challenges do grantees and their partners see in implementing PREP programs on a large scale?

• To what extent have grantees’ responses to the COVID-19 public health emergency persisted or changed as grantees have adjusted to continued operations during a pandemic?

Study Design

The data that the grantees report to ACF will originate from three levels – the grantee, grantees’ subrecipient providers, and the youth completing entry and exit surveys (Figure 1). For some performance measures, grantees will provide data about activities or decisions that they undertake directly at the grantee level. For other measures, data will come from the subrecipient providers to the grantee because subrecipients oversee the activities to be documented. In addition, some data will come from the youth themselves, who will be asked to complete entry and exit surveys. The efforts expected to be undertaken at each level and the estimated level of burden are further explained in Section A.12.

Figure 1: Levels of PREP Performance Measures Data

The performance measures data is reported by grantees to the PREP PM data warehouse, called the Performance Measures Management System (PMMS).

The purpose of measuring performance is to track inputs, outputs and outcomes over time to provide information on how all PREP grantees and their programs are performing. Through the PM, grantees will be required to submit the following data:

• Participants’ characteristics, behaviors, program experiences, and perceptions of effects –measures based on Instruments 1 and 2

• Structure, cost, and support for program implementation – measures based on Instruments 3 and 4.

• Attendance, reach, and dosage – measures based on Instruments 3 and 4.

Data Collection Activity	Instrument(s)	Respondent, Content, Purpose of Collection	Mode and Duration
Performance Measures Collection	Instrument 1: Participant Entry Survey	Respondents: Youth participating in PREP programs Content: Demographics, sexual behaviors and behaviors related to adulthood preparation, Purpose: To collect information on participant characteristics and behaviors at program entry	Mode Self-administered PAPI and web (facilitated by program providers) Duration: 8 minutes
	Instrument 2: Participant Exit Survey	Respondents: Youth participating in PREP programs Content: Demographics, program experiences, and perceptions of program effects Purpose: To collect information on youth’s characteristics, and perceptions of the program and its effects on their attitudes and intentions at program exit	Mode: Self-administered PAPI and web (facilitated by program providers) Duration: 7 minutes
	Instrument 3: Grantee Performance Reporting System Data Form	Respondents: State (SPREP), Competitive (CPREP), Tribal (TPREP), and PREIS PREP grantees Content: Information on: program structure, cost, and support for program implementation; attendance, reach, and dosage; and aggregated data based on Instruments 1 and 2 at the grantee, provider, and program levels. Purpose: To provide information on program implementation and delivery and youth participant characteristics and behaviors at program entry, as well as youth characteristics and perceptions of the program and its effects on their attitudes and intentions at program exit.	Mode: Electronically submitted to the PMMS Duration: 14 – 18 hours, depending on grant type
	Instrument 4: Subrecipient Performance Reporting System Data Form	Respondents: State (SPREP), Competitive (CPREP), Tribal (TPREP) and PREIS PREP subrecipients Content: Information on: program structure, cost, and support for program implementation, attendance, reach, and dosage; and aggregated data based on Instruments 1 and 2 at the grantee, provider, and program levels. Purpose: To provide information on program implementation and delivery and youth participant characteristics and behaviors at program entry, as well as youth characteristics and perceptions of the program and its effects on their attitudes and intentions at program exit.	Mode: Electronically submitted to the PMMS Duration: 12-14 hours, depending on grant type

Other Data Sources and Uses of Information

There are no other data sources used for the PMAPS performance measures data collection.

A3. Use of Information Technology to Reduce Burden

To reduce grantee burden, ACF (1) provides common data element definitions across PREP grantees and program models, (2) collects these data in a uniform manner through the PMMS and (4) provides a Performance Measures Dashboard (Dashboard) that is interoperable with the PMMS to provide near-real-time data reporting for PREP grantees, FYSB project officers, and other ACF staff. Using the PMMS reduces reporting burden and minimizes grantee and subrecipient costs related to implementing the reporting requirements.

A4. Use of Existing Data: Efforts to reduce duplication, minimize burden, and increase utility and government efficiency

ACF has carefully reviewed the information collection requirements to avoid duplication with existing studies or other ongoing federal teen pregnancy prevention evaluations and believes that this data collection complements, rather than duplicates, the existing literature and the other ongoing federal teen pregnancy prevention evaluations and projects.

Specifically, this effort provides the following unique opportunities:

• Opportunity to learn about using a state formula grant to scale up evidence-based programs. The PREP PM effort will allow us to learn about both the opportunities and the challenges of scaling up evidence-based teen pregnancy prevention programs through both state formula grants (SPREP) and competitive discretionary grants (TREP, SPREP, and PREIS). It is the only federal evaluation to examine both.

• Opportunity to understand the special components of PREP programs. The PREP PM effort will help us to understand the unique components of the programs funded through PREP, such as the adulthood preparation subjects, which are being incorporated in the teen pregnancy prevention programming funded through PREP. These components are not part of the other teen pregnancy prevention programs.

A5. Impact on Small Businesses

Programs in some sites may be operated by community-based organizations. ACF and its contractor teams have provided and will continue to provide thorough training and technical assistance throughout the entire data collection effort, from the planning period all the way through data analysis. This training and technical assistance should help to minimize the burden on small businesses.

A6. Consequences of Less Frequent Collection

The Government Performance and Results Act (GPRA) requires federal agencies to report annually on measures of program performance. Therefore, it is essential that grantees report the performance data described in this ICR to ACF. Failure to collect performance measures across all grantees will inhibit ACF from carrying out its reporting requirements to Congress and OMB. In addition, at the grantee level, most PREP programs are offered in school during each school semester. Biannual reporting of participant performance measures provides grantees with information about the program performance results from the most recent semester, which can be used to improve their program performance for the next semester.

A7. Now subsumed under 2(b) above and 10 (below)

A8. Consultation

Federal Register Notice and Comments

In accordance with the Paperwork Reduction Act of 1995 (Pub. L. 104-13) and Office of Management and Budget (OMB) regulations at 5 CFR Part 1320 (60 FR 44978, August 29, 1995), ACF published a notice in the Federal Register announcing the agency’s intention to request an OMB review of this information collection activity. This notice was published on February 28, 2020, Volume 85, Number 40, page 11995, and provided a sixty-day period for public comment. A copy of this notice is attached as Appendix A. During the notice and comment period, no substantive comments were received.

Consultation with Experts Outside of the Study

To develop the original PREP performance measures (OMB Control # 0970-0398), ACF consulted with staff of Mathematica, Child Trends, and RTI International. For the revised measures, ACF also consulted internal staff from FYSB and OPRE and select PREP grantees, as well as FYSB and ACF leadership.

A9. Tokens of Appreciation

No tokens of appreciation are proposed for the PMs information collection.

A10. Privacy: Procedures to protect privacy of information, while maximizing data sharing

Personally Identifiable Information

Grantees submit aggregate data, so no personally identifiable information is collected by ACF and its contractor.

Assurances of Privacy

Information collected will be kept private to the extent permitted by law. Respondents will be informed of all planned uses of data, that their participation is voluntary, and that their information will be kept private to the extent permitted by law. As specified in the contract, the Contractor will comply with all Federal and Departmental regulations for private information.

Grantees are required to inform participants of the measures that are being taken to protect the privacy of their answers. Data will be reported by grantees only as aggregate counts. There will be no means by which individual respondents can be identified by ACF, Mathematica, or other end-users of the data. Grantees will receive guidance for active or passive consent (see Consent Forms, Appendix B).

Data Security and Monitoring

As specified in the contract, the Contractor shall protect respondent privacy to the extent permitted by law and will comply with all Federal and Departmental regulations for private information. The Contractor has developed a Data Safety and Monitoring Plan that assesses all protections of respondents’ information. The Contractor shall ensure that all of its employees, subcontractors (at all tiers), and employees of each subcontractor, who perform work under this contract/subcontract, are trained on data privacy issues and comply with the above requirements. 

As specified in the evaluator’s contract, the Contractor shall use Federal Information Processing Standard compliant encryption (Security Requirements for Cryptographic Module, as amended) to protect all instances of sensitive information during storage and transmission. The Contractor shall securely generate and manage encryption keys to prevent unauthorized decryption of information, in accordance with the Federal Processing Standard.  The Contractor shall: ensure that this standard is incorporated into the Contractor’s property management/control system; establish a procedure to account for all laptop computers, desktop computers, and other mobile devices and portable media that store or process sensitive information. Any data stored electronically will be secured in accordance with the most current National Institute of Standards and Technology (NIST) requirements and other applicable Federal and Departmental regulations. In addition, the Contractor has submitted an approved plan for minimizing to the extent possible the inclusion of sensitive information on paper records and for the protection of any paper records, field notes, or other documents that contain sensitive information that ensures secure storage and limits on access.  

Participant-level data. Participant-level data required for PM reporting is collected by grantees and their subrecipient providers. Grantees then enter this information in aggregated form into the PMMS. Grantees and subrecipient providers are responsible for ensuring privacy of participant-level data and securing institutional review board (IRB) approvals to collect these items, as necessary.

Grantee, provider, and program-level data. Grantees and subrecipient providers enter all data into the PMMS. The PMMS is designed to ensure the security of data that are maintained in there. Electronic data from the PMAPS projects is stored in a location within the Mathematica network that provides the appropriate level of security based on the sensitivity or identifiability of the data. Further, all data reported by grantees and providers related to program participants is aggregated; no personal identifiers or data on individual participants will be submitted to ACF. Data generated by the PMMS will be in aggregate form only.

Mathematica houses a Performance Dashboard to provide authorized stakeholders with self-service access to various views of performance indicators that support the management and improvement of PREP programs. As needed, Mathematica will enforce security roles to prohibit grantees from accessing others’ data.

The Dashboard is interoperable with the PMMS. It has a near-real-time interface with the PMMS so it can display the status of data submissions and help monitor agencies’ compliance with reporting requirements.

A11. Sensitive Information ¹

A key objective of PREP programs is to prevent teen pregnancy through a decrease in sexual activity and/or an increase in contraceptive use. We understand that issues pertaining to the sexual behavior of and contraceptive use among youth and young adults can be very sensitive in nature; however, the questions for the programs’ PM are necessary to understanding program functioning.

Table A11.1 provides a list of sensitive questions that will be asked on the participant entry and exit surveys and the justification for their inclusion. To address concerns about questions on sexual behavior of younger adolescents at program entry before they have been introduced to program content, information on sexual activity, contraceptive use, incidence of pregnancy, and incidence of STIs will not be collected from middle school participants. Middle school participants will only be asked questions about intentions and reducing intentions to engage in sexual activity and whether they considered their PREP program to be effective in achieving these goals. In addition, grantees will inform program participants that their participation is voluntary and they may refuse to answer any or all of the questions in the entry and exit surveys. All grantees will have the opportunity to obtain waivers from the program office to opt out of asking sensitive questions, if necessary.

Table A11.1. Summary of Sensitive Questions to Be Included on the Participant Entry and Exit Surveys, and Their Justification

Topic	Justification
Participant Entry Survey (Instrument 1)
Sexual activity, contraceptive use, incidence of pregnancy, and incidence of STIs)	Level of sexual activity, contraceptive use, and incidence of pregnancy and STIs are all central to the PREP evaluation. Collecting this information will allow us to document the characteristics of the population served by PREP and the degree to which they engage in risky behavior.
Participant Exit Survey (Instrument 2)
Participants’ perceptions of PREP’s effects on their sexual activity and contraceptive use	Reducing intentions to engage in sexual activity, risky adolescent sexual behavior and increasing contraceptive use for those who are sexually active are among the central goals of PREP-funded programs. Examining whether participating youth consider PREP programs to be effective in achieving these goals is an important element of gauging the success of these programs.

A12. Burden

Explanation of Burden Estimates

Table A12.1 provides the estimated annual burden calculations for the performance measures reporting.

1. Annual Performance Measures Burden for Youth Participants

The estimated number of participants completing the entry and exit surveys is based on data collected by PREP grantees in 2018-2019. We have updated those numbers based on the expected numbers of grants to be awarded in the Funding Opportunity Announcements for fall 2021. The amount of time it will take for youth to complete the entry and exit surveys is estimated based on previous experience administering similar surveys to youth participants and the extent of the proposed revisions from the previous versions. The cost to respondents is estimated by assuming that 7.8 percent of the youth served by grantees will be age 18 or older, and then assigning a value to their time of $7.25 per hour, the federal minimum wage. The estimate of the proportion of youth served by PREP programs that will be 18 or older is based on previous performance measures data collection.

Participant entry survey. We have updated the number of respondents based on the expected numbers of grants to be awarded in the Funding Opportunity Announcements for fall 2021. The revised number of respondents for the entry survey is 351,001 ((319,673 + (319,673*.098)). Based on previous experience with similar instruments, the participant entry survey is estimated to take 8 minutes (0.13333 hour) to complete. The total burden over three years is estimated to be 46,799 hours (351,001 x 0.13333) and the annual burden for this data collection is estimated to be 15,600 hours (46,799/3). The annual cost to respondents for youth 18 or older is estimated to be 15,600 *.078 * $7.25 = $8,822.

Participant exit survey. We have updated the number of respondents based on the expected numbers of grants to be awarded in the Funding Opportunity Announcements for fall 2021. The revised number of respondents to the exit survey is 320,203 ((291,624 + (291,624*.098)). Based on previous experience with similar surveys and the extent of the proposed revisions from the previous versions, the exit survey is estimated to take youth 7 minutes (0.11667 hours) to complete. The total burden over three years is estimated to be 37,358 hours (320,203 x .11667) and the annual burden for this data collection is estimated to be 12,453 hours (37,358/3). The annual cost to respondents for youth age 18 and older is estimated to be 12,453 hours *.078 *$7.25 = $7,042.

2. Annual Performance Measures Burden for Grantees and Subrecipients

The 101 grantees² will report performance measures data into the PMMS. They will gather this information with the assistance of their subrecipient providers (estimated to be 400 across all grantees).³ The grantee and subrecipient data collection efforts described below are record-keeping tasks.

Total Annual Burden and Cost for Grantees

Twice per year, all 101 grantees⁴ will be required to submit required performance measures into the PMMS.⁵ Time for a designated PREP grantee administrator to aggregate the data across each of the grantee’s subrecipient providers and submit all of the required data into the PMMS is included in the burden estimates along with time to collect information at the grantee-level that pertain to grantee structure, cost, and support for program implementation. The Performance Reporting System Data Entry Form includes all of these required data elements that the grantee will collect, aggregate, and submit into the PMMS (see Instrument 3). Time for these activities is estimated to be 36 hours per year per SPREP grantee, 36 hours per year per TPREP grantee, 28 hours per year per CPREP grantee, and 28 hours per year per PREIS grantee. The total annual burden for these activities is estimated to be 3,300 hours (51 SPREP grantees x 36 hours) + (8 TPREP grantees x 36 hours) + (30 CPREP grantees x 28 hours) + (12 PREIS grantees x 28 hours). The annual cost to record-keepers for this activity is estimated to be $87,003 ((2,124 hours x $27.07 for SPREP and TPREP) + (1,176 hours x $25.09 for CPREP and PREIS)). The hourly wage rates represent the mean hourly wage rate for all occupations ($27.07) and the mean hourly wage rate for community and social service occupations ($25.09) (National Occupational Employment and Wage Estimates, Bureau of Labor Statistics, Department of Labor, May 2020).

Total Annual Burden and Cost for Subrecipients

The 400 estimated subrecipients will conduct multiple performance measures activities each year (see Instrument 4). They will aggregate data from participant entry and exit surveys and on attendance and program session hours, report to the grantee on implementation challenges and needs for technical assistance, and report to the grantee on subrecipient structure, cost, and support for program implementation. The total estimated annual time per subrecipient is 28 hours for state, 28 hours for tribal, 24 hours for CPREP, and 24 hours for PREIS. The total estimated annual burden for this activity is 10,904 hours across all subrecipients (299 subrecipients x 28 hours) + (27 subrecipients x 28 hours) + (54 subrecipients x 24 hours) + (20 subrecipients x 24 hours). The cost to record-keepers for this activity is estimated to be $273,581 (10,904 hours x $25.09).

A total annual burden of 42,257 hours (and cost of $376,447) is requested in this ICR. This includes time and cost for performance measures data collection associated with participants, grantees, and subrecipients.

Estimated Annualized Cost to Respondents

Instrument	No. of Respondents (total over request period)	No. of Responses per Respondent (total over request period)	Avg. Burden per Response (in hours)	Total Burden (in hours)	Annual Burden (in hours)	Average Hourly Wage Ratea	Total Annual Respondent Costb
Participant Entry Survey (all versions)	351,001	1	.13333	46,799	15,600	$7.25	$8,822c
Participant Exit Survey (all versions)	320,203	1	0.11667	37,358	12,453	$7.25	$7,042c
Performance reporting system data form - State grantees	51	6	18	5,508	1,836	$27.07	$49,701
Performance reporting system data form - TPREP grantees	8	6	18	864	288	$27.07	$7,796
Performance reporting system data form - CPREP grantees	30	6	14	2,520	840	$25.09	$21,076
Performance reporting system data form - PREIS grantees	12	6	14	1,008	336	$25.09	$8,430
Performance reporting system data form – State subrecipients	299	6	14	25,116	8,372	$25.09	$210,053
Performance reporting system data form – TPREP subrecipients	27	6	14	2,268	756	$25.09	$18,968
Performance reporting system data form – CPREP subrecipients	54	6	12	3,888	1,296	$25.09	$32,517

Performance reporting system data form – PREIS subrecipients	20	6	12	1,440	480	$25.09	$12,043
Total				126,769	42,257		$376,447d

^a For Instruments 1 and 2, the average hourly wage is the Federal Minimum Wage, US Department of Labor (https://www.bls.gov/cps/cpsaat44.pdf), and calculations using that wage are based on respondents age 18 years or older. For Instruments 3 and 4, the hourly wage rates represent the mean hourly wage rate for all occupations ($27.07) and the mean hourly wage rate for community and social service occupations ($25.09) (National Occupational Employment and Wage Estimates, Bureau of Labor Statistics, Department of Labor, May 2020).

^b Differences between this value and the computed values based on the previous two columns are due to rounding.

^c For Instruments 1 and 2, calculations of total annual cost are based on the 7.8% of respondents estimated to be age 18 or older. The estimate of the proportion of youth served by PREP programs that will be 18 or older is based on previous performance measures data collection.

^d Differences between this value and the computed sum of the values above are due to rounding.

A13. Costs

There are no additional costs to respondents.

A14. Estimated Annualized Costs to the Federal Government

The estimated cost for, collection, monitoring, and analysis of the PREP performance measures is $1,453,430 over the three years for requested clearance. The annual cost to the federal government is estimated to be $484,477.

Table 2. Total Estimated Costs by Category for PM Data Collection

Cost Category	Estimated Costs
Dashboard Monitoring	$427,083
Training and Technical Assistance to grantees (on PM)	$163,050
PMMS Monitoring	$343,667
PMMS Training	$114,944
Analysis and Reporting	$339,417
Dissemination	$65,269
Total costs over the request period	$1,453,430
Annual costs	$484,477

A15. Reasons for changes in burden

This data collection is a continuation of a currently approved data collection. The proposed changes to the data collection instruments will reduce the burden hours for respondents. In addition, the revised burden reflects minor changes in the numbers of PREP grantees, subrecipients, and participants, which have been updated to reflect the expected numbers of grantees to be awarded in fall 2021 based on the PREP Funding Opportunity Announcements. The combination of these changes decreases the expected annual burden by 813 hours.

We revised the cost estimates to reflect the most recent wage labor rates from May 2020 (National Occupational Employment and Wage Estimates, Bureau of Labor Statistics, Department of Labor, May 2020). Previous cost estimates were based on the May 2018 wage rates. This change increases the expected annual respondent cost by $22,669.

A16. Timeline

Displays of performance measures data are available to ACF and grantees through the PREP Performance Measures Dashboard soon after each round of submission. In addition, the Contractor analyzes the data and reports on them to ACF. End-of-cohort reports and briefs on the performance data will be made available on ACF’s website.

Performance measures are expected to be continuously collected and analyzed. This request is for a three-year period.

All PREP grantees will collect data on characteristics of the individual youth served, youths’ perceptions of program effectiveness and program experiences, and data on participants’ enrollment, attendance, and delivered program hours; and how grant funds are being used, the program models selected, and the ways in which grantees and subrecipients support program implementation. Grantees will submit performance measures data twice a year: each winter and summer.

The analytical results based on grantees’ reported performance measures data will be compiled for ACF into full written reports once each year, with data profiles more immediately available to ACF and grantees (within one to two months) through the Performance Measures Dashboard. End-of cohort reports (across all grantees for a grant period) will be available to the public.

A17. Exceptions

No exceptions are necessary for this information collection.

Attachments

Instrument 1: Participant Entry Survey for high school and older youth

1a: Entry survey for middle school youth

1b: Entry survey for high school (PREIS/TPREP)

1c: Entry survey for middle school youth (PREIS/TPREP)

Instrument 2: Exit survey for high school and older youth

2a: Exit survey for middle school youth

2b: Exit survey for high school and older youth (PREIS/TPREP)

2c: Exit survey for middle school youth (PREIS/TPREP)

Instrument 3: Performance Reporting Data Entry Form – Grantees

Instrument 4: Subrecipient Data Collection and Reporting Form – subrecipient program providers

Appendix A: 60-day FRN

Appendix B: Consent forms

1 Examples of sensitive topics include (but not limited to): social security number; sex behavior and attitudes; illegal, anti-social, self-incriminating and demeaning behavior; critical appraisals of other individuals with whom respondents have close relationships, e.g., family, pupil-teacher, employee-supervisor; mental and psychological problems potentially embarrassing to respondents; religion and indicators of religion; community activities which indicate political affiliation and attitudes; legally recognized privileged and analogous relationships, such as those of lawyers, physicians and ministers; records describing how an individual exercises rights guaranteed by the First Amendment; receipt of economic assistance from the government (e.g., unemployment or WIC or SNAP); immigration/citizenship status.

2 The estimated 101 grantees include 51 states and territories, 8 grants to tribes and tribal communities, 30 grants under Competitive PREP, and 12 PREIS grantees. Our estimates are based upon the expected numbers of grants to be awarded in fall 2021 based on the Funding Opportunity Announcements.

3 Our estimates are based upon the expected number of grants to be awarded in fall 2021 based on the Funding Opportunity Announcements.

4 As mentioned previously, the 101 grantees include 51 states and territories, 8 grants to tribes and tribal communities, 30 grants under Competitive PREP, and 12 PREIS grantees.

5 Measures of structure, cost, and support for program implementation will be submitted once per year, and all other measures will be submitted twice per year.

14