SUPPORTING STATEMENT - PART A
Navy New Parent Support Program (NPSP) Evaluation – 0704-XXXX
1. Need for the Information Collection
The Military Community & Family Policy (MC&FP) Family Advocacy Program (FAP) within the Department of Defense’s (DoD) Office of the Deputy Assistant Secretary of Defense (OSD) is requesting Office of Management and Budget (OMB) clearance for the New Parent Support Program (NPSP) Evaluation. OSD FAP contracted with Penn State for this data collection to assist in understanding the benefits and limitations of using a DoD developed, standardized, evidence-informed home visitation curriculum (i.e., Take Root Home Visitation [TRHV]) within the New Parent Support Program (NPSP). TRHV is a tailorable home visitation curriculum that addresses risk and protective factors for child maltreatment, which is a primary focus of NPSP home visitation. TRHV is designed to be used by home visitors to structure their time with their clients and their families. TRHV helps home visitors actively work with parents to strengthen core parenting skills, improve the parent-child bond, and promote positive child development. During visits, home visitors will use TRHV to collaborate with parents on identifying areas of strength and challenge, discuss ideas and strategies that can help parents achieve their goals, engage in role play or other skill building activities to help parents master core concepts, observe parents as they interact with their child and provide feedback, provide parents with handouts and other relevant materials, and assign skill practice homework to be completed between visits.
This study will take place within the context of Navy NPSP. Historically, Navy NPSP has utilized the Nurturing Parenting Program (NPP) as their home visitation curriculum; however, Navy stakeholders are interested in shifting to a different curriculum that may better align with the needs of the families they serve. Currently, there have been no experimental evaluations of Navy’s NPSP home visiting curriculum; thus, there is limited information available to OSD FAP to guide curriculum decisions. This data collection effort would overcome that limitation and provide OSD FAP with the information needed to provide oversight on curriculum decisions for Navy NPSP.
The authorization for this study comes from 10 U.S.C 136, Under Secretary of Defense for Personnel & Readiness and DoD Instruction 6400.05, New Parent Support Program (NPSP).
2. Use of the Information
This data collection effort will involve gathering information from Navy home visitors delivering NPSP home visitation services and new NPSP clients receiving home visitation services at six Navy installations to be identified by Navy FAP (e.g., two small, two medium, and two large installations). For the purposes of this data collection, a new NPSP client is defined as a parent or caregiver who is eligible to receive Navy NPSP home visits and who has not yet received a home visit involving curriculum content. Further, clients will be at least 18 years old and able to adequately comprehend English. Information about implementation and client outcomes will be collected from home visitors and clients to understand: (a) how home visitors are perceiving and delivering the curriculum, (b) how many home visitors are using the curriculum (i.e., penetration) and how many new clients are receiving the curriculum (i.e., reach) out of the total number eligible, (c) how clients are perceiving and engaging the curriculum, and (d) how parent and child outcomes that are central to the mission of Navy’s NPSP are changing as a result of receiving the curriculum.
Home visitors will complete the Evidence-Based Practice Attitudes Scale (EBPAS), a study specific Fidelity Checklist (FC), the Ages & Stages Questionnaire, Third Edition (ASQ-3), and the Parenting Skills Assessment, 10th Edition (PSA-10). NPSP clients will complete the Client Satisfaction Questionnaire (CSQ-8), the Client Engagement Survey (CES), the Family Needs Screener (FNS), the Protective Factors Survey (PFS), the Brief Child Abuse Potential Inventory (BCAP), the Parental Stress Scale (PSS), and the Center for Epidemiologic Studies Depression Scale (CESD-10).
All data collection instruments for home visitors and clients will be completed electronically via the online Qualtrics survey platform. Links to the instruments will be sent to the email addresses provided by home visitors and clients when they consent to participate in the study. Up to four reminders to complete assessments will also be sent to the provided email addresses. For home visitors, separate links will be used for each instrument at the scheduled assessment times. For clients, instruments will be compiled into a single survey, so they will receive one link at the scheduled assessment times. There are four main scheduled assessment periods (or waves) for home visitors and clients. The table below displays the assessment schedule for the study.
Outcome |
Reporter |
Outcome Measured |
Assessment Instrument |
Wave 1: Baseline (visits 1-3) |
Wave 2: 3 months post-baseline |
Wave 3: 6 months post-baseline |
Wave 4: NPSP Service or Study Completion |
Study Completion – Administrative Data |
Implementation |
Home Visitor |
Acceptability |
EBPAS |
|
|
|
|
|
Treatment Fidelity |
FC |
|
|
|
|
|
||
Penetration & Reach |
Not Applicable |
|
|
|
|
|
||
Parent |
Parent Satisfaction |
CSQ-8 |
|
|
|
|
|
|
Engagement |
CES |
|
|
|
|
|
||
Client |
Home Visitor |
Child Development |
ASQ-3 |
|
|
|
|
Link to Central Registry data |
Parenting Behaviors |
PSA-10 |
|
|
|
|
|||
Parent |
Child Abuse |
BCAP |
|
|
|
|
||
Risk Assessment |
FNS |
|
|
|
|
|||
Protective Factors |
PFS |
|
|
|
|
|||
Parenting Stress |
PSS |
|
|
|
|
|||
Depression |
CESD-10 |
|
|
|
|
In addition to completing the FC at the four main waves of data collection, home visitors will be asked to complete the measure online after each home visit. At the end of the study, reach (percentage of eligible families receiving the curriculum) and penetration (percentage of eligible home visitors delivering the curriculum) will be calculated. Finally, the Navy will share information from their Central Registry about clients’ reported and met criteria incidents of child abuse and neglect prior to and during their involvement in the study with the Penn State research team.
Home visitors’ and clients’ responses to the scheduled assessment waves will be submitted to a secure, password protected, two-factor authentication, online database housed on Qualtrics servers immediately upon completion of the assessments. Navy Central Registry data will be shared in accordance with DoD policy. A member of the Penn State research team will be responsible for downloading all received responses into a Statistical Package for the Social Sciences (SPSS) data file that will be stored on a secure, password protected, two-factor authentication Penn State server. Once all data collection efforts are completed, the Penn State research team will have a comprehensive and robust data set that will allow them to provide OSD FAP with the information needed for them to make informed decisions about the home visitation curriculum Navy NPSP should implement with their families.
3. Use of Information Technology
All responses from home visitors and clients will be collected electronically via online surveys housed in the Qualtrics survey platform. Links to these surveys will be emailed to the respondents at the scheduled assessment times. Navy Central Registry data will also be shared electronically using secure methods that adhere to DoD policies.
4. Non-duplication
The information obtained through this collection is unique and is not already available for use or adaptation from another cleared source.
5. Burden on Small Businesses
This information collection does not impose a significant economic impact on a substantial number of small businesses or entities.
6. Less Frequent Collection
The majority of clients receive NPSP home visits over a six-month period, and as such, scheduling three of the four main assessment waves to occur at 3-month intervals from intake to the 6-month service mark allows for the possibility of change to be captured in ways that can be adequately modeled in statistical analyses while minimizing participant burden. Scheduling the fourth wave to occur at NPSP service completion, or study completion for those who are still receiving NPSP home visits, provides an opportunity to include additional information in the statistical analyses that can aid in the accurate modeling of change over time. Potential consequences of conducting data collection less frequently include reduced statistical power due to modeling fewer time points, increased risk of greater participant attrition between assessment periods (which would also reduce statistical power), and increased likelihood of producing biased statistical estimates of change due to allowing too much time to pass between assessment periods.
7. Paperwork Reduction Act Guidelines
This collection of information does not require collection to be conducted in a manner inconsistent with the guidelines delineated in 5 CFR 1320.5(d)(2).
8. Consultation and Public Comments
Part A: PUBLIC NOTICE
A 60-Day Federal Register Notice (FRN) for the collection published on Monday, May 9, 2022. The 60-Day FRN citation is 87 FRN 27625.
No comments were received during the 60-Day Comment Period.
A 30-Day Federal Register Notice for the collection published on Monday, August 15, 2022. The 30-Day FRN citation is 87 FR 50072 FRN 50072-50073.
Part B: CONSULTATION
No additional consultation apart from soliciting public comments through the Federal Register was conducted for this submission.
9. Gifts or Payment
Only NPSP clients will receive compensation for completing assessment instruments in the form of Amazon e-gift cards, and compensation will be handled in accordance with DoDI 3216.02. In particular, links to the surveys will be emailed at times that encourage respondents to complete them outside of normal working hours. Also, the email containing the link will have language specifying that federal employees need to complete the surveys outside of normal working hours. Compensation will be emailed to participants on the following compensation schedule: $30 for the wave 1 survey, $20 for the wave 2 survey, and $25 each for the waves 3 and 4 surveys. Compensation for survey completion is being provided: (a) as an expression of gratitude to the clients for taking the time to complete the surveys, and (b) as a mechanism to optimize participant retention, as demonstrated by the extant survey research literature.
10. Confidentiality
The Privacy Act, as defined under 10 U.S.C 136, Under Secretary of Defense for Personnel & Readiness and DoD Instruction 6400.05, New Parent Support Program (NPSP) will be presented before the first question of the online questionnaires. This document specifies the Authority supporting the request for information, the purpose for its collection, the routine uses to which it will be put, the scope of anonymity in the use of personal identifiers and the voluntary nature of participation.
A System of Record Notice (SORN) is not required for this collection because records are not retrievable by PII.
A Privacy Impact Assessment (PIA) is not required for this collection because PII is not being collected electronically. Participants are provided a personal identifier.
Record are temporary. Cut off annually on completion of research project. Destroy 5 years after cutoff.
11. Sensitive Questions
Parents will be asked questions concerning risk factors for child maltreatment. These questions ask parents about family conflict, financial insecurity, relationship discord, substance abuse, violence approval, family of origin violence and neglect, and prior family violence. These questions are important because they assess outcomes targeted by Navy NPSP home visitation, and as such, provide an opportunity to directly test whether the TRHV curriculum helps NPSP home visitation achieve its mission objectives. Not asking these critical questions would undermine the utility of the study.
12. Respondent Burden and its Labor Costs
Part A: ESTIMATION OF RESPONDENT BURDEN
Collection Instrument(s)
Client Wave 1 Survey (FNS, PFS, BCAP, PSS, CESD-10) completed by NPSP clients
Number of Respondents: 300
Number of Responses Per Respondent: 1
Number of Total Annual Responses: 300
Response Time: 40 minutes
Respondent Burden Hours: 200 hours
Client Wave 2 Survey (BCAP, PSS, CES) completed by NPSP clients
Number of Respondents: 300
Number of Responses Per Respondent: 1
Number of Total Annual Responses: 1
Response Time: 20 minutes
Respondent Burden Hours: 100 hours
Client Wave 3 Survey (FNS, PFS, BCAP, PSS, CESD-10, CES, CSQ-8) completed by NPSP clients
Number of Respondents: 300
Number of Responses Per Respondent: 1
Number of Total Annual Responses: 1
Response Time: 50 minutes
Respondent Burden Hours: 250 hours
Client Wave 4 Survey (FNS, PFS, BCAP, PSS, CESD-10, CES, CSQ-8) completed by NPSP clients
Number of Respondents: 300
Number of Responses Per Respondent: 1
Number of Total Annual Responses: 1
Response Time: 50 minutes
Respondent Burden Hours: 250 hours
Total NSPS Client Submission Burden
a) Total Number of Respondents: 300
b) Total Number of Annual Responses: 1200
c) Total Respondent Burden Hours: 798 hours
EBPAS completed by NPSP home visitors
Number of Respondents: 15
Number of Responses Per Respondent: 1
Number of Total Annual Responses: 15
Response Time: 5 minutes
Respondent Burden Hours: 1.24 hours
FC completed by NPSP home visitors
Number of Respondents: 15
Number of Responses Per Respondent: 4
Number of Total Annual Responses: 60
Response Time: 2 minutes
Respondent Burden Hours: 1.99 hours
ASQ-3 completed by NPSP home visitors
Number of Respondents: 15
Number of Responses Per Respondent: 4
Number of Total Annual Responses: 60
Response Time: 15 minutes
Respondent Burden Hours: 15 hour
PSA-10 completed by NPSP home visitors
Number of Respondents: 15
Number of Responses Per Respondent: 3
Number of Total Annual Responses: 45
Response Time: 60 minutes
Respondent Burden Hours: 45 hours
Total Home Visitors Submission Burden
a) Total Number of Respondents: 15
b) Total Number of Annual Responses: 180
c) Total Respondent Burden Hours: 63 hours
Total Submission Burden
Total Number of Respondents: 315
Total Number of Annual Responses: 1380
Total Respondent Burden Hours: 863 hours
Part B: LABOR COST OF RESPONDENT BURDEN
Collection Instrument(s)
Client Wave 1 Survey (FNS, PFS, BCAP, PSS, CESD-10) completed by NPSP clients
Number of Total Annual Responses: 300
Response Time: 40 minutes
Respondent Hourly Wage: $27.07
Labor Burden per Response: $18.14
Total Labor Burden: $5,442.00
Client Wave 2 Survey (BCAP, PSS, CES) completed by NPSP clients
Number of Total Annual Responses: 300
Response Time: 20 minutes
Respondent Hourly Wage: $27.07
Labor Burden per Response: $8.93
Total Labor Burden: $2,679.00
Client Wave 3 Survey (FNS, PFS, BCAP, PSS, CESD-10, CES, CSQ-8) completed by NPSP clients
Number of Total Annual Responses: 300
Response Time: 50 minutes
Respondent Hourly Wage: $27.07
Labor Burden per Response: $22.47
Total Labor Burden: $6,741.00
Client Wave 4 Survey (FNS, PFS, BCAP, PSS, CESD-10, CES, CSQ-8) completed by NPSP clients
Number of Total Annual Responses: 300
Response Time: 50 minutes
Respondent Hourly Wage: $27.07
Labor Burden per Response: $22.47
Total Labor Burden: $6,741.00
Overall NPSP Client Labor Burden
a) Total Number of Annual Responses: 1200
b) Total Labor Burden: $21603.00
EBPAS completed by NPSP home visitors
Number of Total Annual Responses: 15
Response Time: 5 minutes
Respondent Hourly Wage: $31.22
Labor Burden per Response: $2.50
Total Labor Burden: $37.50
FC completed by NPSP home visitors
Number of Total Annual Responses: 60
Response Time: 2 minutes
Respondent Hourly Wage: $31.22
Labor Burden per Response: $0.94
Total Labor Burden: $56.40
ASQ-3 completed by NPSP home visitors
Number of Total Annual Responses: 60
Response Time: 15 minutes
Respondent Hourly Wage: $31.22
Labor Burden per Response: $7.81
Total Labor Burden: $468.60
PSA-10 completed by NPSP home visitors
Number of Total Annual Responses: 45
Response Time: 60 minutes
Respondent Hourly Wage: $31.22
Labor Burden per Response: $31.22
Total Labor Burden: $1,404.90
Overall Home Visitors Labor Burden
a) Total Number of Annual Responses: 180
b) Total Labor Burden: $1967.40
Overall Labor Burden
Total Number of Annual Responses: 1380
Total Labor Burden: $23,570.40
The Respondent hourly wage for clients was determined by using the mean hourly wage across all occupations ($27.07) from the Bureau of Labor Statistics Website (https://www.bls.gov/OES/Current/oes_nat.htm#00-0000). The Respondent hourly wage for home visitors was determined by using the mean hourly wage for Social Workers, All Other ($31.22) from the Bureau of Labor Statistics Website (https://www.bls.gov/OES/Current/oes_nat.htm#00-0000)
13. Respondent Costs Other Than Burden Hour Costs
There are no annualized costs to respondents other than the labor burden costs addressed in Section 12 of this document to complete this collection.
14. Cost to the Federal Government
Part A: LABOR COST TO THE FEDERAL GOVERNMENT
Collection Instrument(s)
Number of Total Annual Responses: 1380
Processing Time per Response: 9 minutes
Hourly Wage of Worker(s) Processing Responses: $38.92
Cost to Process Each Response: $5.84
Total Cost to Process Responses: $8,059.20
Overall Labor Burden to the Federal Government
Total Number of Annual Responses: 1380
Total Labor Burden: $8,059.20
Part B: OPERATIONAL AND MAINTENANCE COSTS
Cost Categories
Equipment: $0
Printing: $0
Postage: $0
Software Purchases: $0
Licensing Costs: $0
Other: $750,000 (USDA cooperative agreement)
Total Operational and Maintenance Cost: $ 750000.00
Part C: TOTAL COST TO THE FEDERAL GOVERNMENT
Total Labor Cost to the Federal Government: $8,059.20
Total Operational and Maintenance Costs: $750,000.00
Total Cost to the Federal Government: $758,059.20
15. Reasons for Change in Burden
This is a new collection with a new associated burden.
16. Publication of Results
The results of the information collection will be published as a DoD publication, and they will also be published external to the DoD in a series of journal articles. The journal articles will be published in outlets whose target audience is home visitors or other social service professionals, implementation scientists, and prevention and intervention scientists. The results of the study are being published because they will have direct implications for OSD and Service-level FAP, as well as the fields of home visitation, implementation science, and prevention and intervention science. Sharing the results through publication can help to inform professionals’ practice, both within and external to the DoD, and create opportunities for future research that advances the capacity of NPSP home visitation across the Services to meet the needs of their clients. We anticipate the study beginning in fall 2022 and concluding in fall 2023. Publication of the study’s results as a DoD publication is expected to occur 6-8 months after the study ends. Publication of the journal articles is expected to occur within a 3-year window following the completion of the study.
17. Non-Display of OMB Expiration Date
We are not seeking approval to omit the display of the expiration date of the OMB approval on the collection instrument.
18. Exceptions to “Certification for Paperwork Reduction Submissions”
We are not requesting any exemptions to the provisions stated in 5 CFR 1320.9.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Kaitlin Chiarelli |
| File Modified | 0000-00-00 |
| File Created | 2022-08-17 |