Final- Part A_MTW Cohort 1

Final- Part A_MTW Cohort 1.docx

Evaluation of Cohort 1 of the Moving to Work Demonstration Program Expansion

OMB: 2528-0328

Document [docx]
Download: docx | pdf


Supporting Statement for Paperwork Reduction Act Submission

Evaluation of Cohort 1 of the Moving to Work Demonstration Program Expansion

OMB Control # 2528-XXXX



A. Justification


1. Explain the circumstances that make the collection of information necessary. Identify any legal or administrative requirements that necessitate the collection. Attach a copy of the appropriate section of each statute and regulation mandating or authorizing the collection of information.


The U.S. Department of Housing and Urban Development (HUD)’s Office of Policy Development and Research (PD&R) is undertaking an evaluation of the Moving to Work demonstration program expansion. Moving to Work (MTW) is a demonstration program that encourages public housing agencies (PHAs) to test ways to achieve any or multiple of three specific objectives: increase the cost effectiveness of federal housing programs, encourage greater self-sufficiency of households receiving housing assistance, and increase housing choice for low-income families. MTW designation gives PHAs relief from many of the regulations and statutory provisions that apply to the public housing and Housing Choice Voucher (HCV) programs. MTW agencies can also merge their public housing and HCV funds into a single block grant and use these funds (if desired) for local activities outside the typical public housing and HCV programs, such as providing supportive services or developing housing for populations with special needs.


In 2016, Congress authorized HUD to expand the MTW program by 100 high performing PHAs. Cohort 1 is the first of five cohorts that HUD has identified for the MTW expansion. Cohort 1 is limited to PHAs with no more than 1,000 housing units across their HCV and public housing programs (“small” PHAs). In Cohort 1, PHAs are free to implement any program and policy change permissible under the MTW program. HUD will learn from the Evaluation of Cohort 1 of the Moving to Work Demonstration Program Expansion (Cohort 1 Evaluation) how small PHAs choose to use MTW flexibility and how their choices affect PHA and tenant outcomes.


By focusing on small PHAs, the Cohort 1 Evaluation fills a gap in the knowledge base on the effects of regulatory and funding flexibility on small PHAs and their tenants. Small PHAs account for about 80 percent of the agencies that administer the HCV and public housing programs but only about 20 percent of the assisted units. Small PHAs do not enjoy the same economies of scale as larger PHAs with their program administration and thus tend to find federal regulations more burdensome and costly. Given that only one of the current 39 MTW agencies is small, HUD knows relatively little about how small agencies and their tenants might benefit from MTW flexibility. The Cohort 1 Evaluation—supported by this information collection request (ICR)—will help HUD evaluate the value of MTW for smaller PHAs.


HUD contracted with Abt Associates Inc. for the Cohort 1 Evaluation. This research is conducted under the authority of the HUD Secretary to undertake programs of research, studies, testing and demonstration related to the mission and programs of HUD (12 USC 1701z-1 et seq.).


Overview of Study and Data Collection Request


The Cohort 1 Evaluation will answer two main questions:

  • How do small PHAs use their MTW flexibility?

  • What are the consequences of MTW flexibility for small PHAs and their tenants?


The Cohort 1 Evaluation will collect descriptive information on the programs and policies implemented by the set 43 PHAs involved in the study. The study will also compare the outcomes achieved by the MTW PHAs to those achieved by similar PHAs who do not have MTW designation in order to evaluate the impact of MTW.

Between October 2018 and May 2019, HUD invited PHAs with up to 1,000 combined units to apply for MTW designation under Cohort 1. Forty-three (43) PHAs completed the initial application process and met the eligibility requirements for Cohort 1. In November 2019, HUD randomly assigned the 43 PHAs into a treatment group (33 PHAs) and a control group (10 PHAs) for the purposes of the Cohort 1 Evaluation. In late August 2020, HUD notified the 33 treatment group PHAs that they had been selected to apply for MTW designation. Although the second phase of the MTW application process is yet to be completed, HUD expects the 33 PHAs in the treatment group to receive MTW designation, while the 10 PHAs in the control group will continue to operate under the regular program rules. With this design, the evaluation can make definitive statements about the impact of MTW if the PHAs in the treatment group experience different outcomes from those in the control group.


To the extent possible, the Cohort 1 evaluation will use existing data that PHAs already prepare and submit to HUD for the purposes of program administration. However, the evaluation requires modest primary data collection from PHAs to (1) clarify and expand on information in the existing data and (2) obtain qualitative information about the experiences of PHAs implementing activities related to cost effectiveness, self-sufficiency, or housing choice with and without MTW flexibility.


This submission requests OMB approval for three data collection activities:

  1. Interviews with MTW (treatment group) PHAs.

  2. Online surveys to non-MTW (control group) PHAs.

  3. Interviews with non-MTW (control group) PHAs.


Data collection activities are expected to begin in February 2021 and continue through April 2025.


2. Indicate how, by whom and for what purpose the information is to be used. Except for a new collection, indicate the actual use the agency has made of the information received from the current collection.


This is a new collection. HUD will use the information collected to learn about how small PHAs use their MTW flexibility to meet the MTW program’s goals. The information collected will also inform the analysis of the impact of MTW designation on PHA and tenant outcomes. Abt Associates Inc., the evaluation contractor, will carry out the data collection and analysis on HUD’s behalf.


Description of Data Collection Activities


Interviews with MTW (Treatment Group) PHAs

Abt Associates will conduct five rounds of interviews with the PHAs in the study’s treatment group that receive MTW designation under Cohort 1, expected to be 33 PHAs. In each round, Abt research staff will interview up to 3 staff involved in the MTW program (for example, the PHA’s Executive Director, HCV Director, and Public Housing Director). The first round of interviews is expected to take place between approximately February and April 2021, shortly after around the PHAs receive MTW designation (baseline). Subsequent rounds of data collection will take place annually between approximately February and April through 2025.


The interviews with MTW PHAs will answer the research questions and sub-questions in Exhibit A-1. There is no other data source for these questions. The study team will use the data collected through the interviews with MTW PHAs for the evaluation’s Baseline Report (expected August 2021) and four Annual Reports (expected August 2022, 2023, 2024, and 2025).


Exhibit A-1. Questions to be Addressed in Interviews with MTW PHAs


Research Questions

Sub-Questions

Why do small PHAs apply for MTW?

  • What motivated the PHAs to apply for MTW designation?

  • What programmatic or operational goals were they seeking to meet?

  • What role did the Board and other community stakeholders play in the decision to apply?

  • Which statutory objectives and MTW waivers were most important to PHAs at time of initial application?

  • What programmatic or operational changes did the PHAs intend to make?

  • How did the PHAs expect to use MTW funding flexibility?

  • Did PHAs’ motivations for applying change between the first and second step of the application?

  • Did PHAs’ expected use of MTW flexibilities change between the first and second step of the application?

How do small PHAs use MTW flexibility?

  • What were PHAs’ objectives in implementing their MTW activities?

  • What role did the Board and other stakeholders play in the choice of activities?

  • How did the MTW PHAs use their funding flexibility?

  • How did PHAs’ use of MTW flexibilities change over time?

  • How did the PHAs’ MTW activities affect PHA operations and staffing?

  • How did the PHAs’ participation in MTW affect their relations with tenants or the broader community?

  • How do PHAs describe their experiences with MTW?


The research team has developed slightly different interview guides for the first (baseline) interview and for the subsequent (annual) interviews. The main differences between the two guides is that the baseline interview covers motivations for applying for MTW, and the annual interview incorporates information obtained from the previous year’s interview to reduce respondent burden. Appendix A provides the guides for the Baseline Interview with MTW PHAs (A.1) and the Annual Interviews with MTW PHAs (A.2). Each interview is expected to last about 1 hour.


Online Surveys to Non-MTW (Control Group) PHAs

The Abt research team will field a simple online survey with the 10 PHAs assigned to the study’s control group (non-MTW PHAs) three times over the course of the study, at roughly the same time as the interviews with the MTW PHAs but the control group will only be engaged every other year. The purpose of the survey is to identify any program or policy changes the PHA has implemented or is considering implementing that relate to cost effectiveness, self-sufficiency, or housing choice—the three statutory objectives of MTW—even in the absence of MTW designation. In order to contextualize the study’s estimates of MTW impact derived from analysis of impact data, we need to understand how different program implementation is between the MTW and non-MTW PHAs is in these three areas.

The online survey is an easy way to gather initial information on whether non-MTW PHAs are pursuing any relevant activities. If we learn through the online survey that a PHA has made program and policy changes related to any of the MTW statutory objectives, we will interview the staff of that PHA to learn more (see Interviews with Non-MTW (Control Group) PHAs below).

The research team has developed slightly different online survey instruments for the first (baseline) survey and for the subsequent (annual) surveys. The main differences between the two surveys is that the baseline survey covers motivations for applying for MTW, and the annual survey incorporates information obtained from the previous year’s survey to reduce respondent burden. Appendix B provides the instruments for the Baseline Online Survey for Non-MTW PHAs (B.1) and the Annual Online Survey for Non-MTW PHAs (B.2). Each survey is expected to take one staff no more than 30 minutes to complete.


In advance of sending out the survey, the Abt team will review the PHAs’ Administrative Plan (Admin Plan) and Admissions and Continued Occupancy Policy (ACOP) for any program or policy changes described in those documents. If we find such changes, we will identify them in the cover email to the survey so that the PHA is aware if our interest in those areas.


Interviews with Non-MTW (Control Group) PHAs

If a non-MTW PHA indicates on the online survey that it has implemented (or plans to implement) any activities related to cost effectiveness, self-sufficiency, or housing choice, Abt research staff will interview one to two PHA staff to learn more about those activities. These interviews will take place within two weeks of the Abt team receiving the PHA’s response to the online survey—at approximately the same time as the interviews with MTW PHAs. Each interview is expected to last about one hour.


The interviews with non-MTW PHAs will answer the research questions and sub-questions shown in Exhibit A-2.


Exhibit A-2. Questions to be Addressed in Interviews with Non-MTW PHAs


Research Questions

Sub-questions

Which activities did the non-MTW PHAs implement related to the statutory objectives?

  • Which activities (i.e., programs, policies, or procedures) did the PHAs implement?

  • Did the PHAs obtain waivers from HUD to implement the activities? Would the PHAs have made a different program or policy change had they received MTW designation?

  • Which statutory objective(s) did the activities to relate to?

  • Were the PHAs seeking to meet other, local goals with their activities?

  • To what extent did tenant or other stakeholder input affect the choice of activities?

How did the activities affect PHA operations and staffing?

  • Did the activities implemented affect PHA procedures?

  • Did the activities implemented affect program costs?

  • Did the PHA realize administrative cost savings?

  • Did the activities implemented affect PHA staffing levels?

  • Did the activities implemented affect program budgets?

There is no other data source for answering the questions in Exhibit A-2. These questions enable to research team to compare the program and policy changes that non-MTW PHAs make to those made by the MTW PHAs. This information provides important context for interpreting the study’s impact estimates. For example, if none of the control group PHAs implement any program or policy changes in these areas, while all of the MTW PHAs do, we would expect to see a greater impact of MTW. If we learn that the control group PHAs are able to implement similar program and policy changes absent MTW designation, we would not expect to find as large a difference in outcomes. The data collected through the interviews with control group PHAs will be used for the evaluation’s Baseline Report and two Annual Reports.


The research team has developed slightly different interview guides for the first (baseline) interview and for the subsequent interviews. The main difference between the two guides is that the annual interview guide incorporates information obtained from the previous year’s interview to reduce respondent burden. Appendix C provides the guides for the Baseline Interview with Non-MTW PHAs (C.1) and the Annual Interviews with Non-MTW PHAs (C.2). Each interview is expected to last about one hour.


Justification for Data Collection Instruments

Exhibit A-3 summarizes the necessity of the planned data collection under each data collection instrument.




















Exhibit A-3. Justification of Data Collection Instruments


Instruments

Respondents, Content, and Reason for Inclusion

Baseline Interview with MTW PHAs (Appendix A, Exhibit A.1)

Respondents: Executive Directors and staff at MTW PHAs (expected to be 33 PHAs)


Content:

  • Motivation for applying to MTW

  • Changes agency made in planned MTW program between the submission of the Baseline Survey and the MTW Plan

  • Plans for year 1 MTW implementation

    • Activities related to cost effectiveness

    • Activities related to self-sufficiency

    • Activities related to housing choice

    • Activities related to local non-traditional programs

    • Expectations for using funding flexibility

  • Local evaluation plans

  • Other concerns and questions about MTW program


Reason: The baseline interview with key MTW PHA staff is essential for collecting collect more in-depth information on the PHA’s motivation for applying for Cohort 1 and how its motivations may have changed between the first and second phase of the application. Without this interview, the study team will not be able to answer many of the process study questions about the motivations for PHAs to apply for MTW status and challenges they faced or are facing with the MTW program, which are important areas of interest for HUD.

Annual Interview with MTW PHAs (Appendix A, Exhibit A.2)

Respondents: Executive Directors and staff at MTW PHAs (expected to be 33 PHAs)


Content:

  • Introduction

    • Status update of MTW program

    • Any changes that affect MTW program

  • Development of MTW Supplement (MTW report required by HUD)

  • Changes in program goals and activities since MTW Plan or last MTW Supplement

  • Implementation to date of MTW Waivers and activities

  • Information on any local non-traditional programs

  • Lessons learned and recommendations


Reason: The annual interviews with key MTW PHA staff are essential for answering process study research questions on implementation challenges, lessons learned, and other qualitative aspects of MTW execution that cannot be captured through administrative data.

Baseline and Biennial Online Surveys with non-MTW PHAs (Appendix B, Exhibit B.1 and Exhibit B.2)

Respondents: Executive Directors and staff at Non-MTW PHAs (expected to be 10 PHAs)


Content:

  • Objectives for applying to MTW and plans for future application (baseline)

  • Activities implemented related to the statutory objectives

  • Programs or policy changes to implement if designated MTW PHA

  • Space to enter additional thoughts


Reason: The main purpose of the survey is to identify any program or policy changes the PHA has implemented related to cost effectiveness, self-sufficiency, or housing choice. This survey allows the study team to identify which non-MTW PHAs to interview.

Baseline Interview with Non-MTW PHAs (Appendix C, Exhibit C.1)

Respondents: Executive Directors and staff at non-MTW PHAs that are implementing activities in the areas of cost effectiveness, self-sufficiency, or housing choice (expected to be 5 PHAs)


Content:

  • Activities implemented or underway (goals, household application, other information about activity)

  • Planned activities for the coming year (goals, household application, other information about activity)

  • Outcomes realized to date

  • Implementation challenges and lessons learned

  • Interest in applying for MTW in future


Reason: The purpose of the interview is to learn more about the program and policy changes that non-MTW PHAs implement in the absence of MTW flexibility. The interviews will provide information on how PHAs without MTW status are implementing activities related to MTW statutory objectives, and whether there are challenges or lessons to be learned. The information from the interviews will be informative to HUD’s MTW program office and will also provide context for the evaluation’s impact estimates.

Biennial Interview with Non-MTW PHAs (Appendix C, Exhibit C.2)

Respondents: Executive Directors and staff at non-MTW PHAs that are implementing activities in the areas of cost effectiveness, self-sufficiency, or housing choice (expected to be 5 PHAs)


Content:

  • Update on activities underway and discussed in prior interviews (goals, household application, other information about activity)

  • New activities not discussed in prior interviews (goals, household application, other information about activity)

  • Outcomes realized to date

  • Implementation challenges and lessons learned

  • Interest in applying for MTW in future


Reason: The purpose of the interview is to learn more about the program and policy changes that non-MTW PHAs implement in the absence of MTW flexibility. The interviews will provide information on how PHAs without MTW status are implementing activities related to MTW statutory objectives, and whether there are challenges or lessons to be learned. The information from the interviews will be informative to HUD’s MTW program office and will also provide context for the evaluation’s impact estimates.


Study Deliverables

HUD and policy makers will use the information collected through the Cohort 1 evaluation to understand how small PHAs use the flexibility offered by MTW to advance the program’s statutory objectives of cost effectiveness, self-sufficiency, and housing choice. The evaluation will also provide HUD rigorous evidence of the impact of MTW designation on outcomes related to the statutory objectives.


The evaluation will result in five reports: Baseline Report (2021), Annual Report 1 (2022), Annual Report 2 (2023), Annual Report 3 (2024), and Annual Report 4 (2025). The data collection in this ICR will inform all study deliverables.


3. Describe whether, and to what extent, the collection of information involves the use of automated, electronic, mechanical, or other technological collection techniques or other forms of information technology, e.g., permitting electronic submission of responses, and the basis for the decision for adopting this means of collection. Also describe any consideration of using information technology to reduce burden.


The research team will administer an online survey to the non-MTW PHAs to identify those PHAs for which an interview is justified. The survey will be programmed in SurveyGizmo, an extremely user-friendly survey application. Respondents will receive a link to the survey via email and enter their responses directly into the survey. PHAs will also have the option to complete the survey by telephone if they prefer.

Interviews will be conducted remotely via secure videoconference platform (Webex) or over the telephone, with interviewers recording responses directly into Word documents on a laptop. Use of the laptops will allow interviewers to quickly record data and continue with the interview without extended pauses or delays. The interviewers will also request permission to record the interview so as to have a back-up record of responses.


Interview responses will be directly uploaded to NVivo, a qualitative data analysis software for coding and analysis.


4. Describe efforts to identify duplication. Show specifically why any similar information already available cannot be used or modified for use for the purposes described in Item 2 above.


HUD is not aware of any other studies for which this study represents a duplicate research effort. While the MTW program has existed since the late 1990s, the MTW Expansion entails new requirements and activities that have never been studied. Also, the Cohort 1 evaluation is the only MTW evaluation focused exclusively on small PHAs.


During the study’s design phase, the research team closely examined existing HUD data sources to identify the primary data collection needed to address the study’s research questions. The team concluded that a large amount of information was available through existing HUD data systems but that some primary data collection was needed to supplement the existing data sources. For example, there are no existing data sources addressing the following types of questions of importance to the evaluation:

  • What programmatic or operational challenges were PHAs seeking to address in applying for MTW? What other factors played a role in the decision to apply?

  • How did the MTW PHAs’ activities affect PHA operations and staffing?

  • How did the MTW PHAs’ participation in MTW affect its relations with residents or the broader community?

  • How do MTW PHAs describe their experiences with MTW?

  • What “lessons learned” or advice do the PHAs have for other agencies seeking MTW or for new MTW PHAs?

  • Which activities did non-MTW PHAs implement related to the statutory objectives?

  • How did the non-MTW PHAs’ activities affect PHA operations and staffing?


The careful process the research team undertook to review all existing data sources ensures that the current ICR is not a duplication of effort.


To reduce respondent burden, before conducting the interviews with PHA staff, the study team will review all available secondary information for each PHA, such as the MTW Supplement (for MTW PHAs), Administrative Plan, ACOP, and data collected through HUD’s Financial Data System. The team will also pre-populate the interview guides with information collected through the previous years’ online surveys and interviews to minimize the burden on PHA staff.


5. If the collection of information impacts small businesses or other small entities (Item 5 of OMB Form 83-I) describe any methods used to minimize burden.


This data collection does not affect small businesses. Some of the PHAs in the study may qualify as small entities depending on the size of their jurisdictions. The methods used to reduce respondent burden for all PHAs (described in item 4) would also apply to these PHAs.


6. Describe the consequence to Federal program or policy activities if the collection is not conducted or is conducted less frequently, as well as any technical or legal obstacles to reducing burden.


The authorization of the expansion of the MTW program included a mandate that HUD rigorously evaluate the expansion. Without this data collection effort, HUD will be unable to evaluate the implementation and impact of MTW designation on the first cohort of small PHAs. The data collection covered by this ICR is essential for answering research questions regarding MTW implementation and for providing context for interpreting the study’s impact analyses. If this data collection is not conducted or conducted less frequently, HUD would not be able to adequately answer the study’s key research questions or be responsive the Congressional mandate to evaluate the program.


  1. Explain any special circumstances that would cause an information collection to be conducted in a manner:

  • requiring respondents to report information to the agency more than quarterly;

  • requiring respondents to prepare a written response to a collection of information in fewer than 30 days after receipt of it;

  • requiring respondents to submit more than an original and two copies of any document;

  • requiring respondents to retain records other than health, medical, government contract, grant-in-aid, or tax records for more than three years;

  • in connection with a statistical survey, that is not designed to produce valid and reliable results than can be generalized to the universe of study;

  • requiring the use of a statistical data classification that has not been reviewed and approved by OMB;

  • that includes a pledge of confidentiality that is not supported by authority established in statute or regulation, that is not supported by disclosure and data security policies that are consistent with the pledge, or which unnecessarily impedes sharing of data with other agencies for compatible confidential use; or

  • requiring respondents to submit proprietary trade secret, or other confidential information unless the agency can demonstrate that it has instituted procedures to protect the information's confidentiality to the extent permitted by law.


The proposed data collection activities are consistent with the guidelines set forth in 5 CFR 1320 (Controlling Paperwork Burdens on the Public). There are no special circumstances that require deviation from these guidelines. The following below are “Not Applicable” to this collection:

  • requiring respondents to report information to the agency more than quarterly – “Not Applicable”;

  • requiring respondents to prepare a written response to a collection of information in fewer than 30 days after receipt of it – “Not Applicable”;

  • requiring respondents to submit more than an original and two copies of any document – “Not Applicable”;

  • requiring respondents to retain records other than health, medical, government contract, grant-in-aid, or tax records for more than three years – “Not Applicable”;

  • in connection with a statistical survey, that is not designed to produce valid and reliable results than can be generalized to the universe of study – “Not Applicable”;

  • requiring the use of a statistical data classification that has not been reviewed and approved by OMB – “Not Applicable”;

  • that includes a pledge of confidentiality that is not supported by authority established in statute or regulation, that is not supported by disclosure and data security policies that are consistent with the pledge, or which unnecessarily impedes sharing of data with other agencies for compatible confidential use – “Not Applicable”; or

  • requiring respondents to submit proprietary trade secret, or other confidential information unless the agency can demonstrate that it has instituted procedures to protect the information's confidentiality to the extent permitted by law – “Not Applicable”.


  1. If applicable, provide a copy and identify the date and page number of publication in the Federal Register of the agency's notice, required by 5 CFR 1320.8(d), soliciting comments on the information collection prior to submission to OMB. Summarize public comments received in response to that notice and describe actions taken by the agency in response to these comments. Specifically address comments received on cost and hour burden.

  • Describe efforts to consult with persons outside the agency to obtain their views on the availability of data, frequency of collection, the clarity of instructions and recordkeeping disclosure, or reporting format (if any) and the data elements to be recorded, disclosed, or reported.

  • Consultation with representatives of those from whom information is to be obtained or those who must compile records should occur at least once every 3 years -- even if the collection of information activity is the same as in prior periods. There may be circumstances that preclude consultation in a specific situation. These circumstances should be explained.


In accordance with 5 CFR 1320.8 (Paperwork Reduction Act of 1995), a Notice of Proposed Information Collection for publication in the Federal Register has been prepared to announce the agency’s intention to request an OMB review of data collection activities for the Cohort 1 Evaluation. HUD published a 60-Day Notice of Proposed Information Collection in the Federal Register on September 11, 2020 (Docket No. FR-7029-N-08, pages 56266-56267). The notice provided a 60-day period for public comments, and comments are due November 10, 2020.


The Cohort 1 Evaluation was developed and is being implemented by Abt Associates Inc., HUD’s contractor. Key members of the Abt team include Principal Investigator Dr. Laura Peck; Project Director Dr. Larry Buron; Data Collection Manager Tanya de Sousa; Project Quality Advisor Dr. Jill Khadduri; and Director of Analysis Dr. Judy Geyer. Staff from HUD’s Office of Policy Development and Research and Office of Public and Indian Housing have collaborated with the Abt study team on study design and data collection plan. In addition, Abt has established a panel of Senior Advisors to provide review and input at all phases of the study.


The study’s data collection period is five years. Throughout the data collection period, the Abt team will offer webinars to the PHAs in the study to keep them apprised of data collection activities and study findings.


  1. Explain any decision to provide any payment or gift to respondents, other than remuneration of contractors or grantees.


There will be no payments or gifts to respondents.


  1. Describe any assurance of confidentiality provided to respondents and the basis for assurance in statute, regulation or agency policy.


HUD has entered into a contract with an independent research team, Abt Associates Inc., to conduct this research effort. HUD and Abt Associates will make every effort to maintain the privacy of respondents, to the extent permitted by law. The information requested under this collection is protected and held confidential in accordance with 42 U.S.C. 1306, 20 CFR 401 and 402, 5 U.S.C.552 (Freedom of Information Act), 5 U.S.C. 552a (Privacy Act of 1974) and OMB Circular No. A-130.


All research staff working on the project have been trained to protect private information and the study has a Data Security Plan governing the storage and use of the data collected through the study. Individuals will not be cited as sources of information in prepared reports.

All respondents included in the study will be informed that their participation in the data collection is voluntary and the information they provide will be used only for research purposes.


  1. Provide additional justification for any questions of a sensitive nature, such as sexual behavior and attitudes, religious beliefs, and other matters that are commonly considered private. This justification should include the reasons why the agency considers the questions necessary, the specific uses to be made of the information, the explanation to be given to persons from whom the information is requested, and any steps to be taken to obtain their consent.


The data collection instruments do not contain any sensitive questions.


12. Provide estimates of the hour burden of the collection of information. The statement should:

  • indicate the number of respondents, frequency of response, annual hour burden, and an explanation of how the burden was estimated. Unless directed to do so, agencies should not conduct special surveys to obtain information on which to base hour burden estimates. Consultation with a sample (fewer than 10) of potential respondents is desirable. If the hour burden on respondents is expected to vary widely because of differences in activity, size, or complexity, show the range of estimated hour burden, and explain the reasons for the variance. Generally, estimates should not include burden hours for customary and usual business practices;

  • if this request covers more than one form, provide separate hour burden estimates for each form and aggregate the hour burdens in Item 13 of OMB Form 83-I; and

  • provide estimates of annualized cost to respondents for the hour burdens for collections of information, identifying and using appropriate wage rate categories. The cost of contracting out or paying outside parties for information collection activities should not be included here. Instead this cost should be included in Item 13.


Interviews with the treatment group PHAs are expected to take place once a year for each of five years. Interviews with the control group PHAs, and the online survey with control group PHAs, will take place every other year (year 1, year 3, and year 5 of data collection).1

Data collection during years 1, 3, and 5 will require up to 124 hours in combined time for all interviews and survey responses from both the treatment group and control group PHAs. Data collection during years 2 and 4, when data is not collected form the control group PHAs, will require 99 hours in combined time for all interviews and survey responses.


The hour burden comes from three data collection activities as follows:


Interviews with MTW (Treatment Group) PHAs

We expect to interview up to three staff at each of the 33 PHAs in the study’s treatment group once per year, for a total of 99 respondents per year. The interviews will take approximately one hour to complete. There are separate interview guides for baseline and annual interviews, but the respondents and burden are the same. The total estimated annual burden for the interviews with MTW PHAs is 124 hours, 3 hours per PHA. The interview guides are presented in Appendix A.


Online Surveys to Non-MTW (Control Group) PHAs

We expect one staff at each of the 10 PHAs in the study’s control group to complete the online survey every other year, for a total of 10 respondents every other year. The survey will take about 30 minutes to complete. The total estimated annual burden is 5 hours. There are separate surveys for baseline and annual surveys, but the respondents and burden are the same for each. The total estimated annual burden for the online surveys with non-MTW PHAs is 5 hours, 0.5 hours per PHA. The survey instruments are presented in Appendix B.


Interviews with Non-MTW (Control Group) PHAs

We expect to interview up to two staff at PHAs in the study’s control group every other year, for a total of 20 respondents every other year. The interviews will take about one hour to complete. There are separate interview guides for baseline and annual interviews but the respondents and burden are the same. The total estimated annual burden is 20 hours, 2 hours per PHA. The interview guides are presented in Appendix C.


Exhibit A-4 provides the total estimated hour and cost burden per year for Years 1, 3, and 5 of the information collection. Exhibit A-5 provides the total estimated hour and cost burden per year for Years 2 and 4 of the information collection.




Exhibit A-4: Estimated Hour and Cost Burden of Information Collection

for Years 1, 3 and 5


Annualized Burden Table

Information Collection

Number of Respondents

Frequency of Response

Responses

Per Annum


Burden Hour Per Response


Annual Burden Hours


Hourly Cost Per Response

Cost


Interviews with MTW (Treatment Group) PHAs

99.00

1

99.00

1.00

99.00

$52.14

$5,161.86

Online Surveys to Non-MTW (Control Group) PHAs

10.00

1

10.00

0.50

5.00

$52.14

$260.70

Interviews with Non-MTW (Control Group) PHAs

20.00

1

20.00

1.00

20.00

$52.14

$1,042.80

Total

129.00




124.00


$6,465.36


The total estimated annual cost for this information collection during years 1, 3, and 5, when information is collected from both the treatment and the control group, is $6,465.36. The total estimated annual cost is the total number of respondent hours (124) multiplied by the hourly cost per respondent ($52.14). To estimate the hourly cost per respondent, the research team used the average hourly compensation (wages and benefits) for state and local government workers according to the Bureau of Labor Statistics’ Employer Costs For Employee Compensation survey from December 2019 (https://www.bls.gov/news.release/pdf/ecec.pdf).



Exhibit A-5: Estimated Hour and Cost Burden of Information Collection for Years 2 and 4


Annualized Burden Table

Information Collection

Number of Respondents

Frequency of Response

Responses

Per Annum


Burden Hour Per Response


Annual Burden Hours


Hourly Cost Per Response

Cost


Interviews with MTW (Treatment Group) PHAs

99.00

1

99.00

1.00

99.00

$52.14

$5,161.86

Total

99.00




99.00


$5,161.86


The total estimated annual cost for this information collection in years 2 and 4, when information is collected from only the treatment group is $5,161.86. The total estimated annual cost is the total number of respondent hours (99) multiplied by the hourly cost per respondent ($52.14). To estimate the hourly cost per respondent, the research team used the average hourly compensation (wages and benefits) for state and local government workers according to the Bureau of Labor Statistics’ Employer Costs for Employee Compensation survey from December 2019 (https://www.bls.gov/news.release/pdf/ecec.pdf).


Averaging across all 5 years, there is an average of 111 respondents, an estimated annualized hour burden of 114 hours, and average annualized cost of $5,943.96.


13. Provide an estimate of the total annual cost burden to respondents or recordkeepers resulting from the collection of information (do not include the cost of any hour burden shown in Items 12 and 14).


  • The cost estimate should be split into two components: (a) a total capital and start-up cost component (annualized over its expected useful life); and (b) a total operation and maintenance purchase of services component. The estimates should take into account costs associated with generating, maintaining, and disclosing or providing the information. Include descriptions of methods used to estimate major cost factors including system and technology acquisition, expected useful life of capital equipment, the discount rate(s) and the time period over which costs will be incurred. Capital and start-up costs include, among other items, preparations for collecting information such as purchasing computers and software; monitoring, sampling, drilling and testing equipment; and record storage facilities;

  • If cost estimates are expected to vary widely, agencies should present ranges of cost burdens and explain the reasons for the variance. The cost of purchasing or contracting out information collection services should be a part of this cost burden estimate. In developing cost burden estimates, agencies may consult with a sample of respondents (fewer than 10) utilize the 60-day pre-OMB submission public comment process and use existing economic or regulatory impact analysis associated with the rulemaking containing the information collection, as appropriate.

  • generally, estimates should not include purchases of equipment or services, or portions thereof made: (1) prior to October 1, 1995, (2) to achieve regulatory compliance with requirements not associated with the information collection, (3) for reasons other than to provide information or keep records for the government, or (4) as part of customary and usual business or private practices.


This data collection effort involves no recordkeeping or reporting costs for respondents other than the time burden to respond to questions on the data collection instruments as described in item 12 above. There is no known cost burden to the respondents.


14. Provide estimates of annualized cost to the Federal government. Also, provide a description of the method used to estimate cost, which should include quantification of hours, operational expenses (such as equipment, overhead, printing, and support staff), and any other expense that would not have been incurred without this collection of information. Agencies also may aggregate cost estimates from Items 12, 13, and 14 in a single table.


The current effort is being carried out under a HUD Contract with Abt Associates. HUD estimates the costs to the Federal government for this data collection and analysis of these data to be approximately $100,000 per year in professional labor. The professional labor cost estimates for this information collection include project management staff, survey methodologists, interviewers, and IT support staff. Exhibit A-5 summarizes the cost breakdown


Exhibit A-6: Estimated Annual Cost to the Federal Government


Activity

Estimated Cost to Federal Government

Total Labor Hours For Information Collection

Professional Labor

$100,000

827 hours

Total

$100,000

827 hours



15. Explain the reasons for any program changes or adjustments reported in Items 13 and 14 of the OMB Form 83-I.


This submission to OMB is an initial submission and does not involve any program changes or adjustments.


16. For collection of information whose results will be published, outline plans for tabulation and publication. Address any complex analytical techniques that will be used. Provide the time schedule for the entire project, including beginning and ending dates of the collection of information, completion of report, publication dates, and other actions.


The data collected for the Cohort 1 Evaluation will be analyzed, tabulated, and reported to HUD by the evaluation contractor, Abt Associates. Exhibit A-6 presents an overview of the data collection and analysis schedule. This schedule assumes that data collection begins in February 2021.

Exhibit A-7: Project Schedule


Timeframe

Activity

Notes

February 2021 – April 2021

Baseline Interviews with MTW (Treatment Group) PHAs


Provides information on PHA motivations for applying for Cohort 1 and the program and policy changes they intend to pursue using MTW flexibilities.

February 2021

Baseline Online Survey with non-MTW (Control Group PHAs)

Provides information on PHA motivations for applying for Cohort 1. Identifies non-MTW PHAs planning to implement policy and program changes in the areas of cost effectiveness, self-sufficiency, or housing choice.

April 2021

Baseline Interviews with non-MTW (Control Group PHAs)

Provides information on program and policy changes PHAs plan to pursue absent MTW flexibilities.

May 2021 –

June 2021

Analysis of baseline survey and interview data


June 2021

First Draft Baseline Report


July 2021

Second Draft Baseline Report


August 2021

Final Baseline Report


February 2022 – April 2022

Annual Interviews with MTW (Treatment Group) PHAs


Provides information on program and policy changes PHAs are pursuing using MTW flexibilities.

May 2022 –

June 2022

Analysis of Year 1 annual survey and interview data


June 2022

Draft Annual Report 1


July 2022

Second Draft Annual Report 1


August 2022

Final Annual Report 1


February 2023 – April 2023

Annual Interviews with MTW (Treatment Group) PHAs


Provides information on program and policy changes PHAs are pursuing using MTW flexibilities.

February 2023

Annual Online Survey with non-MTW (Control Group PHAs)

Identifies non-MTW PHAs implementing policy and program changes in the areas of cost effectiveness, self-sufficiency, or housing choice.

April 2023

Annual Interviews with non-MTW (Control Group PHAs)

Provides information on program and policy changes PHAs are pursuing absent MTW flexibilities.

May 2023 –

June 2023

Analysis of Year 2 annual survey and interview data


June 2023

Draft Annual Report 2


July 2023

Second Draft Annual Report 2


August 2023

Final Annual Report 2


February 2024 – April 2024

Annual Interviews with MTW (Treatment Group) PHAs


Provides information on program and policy changes PHAs are pursuing using MTW flexibilities.

May 2024 –

June 2024

Analysis of Year 3 annual survey and interview data


June 2024

Draft Annual Report 3


July 2022

Second Draft Annual Report 3


August 2022

Final Annual Report 3


February 2025 – April 2025

Annual Interviews with MTW (Treatment Group) PHAs


Provides information on program and policy changes PHAs are pursuing using MTW flexibilities.

February 2025

Annual Online Survey with non-MTW (Control Group PHAs)

Identifies non-MTW PHAs implementing policy and program changes in the areas of cost effectiveness, self-sufficiency, or housing choice.

April 2025

Annual Interviews with non-MTW (Control Group PHAs)

Provides information on program and policy changes PHAs are pursuing absent MTW flexibilities.

May 2025 –

June 2025

Analysis of Year 4 annual survey and interview data


June 2025

Draft Annual Report 4


July 2025

Second Draft Annual Report 4


August 2025

Final Annual Report 4



17. If seeking approval to not display the expiration date for OMB approval of the information collection, explain the reasons that display would be inappropriate.


All data collection instruments will prominently display the expiration date for OMB approval.


18. Explain each exception to the certification statement identified in item 19.


This submission describing data collection requests no exceptions to the Certificate for Paperwork Reduction Act (5 CFR 1320.9).

1 Year 1 data collection is the baseline data collection.

20


File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
Authorh46776
File Modified0000-00-00
File Created2021-01-12

© 2024 OMB.report | Privacy Policy