National HIV Prevention Program Monitoring and Evaluation Data
OMB No. 0920-0696
EXTENSION
Supporting Statement A
September 9, 2024
Contact Information
Lisa Belcher, Ph.D.
National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention
Division of HIV Prevention
Translation and Evaluation Branch
Centers for Disease Control and Prevention
1600 Clifton Road NE, Mailstop E-59
Atlanta, GA 30333.
Voice: (404-639-5369)
Fax: (404-639-0929)
Email: [email protected]
Title
Table of Contents
Section
A. Justification
Circumstances Making the Collection of Information Necessary
Purpose and Use of Information Collection
Use of Improved Information Technology and Burden Reduction
Efforts to Identify Duplication and Use of Similar Information
Impact on Small Businesses or Other Small Entities
Consequences of Collecting the Information Less Frequently
Special Circumstances Relating to the Guidelines of 5 CFR 1320.5
Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency
Explanation of Any Payment or Gift to Respondents
Protection of the Privacy and Confidentiality of
Information Provided by Respondents
Institutional Review Board (IRB) and Justification for
Sensitive Questions
Estimates of Annualized Burden Hours and Costs
Estimates of Other Total Annual Cost Burden to Respondents or Record Keepers
Annualized Cost to the Government
Explanation for Program Changes or Adjustments
Plans for Tabulation and Publication and Project Time Schedule
Reason(s) Display of OMB Expiration Date is Inappropriate
Exceptions to Certification for Paperwork Reduction Act Submissions
Exhibits
Exhibit 12.A Estimated Annualized Burden Hours
Exhibit 12.B Estimated Annualized Burden Costs
Exhibit 14.A Estimated Cost to the Government
LIST OF ATTACHMENTS
Attachment 1 Authorizing Legislation
Attachment 2 60-Day Federal Register Notice
Attachment 3 NHM&E EvaluationWeb® Screen Shots
Attachment 4 Agencies and Persons Consulted
Attachment 5A NHM&E Data Variable Set
Attachment 6 Data Security and Confidentiality Guidelines for HIV, Viral Hepatitis, Sexually Transmitted Disease, and Tuberculosis Programs
Attachment 7 EvaluationWeb® Authority to Operate
Attachment 8 Authorization to Extend 308(d) Assurance of
Confidentiality Protection
Attachment 9 Privacy Impact Assessment (PIA)
The goal of the National HIV
Prevention Program Monitoring and Evaluation (NHM&E) Data is to
monitor and evaluate HIV prevention programs funded by the Division
of HIV Prevention (DHP) at the Centers for Disease Control and
Prevention. This includes, but is not limited to, HIV testing,
comprehensive prevention with HIV positive persons including
Partner Services, and comprehensive prevention with high risk HIV
negative persons including screening and referral to pre-exposure
prophylaxis (PrEP).
The data will be analyzed to
produce multiple reports for stakeholders, including reports to
Congress and the White House, State Health Departments, other
recipients, and the public. These reports will be used to make
funding decisions, better target resources and efforts, improve
service delivery, and make HIV prevention more effective.
Recipients will report data on all
HIV prevention programs funded by DHP. Data will be submitted
through the EvaluationWeb® reporting software provided to each
recipient.
The populations to be studied are
the recipients receiving HIV prevention funding from DHP.
All recipients report all data; no
sampling is involved. Data will be analyzed in multiple ways,
including comparing recipients to national goals and to average,
determining trends over time, geographical distribution, etc.
Section A. Justification
Circumstances Making the Collection of Information Necessary
The Centers for Disease Control and Prevention requests an extension to OMB approved data collection 0920-0696 (expiration date 10/31/2024) entitled, “National HIV Prevention Program Monitoring and Evaluation (NHM&E) Data,” for a period of 3 years.
This information collection request (ICR) covers the collection of standardized program monitoring and evaluation data from organizations funded by CDC directly, or indirectly through health department funding, under funding opportunity announcements that include conducting HIV prevention programs. This ICR also covers data collection for special program monitoring and evaluation projects that provide additional funding for expanded data collection using the approved variables. This is to include all types of HIV prevention programs, including but not limited to, HIV testing, comprehensive prevention with HIV positive persons including Partner Services, comprehensive prevention with high risk HIV negative persons including pre-exposure prophylaxis (PrEP) screening and referral, and other CDC-funded HIV prevention programs.
A review of the current OMB-approved CDC HIV data collections shows no other approved data collections for collecting program monitoring and evaluation data on CDC-funded HIV prevention programs currently being conducted by health departments (HDs)and community-based organizations (CBOs).
NHM&E data has been an approved data collection since 2005 for CDC-funded HIV prevention programs implemented by HDs (currently n=66) and CBOs (currently n=100) funded through CDC’s flagship and other funding opportunities.
The extension of the currently approved ICR is intended to meet the program monitoring and evaluation needs of CDC HIV prevention goals and objectives and CDC’s High Impact Prevention approach (https://www.cdc.gov/hiv/policies/hip/hip.html). There are no adjustments to the burden request from the previously approved ICR. Details are provided in Section 12.
The NHM&E data are a set of standardized variables to assist HDs and CBOs in monitoring and evaluating their programs and activities to help them develop, deliver, and refine successful HIV prevention interventions. These data are also used to report key program performance indicators to CDC to show whether the programs implemented or supported are efficient and effective in achieving their stated goals. NHM&E data supply program managers with service-level information regarding program processes (e.g., who delivered what to whom, how many, where, and when) and client-level information (e.g., client demographics, behavioral risk factors, HIV test result, linkage to HIV medical care for persons testing HIV positive, screening and referrals into prevention and essential support services, and interview for partner services) for monitoring and enhancing local HIV prevention programs. Much of these data are collected by HDs and CBOs using locally developed forms as part of their usual business process.
Plans for ending the HIV epidemic in the United States (https://www.cdc.gov/endhiv/overview.html) focus on diagnosing all people with HIV as early as possible, treating people with HIV rapidly and effectively, preventing new HIV transmissions by using proven interventions (e.g., pre-exposure prophylaxis or PrEP) and responding quickly to potential HIV outbreaks. CDC’s Division of HIV Prevention (DHP) will work closely with national, state, and local partners to ensure that 1) HIV testing is accessible; 2) persons living with HIV have their infection diagnosed, are linked to care, and have access to the support services they need to stay virally suppressed; and 3) persons at high risk for HIV infection have the prevention information and tools needed to protect themselves from infection. As plans are implemented through requirements presented in funding opportunity announcements, the NHM&E variables are modified to monitor and evaluate the requirements.
The requested extension to the currently approved ICR is to continue collection of the NHM&E variables to monitor and evaluate CDC-funded HIV prevention programs. Beginning in July 2021, all CDC-funded HIV prevention programs were required to report on the same set of NHM&E variables. Data collected and reported will be used to inform progress toward CDC’s HIV prevention goals and objectives.
CDC currently funds HIV prevention programs in all 50 states, District of Columbia, U.S. territories (Puerto Rico, U.S. Virgin Islands and the six Pacific Island territories), 7 city health departments (Baltimore, Chicago, Houston, Los Angeles, New York City, Philadelphia, and San Francisco), and approximately 100 CBOs through cooperative agreements. The number of CBO recipients vary over time and, as noted, may increase, and some recipients may be funded under more than one funding opportunity announcement. To allow for an estimated maximum number of recipients, we have calculated the burden based on up to 150 CBOs.
HIV prevention programs, including, but not limited to, HIV testing, partner services, and referral and linkage to medical care and other prevention and essential support services, are critical for reducing new HIV infections. Monitoring and evaluation of these HIV prevention programs are essential for strengthening CDC’s overall monitoring of HIV prevention. Consequently, accurate and reliable program process and outcome monitoring and evaluation data must be collected. CDC depends on the NHM&E variables for standardized data from all recipients to adequately monitor program performance at both the local and national levels.
In addition, CDC routinely reports key program performance indicators as a method for demonstrating accountability as part of the budget process. The CDC HIV prevention program performance indicators include the recipient’s capacity to deliver prevention services and outputs and outcomes associated with HIV prevention program activity. The recipients and CDC will use performance indicators to show that the programs they implement, or support are efficient and effective in achieving their stated HIV prevention program goals and objectives. HIV prevention program performance indicators are calculated using data included in this ICR for NHM&E data.
The NHM&E data make possible national program evaluation; performance indicator calculation; accountability reporting to Congress, the administration, and other HIV prevention program stakeholders; and informed decision-making about funding and HIV prevention. These data will be used for planning and monitoring the delivery of prevention services to clients, implementing and improving HIV prevention programs, and reporting the required program performance indicators. Additionally, NHM&E data will enable CDC to provide valuable feedback to these programs and to better account for the use of HIV prevention resources. All funded health departments and CBOs, under CDC HIV prevention program funding, will be required to submit the NHM&E data. Exceptions to this may be for demonstration project ICRs. Alignment of data elements will occur whenever possible.
Collection of these data is authorized under Section 306 of the Public Health Services Act [42 U.S.C. 242(k)] (Attachment 1). Respondents are required to submit NHM&E data semiannually and are accountable for conducting monitoring and evaluation of major HIV prevention program activities and services. CDC may place conditions or restrictions on the award of funds to respondents that fail to meet these requirements.
2. Purpose of Use of the Information Collection
The NHM&E data variables provide a comprehensive, yet parsimonious, standardized set of program data variables essential to monitoring and evaluating HIV prevention programs. As program evaluation, the results of analyses of NHM&E data are not generalizable (i.e., it is not possible to induce or derive a general conclusion or principle about all HIV prevention from the particulars of the evaluation of a particular recipient’s activities). Moreover, given the variety in implementation of HIV prevention interventions among health departments and CBOs, when used for assessing outcomes associated with CDC-funded HIV prevention program activities, the results of analyses of NHM&E data will not be generalizable. However, the NHM&E data enable CDC to track program activity, identify best practices, and assist recipients in redesigning interventions that do not accomplish stated goals, such as linking HIV positives persons to medical care. CDC has used the NHM&E data received to date, in combination with surveillance and research data, for the following purposes:
Publish annual reports on HIV testing at the national and jurisdiction levels, including HIV positivity rates.
Disseminate rapid feedback reports to the recipients showing progress toward meeting priority goals and objectives, recipient comparison to national averages, and recipient comparison to other recipients.
Publish peer-reviewed articles on HIV testing for priority population groups including youth, women, Blacks/African Americans, Hispanics/Latinos, and men who have sex with men (MSM).
Assess CDC HIV budget allocations with respect to prioritized populations at the jurisdiction level.
Identify gaps in HIV prevention service provisions
Respond to data requests from Congress, the administration, HIV researchers, and other interested parties.
Assess the extent to which HIV prevention programs have reached their target population.
Highlight opportunities to strengthen collaboration among CDC, its prevention partners, and other federal agencies
Assess the annual performance of CDC and its recipients in meeting priority goals and objectives.
The NHM&E data variables have been developed with extensive input from respondents (representatives of HDs and CBOs), other HIV prevention partners, and DHP leadership. See Attachment 4 for a list of external organizations and persons who provided input on the NHM&E data variables. The data variables are based on HIV prevention business processes and sound scientific approaches to HIV prevention. Specifically, the NHM&E data variables cover a range of HIV prevention activities such as agency information, HIV testing, partner services, linkage to HIV medical care, and referral to PrEP.
Collection of the NHM&E data will supply program managers with service-level information regarding program processes (e.g., who delivered what to whom, how many, where, and when) and client-level information (e.g., client demographics, behavioral factors, HIV test result, linkage to HIV medical care for persons testing HIV positive, referrals into prevention and essential support services, and interview for partner services) for monitoring and enhancing local HIV prevention programs. See Attachment 5a for the complete set of NHM&E data variables and values. Beginning in July 2021, all CDC-funded HIV prevention programs will be required to report on the same set of NHM&E variables. See Attachment 3 for screenshots of the EvaluationWeb® direct data key entry screens.
Without these data, CDC would be unable to determine what is being done with the funding it provides, what populations are being served, what services are being provided, or which programs are having the most effect in preventing HIV. It would be unable to account to the administration, Congress, or other stakeholders for the proper use of public money or provide transparency for the programs it funds.
Use of Improved Information Technology and Burden Reduction
Each respondent will determine how data are to be collected. There are no required forms or other data collection instruments. CDC provides optional, modifiable data collection templates that recipients change and adapt for their own procedures and additional, local data needs. Many recipients use their own data system and extract data in specified formats for upload into EvaluationWeb®.
For HDs who choose to key enter data directly into the EvaluationWeb® system, recipients are allowed to customize the system within specified limits to include data for local use that is not reported to CDC. In addition, the system is set up by an administrator who specifies the type of funding received from CDC and other default information that automatically populates what appears on data entry screens in order to simplify data entry.
All directly funded CBOs key enter their data into EvaluationWeb®. Data entry from CBOs directly funded by CDC is slightly different from what is asked of CBOs who are funded by HDs using CDC funds, so the system adjusts the data entry screens for CBOs based on the type of funding.
See Attachment 3 for screenshots of the NHM&E data entry system for collecting NHM&E data variable. System screens may be adjusted to the needs of the specific health department or CBO.
All funded HDs and CBOs under CDC HIV prevention program funding opportunity announcements must submit required NHM&E data to CDC through an approved CDC Data System. CDC is currently using EvaluationWeb® for NHM&E data. EvaluationWeb® is a secure, browser-based software application designed to provide the necessary mechanism for collecting and reporting standardized, sensitive NHM&E data.
HDs are given the option of using their own software system to collect NHM&E data and uploading to EvaluationWeb® or key-entering data directly into the CDC-provided EvaluationWeb® software. Directly-funded CBOs are required to key-enter data directly into the CDC-provided EvaluationWeb® software. HDs who use their own software must collect the standardized NHM&E data and then convert those data into one of several CDC-specified formats for upload to EvaluationWeb®. HDs who choose to enter data directly into EvaluationWeb® and CBOs that are required to enter data directly are provided a free, browser-based, secure electronic mechanism for collecting and reporting the standardized NHM&E HIV prevention program data. The data from both sources is checked for quality and conformity to NHM&E requirements by the contractor before being compiled and submitted to CDC.
The optional EvaluationWeb® software application was designed with input from representatives of HDs, CBOs, and other HIV prevention partners. The EvaluationWeb® software combines agency, program, and client data into one system. This integrated system reduces the burden of entering client data separately by program and allows for enhanced flexibility in monitoring and analyzing data across a range of HIV prevention activities.
Data variable business rules have been built into the EvaluationWeb® software application to enhance the reliability and integrity of the data. These business rules establish the interrelationships among variables and serve as system performance checks for accurate data entry. CDC recipients gain access to EvaluationWeb® after authentication of user identities.
Efforts to Identify Duplication and Use of Similar Information
Efforts to identify duplication of NHM&E data include the assessment of existing or previously used HIV prevention data collection systems used by CDC, other federal agencies, as well as HDs and CBOs. It should be noted that because the NHM&E data reporting requirements are specific to CDC-funded HIV prevention activities, the only possible duplication is if other federal or state organizations or entities are also funding the same HIV prevention activities to be performed by the same recipients.
There are shared data elements in the NEDSS Base System (NBS) developed by CDC and used by some state HDs in collaboration with HIV prevention programs to collect Partner Services (PS) data. Jurisdictions using the NBS STD Module for HIV/AIDS partner services are able to submit data elements to CDC. The data collected in NBS have been modified to match NHM&E data for those items related to HIV PS so that funded state or city HDs have the option of using EvaluationWeb®, NBS, or their own system to collect PS data. Other NBS data are not reported to CDC, except for morbidity data, which are reported through the NETSS system. NBS collects additional information outside the purview of HIV prevention. Only NHM&E PS data collected in NBS are reported to CDC as part of the NHM&E data collection. Recipients may also choose to use their own data collection system. In either case, only the required NHM&E data will be uploaded to EvaluationWeb® for submission to CDC.
In addition to systems at CDC, we reviewed the Health Resources and Services Administration’s (HRSA) “Ryan White HIV/AIDS Program Client-Level Data Reporting System” (OMB 0906-0039, Exp. 12/31/2024). HRSA does not collect detailed HIV prevention program data and therefore, very few similarities were identified.
If the number of new HIV infections is to be reduced, the quality of HIV prevention programs designed to conduct HIV testing, link persons to HIV medical care and other essential support services, and refer high risk HIV negative persons to PrEP and other support services must be improved. The NHM&E data significantly advance the monitoring and evaluation of HIV prevention programs by providing national, standardized information. Using standardized data will allow CDC to evaluate programs on national and regional scales and to compare programs providing similar services or targeting similar populations. On the local level, use of the standardized NHM&E variables will enhance the capacity of HIV prevention programs to thoroughly assess and refine their HIV prevention interventions and to identify unmet needs and redundancies while providing accountability to their stakeholders.
Impact on Small Business or Other Small Entities
HDs and CBOs that receive CDC funding for HIV prevention vary greatly in size and in their capacity to collect and report the NHM&E data. Some CBOs would qualify as small businesses or other small entities. The NHM&E variables represent a set of data with sufficient detail to monitor and improve client outcomes, service delivery, and program design and implementation. In addition, collection of the data will enable agencies to meet their program indicator reporting mandates. Required NHM&E data variables have been kept to a minimum, and thus all respondents will be expected to complete the required data. Moreover, the cost of collecting and reporting these data are included in the CDC funding to all recipients. For small organizations, collection and use of these data are essential to maintaining and improving their HIV prevention activities. When faced with limited resources, these agencies will have the data needed to defend and make the case for expanding existing programs, thereby ensuring continued service delivery to populations in need.
Consequences of Collecting the Information Less Frequently
Respondents are required to submit data to the CDC on a semiannual basis. Less frequent data submission would result in a lag time between the occurrence of program problems and their identification. This lag time could result in costly program inefficiencies, defects, and failures to continue or worsen without a timely opportunity for CDC to provide valuable assistance and corrective measures to agencies funded to prevent the spread of HIV. There are no legal obstacles to reducing the burden.
7. Special Circumstances relating to the Guidelines of 5 CFR 1320.5
This request fully complies with the guidelines of 5 CFR 1320.5.
8. Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency
A 60-day notice to solicit public comments was published in the Federal Register, 2/5/2024, Volume 89, Number 212, pages 7717 – 7718. See Attachment 2 for a copy of the Federal Register notice. No public comments were received.
CDC developed the NHM&E data variables with feedback from state, territorial, and local HDs and CBOs. Developing the NHM&E data variables has been a collaborative process with these stakeholders. A detailed listing of agencies and persons consulted is found in Attachment 4. Representatives from funded agencies continue to be informed through quarterly phone calls, monthly newsletters, and e-mail correspondence. Additional consultations, workshops, and web-conferences will occur as needed.
Explanation of Any Payment or Gift to Respondents
No payments or gifts will be provided to respondents.
10. Protection of the Privacy and Confidentiality of Information Provided by Respondents
The CDC Privacy Review Officer and the NCHHSTP IT Security Information System Security Officer (ISSO), have assessed this package for applicability of 5 U.S.C. § 552a, and determined that the Privacy Act does not apply to the overall information collection. A privacy impact assessment was completed (attachment 9).
All NHM&E data are covered by a CDC Assurance of Confidentiality (attachment 8) specific to NHM&E data under the Public Health Services Act 308(d), as well as state confidentiality laws.
HDs may collect identifiers (name, address, etc.) on clients who receive HIV prevention services, including HIV testing as a normal process in providing patient care. The Privacy Act is not applicable to the client-level data because the information will become a part of the health departments’ already established record systems; moreover, its availability and use will be limited to the provision of services at the local level.
All funded HDs and CBOs under CDC HIV prevention program funding opportunity announcements must submit required NHM&E data to CDC through an approved CDC data system. CDC is currently using EvaluationWeb® for NHM&E data. EvaluationWeb® is a secure, browser-based software application designed to provide the necessary mechanism for collecting and reporting standardized, sensitive NHM&E data.
EvaluationWeb® resides outside the CDC network and is hosted by Luther Consulting, LLC. Twice per year, each of the participating HDs and CBOs send their data, either by key entry or uploading a file, directly to EvaluationWeb® which processes the data and makes specific elements available to authorized agencies or individuals.
Prior to gaining access to EvaluationWeb®, individuals must successfully authenticate their credentials through a process overseen by the CDC and Luther Consulting, LLC. Luther Consulting, LLC enforces required access controls. All users of EvaluationWeb® must complete Electronic Authentication (e-authentication) Assurance Level 3 identity proofing requirements established by CDC. Once a user has completed e-authentication, they are issued a SAMS grid card and the completed authorization is transmitted to Luther Consulting via the Secure Access Management System (SAMS). Luther Consulting, LLC will only authorize accounts for individuals who have successfully completed the identity proofing process, who have been recommended by their appropriate jurisdiction, and have been authorized by the CDC program official. Users are assigned access levels based on their organizational role in the recipient jurisdiction. Once users have been granted access, they can access the system via the SAMS login portal using their SAMS issued grid card. The grid card provides a combination of letters and numbers that are unique to the user. Users are not permitted to share their SAMS issued grid card with anyone. Each user must have his or her own SAMS grid card. Users must also read and sign the rules of behavior for EvaluationWeb® on an annual basis to ensure they adhere to the requirements for use of the system.
Luther Consulting, LLC maintains configuration management of the EvaluationWeb® system by adhering to the System Baseline Configuration (SBC) established by CDC for all system servers. Changes to the system are managed by using the CDC Office of the Chief Information Security Officer (OCISO) Information System Change Management (ISCM) Standard Operating Procedures (SOP), which requires that all changes must be approved by OCISO prior to implementation into the production environment.
Additionally, the system uses Transport Layer Security (TLS) 1.2 as required by CDC to encrypt the browser to browser connections. Encryption used by the EvaluationWeb® system includes column level SQL encryption per (Microsoft CryptoAPI (CNG) FIPS 140-2 CertID# 2936) and incorporates products with strong encryption capabilities such as Cisco Firepower firewalls. All encryption used by the EvaluationWeb® system meets Federal Information Processing Standards (FIPS) 140-2 requirements as certified by NIST.
The EvaluationWeb® system has passed the full Security Assessment and Authorization Process and has an authority to operate (ATO) until September 29, 2025 (Attachment 7). This means that our security measures meet the requirements of the NIST 800-53, HHS, and CDC.
About half the HDs maintain their own electronic data collection systems and upload data from their systems into EvaluationWeb®. The other HDs and all directly funded CBO recipients key-enter data directly into EvaluationWeb®.
Information about agencies and programs is required as part of the Funding Opportunity Announcement. Information about clients is collected by the agencies as part of their routine data collection, and clients are informed of any consent required by the agency or state regulations. Program data accessible by CDC will not contain client names but will include “sensitive” information such as client demographics (age, gender, race, pregnancy status, HIV status, etc.) and behavior. Information in identifiable form, such as name, address, birthday, etc., may be collected by the HD or CBO working with the individual for purposes of local program activity such as case management, but no individually identifiable information will be submitted to CDC.
Whether data is uploaded to EvaluationWeb® using CDC-specified formats or directly entered, no individually identifiable information is submitted to CDC. For NHM&E data management purposes, each individual record will be identified by a unique key that is linked to an agency and state. This key is maintained in EvaluationWeb®, but only at the local level can the client key be re-linked to identifiers.
11. Institutional Review Board (IRB) and Justification for
IRB Approval
This data collection has been determined not research involving
human subjects. Therefore, IRB approval is not required.
Sensitive Questions
Some of the client-level data to be collected are highly sensitive. HIV can be transmitted from person to person through sexual contact and the sharing of HIV contaminated needles and syringes. These modes of transmission necessitate the collection of sensitive data regarding sexual behavior and drug use. Because collection of these data will be used to provide improved HIV prevention services to high-risk populations, to enhance HIV prevention programs at the local level, and to reduce high-risk behaviors in persons most likely to acquire or transmit HIV, specific information about client demographics and client behavior and needs is essential to designing appropriate interventions and programs and to monitoring and evaluating these programs.
This data collection also includes race and ethnicity questions, which may also be viewed as sensitive by some respondents, for use in data analysis (e.g., designing and evaluating programs, as discussed above).
12. Estimates of Annualized Burden Hours and Costs
The estimates for the number of annualized burden hours are provided in the table below. There are two types of organizations that are required to provide data. The first is the 66 state, territorial, District of Columbia, and directly funded city HDs. The second type of organization providing information are CBOs. The data required by respondents for this ICR include variables for the following NHM&E data sets:
Agency Data
HIV Testing Data
Partner Services (PS) Data (HDs only)
Budget Data (HDs only)
The numbers on the burden table (Table A.12-A) are estimates since new funding opportunity announcements may alter the number and types of services provided at any time. All HDs and CBOs will also receive training on NHM&E. This burden is included.
CBOs generally do not conduct Partner Services beyond identifying index cases, so that burden will be reported only for health departments. Budget data are also only required for HDs.
The calculations for annualized burden are derived from the HD and CBO time needed to search the EvaluationWeb® database for existing records, gather and maintain the data, complete the collection of records, and review the information prior to submission to CDC.
The annual NHNM&E data reporting burden is summarized in the following table. The total estimated annualized hourly burden anticipated for all data collections would be approximately 204,498 hours.
The NHM&E variable set is in Attachment 5a. We are continuing to work with the recipients to keep the burden to a minimum while still obtaining the data necessary for national reporting and program management.
Table A.12-A. Estimated Annualized Burden Hours
Type of Respondents |
Form Name |
Number of Respondents |
Number of Responses per Respondent |
Average Burden per response (in hours) |
Total Burden Hours |
Health departments
|
Health Department Reporting (att 5A) |
66 |
2 |
1,426.5 |
188,298 |
|
Community-Based Organization Reporting (att 5A) |
150 |
2 |
54 |
16,200 |
Total |
|
|
|
|
204,498 |
B. Annualized Cost to Respondent
The collection and reporting of NHM&E data are part of the activities specified in the HIV prevention funding opportunity announcement as part of the funded activities. Any expense incurred collecting and submitting the NHM&E data, above the routine collection of data required to conduct business, is supported by CDC funding. There is no actual cost to the respondent.
The estimated cost to be supported by CDC funding is as follows. For health departments, we used the 2023 annual mean wage ($43.48 per hour / $90,430 annual) for the occupational category “Epidemiologists” to estimate the salary of health department staff who collect NHM&E information. (https://www.bls.gov/oes/current/oes191041.htm)
For CBO staff, we used the 2023 annual mean wage ($25.30 per hour /$52,610 annual) for the occupational category “Community Health Workers.” (https://www.bls.gov/oes/current/oes211094.htm).
Table A.12-B. Annualized Cost to Respondents
Type of Respondents |
Number of Respondents |
Form Name |
Number of Responses per respondent |
Average Burden per Response (in hours) |
Hourly Wage Rate |
Total Respondent Cost |
|
Health jurisdictions |
66 |
Health Department Reporting (Att 5A) |
2 |
1,426.5 |
$43.48 |
$8,187,197.04 |
|
Community-Based Organizations |
150 |
Community-Based Organization Reporting (Att 5A) |
2 |
54 |
$25.30 |
$409,860 |
|
TOTAL |
$8,597,057.04 |
Source: https://www.bls.gov/oes/current/oes_stru.htm
13. Estimates of Other Total Annual Cost Burden to Respondents and Record Keepers
There are no costs to respondents that are not supported by CDC funding under the funding opportunity announcement beyond usual and customary business practices that would be carried out even if NHM&E data collection were not required. The conditions of the cooperative agreements that CDC awards for HIV prevention programs require recipients to conduct evaluation of major program activities, interventions, and services, including data collection on interventions and clients served. Funding opportunity announcements specify that a portion of the funding is to be used for evaluation activities, including data collection. It is the usual and customary business practice of the recipients to gather and maintain HIV prevention program data, complete the collection of records, and review the information prior to submission to CDC. Since the collection of data is a routine and customary practice, recipients that collect NHM&E data should incur little or no net additional costs to respond to this data collection.
Overall, HDs may choose one of the following options in which to enter and submit the required NHM&E data variables:
Directly key-enter data into the EvaluationWeb software provided by CDC at no cost to the HD
Revise their existing HIV prevention information technology system and upload the required NHM&E data in one of the allowed formats into EvaluationWeb®
CBOs are required to directly key-enter data into the EvaluationWeb® software provided by CDC at no cost to the CBO.
Services offered to the recipients by CDC to support NHM&E data collection include training, technical assistance, and continued support to recipients through a help desk, website, and various forms of correspondence. Implementing the EvaluationWeb® software will require no start-up costs for the respondents.
Release of various EvaluationWeb® software versions will be necessary over time, but it is anticipated that EvaluationWeb® and the NHM&E data variables will be essential tools for monitoring and evaluating HIV prevention programs for many years and there will be no cost to the recipients for these updates.
14. Annualized Cost to the Federal Government
The annualized cost to the government is $959,067.20. The NHM&E data collection is a multi-year project expected to be in use for many years. For the purposes of this submission, a three-year life expectancy has been used to estimate the annualized cost to the government.
CDC supports costs for HIV prevention program cooperative agreements using funds budgeted for these purposes. The cooperative agreements for which NHM&E data are collected are CDC-RFA-PS18-1802, Integrated HIV Surveillance and Prevention Programs for Health Departments; CDC-RFA-PS17-1704, Comprehensive High-Impact HIV Prevention Projects for Young Men of Color Who Have Sex with Men and Young Transgender Persons of Color; CDC-RFA-PS20-2010, Integrated HIV Programs for Health Departments to Support Ending the HIV Epidemic in the United States; and CDC-RFA-PS21-2102, Comprehensive High-Impact HIV Prevention Projects for Community-Based Organizations that will be awarded July 1, 2021. Additional expenses will be incurred by CDC for training recipients, providing technical assistance, monitoring and analyzing the submitted NHM&E data, and generating assorted reports. Total costs for these activities, using the Atlanta locality salary schedule, are estimated at $959,067.20 annually (see table below).
Training for recipients is currently available online and is being revised to reflect these revised data requirements. Instruction will include topics such as confidentiality and computer security, evaluation principles, and use of data for program improvement. The base Federal General Schedule 2023 (GS) salary for full-time employees (FTEs) with experience in these areas is estimated to be a GS-13 step 9. It is expected that the equivalent of two FTEs paid $63.13/hour will each expend approximately twenty-five percent (25%) of their time or a total of 1040 hours/FTE annually to oversee these trainings.
Technical assistance will be provided through an e-mail and telephone service center overseen by a CDC FTE. It is expected that the equivalent of two GS-13 step 9 ($63.13 /hour) FTEs will expend approximately twenty-five percent (25%) of working hours (1040 hours) to oversee this service center.
Monitoring, analyzing, and reporting the NHM&E data are projected to require the expertise of the equivalent of two data managers and six data analysts. The data managers would be at the pay scale of GS-13 step 5 ($56.48 /hour) and the data analysts would be at the pay scale of GS-12 step 5 ($47.50 /hour).
Table 14.A Annualized Cost to the Government
Employee Function |
Annual Burden (in hours) |
Hourly Wage Rate |
Annual Cost |
Training |
1,040 |
$63.13 |
$ 65,655.20 |
Technical Assistance |
1,040 |
$63.13 |
$ 65,655.20 |
Data Manager |
4,160 |
$56.48 |
$234,956.80 |
Data Monitoring, Analysis, and Reporting |
12,480 |
$47.50 |
$592,800 |
TOTAL ANNUAL FEDERAL GOVERNMENT COSTS: 959,067.20 |
15. Explanation for Program Changes or Adjustments
There is no change in burden hours. A total 204,498 burden hours per year were approved under the existing ICR covering through October 31, 2024.
The costs above the normal cost of doing business are covered by CDC funding rather than imposing a financial cost on the recipient. All these data collections will be part of HIV prevention programs funded by CDC so that even the hours spent collecting the data are part of the CDC funded activities, so, in effect, there is no burden. These activities should be made visible to OMB through the normal program announcement approval process, so that OMB is aware of the programs that are covered under this ICR.
16. Plans for Tabulation and Publication and Project Time Schedule
Data are being collected under the existing approved ICR and is anticipated to continue semiannually for the 3-year requested approval period without interruption if this ICR is approved.
Analysis is focused on improving program monitoring, conducting national analysis of HIV prevention programs, identifying needs for prevention research and evaluation studies, and responding to data requests from Congress and the Executive Branch. All of these activities are currently in process. Annual reports on the data, starting with reports on the 2009-2010 data, have been produced or are in production for more recent years. NHM&E data will also be analyzed in conjunction with data from other Division of HIV Prevention (DHP) collection systems for enhanced monitoring of the HIV epidemic.
In addition, NHM&E data are being used to improve knowledge of local prevention practices, implementation of effective HIV prevention interventions, adherence to program reporting requirements, and compliance with the National HIV/AIDS Strategy. Reports generated by the system include reports for quality assurance, comparison of planned activities or expenditures to actual activities or expenditures, data for calculating required performance indicators, data on specific interventions, data for contract monitoring, and data for assessing needs. These types of reports are available on the recipient, jurisdiction, or national level.
17. Reason(s) Display of OMB Expiration Date is Inappropriate
Not applicable.
18. Exceptions to Certification for Paperwork Reduction Act (PRA) Submissions 5CFR 1320.3(h)(1)-(10)
There are no exceptions to the certification.
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
File Title | Items to Look for in the Initial Review of an OMB Package |
Author | pax1 |
File Modified | 0000-00-00 |
File Created | 2024-10-27 |