Supporting Statement A_0920-1071_edit 091724

Goal of the study: To enable the CDC to garner customer and stakeholder feedback in an efficient, timely manner, in accordance with our commitment to improving service delivery
Intended use of the resulting data: To improve agency programs.
Methods to be used to collect: Routine customer feedback via online surveys, in-person surveys, focus groups, usability testing, and customer comment cards.
The subpopulation to be studied: Will vary for each gen-IC
How data will be analyzed: Will vary for each gen-IC

Circumstances Making the Collection of Information Necessary

CDC/NCEZID is seeking a three-year revision of GENERIC OMB control No. 0920-1071 to continue collecting routine customer feedback on agency service delivery.

Executive Order 12862 directs Federal agencies to provide service to the public that matches or exceeds the best service available in the private sector. In order to work continuously to ensure that our programs are effective and meet our customers’ needs, the National Center for Emerging and Zoonotic Infectious Diseases, Centers for Disease Control and Prevention (CDC) (hereafter the “Agency”) seeks to obtain OMB approval of a generic clearance to collect qualitative feedback on our service delivery. By qualitative feedback we mean information that provides useful insights on perceptions and opinions, but are not statistical surveys that yield quantitative results that can be generalized to the population of study.

This collection of information is necessary to enable the Agency to garner customer and stakeholder feedback in an efficient, timely manner, in accordance with our commitment to improving service delivery. The information collected from our customers and stakeholders will help ensure that users have an effective, efficient, and satisfying experience with the Agency’s programs. This feedback will provide insights into customer or stakeholder perceptions, experiences and expectations, provide an early warning of issues with service, or focus attention on areas where communication, training or changes in operations might improve delivery of products or services. These collections will allow for ongoing, collaborative and actionable communications between the Agency and its customers and stakeholders. It will also allow feedback to contribute directly to the improvement of program management.

Since the previous renewal in 2021, NCEZID has utilized 0920-1071 nineteen times. The total number of responses was 37,020. The total number of burden hours was 3,902.

Project	Responses	Burden Hours
Project Firstline Training Completion on CDCs TRAINTCEO Systems	28300	1765
DFWED Data System User Feedback Survey	1100	275
HAI/AR Program Multi-Drug Resistant Organism (MDRO) Prevention and Response Needs Assessment Survey	64	96
Understanding Food Safety in Correctional Settings	240	220
Year 6 (2021) Customer Satisfaction Survey for the CDC Antibiotic Resistance (AR) Isolate Bank	700	117
Year 7 (2022) Customer Satisfaction Survey for the CDC Antibiotic Resistance (AR) Isolate Bank	700	117
[2022] The Science Ambassador Fellowship Summer Course Satisfaction Survey [CSELS]	38	6
BEAM Dashboard User Feedback Survey	500	42
DCIPHER External User Satisfaction Survey	400	67
Evaluation of communication between CDC and Association of Refugee Health Coordinators (ARHC) partners during responses in 2021-2022	40	20
HHS Protect User Satisfaction Survey	500	83
Improving Traveler Data Exchange Between Health Departments and CDC Division of Global Migration and Quarantine	40	40
NHSN Facility End User Survey	66	7
Survey of Nursing Homes to Support a Pilot Test of a National Healthcare Safety Network (NHSN) Electronic Health Record (EHR) Implementation Guide (IG)	250	83
Year 8 (2023) Customer Satisfaction Survey for the CDC Antibiotic Resistance (AR) Isolate Bank	700	117
Year 9 (2024) Customer Satisfaction Survey for the CDC Antibiotic Resistance (AR) Isolate Bank	700	117
DCIPHER External User Satisfaction Survey	532	80
SBS Excel Tool for Thematic Analysis Feedback Survey	2000	500
TB Care Finder	150	150

TOTAL	37,020	3,902

Authorizing legislation comes from Section 301 of the PHSA (42 USC 241) (Attachment A).

Purpose and Use of Information Collection

Improving agency programs requires ongoing assessment of service delivery, by which we mean systematic review of the operation of a program compared to a set of explicit or implicit standards, as a means of contributing to the continuous improvement of the program. The Agency will collect, analyze, and interpret information gathered through this generic clearance to identify strengths and weaknesses of current services and make improvements in service delivery based on feedback. The solicitation of feedback will target areas such as timeliness, appropriateness, accuracy of information, courtesy, efficiency of service delivery, and resolution of issues with service delivery. Responses will be assessed to plan and inform efforts to improve or maintain the quality of service offered to the public. If this information is not collected, vital feedback from customers and stakeholders on the Agency’s services will be unavailable.

The Agency will only submit a collection for approval under this generic clearance if it meets the following conditions:

Information gathered will be used only internally for general service improvement and program management purposes and is not intended for release outside of the agency (if released, procedures outlined in Question 16 will be followed);

Information gathered will not be used for the purpose of substantially informing influential policy decisions¹;

Information gathered will yield qualitative information; the collections will not be designed or expected to yield statistically reliable results or used as though the results are generalizable to the population of study;
The collections are voluntary;
The collections are low-burden for respondents (based on considerations of total burden hours, total number of respondents, or burden-hours per respondent) and are low-cost for both the respondents and the Federal Government;
The collections are non-controversial and do not raise issues of concern to other Federal agencies;
Any collection is targeted to the solicitation of opinions from respondents who have experience with the program or may have experience with the program in the near future; and
With the exception of information needed to provide renumeration for participants of focus groups and cognitive laboratory studies, personally identifiable information (PII) is collected only to the extent necessary and is not retained.

If these conditions are not met, the Agency will submit an information collection request to OMB for approval through the normal PRA process.

To obtain approval for a collection that meets the conditions of this generic clearance, a standardized form (Attachment C) will be submitted to OMB along with supporting documentation (e.g., a copy of the comment card). The submission will have automatic approval, unless OMB identifies issues within 5 business days.

The types of collections that this generic clearance covers include, but are not limited to:

Customer comment cards/complaint forms
Small discussion groups
Focus Groups of customers, potential customers, delivery partners, or other stakeholders
Cognitive laboratory studies, such as those used to refine questions or assess usability of a website;
Qualitative customer satisfaction surveys (e.g., post-transaction surveys; opt-out web surveys)
In-person observation testing (e.g., website or software usability tests)

The Agency has established a manager/managing entity to serve for this generic clearance and will conduct an independent review of each information collection to ensure compliance with the terms of this clearance prior to submitting each collection to OMB.

Use of Improved Information Technology and Burden Reduction

If appropriate, agencies will collect information electronically and/or use online collaboration tools to reduce burden.

Efforts to Identify Duplication and Use of Similar Information

No similar data are gathered or maintained by the Agency or are available from other sources known to the Agency.

Impact on Small Businesses or Other Small Entities

Small business or other small entities may be involved in these efforts, but the Agency will minimize the burden on them of information collections approved under this clearance by sampling, asking for readily available information, and using short, easy-to-complete information collection instruments.

Consequences of Collecting the Information Less Frequently

Without these types of feedback, the Agency will not have timely information to adjust its services to meet customer needs.

Special Circumstances Relating to the Guidelines of 5 CFR 1320.5

There are no special circumstances. The information collected will be voluntary and will not be used for statistical purposes.

Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency

In accordance with 5 CFR 1320.8(d), a 60-day notice for public comment was published in the Federal Register on 01/23/2024 (Volume 89, Number 15, Pages4 304-4306) (Attachment B). CDC received two public comments in response to this notice (Attachments D1-D3). One of those comments was substantive, but no contact information was provided so CDC was not able to provide a response. This ICR package addresses the commenter’s concerns.

Explanation of Any Payment or Gift to Respondents

The Agency will not provide payment or other forms of remuneration to respondents of its various forms of collecting feedback. Focus groups and cognitive laboratory studies are the exceptions.

In the case of in-person cognitive laboratory and usability studies, the Agency may provide stipends of up to $40. In the case of in-person focus groups, the Agency may provide stipends of up to $75. If respondents participate in these kinds of studies remotely, via phone, or Internet, any proposed stipend needs to be justified to OMB and must be considerably less than that provided to respondents in in-person studies, who have to travel to the agency or other facility to participate. If such information collections include hard-to-reach groups and the agency plans to offer non-standard stipends, the Agency will provide OMB with additional justifications in the request for clearance of these specific activities.

Protection of the Privacy and Confidentiality of Information Provided by Respondents

If a confidentiality pledge is deemed useful and feasible, the Agency will only include a pledge of confidentiality that is supported by authority established in statute or regulation, that is supported by disclosure and data security policies that are consistent with the pledge, and that does not unnecessarily impede sharing of data with other agencies for compatible confidential use. If the agency includes a pledge of confidentiality, it will include a citation for the statute or regulation supporting the pledge.

Institutional Review Board (IRB) and Justification for Sensitive Questions

Institutional Review Board (IRB)

NCEZID’s Human Subjects Advisor has determined that information collection is not research involving human subjects. IRB approval is not required (Attachment E). Each gen-IC submission will include a separate human subjects determination.

Justification for Sensitive Questions

No questions will be asked that are of a personal or sensitive nature.

Estimates of Annualized Burden Hours and Costs

A. Estimated Annualized Burden Hours

A variety of instruments and platforms will be used to collect information from respondents. The total burden hours requested for the three years (5,000) are based on the number of collections we expect to conduct over the requested period for this clearance.

Type of Collection

No. of Respondents

Annual Frequency per Response

Hours per Response

Total Hours

Online Surveys

3800

30/60

1900

Focus Groups

800

1600

In-person Surveys

1000

30/60

500

Usability testing

1500

30/60

750

Customer comment cards

1000

15/60

250

TOTAL

5,000

B. Estimated Annualized Burden Costs

Estimated total burden costs for the three years are described in the following table:

Type of Collection	Total Burden Hours	Hourly Wage Rate²	Total Respondent Costs
Online Surveys	1900	$31.48	$59,812
Focus Groups	1600	$31.48	$50,368
In-person Surveys	500	$31.48	$15,740
Usability testing	750	$31.48	$23,610
Customer comment cards	250	$31.48	$7,870
TOTAL			$157,400

Estimates of Other Total Annual Cost Burden to Respondents or Record Keepers

No other costs are anticipated.

Annualized Cost to the Government

The anticipated cost to the Federal Government is approximately $50,000.00 annually. These costs are comprised of an estimate of applicable costs, such as operational expenses (e.g., equipment, overhead, printing, postage, and support staff), contractor payments and any other expense that is necessary to collect the information approved under this generic clearance.

Explanation for Program Changes or Adjustments

This Revision includes a request to increase the burden allotment from the previously approved 3,850 hours to 5,000 hours. CDC’s use of this generic has continued to increase since 2015. Increasing the burden would help the Agency continue to garner customer and stakeholder feedback to improve service delivery.

Plans for Tabulation and Publication and Project Time Schedule

Feedback collected under this generic clearance provides useful information, but it does not yield data that can be generalized to the overall population. Findings will be used for general service improvement, but are not for publication or other public release.

Although the Agency does not intend to publish its findings, the Agency may receive requests to release the information (e.g., congressional inquiry, Freedom of Information Act requests). The Agency will disseminate the findings when appropriate, strictly following the Agency's "Guidelines for Ensuring the Quality of Information Disseminated to the Public," and will include specific discussion of the limitation of the qualitative results discussed above.

Reason(s) Display of OMB Expiration Date is Inappropriate

The display of the OMB Expiration date is not inappropriate.

Exceptions to Certification for Paperwork Reduction Act Submissions

There are no exceptions to the certification.

Attachments

Authorizing legislation
60-day notice
Gen-IC request form
Public Comments and Response
Human Subjects Determination

1 As defined in OMB and agency Information Quality Guidelines, “influential” means that “an agency can reasonably determine that dissemination of the information will have or does have a clear and substantial impact on important public policies or important private sector decisions.”

2 Hourly wage rates were based on the BLS May, 2023 wage estimates for all occupations available here: https://www.bls.gov/oes/current/oes_nat.htm

File Type	application/vnd.openxmlformats-officedocument.wordprocessingml.document
Author	Samuel, Lee (CDC/OID/NCEZID)
File Modified	0000-00-00
File Created	2024-09-20

Supporting Statement A_0920-1071_edit 091724

Supporting Statement A_0920-1071_edit 091724.docx

[NCEZID] Generic Clearance for the Collection of Qualitative Feedback on Agency Service Delivery

OMB: 0920-1071

Request for OMB approval of a Revision Information Collection

4/18/24

Supporting Statement A

Table of Contents

Circumstances Making the Collection of Information Necessary

Purpose and Use of Information Collection

Use of Improved Information Technology and Burden Reduction

Efforts to Identify Duplication and Use of Similar Information

Impact on Small Businesses or Other Small Entities

Consequences of Collecting the Information Less Frequently

Special Circumstances Relating to the Guidelines of 5 CFR 1320.5

Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency

Explanation of Any Payment or Gift to Respondents

Protection of the Privacy and Confidentiality of Information Provided by Respondents

Institutional Review Board (IRB) and Justification for Sensitive Questions

Estimates of Annualized Burden Hours and Costs

Estimates of Other Total Annual Cost Burden to Respondents or Record Keepers

Annualized Cost to the Government

Explanation for Program Changes or Adjustments

Plans for Tabulation and Publication and Project Time Schedule

Reason(s) Display of OMB Expiration Date is Inappropriate

Exceptions to Certification for Paperwork Reduction Act Submissions

Attachments