OSTLTS Information Collection Request
OMB No. 0920-1078
Submitted: 9/15/2017
Program Official/Project Officer
Name: Robyn Sobelson, PhD
Title: Behavioral Scientist
CIO: Office for State, Tribal, Local, and Territorial Support (OSTLTS)
Division: Division of Public Health Performance Improvement (DPHPI)
Branch: Applied Systems Research and Evaluation Branch (ASREB)
Address: 1825 Century Center
Phone: 404.498.0227
Fax: 404-929-2749
Email: [email protected]
Section B – Data Collection Procedures 3
1. Respondent Universe and Sampling Methods 3
2. Procedures for the Collection of Information 3
3. Methods to Maximize Response Rates Deal with Nonresponse 4
4. Test of Procedures or Methods to be Undertaken 5
5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data 5
Data will be collected via two distinct data collection instruments from the following distinct respondent groups:
PHAP Host Site Supervisors: individuals who serve as host site supervisors of associates currently participating in PHAP will be invited to participate. Respondents will be employees of state, tribal, local, territorial, or federal government agencies or non-governmental organizations. Official titles will vary; examples of respondent titles include (but are not limited to): epidemiologist, health department director, TB control program director, quarantine officer, health program director. Up to 400 respondents will be invited to participate each time the survey is deployed (see Attachment D: PHAP Host Site Supervisor Survey Respondent Information).
PHAP Alumni: alumni for whom the PHAP evaluation team has a valid, personal email address will be invited to participate. Although the PHAP program was initiated in 2007 and continues today, valid personal email addresses were not systematically collected until 2014. Therefore, the primary respondent pool for the PHAP Alumni Assessment will focus on alumni who graduated in 2014 and beyond. Each year, the PHAP program enrolls up to 200 associates. Given that the Alumni Survey will be administered at different time periods to different cohorts (1 year, 3 years, and 5 years post-graduation), the maximum number of potential respondents during a given year will not exceed 600 respondents.
The data collection efforts described concern the entire universe of potential respondents for both data collection instruments. As collecting data from the entire population of respondents is feasible, a sampling strategy will not be employed.
Data collection procedures by instrument are described below:
PHAP Host Site Supervisor Survey: The PHAP Host Site Supervisor Survey will be deployed every year to all active PHAP Host Site Supervisors. The decision to deploy the survey every year was purposeful, to capture the perspectives of supervisors as associates rotate in and out of the program. For each deployment of the survey, the following steps will be followed:
A list of all active PHAP host site supervisors will be obtained via the PHAP program staff (will include name, email address, host site name, host site type).
The web-based survey (see Attachment E: PHAP Host Site Supervisor Survey Screenshots) will be sent to all active host site supervisors via an email invitation (see Attachment F: PHAP Host Site Supervisor Survey Email Invitation).
Host Site Supervisors will have 10 business days to respond to the web-based survey.
Because the survey is anonymous, up to three reminder emails will be sent prior to the survey close date to all respondents encouraging participation (see Attachments G-I: PHAP Host Site Supervisor Survey Reminder Emails).
The PHAP evaluation team will close the survey no more than 20 business days after initial administration.
PHAP Alumni Survey: Data will be collected through an online data collection instrument distributed to all individuals within the respondent universe at pre-determined data collection administration points: 1 year, 3 years, and 5 years post-graduation for a PHAP cohort (note: given that OMB clearance will last for three years, it will be necessary to submit an ICR extension to fulfill data collection at 5 years post-PHAP graduation). Respondents will include PHAP alumni for whom the PHAP evaluation team has valid, personal email addresses. For each deployment of the survey, the following steps will be followed:
An introductory email notification (see Attachment J: PHAP Alumni Survey Email Invitation) will be sent to all potential respondents informing them of the planned data collection, announcing the dates the data collection will remain open, and providing a link to the online instrument (see Attachment K: PHAP Alumni Survey Screenshots).
Respondents will have a period of 20 days to complete the instrument.
Two reminder emails will be sent to non-responders 1 week following survey distribution and 1 day prior to the closure of the data collection window (Attachments L-M: PHAP Alumni Survey Reminder Emails).
The PHAP evaluation team will close the survey no more than 20 business days after initial administration.
All identifying information will be kept secure, stored in a password protected file, and will only be accessible by the PHAP evaluation team. Data collected will be downloaded into Microsoft Excel for analysis. No identifiable information describing respondents will be included in the analyzed data and aggregate reports.
Advance notification via the email invitation to the data collection instruments will be utilized to maximize response rates. The email invitation introductions will contain the purpose of the information collections and directions for completing the web-based data collection instruments. The introduction will emphasize the importance of input. The web-based format is expected to increase the response rate because it will ease administration of the assessment. Additionally reminder emails will be utilized to maximize response rates.
Specifically concerning the PHAP Alumni Survey, prior to associates’ departure from PHAP, the PHAP evaluation team will notify associates of plans to contact alumni to track career progression for the purposes of demonstrating evidence of program outcomes. Associates will have the option of providing personal email addresses to the evaluation team for the purpose of follow-up contact. As the respondent pool will consist of those willing to provide personal contact information for the purpose of continued follow-up, it is expected that the respondent pool will be open to responding to the data collection instrument when it is distributed. Given that data will be collected from alumni who are volunteering to complete the PHAP Alumni Assessment, it is reasonable to expect that the response rates will progressively decline as more time passes between when an alumnus graduated from PHAP and when he/she receives the Alumni Survey. That is, it is expected that the response rate for the Alumni Survey administered 1 year post-graduation will be better than the Alumni Assessment administered 3 years post-graduation.
Pilot testing was conducted for each data collection instrument:
PHAP Host Site Supervisor Survey: The estimate for burden hours is based on a pilot test of the web-based survey by two public health professionals. The maximum time for completion, including time for reviewing instructions and completing the survey was 20 minutes; the minimum amount of time was 11 minutes. To generate the estimate for the burden table calculations, the maximum time was used (i.e., 20 minutes).
PHAP Alumni Survey: The Alumni Survey was piloted with 5 public health professionals to assess the clarity of the questions and response categories and estimated time required to complete the data collection. The average time to complete the survey was approximately 7.5 minutes (range: 6-8 minutes). For the purposes of estimating burden hours, the upper limit of this range (i.e., 8 minutes) is used.
The plans for statistical analyses for this assessment were developed by CDC staff in OSTLTS/Division of Public Health Performance Improvement (DPHPI)/Applied Systems Research and Evaluation Branch (ASREB). Data collection will be supported by CDC/OSTLTS/DPHPI/ASREB staff. The following individuals support this effort.
Robyn Sobelson, PhD
Behavioral Scientist, Applied Systems Research & Evaluation Branch (ASREB)
Division of Public Health Performance Improvement (DPHPI)
Office for State, Tribal, Local, & Territorial Support (OSTLTS)
Centers for Disease Control and Prevention (CDC)
1825 Century Center - Office 4024, MS-E-70
Atlanta, GA 30345
Office: 404.498.0227
Mobile: 404.434.9983
Corinne J. Wigington, MPH
Health Scientist, Applied Systems Research and Evaluation Branch (ASREB)
Division of Public Health Performance Improvement (DPHPI)
Office for State, Tribal, Local and Territorial Support (OSTLTS)
Centers for Disease Control and Prevention (CDC)
1825 Century Center - Office 4024, MS-E-70
Atlanta, GA 30345
Email: [email protected]
Office: 404.498.0223
Cell: 404.574.3497
Adzua Gilliam, MS
Health Scientist, Applied Systems Evaluation and Research Branch
Division of Public Health Performance Improvement
Office for State, Tribal, Local and Territorial Support
Centers for Disease Control and Prevention
1825 Century Center, MS E-70
Atlanta, Georgia 30345
Email: [email protected]
Office: 404-498-0338
Attachment D: PHAP Host Site Supervisor Survey Respondent Information
Attachment E: PHAP Host site Supervisor Survey Screen shots
Attachment F: PHAP Host site Supervisor Survey Invitation Email
Attachment G: PHAP Host Site Supervisor Survey Reminder Email
Attachment H: PHAP Host Site Supervisor Survey Reminder Email 2
Attachment I: PHAP Host Site Supervisor Survey Final Reminder
Attachment J: PHAP Alumni Survey Email Invitation
Attachment K: PHAP Alumni Survey Screen shots
Attachment L: PHAP Alumni Survey Reminder Email
Attachment M: PHAP Alumni Survey Reminder Email 2
Page
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | CDC User |
| File Modified | 0000-00-00 |
| File Created | 2021-01-21 |