Data Collection for Evaluation of Education, Communication, and Training Activities for the Division of Global Migration and Quarantine
Request for OMB Approval of a “Generic Clearance” Data Collection
Statement B
National Center for Emerging and Zoonotic Infectious Diseases
Centers for Disease Control and Prevention
1600 Clifton Road, N.E., MS D76
Fax: (404) 248-4146
Email: [email protected]
TABLE OF CONTENTS
PART B. COLLECTION OF INFORMATION EMPLOYING STATISTICAL METHODS 3
B.1. Respondent Universe and Sampling Methods 3
B.2. Procedures for the Collection of Information 3
B.3. Methods to Maximize Response Rates and Deal with Non-response 5
B.4. Test of Procedures or Methods to be Undertaken 6
B.5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data 7
Data Collection for Evaluation of Education, Communication, and Training Activities
for the Division of Global Migration and Quarantine
A Generic Clearance Submission
PART B. COLLECTION OF INFORMATION EMPLOYING STATISTICAL METHODS
B.1. Respondent Universe and Sampling Methods
Evaluation research participants will include refugees, immigrants, migrants, expatriates, international travelers, travel industry partners, emergency responders, healthcare providers, non-profit agencies, importers, school officials and staff, business owners and employers, customs brokers and forwarders, childcare providers, state and local health department staff, and the general public. Both purposive and probabilistic samples will be employed for these information collections.
In some cases, purposive samples of respondents will be selected to maximize diversity across demographic subgroups (e.g., age, education level, gender). In other instances, samples will be drawn to include specific characteristics dictated by the nature of hard-to-reach target groups (e.g., immigrants and refugees). For example, when assessing the information needs of immigrant populations, it may be important to select the immigrants based on their country of origin, language, or dialect.
Probabilistic procedures will be used when there is a desire to constitute a representative sample of a population. As an example, a systematic random sample of the U.S. public might be contacted to assess their perceptions about keeping their children home from school during an influenza pandemic.
B.2. Procedures for the Collection of Information
Due to the diverse nature of the Division of Global Migration and Quarantine’s (DGMQ) target audiences and wide variety of public health issues, DGMQ plans to use both qualitative and quantitative information collection methods. Qualitative methods are often used for more exploratory research purposes. These procedures generally rely upon small samples and collect information in open-ended formats. In these studies, samples will be of sufficient size to usefully inform decisions about the development, refinement, implementation and effectiveness of communication, education, and training activities. In contrast, quantitative methods maximize the generalizability of findings by employing large randomly-selected samples and collecting information using closed-ended response formats. Sample sizes for such collections are described below. DGMQ will obtain at least an 80% response rate for each information collection.
Three distinct data collection procedures will be used under this package. Each proposed evaluation project will submit the tools used for data collection, including screenshots of web-based surveys, in the statement provided to OMB.
Focus Groups and Large Group Discussions
Participants will be identified and recruited in accordance with the specific research purpose of the evaluation project. For example, in some instances individuals will be recruited from a variety of geographic regions (e.g., Northeast, South, Midwest, and West Coast) and in both large and small cities in order to maximize the diversity of the sample. As many as 2,500 respondents are anticipated to take part in focus groups or large group discussions each year.
Participants will be recruited using proprietary databases of professional conferences, professional organizations, commercial focus group companies, and other sources. Eligibility criteria will be established for all focus group and large group discussion participants, and potential participants will be screened using a telephone interview or self-administered screening form. Each proposed activity will submit an application for IRB review and approval, which will outline their procedure for participant consent.
Focus group discussions or large group discussions will occur under the direction of a trained moderator. The verbal discussion that ensues will be partly directed by the moderator and partly by the comments of other participants (See Appendix E for a Sample Focus Group Discussion Guide). These discussions may occur in-person, through web-interface or by telephone.
Interviews
Participants will be identified and recruited in accordance with the specific research purpose of the evaluation project. For example, in some instances individuals will be recruited based on their profession (such as travel medicine doctors or state health department employees). As many as 1,000 respondents may take part in an interview each year.
Similar to the focus groups, participants will be recruited using proprietary databases of professional organizations, commercial focus group companies, and other sources. Eligibility criteria will be established for all interview participants, and potential participants will be screened using a telephone interview or self-administered screening form. Each proposed evaluation project will submit an application for IRB review and approval, which will outline their procedure for participant consent.
Interviews will be conducted by trained interviewers, in-person, or over the telephone. The conversation that ensues will be directed by the interviewer, but the content and focus will depend, in part, on the responses of the interviewee (See Appendix F for a Sample of an Interview Guide).
Sample surveys
Information collections may employ large-sample self-administered mail surveys, telephone surveys, in-person-interviews, or electronic surveys (See Appendix G for a Sample Survey). As many as 7,500 respondents may take part in a survey each year. Sampling frames will be created by a variety of methods that will include solicitation through the use of conference participant lists and commercial survey panels, or other means as appropriate for the target population. Potential participants will be randomly selected from the sampling frame and screened for appropriate demographic or other characteristics as indicated by the research purpose. Each proposed evaluation project will submit an application for IRB review and approval, which will outline their procedure for participant consent.
Estimation procedures
All data analysis will be conducted under the advice of a statistician/data analyst as needed, and will involve estimation of descriptive statistics and regression analysis. Linking collected data to existing data sources by non-personal identifiers (e.g., state, county, city name) may be used to increase the overall utility of a proposed data collection. When required, the planned sample sizes will also permit sub-analyses that may include analyzing knowledge, attitude, and belief disparities among different populations. Corrections will be made for over/under sampling, non-response, non-standard distributions, etc.
Degree of accuracy needed for the purpose described in the justification
DGMQ conducts evaluation research in order to plan, implement, and demonstrate outcomes and impact of health communication, education, and training activities. The use of scientifically sound sampling methods will ensure that DGMQ collects quality data to inform the division of the effectiveness of their programs and services.
Unusual problems requiring specialized sampling procedures
Unusual problems requiring specialized sampling are expected to be rare and will be disclosed in individual requests under this generic clearance.
Any use of periodic (less frequent than annual) data collection cycles to reduce burden
Use of periodic (less frequent than annual) data collection to reduce burden is likely for most data collection as part of this generic clearance. There may be a need for recurrent data collection, dependent upon purpose of data collection, which will be disclosed in individual requests under this generic clearance. Use of periodic data collection will be encouraged and will be described in each proposed evaluation project. Justification and description for more frequent data collection will be provided if it applies to the proposed evaluation project.
B.3. Methods to Maximize Response Rates and Deal with Non-response
The following are the examples of the procedures that have proven effective in previous studies and will be used when possible to obtain at least an 80% response rate:
Informing respondents of what the evaluation project is asking, why it is being asked, who will see the results, and how the results will be used, as well as discussing how respondents will benefit from the results and how the findings will be put into action.
Using bilingual and bicultural interviewers and culturally and linguistically appropriate data collection instruments.
A token of appreciation for a respondent’s time and interest may be given to research participants.
Addressing data security and anonymity with respondents.
Minimizing the time needed for participation in the evaluation project.
Informing respondents how much time the evaluation project will take so that they know what to expect.
Utilizing deadlines, reminders, and follow-ups to remind respondents and encourage participation.
Providing easy access to research instruments, regardless of method being utilized. When appropriate for the audience being studied, research instruments will be designed to be easily accessed by electronic means, from a link in an e-mail or on a website.
Potential respondents will be informed about the importance of these evaluation projects and encouraged to participate through a variety of methods, including newsletters from professional associations or community organizations and letters of support from key individuals.
When appropriate, a dedicated toll-free number and e-mail account will be established at CDC or a contractor’s office to allow potential respondents to confirm a research activity’s legitimacy, ask questions, and voice concerns.
For telephone interviews, outgoing calls that result in no answer, a busy signal, or an answering machine will be automatically rescheduled for subsequent attempts.
A phone or in-person interview will be arranged in case of non-response to initial web-based distribution of questionnaires.
Over-sampling if necessary to address potential for non-response.
B.4. Test of Procedures or Methods to be Undertaken
Focus Groups, Large Group Discussions, and Interviews
Before each information collection is implemented, instruments and method of data collection will be pilot tested. Lessons from the pilot test will be identified, and changes will be incorporated into the instrument and method, as necessary. All pre-tests will involve no more than nine individuals unless OMB clearance is sought for more than nine participants.
Surveys
The tests proposed for survey instruments include several procedures as outlined by Michael W. Eysenck (1) in A Handbook of Cognitive Psychology. Procedures that may be used include:
Developing protocols, scenarios, and question probes--follow-up questions used to gain more information about respondents' strategies for answering questions.
Concurrent think-aloud interview--respondents think aloud while answering questions and responses are probed extensively.
Retrospective think-aloud interview--respondents answer all questions first, then are asked how they arrived at their answers.
Sorting and ranking tasks--respondents sort lists or similar items into groups that go together and rank the items according to a specified scale.
Confidence ratings--respondents relate the degree of confidence they have in the accuracy of their answers.
Memory cues--interviewer reads terms which are intended as aids to recall.
Response latency--measurement of the elapsed time between the presentation of the question and the respondent’s answer.
Paraphrasing--respondents repeat the questions in their own words.
B.5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data
The following individuals, including contractors, who may be chosen to pre-test and conduct information collections, will be available to provide advice about the design of statistical and sampling procedures undertaken as part of these data collection activities:
Clive Brown, MBBS, Associate Director for Science, Division of Global Migration and Quarantine
Nicole Cohen, MD, Associate Chief for Science, Quarantine and Border Health Services Branch, Division of Global Migration and Quarantine
Noelle Molinari, PhD, Mathematical Statistician, Quarantine and Border Health Services Branch, Division of Global Migration and Quarantine
Christine Prue, PhD, Health Communication Specialist, Office of the Director, National Center for Emerging and Zoonotic Infectious Diseases
Margaret Coleman, PhD, Economist, Office of the Director, Division of Global Migration and Quarantine
Jianrong Shi, Statistician, Office of the Director, Division of Global Migration and Quarantine
DGMQ will determine if additional consultation is required and will report any consultants, as well as any individuals collecting and/or analyzing the data in the individual packages.
1. Eysenck MW. A handbook of cognitive psychology. London: Lawrence Erlbaum Associates, Ltd; 1984.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | wernerk |
| File Modified | 0000-00-00 |
| File Created | 2021-01-31 |