60 Day FRN

Attachment B: 60-Day Federal Register Notice
Federal Register / Vol. 83, No. 41 / Thursday, March 1, 2018 / Notices
Law 92–463. The grant applications and
the discussions could disclose
confidential trade secrets or commercial
property such as patentable material,
and personal information concerning
individuals associated with the grant
applications, the disclosure of which
would constitute a clearly unwarranted
invasion of personal privacy.
Name of Committee: Disease,
Disability, and Injury Prevention and
Control Special Emphasis Panel (SEP)
IP18–002, Economic Studies of
Immunization Policies and Practices.
Date: April 3, 2018.
Time: 10:00 a.m.–3:00 p.m., EDT.
Place: Teleconference.
Agenda: To review and evaluate grant
applications.
FOR FURTHER INFORMATION CONTACT:
Gregory Anderson, MS, MPH, Scientific
Review Officer, CDC, 1600 Clifton Road
NE, Mailstop E60, Atlanta, Georgia
30333, (404) 718–8833, [email protected].
The Director, Management Analysis
and Services Office, has been delegated
the authority to sign Federal Register
notices pertaining to announcements of
meetings and other committee
management activities, for both the
Centers for Disease Control and
Prevention and the Agency for Toxic
Substances and Disease Registry.
Elaine L. Baker,
Director, Management Analysis and Services
Office, Centers for Disease Control and
Prevention.
[FR Doc. 2018–04134 Filed 2–28–18; 8:45 am]
BILLING CODE 4163–18–P

DEPARTMENT OF HEALTH AND
HUMAN SERVICES
Centers for Disease Control and
Prevention
[60Day–18–0222; Docket No. CDC–2018–
0014]

Proposed Data Collections Submitted
for Public Comment and
Recommendations
AGENCY: Centers for Disease Control and

Prevention (CDC), Department of Health
and Human Services (HHS).
ACTION: Notice with comment period.

SUMMARY: The Centers for Disease

Control and Prevention (CDC), as part of
its continuing effort to reduce public
burden and maximize the utility of
government information, invites the
general public and other Federal
agencies the opportunity to comment on
a proposed and/or continuing
information collection, as required by
the Paperwork Reduction Act of 1995.

This notice invites comment on a
proposed information collection project
titled the Collaborating Center for
Questionnaire Design and Evaluation
Research (CCQDER), formerly the
Questionnaire Design Research
Laboratory (QDRL), generic clearance
request, which encompasses general
questionnaire development, pre-testing,
and measurement-error reduction
activities to be carried out in 2018–
2020.
DATES: CDC must receive written

comments on or before April 30, 2018.
ADDRESSES: You may submit comments,

identified by Docket No. CDC–2018–
0014 by any of the following methods:
 Federal eRulemaking Portal:
Regulations.gov. Follow the instructions
for submitting comments.
 Mail: Leroy A. Richardson,
Information Collection Review Office,
Centers for Disease Control and
Prevention, 1600 Clifton Road NE, MS–
D74, Atlanta, Georgia 30329.
Instructions: All submissions received
must include the agency name and
Docket Number. CDC will post, without
change, all relevant comments to
Regulations.gov.
Please note: Submit all comments
through the Federal eRulemaking portal
(regulations.gov) or by U.S. mail to the
address listed above.
FOR FURTHER INFORMATION CONTACT: To
request more information on the
proposed project or to obtain a copy of
the information collection plan and
instruments, contact Leroy A.
Richardson, Information Collection
Review Office, Centers for Disease
Control and Prevention, 1600 Clifton
Road NE, MS–D74, Atlanta, Georgia
30329; phone: 404–639–7570; Email:
[email protected].
SUPPLEMENTARY INFORMATION: Under the
Paperwork Reduction Act of 1995 (PRA)
(44 U.S.C. 3501–3520), Federal agencies
must obtain approval from the Office of
Management and Budget (OMB) for each
collection of information they conduct
or sponsor. In addition, the PRA also
requires Federal agencies to provide a
60-day notice in the Federal Register
concerning each proposed collection of
information, including each new
proposed collection, each proposed
extension of existing collection of
information, and each reinstatement of
previously approved information
collection before submitting the
collection to the OMB for approval. To
comply with this requirement, we are
publishing this notice of a proposed
data collection as described below.
The OMB is particularly interested in
comments that will help:

8875

1. Evaluate whether the proposed
collection of information is necessary
for the proper performance of the
functions of the agency, including
whether the information will have
practical utility;
2. Evaluate the accuracy of the
agency’s estimate of the burden of the
proposed collection of information,
including the validity of the
methodology and assumptions used;
3. Enhance the quality, utility, and
clarity of the information to be
collected; and
4. Minimize the burden of the
collection of information on those who
are to respond, including through the
use of appropriate automated,
electronic, mechanical, or other
technological collection techniques or
other forms of information technology,
e.g., permitting electronic submissions
of responses.
5. Assess information collection costs.
Proposed Project
The Collaborating Center for
Questionnaire Design and Evaluation
Research (CCQDER) (OMB Control
Number 0920–0222, Expiration 07/31/
2018)—Revision—National Center for
Health Statistics (NCHS), Centers for
Disease Control and Prevention (CDC).
Background and Brief Description
Section 306 of the Public Health
Service (PHS) Act (42 U.S.C. 242k), as
amended, authorizes that the Secretary
of Health and Human Services (DHHS),
acting through NCHS, shall undertake
and support (by grant or contract)
research, demonstrations, and
evaluations respecting new or improved
methods for obtaining current data to
support statistical and epidemiological
activities for the purpose of improving
the effectiveness, efficiency, and quality
of health services in the United States.
The Collaborating Center for
Questionnaire Design and Evaluation
Research (CCQDER) is the focal point
within NCHS for questionnaire and
survey development, pre-testing, and
evaluation activities for CDC surveys
(such as the NCHS National Health
Interview Survey, OMB No. 0920–0214)
and other federally sponsored surveys.
NCHS is requesting 3 years of OMB
Clearance for this generic submission.
The CCQDER and other NCHS
programs conduct cognitive interviews,
focus groups, in-depth or ethnographic
interviews, usability tests, field tests/
pilot interviews, and experimental
research in laboratory and field settings,
both for applied questionnaire
development and evaluation as well as
more basic research on measurement
errors and survey response.

8876

Federal Register / Vol. 83, No. 41 / Thursday, March 1, 2018 / Notices

Various techniques to evaluate
interviewer administered, selfadministered, telephone, Computer
Assisted Personal Interviewing (CAPI),
Computer Assisted Self-Interviewing
(CASI), Audio Computer-Assisted SelfInterviewing (ACASI), and web-based
questionnaires are used.
The most common questionnaire
evaluation method is the cognitive
interview. These evaluations are
conducted by the CCQDER. The
interview structure consists of
respondents first answering a draft
survey question and then providing
textual information to reveal the
processes involved in answering the test
question. Specifically, cognitive
interview respondents are asked to
describe how and why they answered
the question as they did. Through the
interviewing process, various types of
question-response problems that would
not normally be identified in a
traditional survey interview, such as
interpretive errors and recall accuracy,
are uncovered. By conducting a
comparative analysis of cognitive
interviews, it is also possible to
determine whether particular
interpretive patterns occur within
particular sub-groups of the population.
Interviews are generally conducted in
small rounds totaling 40–100
interviews; ideally, the questionnaire is
re-worked between rounds, and
revisions are tested iteratively until
interviews yield relatively few new
insights.
Cognitive interviewing is inexpensive
and provides useful data on
questionnaire performance while

minimizing respondent burden.
Cognitive interviewing offers a detailed
depiction of meanings and processes
used by respondents to answer
questions—processes that ultimately
produce the survey data. As such, the
method offers an insight that can
transform understanding of question
validity and response error.
Documented findings from these studies
represent tangible evidence of how the
question performs. Such documentation
also serves CDC data users, allowing
them to be critical users in their
approach and application of the data.
In addition to cognitive interviewing,
a number of other qualitative and
quantitative methods are used to
investigate and research measurement
errors and the survey response process.
These methods include conducting
focus groups, usability tests, in-depth or
ethnographic interviews, and the
administration and analysis of questions
in both representative and nonrepresentative field tests. Focus groups
are conducted by the CCQDER. They are
group interviews whose primary
purpose is to elicit the basic
sociocultural understandings and
terminology that form the basis of
questionnaire design. Each group
typically consists of one moderator and
4 to 10 participants, depending on the
research question. In-depth or
ethnographic interviews are one-on-one
interviews designed to elicit the
understandings or terminology that are
necessary for question design, as well as
to gather detailed information that can
contribute to the analysis of both
qualitative and quantitative data.

Usability tests are typically one-on-one
interviews that are used to determine
how a given survey or information
collection tool functions in the field,
and how the mode and layout of the
instrument itself may contribute to
survey response error and the survey
response process.
In addition to these qualitative
methods, NCHS also uses various tools
to obtain quantitative data, which can
be analyzed alone or analyzed alongside
qualitative data to give a much fuller
accounting of the survey response
process. For instance, phone, internet,
mail, and in-person follow-up
interviews of previous NCHS survey
respondents may be used to test the
validity of survey questions and
questionnaires and to obtain more
detailed information that cannot be
gathered on the original survey.
Additionally, field or pilot tests may be
conducted on both representative and
non-representative samples, including
those obtained from commercial survey
and web panel vendors. Beyond looking
at traditional measures of survey errors
(such as item missing rates and nonresponse, and don’t know rates), these
pilot tests can be used to run
experimental designs in order to capture
how different questions function in a
field setting.
Similar methodology has been
adopted by other federal agencies, as
well as by academic and commercial
survey organizations. There are no costs
to respondents other than their time.
The total estimated annual burden
hours are 23,350.

ESTIMATED ANNUALIZED BURDEN HOURS
Type of respondents

Individuals or households
Individuals or households
Individuals or households
Individuals or households

Form name

Number of
respondents

Number of
responses per
respondent

Average
burden per
response
(in hours)

Total
burden
(in hours)

.................
.................
.................
.................

Eligibility Screening ..........................
Questionnaire Development Studies
Respondent Data Collection Sheet ..
Focus groups ...................................

4,000
7,300
7,300
100

1
1
1
1

5/60
55/60
5/60
1.5

333
6,692
608
150

Total ...........................................

...........................................................

........................

........................

........................

7,783

Leroy A. Richardson,
Chief, Information Collection Review Office,
Office of Scientific Integrity, Office of the
Associate Director for Science, Office of the
Director, Centers for Disease Control and
Prevention.
[FR Doc. 2018–04152 Filed 2–28–18; 8:45 am]
BILLING CODE 4163–18–P