OMB Memo

Generic Information Collection Request

Cognitive Testing of National Survey of Children’s Health Questionnaire

Request: The U.S. Census Bureau plans to conduct additional research under the generic clearance for questionnaire pretesting research (OMB number 0607-0725). We propose to conduct cognitive interviews to pretest the revised topical questionnaires for the National Survey of Children’s Health (NSCH). We are seeking approval for this project.

Background: The National Survey of Children’s Health (NSCH), is conducted by the Census Bureau and sponsored by the Health Resources and Services Administration (HRSA). The NSCH is conducted using self-administered paper and web modes. The survey first employs a screener instrument (NSCH-S1) and then a child is randomly selected to be the focus of a main topical questionnaire. The three topical questionnaires collect detailed information about children who are aged 0-5 (NSCH-T1), 6-11 (NSCH-T2), and 12-17 (NSCH-T3). The Census Bureau’s Demographic Statistical Methods Division (DSMD) Survey Methodology (SM) team was tasked with enhancing these survey instruments and evaluating new content for the topical questionnaires in preparation for the upcoming survey cycle. The SM team updated the topical questionnaires based on an expert review of the current versions and the new content requested by HRSA. The next step is to conduct cognitive interviews to evaluate how well the revised materials work and to identify any ways they may be improved.

Purpose: The purpose of this research is to interview adults from the general U.S. population who have children within each of the age ranges covered by the three topical questionnaires to assess their understanding of the questions and response options as presented in the proposed revised NSCH survey instruments. In the cognitive interviews, we will assess the clarity and potential effectiveness of the revised instruments and identify respondent issues with comprehension or interpretation, with the goal of producing valid survey items that minimize the potential for measurement error attributable to the questions themselves. The results of the cognitive interviews will influence decisions about final content and wording of the topical questionnaires for the next NSCH survey cycle.

Population of Interest: Participants will be screened during the study recruitment effort to ensure they have children within the target age ranges of each of the topical questionnaires. This will allow testing of the NSCH-T1 questionnaire with participants whose reference child is aged 0-5, the NSCH-T2 questionnaire with a reference child aged 6-11 and the NSCH-T3 questionnaire with a reference child aged 12-17.

Language: The interviews will be conducted in English.

Timeline: Cognitive interviews will be conducted from August 29, 2019 to December 4, 2019.

Project scope: The cognitive testing of the proposed revisions to the NSCH topical questionnaires will be carried out according to the schedule described in Table 1.

Table 1. Estimated Project Schedule

Recruiting (Ongoing)	Monday 8/26 - Monday 11/25
Conduct Cognitive Interviews	Thursday, 8/29 - Wednesday 12/4
Data Analysis – Preliminary Results	Thursday 12/5 - Tuesday 12/10
Develop Final Content Recommendations	Thursday 12/12 - Monday 12/30
Deliver Report	Tuesday 12/31

General Protocol: Participants will be asked to review one of the topical questionnaires (NSCH-T1, NSCH-T2, or NSCH-T3), either using the paper questionnaire or the web instrument. Those who participate in the web mode will see a few questions from the screener survey before navigating to the topical survey. Those participating in the paper mode will only see the content of the topical questionnaire. Participants will be asked to think aloud. We will use concurrent and retrospective probing to get a full understanding of the participant’s thought processes and interpretations of specific terminology and perceptions of specific elements of the survey. After completing the task, each participant will be asked debriefing questions. All interviews will be audio-recorded to facilitate a summary of the results. Participants will be asked to sign consent forms and for permission to be recorded.

Sample: A total of 54 participants will be interviewed over two rounds (27 per round) in the Washington, DC, and Baltimore, MD metropolitan areas and Northern AZ. Participants will be screened during the study recruitment to ensure they have children within the target age ranges of the topical questionnaires. DSMD SM researchers will conduct up to 12 interviews per round using the NSCH-T1 questionnaire, up to 3 interviews per round using the NSCH-T2 questionnaire, and up to 12 interviews per round using the NSCH-T3 questionnaire.

Recruitment: We will use a multi-pronged strategy to recruit participants, such as posting ads on Craigslist, distributing flyers, and using personal networks. While not nationally representative, an attempt will be made to recruit participants with varying demographic characteristics (e.g., sex, education, age, race and ethnicity).

Use of Incentive: Due to the length and complexity of the task as well as the necessity to travel to test locations, we plan to offer an incentive of $40 to offset the costs of participation, such as travel and parking.

Below is a list of materials to be used in this research.

1. NSCH Screener Survey

2. NSCH T1_Cognitive Interviewing Version

3. NSCH T2_Cognitive Interviewing Version

4. NSCH T3_Cognitive Interviewing Version

Length of interview: Based on past experience with similar pretesting efforts it requires four screener conversations to recruit one participant. Each screener conversation lasts approximately three minutes. We estimate it will take 11 hours to screen and recruit 54 participants. We estimate it will take 60 minutes per participant to complete the cognitive interview. For 54 participants, the estimated burden for the interviews is therefore 54 hours, bringing the total burden to no more than 65 hours with recruitment.

The contact person for questions regarding data collection and statistical aspects of the design of this research is listed below:

M. Christopher Stringer

Demographic Statistical Methods Division

U.S. Census Bureau

Washington, D.C. 20233

[email protected]

2