OMB Memo

Generic Information Collection Request

Cognitive Testing of National Survey of Children’s Health Questionnaire

Request: The U.S. Census Bureau plans to conduct additional research under the generic clearance for questionnaire pretesting research (OMB number 0607-0725). We propose to conduct cognitive interviews to pretest the revised screener and topical questionnaires for the National Survey of Children’s Health (NSCH). We are seeking approval for this project.

Background: The National Survey of Children’s Health (NSCH), is conducted by the Census Bureau and sponsored by the Health Resources and Services Administration (HRSA). The NSCH is conducted using self-administered paper and web modes. The survey first employs a screener instrument (NSCH-S1) and then a child is randomly selected to be the focus of a main topical questionnaire (Child and Adolescent Health Measurement Initiative, 2017). The three topical questionnaires collect detailed information about children who are aged 0-5 (NSCH-T1), 6-11 (NSCH-T2), and 12-17 (NSCH-T3). The Census Bureau’s Demographic Statistical Methods Division (DSMD) Survey Methodology (SM) team was tasked with enhancing these survey instruments in preparation for the upcoming survey cycle. The SM team updated the screener and topical questionnaires based on an expert review of the current versions. The next step is to conduct cognitive interviews to evaluate how well the revised materials work and to identify any ways they may be improved.

Purpose: The purpose of this research is to interview adults from the general U.S. population who have children within each of the age ranges covered by the three topical questionnaires to assess their understanding of the questions and response options as presented in the proposed revised NSCH survey instruments. In the cognitive interviews, we will assess the clarity and potential effectiveness of the revised instruments and identify respondent issues with comprehension or interpretation, with the goal of producing valid survey items that minimize the potential for measurement error attributable to the questions themselves. The results of the cognitive interviews will influence decisions about final content and wording of the screener and topical questionnaires for the next NSCH survey cycle.

Population of Interest: Participants will be screened during the study recruitment effort to ensure they have children within the target age ranges of each of the topical questionnaires. This will allow testing of the NSCH-T1 questionnaire with participants whose reference child is aged 0-5, the NSCH-T2 questionnaire with a reference child aged 6-11 and the NSCH-T3 questionnaire with a reference child aged 12-17.

Language: The interviews will be conducted in English and Spanish. The Spanish questionnaires will be updated to be in line with the English questionnaires.

Timeline: Cognitive interviews will be conducted from August 14, 2017 to September 29, 2017.

Project scope: The cognitive testing of the proposed revisions to the NSCH screener and topical questionnaires will be carried out according to the schedule described in Table 1.

Table 1. Estimated Project Schedule

Recruiting (Ongoing)	Friday 7/28 - Monday 9/18
Conduct Cognitive Interviews	Monday, 8/14 - Friday 9/29
Data Analysis – Preliminary Results	Friday 9/29 - Friday 10/13
Develop Final Content Recommendations	Friday 10/13 - Friday 11/17
Deliver Report	Friday 11/17 - Friday 11/17

General Protocol: Participants will be asked to review the proposed screener (NSCH-S1) and topical questionnaires (NSCH-T1, NSCH-T2, NSCH-T3). Participants will be asked to think aloud. We will use concurrent and retrospective probing to get a full understanding of the participant’s thought processes and interpretations of specific terminology and perceptions of specific elements of the survey. After completing the task, each participant will be asked debriefing questions. All interviews will be audio-recorded to facilitate a summary of the results. Participants will be asked to sign consent forms and for permission to be recorded.

Sample: A total of 30 participants will be interviewed over two rounds (15 per round) in the Washington, DC, Raleigh-Durham, NC, and Baltimore, MD metropolitan areas. Participants will be screened during the study recruitment to ensure at least 5 participants in each round have a child within the age range of each of the topical questionnaires so they are representative of the NSCH target population.

Recruitment: We will use a multi-pronged strategy to recruit participants, such as posting ads on Craigslist, distributing flyers, and using personal networks. While not nationally representative, an attempt will be made to recruit participants with varying demographic characteristics (e.g., sex, education, age, race and ethnicity).

Use of Incentive: Due to the length and complexity of the task as well as the necessity to travel to test locations, we plan to offer an incentive of $40 to offset the costs of participation, such as travel and parking.

Below is a list of materials to be used in this research.

1. NSCH S1_Cognitive Interviewing Version (Screener - English)

2. NSCH T1_Cognitive Interviewing Version (Topical Questionnaire 1 - English)

3. NSCH T2_Cognitive Interviewing Version (Topical Questionnaire 2 - English)

4. NSCH T3_Cognitive Interviewing Version (Topical Questionnaire 3 - English)

5. NSCH S1(S)_Cognitive Interviewing Version (Screener - Spanish)

6. NSCH T1(S)_Cognitive Interviewing Version (Topical Questionnaire 1 - Spanish)

7. NSCH T2(S)_Cognitive Interviewing Version (Topical Questionnaire 2 - Spanish)

8. NSCH T3(S)_Cognitive Interviewing Version (Topical Questionnaire 3 - Spanish)

Length of interview: Based on past experience with similar pretesting efforts it requires four screener conversations to recruit one participant. Each screener conversation lasts approximately three minutes. We estimate it will take 6 hours to screen and recruit 30 participants. We estimate it will take 60 minutes per participant to complete the cognitive interview. For 30 participants, the estimated burden for the interviews is therefore 30 hours, bringing the total burden to no more than 36 hours.

The contact person for questions regarding data collection and statistical aspects of the design of this research is listed below:

M. Christopher Stringer

Demographic Statistical Methods Division

U.S. Census Bureau

Washington, D.C. 20233

[email protected]

3