The Census Bureau plans to conduct additional research under the generic clearance for questionnaire pretesting research (OMB number 0607-0725). The objective of this research is to conduct cognitive and usability testing of the 2015 National Survey of College Graduates, sponsored by the National Science Foundation (NSF). This letter contains an updated protocol and paper form for the second round of testing. That testing was previously approved during the summer of 2013.
In this round, new questions are added at D14, D15, D16, and A40. Questions D14-D16 are on the concept of U.S. Federal Government support for education or research. The educational certificates questions are significantly revised (D17-D20) for this round. Reworded questions include A12 and A13, A35, A44, and C6. Other changes to question order, question instructions and the reference date are also included. New occupational history questions were planned for the 2015 NSCG and were mentioned in the summer 2013 OMB cognitive testing letter. However, NSF decided to do more research on the topic before proceeding to add those questions to the 2015 questionnaire.
Between March and June, 2014, staff from the Center for Survey Measurement (CSM) will conduct a second round of testing in each of three modes: self-administered paper, CATI, and Internet. A maximum of 15 interviews will be conducted per round per mode, for a total of 45 interviews. We will be targeting respondents who have at least a bachelor’s degree; a few who are PhD recipients; respondents with STEM (science, technology, engineering or math) degrees; some recent graduates and some who have been in the workforce longer, and a few independent contractors. To the maximum extent possible, within these specific criteria we will attempt to interview respondents of varying ages, genders and races. We will use a multi-pronged strategy to recruit the respondents needed for this study, such as posting ads in free local newspapers and in the local Gazette, distributing flyers, contacting local associations, and using personal networks.
All interviews will be conducted in the Washington DC metropolitan area. The cognitive paper and CATI interviews will be conducted at the Census Bureau’s cognitive laboratory and locations convenient to respondents. A copy of the self-administered paper questionnaire is attached. Screen shots of the CATI instrument are not available yet because the programming has not been finalized, but the content is the same as the paper questionnaire.
The usability interviews will be conducted at the Census Bureau’s usability lab. Screen shots of the Internet instrument are not available because programming of that instrument is not complete. The content is the same as the other two questionnaires. Copies of the demographic questionnaire, the background questionnaire, and the satisfaction questionnaire used in usability studies are attached.
The same protocol will be used for all the interviews. It is also attached. Interviews using the paper questionnaire will be conducted using respective think-aloud techniques, with probes being asked at the end of each section to avoid respondents’ navigation through the section. For the CATI and web interviews, the concurrent think-aloud interviews will be conducted. This method will avoid the necessity to scroll back through the questionnaire to see the questions and responses.
Cognitive and CATI interviews will be tape-recorded, with the participants' permission, to facilitate a summary of the results. Web interviews will be audio and video-recorded. Eye tracking data will also be collected during the Web interviews. All participants will be informed that their response is voluntary and that the information they provide is confidential. Respondents will receive $40 for their participation.
In general, for Census Bureau staff, it requires three screener conversations to recruit one participant. Each screener conversation lasts approximately three minutes. We estimate it will take four and one-half hours to screen and recruit 45 respondents. The estimated time for completion of each cognitive/usability interview is one and one-half hours. Thus, the estimated burden for this research is 72 hours.
The contact person for questions regarding data collection and study design is:
Elizabeth Nichols
Center for Survey Measurement
U.S. Census Bureau
Room 5K020A
Washington, D.C. 20233
(301) 763-1724
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Rodney L Terry |
| File Modified | 0000-00-00 |
| File Created | 2021-01-28 |