2017 Census Test OMB Package Part A_final with updates

Department of Commerce

United States Census Bureau

OMB Information Collection Request

2017 Census Test

OMB Control Number 0607-XXXX

Part A. Justification

1. Necessity of the Information Collection

During the years preceding the 2020 Census, the Census Bureau is pursuing its commitment to reducing the cost of conducting the census while maintaining the quality of the results. Testing of the feasibility of collecting tribal enrollment information is the primary objective of this test. A sample of 80,000 households will be drawn for a self-response-only operation, oversampled in areas with relatively higher concentrations of people identifying as American Indian or Alaska Native, as indicated through American Community Survey data.

These households will be mailed census questionnaires and other materials that provide details about the available modes of response, including Internet. Census Questionnaire Assistance (CQA) will offer the option for completing the questionnaire on the telephone, as well as language assistance with completing the questionnaire and Interactive Voice Recognition to answer respondent questions and route calls appropriately.

Self-response to the test can occur through Internet, paper questionnaire or telephone modes. There will be no follow-up field operation to obtain response. However, there will be a sample of 15,000 housing units selected for reinterview. Responses received to both the self-enumeration and the reinterview will be used for the test results and evaluation.

A second objective is continued testing of the systems designed for Internet self-response and the integration of the systems associated with self-response. With the development of these systems, the Census Bureau has made the transition from in-house test systems created in prior years to the full systems designed under the Census Enterprise Data Collection and Processing (CEDCaP) contract. It is crucial to test and prove in the new systems in pre-decennial tests, starting with this 2017 Census Test. Internet Self-Response has been prioritized as the system to complete in time for the 2017 Census Test. The Internet Self-Response application will have a Spanish language option. Other key systems that will be tested are the CQA and the Operational Control System that is integrated with these two response modes. In addition, the processes to detect fraudulent questionnaire submissions will be established and tested. The Census Bureau will also test the ability to provision and run in a Cloud environment.

Further systems will be developed and tested through the integration stages in the planned 2018 End-to-End Census Test, in particular for the Nonresponse Followup and Update Enumerate operations. The 2018 End-to-End Census Test will be the last opportunity to test all systems in an integrated environment before full implementation in the 2020 Census.

In Appendix C, the levels of involvement of each of the 34 operations described in the 2020 Census Operational Plan as related to the 2017 Census Test are shown. The Census Bureau submits along with the required materials our documentation showing the Goals, Objectives, and Success Criteria (GOSC) for this test. Following, additional details about the specific operations that will be tested or refined in this test are included.

Operations

Content and Forms Design

The content objective of this test is to test the feasibility of collecting tribal enrollment information in a census environment. The 2017 Census Test will include a reinterview operation to further assess the accuracy and reliability of the question wording and response categories for tribal enrollment.

The Census Bureau’s testing of the feasibility of collecting tribal enrollment information in a census environment came as a result from the 2007 Tribal Consultations with American Indian and Alaska Native (AIAN) tribal leaders as well as requests from other federal agencies, such as the United States Department of Housing and Urban Development (HUD). In response to these requests, the U.S. Census Bureau committed to testing the feasibility of collecting data on tribal enrollment through focus groups, cognitive interviews, and a field test.

Testing the feasibility of testing tribal enrollment started by conducting focus groups with AIAN participants. The insights gained from the focus groups informed the designs for three tribal enrollment question versions to be further qualitatively tested in cognitive interviews. The cognitive interviews provided additional opportunities to test the question wording, content, and respondent comprehension of the tribal enrollment questions. The findings from the focus groups and cognitive interviews informed the final tribal enrollment question design, which will be tested in the 2017 Census Test.

The 2017 Census Test will continue to include the response categories recommended by the OMB Interagency Working Group (see Section 11 of this document – Justification for Sensitive Questions) for opposite-sex and same-sex husband/wife/spouse households and for the category for unmarried partner. There may be additional results from this test that could inform final decisions about the use of these categories. The Census Bureau is working to refine the operation of the question in electronic instruments, in terms of agreement between the relationship report for coupled households and the sex reports for the householder and their spouse or partner.

The 2017 Census Test will also include the topic of race and ethnicity, which is being researched as the Census Bureau prepares for the 2020 Census. In the past, the Census Bureau has conducted content tests to research and improve the design and function of the questions on race and ethnicity. One challenge the Census Bureau currently faces is how Americans view “race” and “ethnicity” differently than in decades past. In our diverse society, a growing number of people find the current race and ethnic categories in the two separate questions format confusing, or they wish to see their own specific group reflected. The Census Bureau’s research has found that, over time, there have been a growing number of people who do not identify with any of the minimum race categories established by OMB as the minimum standard for maintaining, collecting, and presenting data on race and ethnicity for all Federal reporting purposes, and that the Census Bureau has seen that increasingly, millions of respondents have been racially classified as “Some Other Race.”

Taking note of this, over the past decade, Census Bureau researchers have been exploring different strategies for improving respondent understanding of the questions asked by the Census Bureau, as well as improving the accuracy of the resulting data produced on race and ethnicity. This research began in 2008, with the design of the 2010 Census Alternative Questionnaire Experiment (AQE) Research on Race and Hispanic Origin, which at the time was the most comprehensive research effort on race and Hispanic origin ever undertaken by the Census Bureau. In 2012, the AQE research was completed, and the results demonstrated promising strategies that combined race and ethnicity into one question.

The 2015 National Content Test (NCT) continued exploring ways to improve the race/ethnicity questions to better measure our nation's myriad racial/ethnic identities, and the results built upon the 2010 AQE findings, showing that a combined question resulted in no changes to distributions for major groups; decreased reporting of “Some Other Race;” lower item nonresponse; and higher overall consistency of race/ethnicity reporting for Hispanics. In addition, the 2015 NCT research showed that the use of a distinct Middle Eastern and North African (MENA) category elicited higher quality data and people who identify as MENA used the category when it was available. Finally, the 2015 NCT also yielded an important improvement on the 2010 AQE research, by obtaining the same or higher levels of detailed reporting across all groups, including for Hispanics and Asians, through the use of an innovative combined question with detailed checkboxes design. The 2015 NCT research is the Census Bureau’s primary test to help examine and evaluate alternative designs for 2020 Census content. In addition to the designs tested in the 2015 NCT, a 2016 Census Test evaluated a small change to the wording for the race category of “Black or African Am.” vs. “Black or African American.” This 2016 Census Test included a version of the combined race/ethnicity question which used write-in areas to collect detailed responses. Now, with the results from the 2015 NCT research, the Census Bureau has determined that the combined question with detailed checkboxes design exceeded the performance of both the two separate questions design and the combined question with write-in areas design in meeting the Census Bureau’s research objectives, as described above. Therefore, the Census Bureau will employ a combined question with detailed checkboxes design for the 2017 Census Test.

The 2017 Census Test also provides an important opportunity to field a successful 2015 NCT combined race/ethnicity question with detailed checkboxes design, with slight revisions to address two modifications. First, the American Indian and Alaska Native (AIAN) response category on paper forms is being revised to include only a write-in area, which has resulted in increased reporting of detailed tribal affiliation when tested in similar question designs. Second, several groups used as checkboxes and examples in the MENA response category are being revised to better reflect the diversity of the MENA population in the United States. Including this revised design in the 2017 Census Test will add a data point to help advance the body of knowledge about the combined race/ethnicity question. The Census Bureau plans to analyze the results from the 2017 Census Test’s revised version of the combined race/ethnicity question. The Census Bureau will have an opportunity to examine item nonresponse rates, detailed reporting for AIAN responses with the paper write-in areas design, and MENA responses with the revised detailed checkboxes and examples. These insights will complement the 2015 NCT research, and help inform the Census Bureau and other agencies within the Federal statistical system who have a desire to improve the collection and tabulation of detailed AIAN data and MENA data. This research will also help fill a gap in the current social science literature, and contribute to the larger academic and social discussion on racial/ethnic identity, as there are not many research studies to date that examine the performance of different question designs to improve the collection of self-identified race/ethnicity responses for the reporting of detailed AIAN groups and detailed MENA groups.

OMB and the Census Bureau have made no decision on which race/ethnicity question(s) format will be used for the 2020 Census. When this decision is finally made, it will be based on empirical research and results from decennial census testing, as well as years of engagement with key stakeholders, the U.S. Congress, the U.S. Office of Management and Budget, and the public.

Response Processing Operations

The reinterview operation will serve the additional purpose of testing processes for detecting fraudulent questionnaire submissions. The data gathered in the reinterview serves as a quality check on the data collected from the initial response.

This test was described in the 60-day Federal Register Notice (FRN) published August 8, 2016, 81 FR 52398. Based on the proposed funding levels for FY 2017, the Census Bureau subsequently reprioritized the test activities for 2017 to include only one of the two components described in the August FRN. The current test scope includes only that which is necessary to answer our most immediate design questions. The scope also includes enabling our new CEDCaP systems to test systems integration for key systems. The Census Bureau will not continue expending resources to prepare for the 2017 field tests. Documentation on the change in scope is available at:

http://www.census.gov/programs-surveys/decennial-census/2020-census/planning-management/memo-series/2020-memo-2016_21.html

2. Needs and Uses

The testing that is planned for the 2017 Census Test is necessary in order to test integration of recently implemented systems, as well as collect data on the feasibility for the collection of tribal enrollment information. It will also be possible to collect additional data regarding Internet response and calls to CQA within this population.

Information Quality

Information quality is an integral part of the pre-dissemination review of the data disseminated by the Census Bureau (fully described in the Census Bureau’s Information Quality Guidelines at https://www.census.gov/quality/guidelines/). Information quality is also integral to the data collections conducted by the Census Bureau and is incorporated into the clearance process required by the Paperwork Reduction Act.

The data collected from households and individuals during the 2017 Census Test will be used to research and evaluate the feasibility of collecting tribal enrollment information on the census questionnaire and to test systems planned for use in the 2020 Census. The Census Bureau will not publish any tabulations or population estimates using the results from this test. However, methodological papers may be written that include summary tallies of response characteristics or problems identified, and responses may be used to inform future research studies building upon these results. The Census Bureau plans to make the evaluation results of this study available to the general public.

3. Use of Information Technology

The 2017 Census Test respondents will have the option to respond to this test via the Internet (on various devices, e.g. computers, tablets, smart phones), via mailed questionnaires, or on the telephone through CQA. A sample of respondents will also be contacted by telephone for a reinterview for the purpose of further assessing the accuracy and reliability of response information.

Mailing of the paper questionnaires and processing of the questionnaires received will also use automated and integrated systems.

4. Efforts to Identify Duplication

As part of its efforts to reduce the cost of conducting the next Decennial Census while still providing the highest data quality possible, the Census Bureau continues its testing of new methods for the public to respond to content that have not previously been examined or used in a decennial census. The 2017 Census Test will include feasibility of collecting tribal enrollment information through the decennial census.

To date, the only Census Bureau test of a tribal enrollment question was conducted in the 2005 National Census Test, where one of the research objectives was to obtain information on tribal affiliation and enrollment. This test asked a tribal enrollment question to approximately 30,000 housing units.

Specifically, the 2005 National Census Test tribal enrollment question asked, “If Person 1 is an American Indian or Alaska Native, what is this person’s tribe?” with a write-in box. Underneath the write-in field, the question asked “Enrolled?” with three check boxes: “Yes,” “No,” and “Don’t know”. Ultimately, the 2005 National Census Test provided only descriptive statistics on the tribal enrollment responses. Some of the findings, however, highlighted a need to test the overcounting and undercounting of self-reported tribal enrollment data.

The 2017 Census Test version of the tribal enrollment question was designed to overcome the limitations of the 2005 test by gathering qualitative information from American Indian and Alaska Native participants during focus groups and cognitive interviews.

5. Minimizing Burden

The collection of data is only for households and individuals and should have no effect on small businesses. Housing units that were selected to participate in the 2015 National Content Test, 2016 Census Test, 2016 American Community Survey (ACS), 2017 ACS, and the recent Small Scale Mailout Testing will be removed from the universe to reduce respondent burden

6. Consequences of Less Frequent Collection

If this collection of information does not occur, it would significantly delay or prevent the Census Bureau’s ability to evaluate the feasibility of collecting tribal enrollment information and to test the integration of key systems for receiving census responses.

7. Special Circumstances

No special circumstances exist.

8. Consultations outside the Agency

In developing the 2017 Census Test, the Census Bureau consulted with a variety of stakeholders, including, but not limited to, academics, national researchers, community and organizational leaders, and the Census Bureau’s Advisory Committees. In addition, external consultants from the National Academy of Sciences shared information about other relevant studies and provided quarterly feedback about the Census Bureau’s research plans and objectives for the 2017 Census Test. To support the development of the question wording for data collection, the Census Bureau conducted cognitive testing under separate submissions for OMB approval; participants were recruited from outside the Census Bureau to provide their views on the wording of questionnaire. The results from these tests will be shared widely with Decennial Census stakeholders.

The notice for public comment, entitled, “2017 Census Test,” was published in the Federal Register August 8, 2016, 81 FR 52398. The Census Bureau received one set of comments comprising multiple comments from the National Association of Latino Elected and Appointed Officials (NALEO) Education Fund during the 60-day period. All of the comments from NALEO applied to aspects that have been removed from the scope of the 2017 Census Test.

The second notice for public comment, entitled, “2017 Census Test,” was published in the Federal Register December 1, 2016, 81 FR 86692. The Census Bureau received one set of comments comprising multiple comments from the NALEO. The comments on fall into major categories, which will be addressed below. In general, the NALEO organization is in favor of the testing efforts undertaken by the Census Bureau in advance of the 2020 Census and recommends specific testing and analysis regarding enumeration of the Latino population in the United States. 

1. A related set of recommendations consists of the following:

“We urge the Bureau to assess in the 2017 Test: 

• The extent to which self-response rates overall vary between Latinos based on a wide range of demographic characteristics, including geography, age, and national origin and sub-group. 

• The extent to which Latinos respond using computers compared to mobile devices, and the demographic characteristics of those who use different modes of response.” 

In addition:

• “Evaluation of Strategies to Deliver Paper Questionnaires: The 2017 Test’s assessment of self-response options includes the dissemination of paper questionnaires to households that cannot or do not respond using the Internet. This evaluation should include a thorough examination of the demographic characteristics of those who do not use the Internet response option including Hispanic national and sub-group origin, linguistic abilities, and geographic location.”

The following Census Bureau response addresses these recommendations.

The Census Bureau is committed to optimizing self-response across all demographic groups, particularly for traditionally hard-to-count populations.  While our goal is to maximize response rates and reduce the reliance on paper, the Census Bureau is aware that there are disparities in Internet-usage across certain populations and are taking steps to ensure that all households have the opportunity to respond to the census so that everyone is counted.  

As part of our analyses of the 2017 Census Test, the Census Bureau will be comparing response rates overall and by response mode, and also studying the demographic characteristics of the respondents in each mode. This includes assessing those who respond online with different devices, such as a desktop or laptop computer, a smartphone, or a tablet.

Other efforts in the 2017 Census Test to make it easier for all households to respond include: an Internet instrument optimized for mobile devices such as smartphones; Internet response available with and without a pre-assigned Census ID number; Census Questionnaire Assistance, which allows respondents to call over the phone to ask questions or to provide their census information by phone; support in both English and Spanish; and the delivery of a paper questionnaire to all households. 

2. The following is a separate recommendation from NALEO:

“We urge the Bureau to assess in the 2017 Test: 

• The extent to which heads of households receive assistance from other household members in utilizing the different technological response modes. As is the case with other population groups, Latino youth are generally more comfortable with new technology than older Latinos, and it would be useful to understand the extent to which older household members obtain assistance from younger ones in completing the questionnaire through the Internet.” 

Census Response:

This recommendation has been provided to the Census Bureau regarding previous census tests. We previously responded that this question could only be addressed in focus groups but that a question about this would be added to those tests. Below we present some of the responses from our focus groups for prior census tests.

From the focus groups the Census Bureau conducted in LA, California and Harris County, Texas the Census Bureau found that most participants were comfortable in filling out the survey online. Several respondents in the focus groups mentioned completing the Census test by phone (internet). A few Latino responders preferred completing the Census Test by phone; that way they could ask questions throughout the phone call. Nonresponse Followup responders did not respond because they forgot to complete the Census or did not see the correspondence. However, in all focus groups each head of the family mentioned completing the 2016 Census Test on their own (or with their spouse but it was not because they needed help). It is important to note that for the Latino focus groups, the groups were not divided by age. (Morales)

For the 2015 Census Test focus groups, which were divided by age and ethnicity, the older Latino focus group mentioned not having access to emails or were not well versed in the new technology such as mobile devices. Many mentioned having an old phone that could not access the internet well, whereas others did not understand how to use a phone well or did not want to try to use new technology. Having said all of this, this group were all Nonresponse Followup respondents, therefore no one in their families helped them, but they were helped by a Census enumerator. (Morales, et al)

Separately, the 2011 Census Barriers, Attitudes, and Motivators Survey II provided some results into how the Latino population perceives the decennial census. < "Census Knowledge and Census Participation Among Hispanics" Blog post> (Conrey, Frederica R., Randal ZuWallack and Robynne Locke.)

In particular, this study found the following results about who completes the census form.

ce3. Did you personally fill out the form or did someone else in your household fill out the form?
% who answered…	General Population	Hispanics
	%	%
Filled out the form	73	62
Someone else filled out the form	22	31
We worked on it together	4	6
Don't know	1	1
Refused/No answer	0	N/A
	100	100
N	2974	444
Source:Census,. Barriers and Motivators Survey II(2011)

3. The next recommendation from NALEO was related to multilingual response and materials.

“We commend the Bureau for its recognition of the importance of refining its support for and communication with Latinos who are not yet fully fluent in English, because these Latinos need specialized strategies to promote their self-response. With respect to the contact strategies, we strongly encourage the Bureau to do as much testing in multiple languages of messages, vehicles, and response options as is feasible. We also note that the 2017 Test will involve a CQA support component, and we recommend that the Bureau include a mechanism to evaluate customer satisfaction with the in-language assistance the Bureau provides. Similarly, the Bureau should examine the effectiveness of its Interactive Voice Recognition system for answering questions from respondents who need non-English language assistance.”

Census Response:

A list of the paper materials is included elsewhere within this package. While the focus of the 2017 Census Test is on the tribal enrollment question, the language services for this test are fairly extensive given the scale of the test. The following provides a list of what languages are available for materials and response modes.

* Paper questionnaires - English or bilingual English/Spanish

* Internet - English or Spanish

* Mailing materials - English or bilingual English/Spanish; also a Census Questionnaire Assistance (CQA) information sheet in seven languages

* CQA - support in eight languages: English, Spanish, Chinese (Mandarin and Cantonese), Korean, Vietnamese, Russian, Arabic

The CQA component will not evaluate customer satisfaction in the 2017 Census Test. The 2017 Census Test implementation of CQA will include Interactive Voice Recognition in English and Spanish, and Interactive Voice Recognition in Mandarin will be tested.

9. Paying Respondents

Respondents participating in the 2017 Census Test will not receive any form of compensation for their participation.

10. Assurances of Confidentiality

The Census Bureau will conduct the 2017 Census Test under the authority of Title 13 United States Code Sections 141 and 193. All respondents who participate in the 2017 Census Test will be informed that the information they provide is confidential under that law, but that the same law makes participation mandatory. All collected information that identifies individuals will be held in strict confidence according to the provisions of Title 13 United States Code, Section 9 and 214.

11. Justification for Sensitive Questions

In the 2017 Census Test we are testing a question about tribal enrollment, which some people might find sensitive. The objective is to test the questions and measure response, both as a self-response rate and as item response rates, as well as in reaction to the questions by the population included in the test. Focus groups and cognitive testing prior to the 2017 Census Test helped us assess public reaction to these revised questions in order to create the most useful implementation within the test.

In 2016, two qualitative research studies were conducted to develop and qualitatively pretest, respectively, multiple versions of a separate and specific tribal enrollment question. In the first study, 11 focus groups were conducted with AIAN respondents in 11 U.S. sites. Results showed that (a) enrollment status can change, (b) Alaska Natives have relationships to ethnic tribe entities that use terms other than “tribe,” as well as relationships to federally recognized Alaska Native corporations, and (c) simplicity, clarity, and directness were the most desired traits of a question. Three question versions that addressed these results were developed for cognitive testing. (Terry, R. L., Schwede, L., & Fobia, A. )

In the second study, 63 cognitive interviews were conducted with AIAN respondents in seven U.S. sites. Results showed that (a) the term “village” is better understood than other terms to describe Alaska Native ethnic tribe entities, and (b) Alaska Native respondents reported Alaska Native corporations less often in a one-question format. As a result, the question format selected for the 2017 Census Test was a two-question format that used the term “village” and asked about tribe enrollment and corporation shareholder status in separate questions. (Terry, R. L., Schwede, L., Graber, J., & Sandoval, A.)

The Census Bureau committed to testing the feasibility of collecting tribal enrollment for two main reasons. The first was a result from the 2007 AIAN Tribal Consultation. A major finding from last decade’s consultations was that the tribal leaders from that consultation asked the Census Bureau to test collecting tribal enrollment in the 2010 Census (for more details, see http://www.census.gov/aian/pdf/CensusFinalReport_07_color-hi_res.pdf). At the time, it was too late to test in time for the 2010 Census, so the Census Bureau committed to testing this for the 2020 Census. The second reason was a formal request from the U.S. Department of Housing and Urban Development.

The Census Bureau is currently considering the inclusion of new categories for same-sex couples on the decennial census questionnaire. In August 2009, the Secretary of Commerce requested that the Office of Management and Budget (OMB) establish the interagency task force [Measuring Relationship in Federal Household Surveys] to research issues related to improving the collection and tabulation of marriage and relationship data. One focus of the research was family relationships, particularly with respect to same-sex couples who report being married. The first phase of research involved focus groups conducted primarily with persons cohabiting in same-sex relationships. The focus groups explored the meaning and interpretation of the current decennial Census and ACS relationship and marital status items.

The U.S. Office of Management and Budget currently chairs the Interagency Working Group for Research on Race and Ethnicity. This Interagency Working Group is currently researching alternative question format designs for the Federal measurement of race and ethnicity. In addition, they are requesting public comment on the current OMB standards on race and ethnicity through the Federal Register. The Census Bureau’s extensive research over the past decade has helped to inform this exploration, which aims to address concerns about the current race and ethnicity questions. The 2017 Census Test provides an opportunity to field the 2015 NCT combined race/ethnicity question with detailed checkboxes design again. Slight revisions were made to the question design for the 2017 Census Test to address improving the reporting of detailed American Indian and Alaska Native tribal affiliation and to better reflect the diversity of the MENA population. The 2017 Census Test will help advance the body of knowledge about the combined race/ethnicity question.

OMB and the Census Bureau have made no decision on which race/ethnicity question(s) format will be used for the 2020 Census. The final decision made by OMB and the Census Bureau will be based on empirical research, results from decennial census testing, and years of engagement with key stakeholders, the U.S. Congress, and the public.

12. Estimate of Burden Hours

Type of Respondent/Operation	Estimated Number of Responding Housing Units	Estimated Time per Response	Estimated Total Annual Burden Hours
Self-Response	36,000	10 minutes	6,000
Reinterview	7,500	7 minutes	875
Totals	43,500		6,875

13. Estimate of Cost Burden to Respondents

There are no costs to respondents other than their time to participate in this data collection.

14. Cost to Federal Government

The cost of this collection is covered under the requested budget for the 2017 Census Test, Research and Testing Program, and is estimated to be $2.4 million. This amount includes postage and print contracts (“other objects”). This estimate also includes salaries for Census Questionnaire Assistance agents, data capture processing staff, and the staff in headquarters providing program management and/or systems engineering and integration (SE&I) support.

15. Reason for Change Burden

The increase in burden is attributable to the information collection being submitted as a new collection.

16. Project Schedule

Activity/Milestone	Date/Range
Begin Self-Response	March 20, 2017
Census Day	April 1, 2017
Begin Reinterview	April 10, 2017
End Self-Response	May 12, 2017
End Reinterview	July 10, 2017

17. Request to Not Display Expiration Date

No exemption is requested.

18. Exceptions to the Certification

There are no exceptions to the certification.

Appendix A – Documents Included in the 2017 Census Test Package

1. Supporting Statement A (this document)

2. Supporting Statement B

3. 2017 Census Test Goals, Objectives, and Success Criteria

4. 2017 Census Test Panel Design Matrix

5. 2017 Census Test – Index of Forms

6. 2017 Census Test mailing materials (including questionnaires)

7. 2017 Census Test Internet and Census Questionnaire Assistance Specifications

8. 2017 Census Test Reinterview Front End Flow Chart

9. 2017 Census Test 60-Day Federal Register Notice

10. Comments received on 60-Day Federal Register Notice (NALEO Educational Fund)

11. 2017 Census Test 30-Day Federal Register Notice

12. 2017 Census Test 83-I

13. Adjustment of 2017CT Scope Memo

14. Comments received on 30-Day Federal Register Notice (NALEO Educational Fund)

Appendix B – References

Conrey, Frederica R., Randal ZuWallack and Robynne Locke. 2011. “Census Barriers, Attitudes, and Motivators Survey II. Final Report.” Statistical Research Division. U.S. Census Bureau. Washington, D.C. 20233. Available at: CBAMS_II_Final_Report.pdf

Morales, Holzberg and Eggleston (2017). 2015 Census Test Focus Groups

Morales (Forthcoming). 2016 Census Test Focus Groups

Terry, R. L., Schwede, L., & Fobia, A. (Forthcoming). Focus group research on the tribal enrollment question for American Indians and Alaska Natives. Center for Survey Measurement Report Series. U.S. Census Bureau, Suitland, MD.

Terry, R. L., Schwede, L., Graber, J., & Sandoval, A. (Forthcoming). Cognitive pretesting of a tribal enrollment question for American Indians and Alaska Natives. Center for Survey Measurement Report Series. U.S. Census Bureau, Suitland, MD.

Appendix C – 2020 Census Operations Included in the 2017 Census Test

11