B. COLLECTION OF INFORMATION EMPLOYING STATISTICAL
METHODS
Describe (including a numerical estimate) the potential respondent universe and any sampling or other respondent selection method to be used. Data on the number of entities (e.g., establishments, State and local government units, households, or persons) in the universe covered by the collection and in the corresponding sample are to be provided in tabular form for the universe as a whole and for each of the strata in the proposed sample. Indicate expected response rates for the collection as a whole. If the collection had been conducted previously, include the actual response rate achieved during the last collection.
The December Food Security Supplement is conducted in conjunction with the CPS, for which the universe is approximately 130 million households, comprising the non-institutionalized civilian population of the United States. From this universe, a stratified, clustered, probability sample of approximately 70,000 household addresses is selected each month. The last collection of CPS-FSS data available was in December 2020. In December 2020, 68,932 housing units were sampled. Of these, 59,071 households were eligible for interview (i.e., were currently residences), and 45,283 (76.7 percent) completed the core labor force survey. All households completing the core labor force questions are asked to answer the supplement questions applicable to their household. For the December 2020 Food Security Supplement, 34,330 households (75.8 percent of those that completed the core labor force interview) responded to the supplement. In 2020, CPS response rates were affected by the COVID-19 pandemic and it was the first year in which response rates for the CPS labor force interview fell below 80 percent.
The response rate to the core labor force survey in December 2020 (the most recent collection available) was 76.7 percent. In December 2020, the overall response rate to the Supplement was 58.1 percent when both the response rate to the CPS labor force interview and response rate to the FSS are considered (76.7 percent x 75.8 percent). However, the supplement is reweighted to national control totals and to match the income profile of the core respondents, so food security statistics are less biased by non-response than would be the case without information from the core survey about the supplement non-respondents.
The questions are intended to be asked of the person most knowledgeable about food shopping and meal preparation in the household. If one person is most knowledgeable about shopping for food but another is most knowledgeable about meal preparation, the person most knowledgeable about meal preparation is interviewed. If there is no one person in the household who is most knowledgeable about the food that is bought or eaten, or if that person is not available for interview, the labor force respondent is encouraged to answer the questions the best they can.
2. Describe the procedures for the collection of information including:
Statistical methodology for stratification and sample selection,
Estimation procedure,
Degree of accuracy needed for the purpose described in the justification,
Unusual problems requiring specialized sampling procedures, and
Any use of periodic (less frequent than annual) data collection cycles to reduce burden.
The collection is a supplemental interview associated with the December CPS. The CPS sample is a stratified clustered address-based sample. Census Bureau field staff conduct about one-third of interviews face-to-face in respondents’ homes and the remainder by telephone, using computer assisted interviewing technology. Weights for the core (labor force) CPS are calculated beginning with a basic weight for each person, which represents the probability of selection for the survey. The basic weight is adjusted for special sampling situations and failure to obtain interviews from eligible households. A two-stage ratio estimation procedure adjusts the sample population to the known distribution of the entire population by age, gender, race, and Hispanic ethnicity. The Census Bureau also calculates person and household weights for use with the food security supplement data that account for nonresponse to the supplement by households that respond to the core CPS.
Attachment H contains an overview of the CPS sample design and weighting methodology (this 2010 version remains applicable). The statistical properties of these supplemental items will be similar to those associated with the basic CPS items.
The U.S. Census Bureau provides replicate weights to support balanced repeated replication (BRR) variance estimates. Procedures for estimating variances using these weights are described in U.S. Census Bureau guidance available at: https://www2.census.gov/programs-surveys/cps/datasets/2018/supp/HH-level_Use_of_the_Public_Use_Replicate_Weight_File.doc (direct link for guidance on use of replicate weights) and https://www.census.gov/data/datasets/time-series/demo/cps/cps-supp_cps-repwgt/cps-food-security.html (webpage to download data, replicate weights, and documentation) . In 2020, the standard error for the estimated national percentage of food insecure households (10.5 percent) was 0.203 percentage points. For the estimated percentage of households with children in which children experience very low food security (0.8 percent), the standard error was 0.124 percentage points. Both these measures are objectives in the Health and Human Services Healthy People 2030 initiative and the percentage of food secure households is cited in the current USDA strategic plan. The sampling errors are sufficiently small to support credible monitoring of progress toward these goals.
Describe methods to maximize response rates and to deal with issues of non-response. The accuracy and reliability of information collected must be shown to be adequate for intended uses. For collections based on sampling, a special justification must be provided for any collection that will not yield "reliable" data that can be generalized to the universe studied.
Response rates and data accuracy for the CPS are maintained at high levels by the U.S. Census Bureau through advance notification of respondents, interviewer training and standardization, computerized tracking of call attempts and callbacks, computerized interviewing, internal consistency edits in the computerized instrument and in data editing, and close monitoring of these data. ERS expects response rates consistent with recent surveys.
ERS conducts psychometric assessment of the food security response data using statistical methods based on Item Response Theory to assess quality of the food security response data nationally and in key subpopulations. This ensures that food security prevalence statistics are comparable over time and across key subpopulations.
Beginning in December 2012, U.S. Census Bureau staff who conduct CPS Food Security Supplement interviews in Spanish were provided with a standardized translation of the questions that are used to determine households’ food security status to minimize bias in comparing food security statistics between Hispanic and non-Hispanic households. Beginning with the December 2014 survey, ERS provided a standardized Spanish translation of the entire supplement. The Spanish language for the entire supplement was integrated into the computerized interview instruments. Prior to 2012, interviewers translated “on the fly” when interviewing households that could only be interviewed in Spanish.
ERS contracted with the U.S. Census Bureau to conduct a nonresponse bias analysis on the FSS after the FSS response rate dropped to 75 percent in 2015 (see Attachment I “Evaluating Nonresponse Bias in the 2015 Food Security Supplement to the Current Population Survey”). The U.S. Census Bureau conducted a nonresponse bias study for each year of FSS data from 2011 through 2015. The analysis found evidence of potential nonresponse bias for both CPS and FSS households. The study showed that the distributions of FSS respondents and non-respondents differed on some characteristics, such as age and race of reference person, but these differences do not necessarily indicate a nonresponse bias problem. The effects of these differences are reduced through noninterview weighting adjustments. Additionally, the differences only cause bias if the respondents and nonrespondents report differing rates of food security. The food security status of nonrespondents cannot be determined, so it is difficult to say with certainty whether or to what extent nonresponse may bias the food security estimates. The 2020 response rate of 75.8 percent is only slightly below the target of 80 percent and weighting adjusts for differences in known characteristics of respondents and nonrespondents, so nonresponse bias is not likely to be a major concern. However, the U.S. Census Bureau and ERS will continue to monitor FSS response rates and potential sources of bias. ERS is currently contracting with the U.S. Census Bureau to conduct a nonresponse bias analysis of the 2020 CPS-FSS data and plans to conduct nonresponse bias analyses annually going forward.
4. Describe any tests of procedures or methods to be undertaken. Testing is encouraged as an effective means of refining collections of information to minimize burden and improve utility. Tests must be approved if they call for answers to identical questions from 10 or more respondents. A proposed test or set of tests may be submitted for approval separately or in combination with the main collection of information.
USDA has completed several tests suggested by the Committee on National Statistics Panel report of 2006. ERS also recently completed cognitive interview testing for modified survey items and a split panel test of the updated instrument in September 2020. The findings and recommendations from the cognitive testing were incorporated into the test instrument (see questionnaire in Attachment A and cognitive interview report in Attachment J). The cognitive testing and split panel test have formed the basis for our current proposed instrument for 2022. No further testing is planned in the 2022-24 period covered by this request.
5. Provide the name and telephone number of individuals consulted on statistical aspects of the design and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.
The following individuals may be consulted concerning the statistical data collection and analysis operations:
Statistical Design:
David Hornick
Demographic Statistics Methods Division
U.S. Census Bureau
(301) 763-4183
Data Collection/ Survey Design:
Kyra Linse
Survey Director, Current Population Survey and American Time Use Survey
Demographic Surveys Division
U.S. Census Bureau
(240) 433-0028
Analysis of Food Security Data
Alisha Coleman-Jensen
Food Assistance Branch
Economic Research Service, USDA
(202) 694-5456
Attachments
Proposed December 2022 Food Security Supplement Questionnaire
Copy of Federal Register Notice Regarding this Collection
C-1. Public Comment (Reamer) Received in Response to Federal Register Notice
C-2. Public Comment (Carter) Received in Response to Federal Register Notice
NASS Review CPS-FSS
CPS Advance Letter
CPS Confidentiality Brochure
CPS Fact Sheet Brochure
Overview of CPS Sample Design and Methodology
Census Report “Evaluating Nonresponse Bias in the 2015 Food Security Supplement to the Current Population Survey”
Census Report “Cognitive Testing Results for the Current Population Survey Food Security Supplement”
Draft Report “Analysis of the September 2020 Current Population Survey Split Panel Test”
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | JHESSION |
| File Modified | 0000-00-00 |
| File Created | 2022-06-13 |