Attachment K Draft Report “Analysis of the September 2020 Current Population Survey Split Panel Test” Sept 2020 CPS-FSS Split Panel, page 1 Analysis of the September 2020 Current Population Survey Split Panel Test Alisha Coleman-Jensen ([email protected]) and Matthew P. Rabbitt ([email protected]) U.S. Department of Agriculture, Economic Research Service Food Economics Division, Food Assistance Branch Draft Report November 22, 2021 Note: This draft report is intended to inform decision making for the proposed content of the 2022 Current Population Survey Food Security Supplement questionnaire. This report has not undergone the full review and editorial process of official ERS publications. Sept 2020 CPS-FSS Split Panel, page 2 Introduction USDA’s Economic Research Service (ERS) has sponsored annual data collection of the Food Security Supplement since 1995. The Food Security Supplement is added to the monthly Current Population Survey each December to form the Current Population Survey Food Security Supplement (CPS-FSS). 1 The CPS-FSS is used for annual monitoring of household food security in the United States (Coleman-Jensen et al., 2021). Food insecurity has become a key indicator of well-being for the U.S. population (see, for example, Healthy People 2030, https://health.gov/healthypeople/objectives-and-data/browse-objectives/nutrition-and-healthyeating/reduce-household-food-insecurity-and-hunger-nws-01, and America’s Children: Key National Indicators of Well-Being, https://www.childstats.gov/americaschildren/eco4.asp). The CPS-FSS survey questions have been largely unchanged since collection began in 1995. As ERS was coming up on 25 years of data collection with the CPS-FSS, agency researchers believed it was important to critically review the survey instrument. To ensure the continued relevance of the survey questions, ERS contracted with the U.S. Census Bureau to review the CPS-FSS instrument as was currently implemented, develop changes as needed, and conduct cognitive testing of any possible revisions to the survey instrument. To begin, ERS researchers undertook a review of the survey items in collaboration with research staff at USDA’s Food and Nutrition Service (FNS) and survey methods staff at the Census Bureau’s Center for Behavior Science Methods in the Research and Methodology Directorate. ERS also considered previous comments about the survey received from academic food security experts. Through this review, some wording used in the survey items was perceived to be outdated (for example, questions asking about food spending referred to spending at produce stands and meat markets but did not ask about spending at farmers markets or online food purchases). Thus, some survey items were updated. Also, based on this review, we included minor modifications to some food security items that are part of the 18-item food security measure, to streamline consistent language across items and reduce burden (for example, consistently using “wasn’t enough money for food” across items in place of “we just couldn’t afford more food” used in only a few For a full history of the food security measure, see: https://www.ers.usda.gov/topics/food-nutrition-assistance/foodsecurity-in-the-us/history-background/ 1 Sept 2020 CPS-FSS Split Panel, page 3 items). Some new questions regarding nutrition assistance were added to reflect new and changing Federal and community nutrition assistance programs (for example, a new question asks about receipt of a free or reduced-price meal or snack at an after-school program). In addition, reordering of questions was proposed. The food security items were moved earlier in the survey interview with a possible effect of reducing non-response to the food security items from break-offs part way through the survey. A new questionnaire was developed for testing that incorporated revisions to some of the survey items and a reordering of survey items. The revised questionnaire went through three rounds of cognitive testing led by the U.S. Census Bureau in 2019. The findings and recommendations from the cognitive test are included in a published Census report (Kephart et al., 2021). In 2020, ERS sought and received OMB approval for a one-time split panel test to assess the revised CPS-FSS survey that resulted from the review and cognitive testing process. This split panel test was a separate data collection from the regular annual CPS-FSS data collection used to monitor the Nation’s food security. We proposed adding a split panel test because we did not want the test instrument to impact annual food security estimates in such a way that would cause an unnecessary break in the long time series. The data from this one-time split panel test are being used to assess the functioning of the updated questionnaire and the effect of modifying some survey items on key outcomes of interest, like the measure of food security. Sept 2020 CPS-FSS Split Panel, page 4 Data and Methods The general methodology for food security measurement is described in the annual food security report (Coleman-Jensen et al., 2021) and elsewhere (Bickel et al., 2000; National Research Council, 2006). 2 This section focuses on the data and methods for the September 2020 split panel. In a split panel test, a portion of the survey sample receives one questionnaire, and the other portion of the sample receives an alternate questionnaire. Three-quarters of the regular monthly CPS sample was eligible for the September 2020 split panel test. Only three-quarters of the CPS sample was eligible because we did not want to interview households in the test that may also be interviewed in the regular December 2020 CPS-FSS. CPS months-in-sample groups 2, 3, 4, 6, 7, and 8 were eligible to be interviewed in the September 2020 split panel. We did not include CPS months-in-sample groups 1 and 5 (one-quarter of the total sample) because they would be eligible for interview in the regular December 2020 CPS-FSS data collection. The eight months-in-sample groups are eight representative subsamples of the CPS sample. Therefore, the September 2020 split panel remains representative as it includes six complete month-in-sample groups which comprise six representative subsamples. For the split panel test in September 2020, half of the sample interviewed received the standard food security questionnaire, and half received the revised test questionnaire that resulted from the expert review and cognitive interviewing. In the September 2020 CPS there were 46,300 households. Of these, 11,216 were not eligible for the food security supplement because they were in months-in-sample groups 1 or 5. The remaining 35,084 households were eligible for the split panel. For the split panel, 17,496 households were assigned to the test instrument and 17,588 were assigned to the original instrument. There was a total of 26,292 completed interviews. For the standard instrument there were 13,160 completed interviews (74.8% response). For the test instrument there were 13,132 completed interviews (75.1% response). See also a listing of food security measurement and technical research here: https://www.ers.usda.gov/topics/foodnutrition-assistance/food-security-in-the-us/survey-tools/#technical 2 Sept 2020 CPS-FSS Split Panel, page 5 Each split panel is weighted separately to be representative of the U.S. population. All statistics in this report were calculated by applying the food security supplement weight for the appropriate panel (test instrument or standard instrument). Unweighted estimates are specifically noted as being unweighted. Unless otherwise noted, statistical differences described in this report are significant at the 90-percent confidence level. Standard errors were calculated using balanced repeated replication (BRR) methods based on replicate weights computed for the September 2020 CPS-FSS by the U.S. Census Bureau. Replicate weights were computed separately for each panel. The CPS Food Security Supplement includes questions on food spending, food security, and use of nutrition assistance programs. Each section was modified, although most modifications were minor updates to question text. There was also reordering of questions with the food security questions being moved earlier in the module immediately after the food spending questions. As a result, the questions on Federal nutrition assistance were moved after the food security questions. This change was made for two reasons, possibly to reduce missing responses on the food security questions from respondents that started the survey but dropped off part way through and to reduce any possibility that asking about nutrition assistance prior to the food security items could influence responses to the food security questions. Modifications to the instrument are shown in Appendix A which includes the test instrument with revisions highlighted in yellow. For a summary of modifications and updates, see Box 1: Modifications to the CPS-FSS Test Instrument. Sept 2020 CPS-FSS Split Panel, page 6 --------------------------------------------------------------------------------------------------------------------Box 1: Modifications to the CPS-FSS Test Instrument. Food Spending: Questions in the section on food spending were updated and modified to reflect changes in terminology, the retail environment, and technology. The section first asks respondents to think about all the places they purchased food, and how much they spent, and then asks them to report usual food spending. Questions that ask respondents to think about all the places they spent money on food purchases and how much they spent last week were modified. For example, the new wording asks about online food purchases and purchases as farmers markets that were not included when the survey was developed in the 1990s. Food Security: The section on food security was moved earlier in the survey instrument. A few child items were modified to standardize the resource constraint to “there wasn’t enough money for food.” Also, the lead-in to one of the screening variables (HES9) was changed due to moving sections in the questionnaire. Federal Nutrition Assistance: The section on Federal nutrition assistance was moved after the food security section. The lead-in to the first question (HESP1) in the section changed due to moving the section. Questions on school meals were modified slightly to refer to “reduced-price” meals instead of “reduced-cost.” A new question was added on receipt of free or reduced-price afterschool meals and snacks. Community Food and Nutrition Assistance: The section on community food and nutrition assistance was modified to use new questions that ask about receipt of free groceries and free meals. These questions were recommended by Feeding America, based on their expertise in the charitable feeding sector and their own testing of the questions. The section no longer asks separate questions about free meals received by the elderly but incudes those programs in the more general questions about receipt of free meals. End of Box 1 --------------------------------------------------------------------------------------------------------------------- Sept 2020 CPS-FSS Split Panel, page 7 Methods and Results: Food Spending In USDA’s annual food security report (Coleman-Jensen et al., 2021) food spending is reported for various demographic and household groups and by food security status. The survey questions on food spending aim to help respondents reflect on all the places the household has purchased food in the previous week. USDA does not report food spending for the individual questions in the survey. Rather, respondents are first asked to report the amount of money their households spent on food in the week before the interview, including purchases made with Supplemental Nutrition Assistance Program (SNAP) benefits. Total spending for food, based on responses to the series of questions about places where food was purchased and how much was spent, was verified with the respondent. The respondent was then asked how much the household usually spent on food during a week. The questions in this section were modified based on expert review and cognitive testing to better reflect the places where households purchase food currently compared with when the instrument was first developed. For example, the test instrument now asks about spending at “Walmart and Target” in addition to supermarkets and grocery stores. The test instrument also asks about purchases as dollar stores, pharmacies, club stores, farmers markets and online; all places that were not previously asked about. Again, the survey asks about these specific places to prompt the respondent to think about all the places they purchased food. The total usual food spending is the focus of USDA’s analysis of this section, not the specific spending at each type of retail outlet. The question that forms the basis for usual food spending was not revised in the test instrument. However, since the questions before it on all the places where the households purchased food in the last week were revised in the test instrument, there may be differences in how respondents reported their usual food spending between the test and standard instrument. Table 1 below is formatted similarly to Table 7 in USDA’s annual food security report. Usual food spending by split panel is shown in the table. Usual food spending was adjusted for household size and composition in two ways. First, researchers divided each household’s usual weekly food expenditure by the number of household members, yielding the “usual weekly food spending per person” for that household. The second adjustment more precisely accounts for the different food needs of households by comparing each household’s usual food spending to the Sept 2020 CPS-FSS Split Panel, page 8 estimated cost of the Thrifty Food Plan (TFP) for that household in September 2020 (https://fnsprod.azureedge.net/sites/default/files/media/file/CostofFoodSep2020.pdf). USDA’s TFP serves as a national standard for a nutritious, minimal-cost diet. Each household’s reported usual weekly food spending was divided by the household-specific cost of the TFP, based on the ageand gender-specific cost of the TFP for each household member and the number of persons in the household. The medians of each of the two food-spending measures (spending per person per week and total spending relative to the cost of the September 2020 TFP) were estimated at the national level and for households in various categories. Medians are reported rather than averages (means) because medians are not unduly affected by the few unexpectedly high values of food spending that are believed to be reporting or data entry errors. Thus, the median better reflects what a typical household spent. Some interviewed household did not respond to the food-spending questions or reported zero usual food spending and were excluded from the analysis. For the standard instrument these exclusions represented 7.8 percent of all U.S. households (6.8 percent of unweighted respondents). For the test instrument these exclusions represented 6.9 percent of all households (6.3 percent of unweighted respondents). Nonresponse to the food-spending questions was somewhat lower with the test instrument—this could be due to random variation or could be due to better understanding of the question based on improvements made to the food-spending questions from the expert review and cognitive interviews. The results for food spending for the standard instrument and test instrument are shown in Table 1. The left-hand side of the table shows the standard instrument sample and the righthand side shows the test instrument sample. According to the findings for the standard instrument, reported usual weekly food spending per person was $60 and median weekly food spending relative to the cost of the TFP was 1.32. The TFP adjust for food price inflation and adjusts more precisely for the food needs of persons in different age-gender categories. A ratio of household food spending relative to the TFP that is above 1.0 indicates the household spends more than the cost of the TFP, a ratio below 1.0 means the household spends less than the cost of Sept 2020 CPS-FSS Split Panel, page 9 the TFP. The findings for the test instrument show that reported usual weekly food spending per person was also $60 and median weekly food spending relative to the cost of the TFP was 1.36. Differences between the panel in food spending relative the TFP were tested for statistical significance. Differences are statistically significant only for a few categories (denoted by an asterisk in Table 1), but when differences are significant, reported food spending is higher for test instrument households. Higher reported food spending suggests an improvement in the instrument because food spending in the CPS-FSS may be underreported compared with other sources. For example, ERS’s reported normalized annual food expenditures by households, suggest a weekly average in food spending of $225 dollars per household in 2020, and $98 per capita (see the ERS page: https://www.ers.usda.gov/data-products/food-expenditure-series/, and specifically Normalized food expenditures by all purchasers and household final users). There is some seasonal variation in food spending, so the total annual expenditures from the food expenditure series used to approximate average weekly spending is not precisely comparable to food spending reported for a single week. Medians are reported in table 1, for those with positive reported food spending, the average food spending per person per week in the standard instrument is $68 and the average food spending per person per week in the test instrument is $69. To conclude, most differences in usual food spending between the split panels are not statistically significant. However, the results suggest that the modified questions functioned at least as well as the standard instrument and show possible improvement, with slightly lower nonresponse and slightly higher reported food spending. Sept 2020 CPS-FSS Split Panel, page 10 Table 1 Weekly household food spending per person and relative to the household cost of the Thrifty Food Plan (TFP), by instrument version, September 2020 Standard Instrument Test Instrument Relative to Relative to household cost of household cost of Number of Per Number of Per September 2020 September 2020 households1 Person TFP households1 Person TFP Category 1,000 Dollars Ratio 1,000 Dollars Ratio All households 120,143 60.00 1.32 121,280 60.00 1.36 Household composition: With children < 18 yrs At least one child < 6 yrs Married-couple families Female head, no spouse Male head, no spouse Other household with child2 With no children < 18 yrs More than one adult Women living alone Men living alone With elderly Elderly living alone 34,860 14,617 22,876 8,490 3,039 NA 85,283 50,494 19,108 15,681 36,555 13,374 48.00 44.00 50.00 45.00 42.00 NA 65.00 57.50 70.00 80.00 50.00 60.00 1.21 1.28 1.25 1.16 1.09 NA 1.42 1.29 1.52 1.63 1.22 1.30 35,854 14,818 23,479 9,127 2,790 NA 85,426 50,934 19,141 15,351 36,874 13,937 50.00 43.33 46.67 50.00 50.00 NA 65.00 60.00 70.00 80.00 55.00 60.00 1.24 1.25 1.22 1.26 * 1.18 NA 1.44 1.36 * 1.52 1.63 1.24 1.3 Race/ethnicity of household reference persons: White, non-Hispanic Black, non-Hispanic Hispanic3 Other, non-Hispanic 79,012 15,339 16,697 9,095 60.00 50.00 50.00 60.00 1.40 1.14 1.23 1.38 79,521 15,073 17,591 9,095 60.00 50.00 50.00 56.00 1.42 1.19 1.22 1.29 Household income-to-poverty ratio: Sept 2020 CPS-FSS Split Panel, page 11 Under 1.00 Under 1.30 Under 1.85 1.85 and over Income unknown Area of residence:4 Inside metropolitan area In principal cities Not in principal cities Outside metropolitan area 9,486 14,616 23,323 66,939 29,882 50.00 50.00 50.00 65.00 50.00 1.08 1.08 1.09 1.47 1.22 8,783 14,598 23,314 67,051 30,915 50.00 50.00 50.00 63.33 55.00 1.06 1.08 1.09 1.47 1.30 * 103,172 35,232 52,485 16,971 60.00 60.00 60.00 50.00 1.38 1.43 1.40 1.13 103,910 35,338 52,593 17,370 60.00 60.00 60.00 50.00 1.40 1.42 1.42 1.14 Census geographic region: Northeast 20,462 60.00 1.47 20,695 62.50 1.48 Midwest 25,509 50.00 1.26 25,946 56.67 1.30 South 46,872 55.00 1.27 46,871 57.50 1.30 West 27,300 60.00 1.41 27,768 60.00 1.33 * Indicates a statistically significant difference between the standard and test instrument in the ratio of food spending relative to the household cost of the September TFP. 1 Totals exclude households that did not answer the questions about spending on food or reported zero usual food spending. For the Standard Instrument these exclusions represented 7.8 percent of all households (6.8 percent of unweighted respondents). For the Test Instrument these exclusions represented 6.9 percent of all households (6.3 percent of unweighted respondents). 2 Households with children in complex living arrangements. Estimates are suppressed (NA) due to small cell sizes, with less than 50 households in the cell. 3 Hispanics may be of any race. 4 Metropolitan are residence is based on 2013 Office of Management and Budget Delineation. Source: USDA, Economic Research Service using data from U.S. Census Bureau September 2020 Current Population Survey, Food Security Supplement. Sept 2020 CPS-FSS Split Panel, page 12 Methods and Results: Food Security Measures The primary focus of the CPS-FSS data collection is to collect data on food security in U.S. households. The data provide information for annual monitoring of the nation’s well-being and enable research to improve our understanding of the determinants of and policy impacts on food security. As such it is important to understand how any changes to the survey instrument may affect food insecurity prevalence estimates. As mentioned previously, the methods underlying the food security scale have been described elsewhere. Here we focus on a discussion of how the data from the split panel were analyzed. The food security questions and rules for assigning each household a food security status are shown in Box 2: Questions Used to Assess the Food Security of Households in the CPS Food Security Supplement. The measurement methods are unchanged between the standard and test instrument. We compare overall food insecurity prevalence rates between the September 2020 standard instrument panel and test instrument panel. We also show the results of the December 2020 annual food security estimates for comparison. As shown in Table 2, panel A, we find statistically significant differences in both the prevalence of food insecurity and very low food security between the standard instrument and both the test instrument and regular December 2020 data collection. The prevalence of food insecurity in the standard instrument in September is 9.7 percent, significantly below the prevalence in both the September test instrument (10.7 percent) and the December standard instrument (10.5 percent). The prevalence of food insecurity in 2019 was also 10.5 percent (not shown in the table). The prevalence of very low food security with the September standard instrument was 3.5 percent, significantly below the prevalence in the September test instrument (4.0 percent) and the December standard instrument (3.9 percent). The difference between the prevalence estimates obtained from the September standard instrument and the December data collection is not due to the survey instrument because the same instrument was used in both data collections. There were no statistically significant differences in the prevalence of food insecurity or very low food security between the September test instrument and December 2020 CPS-FSS. Sept 2020 CPS-FSS Split Panel, page 13 Table 2, panel B shows the results for households with children. The prevalence of household food insecurity for households with children is statistically significantly different between the September standard instrument (12.8 percent) and the September test instrument (14.6 percent) and December 2020 CPS-FSS (14.8 percent). Differences in the prevalence of food insecurity between the test instrument and standard instrument may be due, in part, to sampling error that has a greater impact on the smaller samples in the split panel and was potentially more problematic during the COVID-19 pandemic when response rates were lower. Sampling variation is inherent in any survey that relies on a sample rather than a census. However, there may have been more sampling error during the pandemic that resulted in nonresponse bias. Evidence from Census Bureau analysis suggests that nonresponse during the pandemic was more strongly associated with income than in prior years of the CPS data collections (Rothbaum and Bee 2021). This is an area for future research with the CPS-FSS. The response rates were similar between the test and standard instrument. For all households in both the standard instrument and test instrument panels, 0.2 percent of all households were missing on food security status (weighted; see footnote 1, Table 2). For the standard instrument 22 households (unweighted) were excluded and for the test instrument 26 households (unweighted) were excluded due to having no valid responses to the food security questions. For households with children, 0.1 percent of households (weighted) in the standard instrument panel and 0.3 percent of households (weighted) in the test instrument panel were excluded due to nonresponse on the food security (see footnote 2, Table 2). For the standard instrument, 3 households with children (unweighted) in the sample were excluded, and the for the test instrument, 7 households with children (unweighted) in the sample were excluded, based on nonresponse to the food security items. The percent of households affirming each of the individual food security questions is shown in Table 3. Like the results for the food security measures shown in Table 2, Table 3 shows that a lower percentage of households in the September standard instrument tended to affirm the food security questions when compared to households in the September test instrument, with statistically significant differences marked with an asterisk. Note that the child Sept 2020 CPS-FSS Split Panel, page 14 items with changes in wording between the test and standard instrument were not statistically significantly different. Given the modest differences observed in the prevalence of food insecurity and rates of affirmative responses to the food security questions used to construct food security measures between the standard and test supplements, we conducted additional psychometric analyses to better understand these differences and their implications for future food security measurement activities. To do so, we constructed two measurement subsamples based on households administered the standard and test instruments in the September 2020 CPS-FSS. Households were included in our standard and test measurement subsamples if their incomes were below 185 percent of the Federal poverty line 3, had no incomplete or missing responses to the food security questions, and no extreme raw scores (i.e., count of affirmative responses to the food security questions, extreme raw scores are no affirmative responses or all affirmative responses) on the 10 question adult and 8 question child food security scales. Households with extreme raw scores are omitted from our subsamples because households with these raw scores are not identified under the assumptions of the Conditional Maximum Likelihood (CML) Rasch measurement model used by USDA to develop and continually monitor the properties of adult and child food security scales. The resulting subsamples for the adult food security scale consisted of 1,192 and 1,241 households administered the standard and test instruments, respectively. For our analysis of the child food security scales, the subsamples consisted of 316 households administered the standard instrument and 296 households administered the test instrument. The four measurement subsamples were used to estimate the parameters of the Rasch measurement model for the adult and child food security scales, separately, for households administered the standard and test instruments using the ERSRasch program developed in SAS by ERS. For the purposes of this report, we will focus our discussion on the Rasch model parameters that capture the relative severity (in terms of food hardship) for each food security question. Any differences in the estimates of these severity parameters for households administered the standard and test instruments may be indications of respondents perceiving the We use this income threshold for our analyses because it is the screening threshold for a household to be administered the food security questions in the CPS-FSS. While this does result in the exclusion of small proportion of high income households from our analyses, it does mitigate bias associated with income that could result from the screening procedure (Nord, 2012). 3 Sept 2020 CPS-FSS Split Panel, page 15 food security questions differently or reflect differences in the way they experience food hardships. If this were to occur, then the standard and test instruments would be measuring different levels of the severity of food hardship, leading to biased comparisons of food security measures—such as the prevalence of food insecurity—based on these scales. Estimates of the Rasch severity parameters for the questions for adult food security scale are show, separately, in Figure 1 for those households administered the standard and test instruments. The food security questions that are estimated to capture a greater severity of food hardship in the test instrument relative to the standard instrument are indicated by the red “x’s” that are located above the equal severity line while those that capture a lesser severity of food hardship in the test instrument will be below the equal severity line. All the food security questions that comprise the adult food security scale captured similar levels of the severity of food hardship in the standard and test instruments, suggesting they would produce comparable measures of adult food security. Figure 2 provides estimates of the Rasch severity parameters for the child food security scale questions, estimated separately for households administered the standard and test instruments. Like our findings for the adult food security questions, we find that the severity of the child food security questions is similar for households administered the standard and test instruments. Therefore, food security measures based these instruments capture similar experiences related to food insecurity and are comparable. In addition, the proposed wording changes for “The child in (my/our) household was/The children were) not eating enough because (I/we) just couldn't afford enough food” and “In the last 12 months, (was the child/were the children) ever hungry but you just couldn't afford more food?” does not appear to have affected the way households with children interpreted these questions (see Box 2 for a comparison of wording between the standard and test questions). While our psychometric analyses provide evidence that standard and test instruments produce similar food security measures, it is important to note that the test instrument screened in more households than the standard supplement. Similar proportions of households administered the standard (38.2 percent) and test (38.1 percent) instruments were initially screened into the food security module; however, households administered the test instrument were more likely Sept 2020 CPS-FSS Split Panel, page 16 than those administered the standard instrument to screen past the first (18.2 percent versus 17.1 percent) and second (8.3 percent versus 7.3 percent) internal food security screeners. Households administered the standard (12.8 percent) and test (12.9 percent) instruments had similar rates of passing the child food insecurity screener. Therefore, the test instrument has the potential to lead to more precisely estimated measures of food security, which has important implications for the CPS-FSS and ERS food security monitoring procedures. Given the decline in response rates over the past few years to the monthly CPS and CPS-FSS, screening additional households into food security module, and in particular to the most severe food insecurity questions, will ensure ERS is able to reliability produce food security statistics for even the most severe forms of food insecurity well into the future. These Rasch analyses suggest that the test instrument measured food insecurity comparably to the standard USDA instrument. When USDA instituted similar modifications in previous years, those modifications also did not appreciably affect the food security measure. For example, in the 2007 CPS-FSS, food security questions were reordered in the questionnaire so that all household- and adult-referenced questions were administered first, followed by the childreferenced items. Changes were also made in internal screener specifications to accommodate the new order of questions in 2007, but those changes resulted in only negligible changes in item responses (see: “December 2007 Microdata File: Technical Documentation, available at https://www.ers.usda.gov/webdocs/DataFiles/50764/26516_notes1207.pdf?v=5277.8). The changes in item ordering did not result in a break in the food security series, and food insecurity estimates were comparable to previous years (Nord et al., 2008). Also, in the 2006 CPS-FSS questionnaire, the resource constraint was standardized for the adult items, “were you ever hungry” and “did you lose weight,” to “because there wasn’t enough money for food” so that the wording of the resource constraint was more consistent across questions (see Nord et al., 2006 and Nord et al., 2007). Again, this minor change did not result in a break in the series or change in comparability of the estimates from year to year. Given the current findings and past findings regarding the stability of the food security scale to similar minor modifications, we expect that the proposed updates to the CPS-FSS instrument will continue to produce comparable estimates to previous years. Sept 2020 CPS-FSS Split Panel, page 17 --------------------------------------------------------------------------------------------------------------------Box 2: Questions Used to Assess the Food Security of Households in the CPS Food Security Supplement 1. “We worried whether our food would run out before we got money to buy more.” Was that often, sometimes, or never true for you in the last 12 months? 2. “The food that we bought just didn’t last, and we didn’t have money to get more.” Was that often, sometimes, or never true for you in the last 12 months? 3. “We couldn’t afford to eat balanced meals.” Was that often, sometimes, or never true for you in the last 12 months? 4. In the last 12 months, did you or other adults in the household ever cut the size of your meals or skip meals because there wasn’t enough money for food? (Yes/No) 5. (If yes to question 4) How often did this happen—almost every month, some months but not every month, or in only 1 or 2 months? 6. In the last 12 months, did you ever eat less than you felt you should because there wasn’t enough money for food? (Yes/No) 7. In the last 12 months, were you ever hungry, but didn’t eat, because there wasn’t enough money for food? (Yes/No) 8. In the last 12 months, did you lose weight because there wasn’t enough money for food? (Yes/No) 9. In the last 12 months did you or other adults in your household ever not eat for a whole day because there wasn’t enough money for food? (Yes/No) 10. (If yes to question 9) How often did this happen—almost every month, some months but not every month, or in only 1 or 2 months? (Questions 11-18 were asked only if the household included children age 0-17) 11. “We relied on only a few kinds of low-cost food to feed our children because we were running out of money to buy food.” Was that often, sometimes, or never true for you in the last 12 months? Sept 2020 CPS-FSS Split Panel, page 18 12. “We couldn’t feed our children a balanced meal, because we couldn’t afford that.” Was that often, sometimes, or never true for you in the last 12 months? 13. Standard: “The children were not eating enough because we just couldn’t afford enough food.” Was that often, sometimes, or never true for you in the last 12 months? Test: “The children were not eating enough because there wasn’t enough money for food.” Was that often, sometimes, or never true for you in the last 12 months? 14. In the last 12 months, did you ever cut the size of any of the children’s meals because there wasn’t enough money for food? (Yes/No) 15. Standard: In the last 12 months, were the children ever hungry but you just couldn’t afford more food? (Yes/No) Test: In the last 12 months, were the children ever hungry because there wasn’t enough money for food? (Yes/No) 16. In the last 12 months, did any of the children ever skip a meal because there wasn’t enough money for food? (Yes/No) 17. (If yes to question 16) How often did this happen—almost every month, some months but not every month, or in only 1 or 2 months? 18. In the last 12 months did any of the children ever not eat for a whole day because there wasn’t enough money for food? (Yes/No) Coding of Responses Questions 1-3 and 11-13 are coded as affirmative (i.e., possibly indicating food insecurity) if the response is “often” or “sometimes.” Questions 5, 10, and 17 are coded as affirmative if the response is “almost every month” or “some months but not every month.” The remaining questions are coded as affirmative if the response is “yes.” Assessing Food Security Status in Households Without Children Households without children are classified as food insecure if they report 3 or more indications of food insecurity in response to the first 10 questions; they are classified as having very low food security if they report 6 or more food-insecure conditions out of the first 10 questions. Assessing Food Security Status in Households with Children Age 0-17 Sept 2020 CPS-FSS Split Panel, page 19 Households with children are classified as food insecure if they report 3 or more indications of food insecurity in response to the entire set of 18 questions; they are classified as having very low food security if they report 8 or more food-insecure conditions in response to the entire set of 18 questions. The food security status of children in the household is assessed by responses to the childreferenced questions (11-18). Households reporting two or more of these conditions are classified as having food insecurity among children. Households reporting five or more are classified as having very low food security among children. End of Box 2 --------------------------------------------------------------------------------------------------------------------- Sept 2020 CPS-FSS Split Panel, page 20 Table 2 Households by food security status and instrument version, September and December 2020 Panel A: All Households Category Food insecure Total1 1,000 Food secure 1,000 Percent All 1,000 Percent With low food security 1,000 Percent With very low food security 1,000 Percent September Standard Instrument All Households 130,124 117,511 90.3 12,613 9.7*+ 8,025 6.2 4,588 3.5*+ September Test Instrument All households 116,080 89.3 13,896 10.7 8,738 6.7 5,158 4.0 December 2020 (standard instrument) 130,459 116,705 All households 89.5 13,754 10.5 8,613 6.6 5,141 3.9 129,976 Panel B: Households with Children Households with foodinsecure children 1,000 Percent Households with very low food security among children 1,000 Percent Food-secure households 1,000 Percent Food-insecure households 1,000 Percent September Standard Instrument All households with children 37,275 32,506 87.2 4,769 12.8*+ 2,320 6.2+ 200 0.5 September Test Instrument All households with children 32,331 85.4 5,533 14.6 2,707 7.1 311 0.8 Category Total2 1,000 37,864 December 2020 (standard instrument) Sept 2020 CPS-FSS Split Panel, page 21 All households with children 37,903 32,280 85.2 5,623 14.8 2,870 7.6 322 0.8 * Difference between the September standard instrument and September test instrument is statistically significant with 90-percent confidence (t > 1.645). + Difference between the September standard instrument and December standard instrument is statistically significant with 90-percent confidence (t > 1.645). 1 Totals exclude households for which food security status is unknown because household respondents did not give a valid response to any of the questions in the food security scale. For all households (panel A) these exclusions representations: September 2020 Standard Instrument: 218,000 households (0.2 percent of all households) September 2020 Test Instrument: 315,000 households (0.2 percent of all households) December 2020 CPS-FSS: 308,000 households (0.2 percent of all households) 2 Totals exclude households for which food security status is unknown because household respondents did not give a valid response to any of the questions in the food security scale. For households with children (panel B) these exclusions representations: September 2020 Standard Instrument: 28,000 households (0.1 percent of all households) September 2020 Test Instrument: 115,000 households (0.3 percent of all households) December 2020 CPS-FSS: 106,000 households (0.3 percent of all households with children) Source: USDA, Economic Research Service using data from U.S. Census Bureau September 2020 and December 2020 Current Population Survey, Food Security Supplement. Sept 2020 CPS-FSS Split Panel, page 22 Table 3 Responses to items in the food security scale, Standard Instrument and Test Instrument, September 2020 Households affirming item Scale item1 Standard Test Household items: Worried food would run out before (I/we) got money to buy more Food bought didn't last and (I/we) didn't have money to get more Couldn't afford to eat balanced meals Adult items: Adult(s) cut size of meals or skipped meals Respondent ate less than felt he/she should Adult(s) cut size or skipped meals in 3 or more months Respondent hungry but didn't eat because couldn't afford Respondent lost weight Adult(s) did not eat for whole day Adult(s) did not eat for whole day in 3 or more months 14.0 10.9 10.4 14.7 11.6 11.8 * 5.7 5.7 4.1 3.0 2.0 1.1 0.8 6.3 * 6.5 * 4.7 * 3.2 2.2 1.1 0.8 Child items: Relied on few kinds of low-cost food to feed child(ren) 11.6 11.8 Couldn't feed child(ren) balanced meals 6.6 7.4 Child(ren) were not eating enough 3.0 2.9 Cut size of child(ren)'s meals 1.5 1.6 Child(ren) were hungry 0.6 1.0 Child(ren) skipped meals 0.4 0.6 Child(ren) skipped meals in 3 or more months 0.2 0.4 Child(ren) did not eat for whole day 0.1 0.1 * Difference between the September standard instrument and September test instrument is statistically significant with 90-percent confidence (t > 1.645). 1 The full wording of each questions includes explicit reference to resource limitation. See Box 2 for item wording. 2 Households not responding to an item are omitted from the calculations of percentages for that item. Household without children are omitted from the calculation of child-referenced items. Source: USDA, Economic Research Service using data from U.S. Census Bureau September 2020 Current Population Survey Food Security Supplement. Sept 2020 CPS-FSS Split Panel, page 23 Figure 1. Comparisons of the adult food security scale question severity parameters, 2020 September CPS-FSS test versus standard instrument 9 whldayf whlday losewt Item severity, test instrument 8 hungry 7 cutskipf eatless 6 cutskip 5 balmeal 4 fnotlast 3 2 worried 2 3 4 5 6 7 8 9 Item severity, standard instrument Test instrument Equal Severity Note. Question severity parameters estimated from separate CML Rasch measurement models for households administered the standard and test instruments in the 2020 September CPS-FSS. Source: USDA, Economic Research Service using data from U.S. Census Bureau September 2020 Current Population Survey Food Security Supplement. Sept 2020 CPS-FSS Split Panel, page 24 Figure 2. Comparisons of the child food security scale question severity parameters, 2020 September CPS-FSS test versus standard instrument 13 chwhlday Severity parameter, test instrument 12 11 chskipf 10 chhungry 9 chskip chcut 8 chenuf 7 6 5 chbal 4 3 2 chfewfd 2 3 4 5 6 7 8 9 10 11 12 13 Severity parameter, standard instrument Test instrument Equal Severity Note. Question severity parameters estimated from separate CML Rasch measurement models for households administered the standard and test instruments in the 2020 September CPS-FSS. Source: USDA, Economic Research Service using data from U.S. Census Bureau September 2020 Current Population Survey Food Security Supplement. Sept 2020 CPS-FSS Split Panel, page 25 Methods and Results: Federal Nutrition Assistance In USDA’s annual food security report, statistics on the use of Federal Nutrition Assistance by food security status is presented. The CPS-FSS data on nutrition assistance is not intended to describe total participation in these programs. Participation rates of eligible households and characteristics of participation are available from USDA’s Food and Nutrition Service. Rather, the data in the CPS-FSS and information presented in USDA’s report is meant to inform understanding of the relationship between nutrition assistance programs and food security. This section includes information on participation in the three largest Federal nutrition assistance programs: SNAP (Supplemental Nutrition Assistance Program, formerly Food Stamps), free or reduced-price school lunch from the National School Lunch Program (NSLP), and WIC (Special Supplemental Nutrition Program for Women, Infants, and Children (WIC). In the CPS-FSS all households with reported annual income below 185 percent of the Federal Poverty threshold were asked questions about their participation in Federal nutrition assistance. To minimize respondent burden, households with annual incomes above that range were not asked the questions unless they indicated some level of difficulty in meeting their food needs on the first of the two preliminary screener questions asked of all households (HES9). Due to the change in the location of the nutrition assistance questions in the test instrument, the second preliminary screener question on food insufficiency was also used as a screener question for the nutrition assistance items in the test instrument. In the split panel, there were a few differences between the standard and test instrument. In the test instrument, the questions on Federal nutrition assistance were moved after the questions on food security. The lead in to one of the screener questions (HES9) was also changed, due to the change in location of the question. The standard and test lead ins for HES9 are: Standard: People do different things when they are running out of money for food in order to make their food or their food money go further. In the last 12 months, since September of last year, did you ever run short of money and try to make your food or your food money go further? Sept 2020 CPS-FSS Split Panel, page 26 Test: The next questions are about the food eaten in your household in the last 12 months, since September of last year, and whether you were able to afford the food you need. In the last 12 months, since September of last year, did you ever run short of money and try to make your food or your food money go further? Also, a lead in for the question about participation in SNAP was added (HESP1) in the test instrument due to the new location in the instrument. There was no lead in for the standard instrument because the question about SNAP immediately followed question HES9 (shown just above). For both these items, there was no change to the wording of the question itself. Questions about free and reduced-price lunch were modified to use reduced-price language instead of reduced-cost meals, which is more consistent with the Federal programs. Standard: In the past 12 months, did (you/anyone in this household) get SNAP or food stamp benefits? Test: Sometimes people need help getting food for their household. There are many programs that can help. In the past 12 months, did (you/anyone in this household) get SNAP or food stamp benefits? A new question was added about the receipt of free or reduced-price meals or snacks at an after-school program. USDA’s Food and Nutrition Service staff recommended we ask about these programs during the expert review of the CPS-FSS instrument. These afterschool supper programs have become more common in recent years. There was a slight error in the test instrument for this item, and only households that reported receipt of free or reduced-price school lunch were asked the item. In the regular implementation of the revised instrument, all low-income or screened-in households with school-age children will be asked this item, regardless of whether they receive free or reduced-price school meals. One potential concern with the item before the test was that only a small number of households might affirm the item. Given that the survey was administered in September 2020 during the COVID-19 pandemic Sept 2020 CPS-FSS Split Panel, page 27 when many school districts had implemented online-learning, and given that only households reporting receipt of free or reduced-price school lunch were asked the item, the number of affirmative responses is likely suppressed. However, a total of 163 households affirmed the item with the test, and that total is likely to be higher when schools are open for in-person learning, the universe of the item is not restricted, and the item is administered in a full CPS sample. Thus, the item will likely have sufficient affirmations in a regular implementation to be useable for research and analysis. New test question: During the past 30 days, did any children in the household (between 5 and 18 years old) receive a free or reduced-price meal or snack at an after school program? [Note: The item will be asked only of households with school-age children. And for households with younger children in the household as well, the parenthetical will be added to indicate to the respondent that the question only refers to school-age children.] Table 4 shows the prevalence of food insecurity by participation in Federal nutrition assistance programs. The only statistically significant differences between the standard and test instrument are in the prevalence of food insecurity for SNAP participants. The prevalence of food insecurity among low-income households that received SNAP benefits in the previous 12 months was 39.3 percent in the standard instrument, significantly lower than 46.7 percent in the test instrument. This difference is driven primarily by the difference in food insecurity between the standard and test instrument for households that received SNAP benefits in all 12 months, where 39.3 percent of SNAP recipients in the standard instrument were food insecure, and 48.6 percent of SNAP recipient households in the test instrument were food insecure. In December 2020, 45.4 percent of low-income households that received SNAP benefits in the previous 12 months were food insecure (for the December 2020 estimates, see table 8 in Coleman-Jensen et al., 2021). The patterns between the test and standard instrument are similar and consistent with findings from previous years. We see higher food insecurity rates among low-income participants, than among low-income non-participants. Like the prevalence of food insecurity shown in Table 2, the prevalence estimates of food insecurity shown in Table 4 for the test instrument are more similar to the December 2020 estimates than are the estimates for the September standard instrument. Sept 2020 CPS-FSS Split Panel, page 28 The results suggest that the modified nutrition assistance items functioned as well as the standard instrument. There were no statistically significant differences for those receiving free or reduced-price school lunch. There is a statistically significant difference for the prevalence of food insecurity among those that received SNAP in the previous 12 months, but this may be due to differences in the sample, since the estimates from the test instrument are more similar to the December 2020 standard instrument than are the estimates from the September standard instrument. Adding the additional food insufficiency screening variable to screen households into the nutrition assistance section of the questionnaire and adding a lead-in to the SNAP variable may have affected SNAP reporting, but any possible effect does not appear to be deleterious. Cell sizes are relatively small for these estimates, so sampling errors or misreporting may have an undue effect on the estimates. There was a total of 672 low-income households in the test instrument and 706 households in the standard instrument that reported receipt of SNAP benefits and had valid food security data. Previous research has shown that nutrition assistance participation is underreported by household survey respondents in the CPS (see footnote 45 in Coleman-Jensen et al., 2021; and Meyer and George, 2011). Sept 2020 CPS-FSS Split Panel, page 29 Table 4 Percentage of households by food security status and participation in selected Federal nutrition assistance programs, by instrument version, September 2020 Standard Instrument Food insecure Food secure Income less than 130 percent of poverty line: Received SNAP1 benefits previous 12 months Received SNAP benefits all 12 months Received SNAP benefits 1 to 11 months Did not receive SNAP benefits previous 12 months Income less than 185 percent of poverty line; school-age children in household: Received NSLP2 free or reduced-price school lunch previous 30 days Did not receive NSLP free or reduced-price school lunch previous 30 days With With very low low food food All security security Percent 60.7 60.7 60.7 39.3 39.3 39.3 20.0 19.7 21.0 19.3 19.6 18.3 78.3 21.7 12.4 68.8 31.2 71.5 28.5 Food secure Test Instrument Food insecure With With very low low food food All security security Percent 53.3 46.7* 51.4 48.6* 57.4 42.6 26.4 29.1 20.5 20.3 19.5 22.2 9.3 75.1 24.9 14.5 10.4 21.8 9.3 62.3 37.7 26.6 11.1 17.0 11.5 71.0 29.0 19.1 10.0 Income less than 185 percent of poverty line; children under age 5 in household: Received WIC3 previous 30 days 70.4 29.6 14.5 15.1 62.4 37.6 30.8 6.9 Did not receive WIC previous 30 days 76.0 24.0 16.6 7.4 70.0 30.0 18.6 11.4 * Difference between September standard instrument and September test instrument is statistically significant with 90-percent confidence (t > 1.645). 1 SNAP=Supplement Nutrition Assistance Program, formerly the Food Stamp Program. 2 NSLP=National School Lunch Program Sept 2020 CPS-FSS Split Panel, page 30 3 WIC= Special Supplemental Nutrition Program for Women, Infants, and Children Source: USDA, Economic Research Service using data from U.S. Census Bureau September 2020 Current Population Survey, Food Security Supplement. Sept 2020 CPS-FSS Split Panel, page 31 Methods and Results: Community Nutrition Assistance In USDA’s statistical supplement to the annual food security report, statistics on the use of community nutrition assistance program are presented by food security status (ColemanJensen et al., 2021b). The combined use of community and Federal nutrition assistance are also reported, as is use of food pantries by household characteristics. Community nutrition assistance refers to free food available from food pantries, food banks, churches, etc., as well as free meals received from community soup kitchens and other sources. Anti-hunger advocates had previously commented to ERS staff that the statistics from the CPS-FSS are likely underestimating the use of community nutrition assistance, do not cover the full-range of how free food is made available, and are dated in the terminology used in the questions. As a result, we revised the items based on recommended wording from Feeding America. These items underwent cognitive testing and based on the recommendations of expert review and cognitive testing these new items were included in the food security test instrument. One item in the standard instrument asked about emergency food from food pantries and another asks about meals from a soup kitchen. These items were revised significantly. See the wording below from the standard and test instruments: Standard Instrument: Food pantries: In the last 12 months, did you or other adults in your household ever get emergency food from a church, a food pantry, or food bank? Soup kitchens: In the last 12 months, did you or other adults in your household ever eat any meals at a soup kitchen or shelter? Test Instrument: Free groceries: In the last 12 months, did you or anyone in your household ever get free groceries from a food pantry, food bank, church, or other place that helps with free food? Free meals: In the last 12 months, have you or anyone in your household received a free meal from a church, shelter, home-delivered meal service like Meals on Wheels, other place that helps with free meals? Sept 2020 CPS-FSS Split Panel, page 32 Differences in statistical significance are not presented in Table 5 because there is no expectation that these items are comparable given the changes in wording. The new questions about receipt of free groceries and free meals appear to have functioned adequately. For both questions in the test panel, receipt of free food was more common for food-insecure households, and most common for households with very low food security. This is to be expected as use of nutrition assistance, both Federal and community, is more common among food-insecure households. In addition, in the test panel, reported receipt was more common among low-income households. For households with incomes under 185 percent of poverty, 21.9 percent reported receipt of free groceries and 7.47 percent reported receipt of free meals. By contrast, in the test panel, among households with incomes of 185 percent of poverty and over, 3 percent reported receipt of free groceries and 0.7 percent reported receipt of free meals (estimates not shown in table). These findings further confirm that the relationship between receipt of community nutrition assistance as obtained from the test instrument and household income is as expected. For both the question about free groceries and free meals in the test supplement, the reported receipt is higher than for the questions about food pantries and soup kitchens in the standard instrument. This is consistent with our expectation for the test items. The language for the test items is more inclusive in several ways, including asking if “anyone in your household” received assistance rather than just “adults,” referring to “free groceries” rather than only “emergency food,” asking about “home-delivered meals”, and by asking about any “other place that helps with free food/meals.” Based on expert review, cognitive testing, and the results of the test instrument the revised questions on community nutrition assistance appear to be an improvement and function well. Sept 2020 CPS-FSS Split Panel, page 33 Table 5 Use of community nutrition assistance1, by standard and test instrument, September 2020 Standard Instrument Test Instrument Food pantries Soup kitchens Free groceries Free meals Total Users Total Users Total Users Total Users 1,000 1,000 Percent 1,000 1,000 Percent 1,000 1,000 Percent 1,000 1,000 Percent All households2 129,564 7,584 5.9 129,574 597 0.5 129,198 8,888 6.9 129,103 2,705 2.1 Households by food security status3: Food secure 117,108 3,618 3.1 117,121 224 0.2 115,597 4,355 3.8 115,533 1,448 1.3 Food insecure 12,454 3,966 31.8 12,437 374 3.0 13,566 4,533 33.4 13,546 1,257 9.3 Low food security 7,963 2,174 27.3 7,938 206 2.6 8,530 2,598 30.5 8,529 579 6.8 Very low food security 4,491 1,793 39.9 4,499 167 3.7 5,036 1,934 38.4 5,018 678 13.5 1 Questions about receipt of community nutrition assistance are not comparable between the standard and test instrument. Percentages between the two instruments are not tested for statistical significance, because the wording of the items changed enough that there is no expectation of comparability. 2 Totals for “All households” exclude households that did not answer the question about food pantries/free groceries or emergency kitchens/free meals. For all households these exclusions represent: September 2020 Standard Instrument: 0.6 percent of all households had missing data on food pantries, and 0.6 percent of all households had missing data on soup kitchens. September 2020 Test Instrument: 0.8 percent of all households had missing data on free groceries, and 0.9 percent of all households had missing data on free meals. 3 Totals also exclude households for which food security status is unknown because household respondents did not give a valid response to any of the questions in the food security scale. Source: USDA, Economic Research Service using data from U.S. Census Bureau September 2020 Current Population Survey, Food Security Supplement. Sept 2020 CPS-FSS Split Panel, page 34 Conclusions Based on the analysis of the split panel test in the September 2020 CPS-FSS discussed here, we believe that the test instrument performed well. Observed differences in the test and standard instrument for food spending and community nutrition assistance were expected. The Rasch analysis confirms that the minor changes to the food security section are unlikely to impact the measurement of food insecurity, or impact comparability of estimates from year-toyear. We concur with the recommendations from the expert review, and from the cognitive testing, and now based on analysis of the survey data, that updates to the CPS-FSS September 2020 test instrument should be implemented in the regular CPS-FSS data collection moving forward. Any changes to the regular CPS-FSS December instrument will be documented for researchers and data users and for stakeholders reading or citing the annual report, Household Food Security in the United States. Sept 2020 CPS-FSS Split Panel, page 35 References Coleman-Jensen, Alisha, Matthew P. Rabbitt, Christian A. Gregory, and Anita Singh, 2021, Household Food Security in the United States in 2020, Economic Research Report Number 298, Economic Research Service, U.S. Department of Agriculture, September 8. https://www.ers.usda.gov/publications/pub-details/?pubid=102075 Coleman-Jensen, Alisha, Matthew P. Rabbitt, Christian A. Gregory, and Anita Singh, 2021b, Statistical Supplement to Household Food Security in the United States in 2020, Administrative Publication Number 091, Economic Research Service, U.S. Department of Agriculture, September 8. https://www.ers.usda.gov/publications/pubdetails/?pubid=102071 Kephart, Kathleen, Jonathan Katz, Matthew Virgile, Rodney Terry, and Jessica Holzberg, 2021, Cognitive Testing Results for the Current Population Survey Food Security Supplement, Research Report Series: Survey Methodology Number 2021-06, Center for Behavioral Science Methods, Research and Methodology Directorate, U.S. Census Bureau, November 12. https://www.census.gov/library/working-papers/2021/adrm/rsm202106.html Meyer, Bruce D., and Robert George, 2011, “Errors in Survey Reporting and Imputation and Their Effects on Estimation of Food Stamp Participation,” Working Paper, The Harris School, University of Chicago. Nord, Mark, Margaret Andrews, and Steven Carlson, 2006, Household Food Security in the United States, 2005, Economic Research Report Number 29, Economic Research Service, U.S. Department of Agriculture, November. https://www.ers.usda.gov/publications/pub-details/?pubid=45668 Nord, Mark, Margaret Andrews, and Steven Carlson, 2007, Household Food Security in the United States, 2006, Economic Research Report Number 49, Economic Research Service, U.S. Department of Agriculture, November. https://www.ers.usda.gov/publications/pub-details/?pubid=45902 Nord, Mark, Margaret Andrews, and Steven Carlson, 2008, Household Food Security in the United States, 2007, Economic Research Report Number 66, Economic Research Service, U.S. Department of Agriculture, November. https://www.ers.usda.gov/publications/pub-details/?pubid=46086 Rothbaum, Jonathan and Adam Bee, 2021, Coronavirus Infects Surveys, Too: Survey Nonresponse Bias and the Coronavirus Pandemic, Working Paper Number SEHSD WP2020-10, Social, Economic, and Housing Statistics Division Working Papers, U.S. Census Bureau, March 30. https://www.census.gov/library/workingpapers/2020/demo/SEHSD-WP2020-10.html Sept 2020 CPS-FSS Split Panel, page 36 Appendix A TEST QUESTIONNAIRE – SEPTEMBER 2020 FOOD SECURITY SUPPLEMENT Test Questionnaire to test recommended changes from Census Cognitive Testing Draft test questionnaire January 3, 2020 NOTE: This test version starts with the 2019 CPS-FSS questionnaire. HRPOOR may need to be updated before final production in September 2020. Changes from 2018 CPS-FSS to 2019 CPSFSS questionnaire: There are updates to the POORCK specification (HRPOOR variable). Three new household size and income combinations will be screened into the module in 2019 with POOR now equal to 1 for these groups. Changes are highlighted in yellow below in POORCK specification and shown here: NUMHOU=1 and FAMINC=8 set POOR=1 NUMHOU=4 and FAMINC=12 set POOR=1 NUMHOU=5 and FAMINC=13 set POOR=1 NOTE: Update year where appropriate to 2020. Update month where appropriate from December to September. Changes for test are highlighted in yellow. SPECIFICATIONS Set SUPTM SUPTM is a timer for the entire supplement. ------------------------------------------------------------NOTES:and are State-specific names for the SNAP/Food Stamp program. ------------------------------------------------------------POORCK NUMHOU = 1 and FAMINC = 1, 2, 3, 4, 5, 6, 7, or 8 set POOR=1 else if NUMHOU = 2 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, or 9 set POOR=1 else if NUMHOU = 3 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10 set POOR=1 else if NUMHOU = 4 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, or 12 set POOR=1 else if NUMHOU = 5 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12 or 13 set POOR=1 else if NUMHOU = 6 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, or 13 set POOR=1 else if NUMHOU = 7 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, or 14 set POOR=1 else if NUMHOU = 8 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, or 14 set POOR=1 else if NUMHOU= 9-16 and FAMINC = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, or 15 set POOR=1 else if Set POOR = 2. ------------------------------------------------------------- Sept 2020 CPS-FSS Split Panel, page 37 [LEAD for one-person households] This month we are asking some questions about food used in your household and the ways you are managing to meet your food needs. [Lead for two or more person households] This month we are asking some questions about food used in your household and the ways you are managing to meet your food needs. (/The best person to answer would be the adult most knowledgeable about food shopping and meal preparation. Would that be you or someone else?) [Change respondent if needed and available, otherwise continue with current respondent] [If group quarters, go to S9] I. FOOD EXPENDITURES S1A If more than one HHMEM=1 has an AGE equal to or greater than 10 fill with second option else fill with first option. These first questions are about all the places at which you bought food LAST WEEK. By LAST WEEK, I mean from Sunday through Saturday. First, did (you/anyone in your household) shop for food at a supermarket, grocery store, Walmart or Target LAST WEEK? <1> <2> Yes No Blind or SCOMPL If onpath entry, D or R in S1A then set SCOMPL=1 otherwise set SCOMPL=0 S1B If more than one HHMEM=1 has an AGE equal to or greater than 10 fill with second option else fill with first option. Think about other places where people buy food, such as dollar stores, pharmacies, club stores, farmers markets, or online. Did (you/anyone in your household) buy food from any stores such as these LAST WEEK? <1> <2> Yes No Blind or S1C If more than one HHMEM=1 has an AGE equal to or greater than 6 fill with second option else fill with first option else fill with first option in first parenthetical. Sept 2020 CPS-FSS Split Panel, page 38 If one or more HHMEM=1 with AGE between 6 and 18 then fill second parenthetical else fill blank. LAST WEEK, did (you/anyone in your household) buy food at a restaurant, fast food place, cafeteria, deli, convenience store, or vending machine? (Include any children who may have bought food at the school cafeteria). <1> <2> Yes No Blind or S1D If more than one HHMEM=1 has an AGE equal to or greater than 10 fill with second option else fill with first option. Did (you/anyone in your household) buy food from any other kind of place LAST WEEK? <1> <2> Yes No Blind or SCKA If onpath entry of <2>, or in S1A, S1B, S1C and S1D then skip to S8 else go to SLEAD. SLEAD Now I'm going to ask you about the TOTAL amount you spent on food LAST WEEK in all the places where you bought food. Then, since LAST WEEK may have been unusual for you, I will ask about the amount you USUALLY spend. Proceed SCKB S2 If onpath entry of <1> in S1A then ask S2 else skip to SCKC. If more than one HHMEM=1 has an AGE equal to or greater than 10 fill with second option else fill with first option. If POOR=1 then fill second parenthetical else fill blank. How much did (you/anyone in your household) spend in total at supermarkets, grocery stores, Walmart or Target LAST WEEK (including any purchases made with
or food stamp benefits)? ENTER <0> IF RESPONDENT CAN ONLY GIVE RANGE Sept 2020 CPS-FSS Split Panel, page 39 $_ _ _.00 S2CK If entry of <0> in S2 goto S2CK1A else store entry in S2O. If S2O is between $1.00 and $450.00 goto S3A else if S2O is equal to D or R go to SCKC otherwise go to S2RC. S2CK1A **************DO NOT READ TO RESPONDENT ******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S2O <1-999> GOTO S2CK1B GOTO SCKC S2CK1B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S2O <1-999> GOTO S2RG GOTO SCKC S2RG Add the entries in S2CK1A and S2CK1B and divide by 2. Store the answer in S2O. If S2O is between $1.00 and $450.00 go to S3A otherwise go to S2RC. S2RC *****************DO NOT ASK THE RESPONDENT******************* Amount spent recorded as: (entry in S2O) Is this entry correct? <1> <2> S2COR YES (GO TO S3A) NO (GO TO S2COR) ***************DO NOT ASK THE RESPONDENT**************** Incorrect entry was recorded as: Correct entry is: (entry in S2O) $_ _ _.00 (store entry in S2O) Sept 2020 CPS-FSS Split Panel, page 40 S3A How much of the (fill with S2O) was for non-food items, such as pet food, paper products, alcohol, detergents, or cleaning supplies? Enter <1> for whole dollar amount (GOTO S3) Enter <2> if respondent can only give range (GOTO S3CK2A) $_ _ _.00 Blind or (GOTO SCKC) S3 Enter whole dollar amount $_ _ _.00 Store amount in S3O <1-100> GOTO SCKC <0, ge 101> GOTO S3RC S3CK2A ******************DO NOT READ TO ESPONDENT******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S3O <1-999> GOTO S3CK2B GOTO SCKC S3CK2B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S3O <1-999> GOTO S3RG GOTO SCKC S3RG Add the entries in S3CK2A and S3CK2B and divide by 2. Store the answer in S3O. Do not allow entry in S3O to be greater than entry in S2O. If S3O is between $1.00 and $100.00 go to SCKC otherwise go to S3RC. S3RC *************DO NOT ASK THE RESPONDENT********************** Amount spent recorded as: (entry in S3O) Sept 2020 CPS-FSS Split Panel, page 41 Is this entry correct? <1> <2> S3COR YES (GO TO SCKC) NO (GO TO S3COR) ***************DO NOT ASK THE RESPONDENT****************** Incorrect entry was recorded as: Correct entry is: (entry in S3O) $_ _ _.00 (store entry in S3O) Do not allow entry in S3O to be greater than entry in S2O. SCKC S4 If onpath entry of <1> in S1B then ask S4 else skip to SCKD. If more than one HHMEM=1 has an AGE equal to or greater than 10 fill with second option else fill with first option. If POOR=1 then fill second parenthetical with first option else fill with blank. How much did (you/your household) spend at stores such as dollar stores, pharmacies, club stores, farmers markets, or online LAST WEEK (including any purchases made with or food stamp benefits)? Enter whole dollar amount Enter <0> if respondent can only give range $_ _ _.00 Blind or (GO TO SCKD) S4CK If entry of <0> in S4 go to S4CK1A else store entry in S4O. If S4O is between $1.00 and $300.00 go to S5 else if S4O is D or R go to SCKD otherwise go to S4RC. S4CK1A **************DO NOT READ TO RESPONDENT******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S4O <1-999> GOTO S4CK1B Sept 2020 CPS-FSS Split Panel, page 42 GOTO SCKD S4CK1B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S4O <1-999> GOTO S4RG GOTO SCKD S4RG Add the entries in S4CK1A and S4CK1B and divide by 2. Store the answer in S4O. If S4O is between $1.00 and $300.00 go to S5A otherwise go to S4RC. S4RC *****************DO NOT READ TO RESPONDENT****************** Amount spent recorded as: (entry in S4O) Is this entry correct? <1> Yes (GO TO S5A) <2> No (GO TO S4COR) S4COR ***************DO NOT READ TO RESPONDENT******************** Incorrect entry was recorded as: (entry in S4O) Correct entry is: $_ _ _.00 (store entry in S4O) S5A How much of the $(fill with S4O) was for non-food items, such as pet food, paper products, alcohol, detergents, or cleaning supplies? Enter <1> for whole dollar amount (GOTO S5) Enter <2> if respondent can only give range (GOTO S5CK1A) $_ _ _.00 Blind or (GOTO SCKD) S5 Enter whole dollar amount $_ _ _.00 Store amount in S5O <1-100> GOTO SCKD Sept 2020 CPS-FSS Split Panel, page 43 GOTO S5RC S5CK1A ******************DO NOT READ TO ESPONDENT******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S5O <1-999> GOTO S5CK1B GOTO SCKD S5CK1B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S5O <1-999> GOTO S5RG GOTO SCKD S5RG Add the entries in S5CK1A and S5CK1B and divide by 2. Store the answer in S5O. Do not allow entry in S5O to be greater than entry in S4O. If S5O is between $1.00 and 100.00 go to SCKD else go to S5RC. S5RC ***************DO NOT ASK THE RESPONDENT*************** Amount spent recorded as : (entry in S5O) Is this entry correct? <1> <2> S5COR Yes (GO TO SCKD) No (GO TO S5COR) ***************DO NOT ASK THE RESPONDENT******************* Incorrect entry was recorded as: Correct entry is: (entry in S5O) $_ _ _.00 (store entry in S5O) Do not allow entry in S5O to be greater than entry in S4O. SCKD If entry of <1> in S1C then ask S6 else skip to SCKE Sept 2020 CPS-FSS Split Panel, page 44 S6 If more than one HHMEM=1 has an AGE equal to or greater than 10 fill with second option else fill with first option. How much did (you/your household) spend for food at restaurants, fast food places, cafeterias, delis, convenience stores, and vending machines LAST WEEK, not including alcohol purchases (including any purchases made with (SNAP/ Food Supplement Program) or food stamp benefits)? Enter whole dollar amount Enter <0> if respondent can only give range $_ _ _.00 Blind or If entry is 1-999, D, or R store in S6O <0> GOTO S6CK1A <1-200, D, R> GOTO SCKE GOTO S6RC S6CK1A **************DO NOT READ TO RESPONDENT ******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S6O <1-999> GOTO S6CK1B GOTO SCKE S6CK1B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S6O <1-999> GOTO S6RG GOTO SCKE S6RG Add the entries in S6CK1A and S6CK1B and divide by 2. Store the answer in S6O. If S6O is between $1.00 and $200.00 go to SCKE else go to S6RC. S6RC ***************DO NOT ASK THE RESPONDENT***************** Sept 2020 CPS-FSS Split Panel, page 45 Amount spent recorded as : (entry in S6O) Is this entry correct? <1> <2> S6COR Yes (GO TO SCKE) No (GO TO S6COR) **************DO NOT ASK THE RESPONDENT******************** Incorrect entry was recorded as: Correct entry is: (entry in S6O) $_ _ _.00 (store entry in S6O) SCKE S7 If entry of <1> in S1D then ask S7 else skip to SCKF. If more than one HHMEM=1 has an AGE equal to or greater than 10 fill with second option else fill with first option. How much did (you/your household) spend for food at any other kind of place LAST WEEK? Enter whole dollar amount Enter <0> if respondent can only give range $_ _ _.00 Blind or If entry is 1-999, D, or R store in S7O <0> GOTO S7CK1A <1-150> GOTO SCKF GOTO S7RC GOTO SCKF S7CK1A **************DO NOT READ TO RESPONDENT ******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S7O <1-999> GOTO S7CK1B GOTO SCKF Sept 2020 CPS-FSS Split Panel, page 46 S7CK1B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S7O <1-999> GOTO S7RG GOTO SCKF S7RG Add the entries in S7CK1A and S7CK1B and divide by 2. Store the answer in S7O. If S7O is between $1.00 and $150.00 go to SCKF otherwise go to S7RC. S7RC *************DO NOT ASK THE RESPONDENT********************** Amount spent recorded as: (entry in S7O) Is this entry correct? <1> <2> S7COR YES (GO TO SCKF) NO (GO TO S7COR) **************DO NOT ASK THE RESPONDENT******************* Incorrect entry was recorded as: Correct entry is: (entry in S7O) $_ _ _.00 (store entry in S7O) SCKF If any amounts 0 or over in S2O, S4O, S6O or S7O then add together and store in SFDAMT. If any amounts 0 or over in S3O or S5O, then add these together and store in SNFAMT. Subtract SNFAMT from SFDAMT and store the result in S8O. S8A If (entry of D or R in S2, S4, S6, and S7) or (S8O equals 0) or (onpath entry of <2>, , or in S1A, S1B, S1C and S1D) then fill first parenthetical with first option else fill with second option. If more than one HHMEM=1 has an AGE equal to or greater than 10 fill remaining parentheticals with second option else fill with first. If POOR= 1 fill last parenthetical with first option else fill with blank. (Let's see, it seems that (you/your household) did not buy any food LAST WEEK. /Let's see, (you/your household) spent about (fill with S8O) on food Sept 2020 CPS-FSS Split Panel, page 47 LAST WEEK.) Now think about how much (you/anyone in your household) USUALLY (spend/spends). How much (do you/does your household) USUALLY spend on food at all the different places we've been talking about IN A WEEK? (Please include any purchases made with or food stamp benefits). Do not include non-food items such as pet food, paper products, detergent or cleaning supplies. Enter <1> for whole dollar amount Enter <2> if respondent can only give range Blind or If entry is D or R store in S8OU <1> GOTO S8 <2> GOTO S8CK1A GOTO S9 S8 Enter whole dollar amount $_ _ _.00 Store amount in S8OU <0> GOTO S8ZA <1-450> GOTO S8B GOTO S8RC GOTO S9 S8CK1A **************DO NOT READ TO RESPONDENT ******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8OU <1-999> GOTO S8CK1B GOTO S9 S8CK1B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8OU <1-999> GOTO S8RG Sept 2020 CPS-FSS Split Panel, page 48 GOTO S9 S8RG Add the entries in S8CK1A and S8CK1B and divide by 2. Store the answer in S8OU. If S8OU is between $1.00 and $450.00 go to S8B otherwise go to S8RC. S8ZA If that is because you shop for food only once in awhile, how much would you say you spend in total in a month? NOTE: This question previously asked “If that is because you shop for food infrequently, how much would the weekly average be over several weeks?”. The previous version asked the respondent to determine the weekly average. The new question asks the respondent how much they spend in a month. The survey software instrument will then calculate the weekly average for the respondent. Census will need to provide guidance on how this change should be reflected in the interviewer instructions below. We still want to enter a weekly average in the data even though the question now asks for a monthly average. Enter <1> for whole dollar amount or if the amount really is zero Enter <2> if respondent can only give range Blind or If entry is D or R store in S8OU <1> GOTO S8Z <2> GOTO S8ZCK1A GOTO S9 S8Z Enter whole dollar amount $_ _ _.00 Store amount in S8OU NOTE: Divide by 4 before storing in S8OU (see note at top of page 14)? <0> GOTO S8RC <1-450> GOTO S8B GOTO S8RC S8ZCK1A **************DO NOT READ TO RESPONDENT ******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8OU <1-999> GOTO S8ZCK1B Sept 2020 CPS-FSS Split Panel, page 49 GOTO S9 S8ZCK1B Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8OU <1-999> GOTO S8ZRG GOTO S9 S8ZRG Add the entries in S8ZCK1A and S8ZCK1B and divide by 2. Store the answer in S8OU. NOTE: Divide by 4 before storing in S8OU (see note at top of page 14)? If S8OU is between $1.00 and $450.00 go to S8B otherwise go to S8RC. S8RC *************DO NOT ASK THE RESPONDENT******************** Amount spent recorded as: (entry in S8OU) Is this entry correct? <1> <2> S8COR Yes (GO TO S8B) No (GO TO S8COR) *************DO NOT ASK THE RESPONDENT******************** Incorrect entry was recorded as: (entry in S8OU) Correct entry is: $ _ _ _ _.00 II. MINIMUM SPENDING NEED TO HAVE ENOUGH FOOD S8B If NUMHOU = 1 then fill parenthetical with first option else fill with second option. In order to buy just enough food to meet (your needs/the needs of your household), would you need to spend more than you do now, or could you spend less? ************************DO NOT READ************************ <1> <2> <3> More (GO TO S8C) Less (GO TO S8D) Same (GO TO S9) Sept 2020 CPS-FSS Split Panel, page 50 Blind or (GO TO S9) S8C About how much MORE would you need to spend each week to buy just enough food to meet the needs of your household? Enter whole dollar amount Enter <0> if respondent can only give range $_ _ _.00 Blind or If entry is 1-999, D, or R store in S8CO <0> GOTO S8CCKA <1-999, D, R> GOTO S9 S8CCKA **************DO NOT READ TO RESPONDENT ******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8CO <1-999> GOTO S8CCKB GOTO S9 S8CCKB Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8CO <1-999> GOTO S8CRG GOTO S9 S8CRG Add the entries in S8CCKA and S8CCKB and divide by 2. Store the answer in S8CO. GOTO S9. S8D About how much LESS could you spend each week and still buy enough food to meet the needs of your household? Enter whole dollar amount Enter <0> if respondent can only give range Sept 2020 CPS-FSS Split Panel, page 51 $_ _ _.00 Blind or If entry is 1-999, D, or R store in S8DO <0> GOTO S8DCKA <1-999, D, R> GOTO S9 S8DCKA **************DO NOT READ TO RESPONDENT ******************* Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8DO <1-999> GOTO S8DCKB GOTO S9 S8DCKB Enter range reported by respondent _ _ _.00 If entry is D or R, store in S8DO <1-999> GOTO S8DRG GOTO S9 S8DRG Add the entries in S8DCKA and S8DCKB and divide by 2. Store the calculated value in S8DO. GOTO S9. Sept 2020 CPS-FSS Split Panel, page 52 III. FOOD SUFFICIENCY AND FOOD SECURITY S9_Lead The next questions are about the food eaten in your household in the last 12 months, since September of last year, and whether you were able to afford the food you need. S9 In the last 12 months, since September of last year, did you ever run short of money and try to make your food or your food money go further? <1> Yes (GO TO SS1) <2 > No (GO TO SS1) Blind or (GO TO SS1) If NUMHOU = 1 then fill parenthetical with first option else fill with second option. SS1 Which of these statements best describes the food eaten in your household-- enough of the kinds of food (I/ we) want to eat, enough but not always the kinds of food (I/ we) want to eat, sometimes not enough to eat, or often not enough to eat? <1> <2> <3> <4> Enough of the kinds of food we want to eat Enough but not always the kinds of food we want to eat Sometimes not enough to eat Often not enough to eat Blind or ----------------------------------------------------SX1CK If POOR=2 and (SS1= <1> or ) and (S9= <2> or ), then go to END OF SUPPLEMENT else ask SS2 -----------------------------------------------------NOTE: ADULT_COUNT=number of household members with AGE>=18 or PURRP=1, 2, 3, 13, or 14 CHILD_COUNT=number of household members with AGE<=17 and PURRP>=4 and PURRP not 13 or 14 -----------------------------------------------------SS2 If ADULT_COUNT=1 for the household then fill first option in parenthetical else fill second option. Now I'm going to read you several statements that people have made about their food situation. For these statements, please tell me whether the Sept 2020 CPS-FSS Split Panel, page 53 statement was OFTEN true, SOMETIMES true, or NEVER true for (you/your household) in the last 12 months. The first statement is "(I/We) worried whether (my/our) food would run out before (I/we) got money to buy more." Was that OFTEN true, SOMETIMES true, or NEVER true for (you/your household) in the last 12 months? <1> Often true <2> Sometimes true <3> Never true (GO TO SS3) Blind or (GO TO SS3) SSM2 Did this ever happen in the last 30 days? <1> Yes <2> No Blind or SS3 "The food that (I/we) bought just didn't last, and (I/we) didn't have money to get more." Was that OFTEN, SOMETIMES or NEVER true for (you/ your household) in the last 12 months? <1> Often true <2> Sometimes true <3> Never true (GO TO SS4) Blind or (GO TO SS4) SSM3 Did this ever happen in the last 30 days? <1> Yes <2> No Blind or SS4 "(I/we) couldn't afford to eat balanced meals." Was that OFTEN, SOMETIMES or NEVER true for (you/ your household) in the last 12 months? <1> Often true (GO TO SSM4) <2> Sometimes true (GO TO SSM4) <3> Never true (GO TO SX2CK) Sept 2020 CPS-FSS Split Panel, page 54 Blind or (GO TO SX2CK) SSM4 Did this ever happen in the last 30 days? <1> Yes <2> No Blind -----------------------------------------------------------SX2CK If SS1 = <3> or <4> OR SS2 = <1> or <2> OR SS3 = <1> or <2> OR SS4 = <1> or <2> then go to SH2 else go to SX4CK. -----------------------------------------------------------SH2 If ADULT_COUNT=1 for the household then fill first option in parenthetical else fill second option. In the last 12 months, did (you/ you or other adults in your household) ever cut the size of your meals or skip meals because there wasn't enough money for food? <1> Yes <2> No (GO TO SH3) Blind or (GO TO SH3) SHF2 How often did this happen--almost every month, some months but not every month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SHM2 If ADULT_COUNT=1 for the household then fill first option in parenthetical else fill second option. Now think about the last 30 days. During that time did (you/ you or other adults in your household) ever cut the size of your meals or skip meals because there wasn't enough money for food? <1> Yes Sept 2020 CPS-FSS Split Panel, page 55 <2> No (GO TO SH3) Blind or (GO TO SH3) SHMF2 How many days did this happen in the last 30 days? ______number of days (GO TO SH3) <1-30> Blind or (GO TO SH3) SH3 In the last 12 months, did you ever eat less than you felt you should because there wasn't enough money for food? <1> Yes <2> No (GO TO SH4) Blind or (GO TO SH4) SHF3 How often did this happen-almost every month, some months but not every month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SHM3 Did this happen in the last 30 days? <1> Yes <2> No (GO TO SH4) Blind or (GO TO SH4) SHMF3 In the last 30 days, how many days did you eat less than you felt you should because there wasn't enough money for food? ______ number of days <1-30> Blind or SH4 In the last 12 months, were you ever hungry but didn't eat because there wasn't enough money for food? Sept 2020 CPS-FSS Split Panel, page 56 <1> Yes <2> No (GO TO SH5) Blind or (GO TO SH5) SHF4 How often did this happen--almost every month, some months but not every month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SHM4 Did this happen in the last 30 days? <1>Yes <2> No (GO TO SH5) Blind or (GO TO SH5) SHMF4 In the last 30 days, how many days were you hungry but didn't eat because there wasn't enough money for food? _____ number of days <1-30> Blind or SH5 In the last 12 months, did you lose weight because there wasn't enough money for food? <1> Yes <2> No (GO TO SX3CK) Blind or (GO TO SX3CK) SHM5 Did this happen in the last 30 days? <1> Yes <2> No Blind or ----------------------------------------------------------------- Sept 2020 CPS-FSS Split Panel, page 57 SX3CK If SH2=<1> OR SH3=<1> OR SH4=<1> OR SH5=<1> then continue to SSH1 else skip to SX4CK ----------------------------------------------------------------SSH1 If ADULT_COUNT=1 for the household then fill first option in parenthetical else fill second option. In the last 12 months, did (you/you or other adults in your household) ever not eat for a whole day because there wasn't enough money for food? <1> Yes <2> No (GO TO SX4CK) Blind or (GO TO SX4CK) SSHF1 How often did this happen--almost every month, some months but not every month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SSHM1 If ADULT_COUNT=1 for the household then fill first option in parenthetical else fill second option. Now think about the last 30 days. During that time did (you/ you or other adults in your household) ever not eat for a whole day because there wasn't enough money for food? <1> Yes <2> No (GO TO SX4CK) Blind or (GO TO SX4CK) SSHMF1 How many times did this happen in the last 30 days? ______ times <1-30> Blind or -------------------------------------------------------------------- Sept 2020 CPS-FSS Split Panel, page 58 SX4CK If CHILD_COUNT is greater than or equal to 1 in household go to SS5 else skip to SP1. ------------------------------------------------------------SS5_LEAD Now I'm going to read you several statements that people have made about the food situation of their children. For these statements, please tell me whether the statement was OFTEN true, SOMETIMES true, or NEVER true in the last 12 months for any child under 18 years old living in the household. SS5 If ADULT_COUNT=1 for the household fill first, third, fourth and fifth parenthetical with first option else fill with second option. If CHILD_COUNT=1 then fill second parenthetical with first option else fill with second option. "(I/we) relied on only a few kinds of low-cost food to feed (the child in (my/our) household/the children) because (I was/we were) running out of money to buy food. Was that OFTEN, SOMETIMES or NEVER true for (you/ your household) in the last 12 months? <1> Often true <2> Sometimes true <3> Never true (GO TO SS6) Blind or (GO TO SS6) SSM5 Did this ever happen in the last 30 days? <1> Yes <2> No Blind or SS6 If ADULT_COUNT=1 fill first, third, fourth and fifth parenthetical with first option else fill with second option. If CHILD_COUNT=1 then fill second parenthetical with first option else fill with second option. "(I/we) couldn't feed (the child in (my/our) household/the children) a balanced meal, because (I/we) couldn't afford that." Was that OFTEN, SOMETIMES or NEVER true for (you/your household) in the last 12 months? <1> Often true (GO TO SSM6) Sept 2020 CPS-FSS Split Panel, page 59 <2> Sometimes true (GO TO SSM6) <3> Never true (GO TO SH1) Blind or (GO TO SH1) SSM6 Did this ever happen in the last 30 days? <1> Yes <2> No Blind or SH1 If ADULT_COUNT=1 then fill second, third, and fourth parenthetical with first option else fill with second option. If CHILD_COUNT=1 then fill first parenthetical with first option else fill with second option. "(The child in (my/our) household was/The children were) not eating enough because there wasn’t enough money for food." Was that OFTEN, SOMETIMES or NEVER true for (you/ your household) in the last 12 months? <1> Often true <2> Sometimes true <3> Never true (GO TO SX5CK) Blind or (GO TO SX5CK) SHM1 Did this ever happen in the last 30 days? <1> Yes <2> No Blind or -----------------------------------------------------------SX5CK If SS5 = <1> or <2> OR SS6 = <1> or <2> OR SH1 = <1> or <2> go to SSH2 else skip to SP1. -----------------------------------------------------------SSH2 option. If CHILD_COUNT=1 then fill with first option else fill with second In the last 12 months, did you ever cut the size of Sept 2020 CPS-FSS Split Panel, page 60 (the child's/any of the children's) meals because there wasn't enough money for food? <1> Yes <2> No (GO TO SSH3) Blind or (GO TO SSH3) SSHF2 How often did this happen - almost every month, some months but not every month, or in only 1 or 2 months? <1> <2> <3> Almost every month Some months but not every month Only 1 or 2 months Blind or SSHM2 Did this happen in the last 30 days? <1> Yes <2> No (GO TO SSH3) Blind or (GO TO SSH3) SSHMF2 If CHILD_COUNT=1 then fill with first option else fill with second option. In the last 30 days, how many days did you cut the size of (the child's/any of the children's) meals because there wasn't enough money for food? ______days <1-30> Blind or SSH3 option. If CHILD_COUNT=1 then fill with first option else fill with second In the last 12 months, (was the child/were the children) ever hungry because there wasn’t enough money for food? <1> Yes <2> No (GO TO SSH4) Blind or (GO TO SSH4) Sept 2020 CPS-FSS Split Panel, page 61 SSHF3 How often did this happen – almost every month, some months but not every month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SSHM3 Did this happen in the last 30 days? <1> Yes <2> No (GO TO SSH4) Blind or (GO TO SSH4) SSHMF3 If CHILD_COUNT=1 then fill with first option else fill with second option. In the last 30 days, how many days (was the child/were the children) hungry because there wasn’t enough money for food? ______ number of days <1-30> Blind or SSH4 If CHILD_COUNT=1 then fill with first option else fill with second option. In the last 12 months, did (the child/ any of the children) ever skip a meal because there wasn't enough money for food? <1> Yes <2> No (GO TO SSH5) Blind or (GO TO SSH5) SSHF4 How often did this happen--almost every month, some months but not every month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SSHM4 If CHILD_COUNT=1 then fill with first option else fill with second option. Sept 2020 CPS-FSS Split Panel, page 62 Now think about the last 30 days. Did (the child/any of the children) ever skip a meal during that time because there wasn't enough money for food? <1> Yes <2> No (GO TO SSH5) Blind or (GO TO SSH5) SSHMF4 How many days did this happen in the last 30 days? ______days <1-30> Blind or SSH5 option. If CHILD_COUNT=1 then fill with first option else fill with second In the last 12 months, did (the child/any of the children) ever not eat for a whole day because there wasn't enough money for food? <1> Yes <2> No (GO TO SP1) Blind or (GO TO SP1) SSHM5 Did this happen in the last 30 days? <1> Yes <2> No Blind or All responses go to SP1 IV. FOOD PROGRAM PARTICIPATION SP1_LEAD SP1 Sometimes people need help getting food for their household. There are many programs that can help. If hhnum=1 fill with first option else fill with second. In the past 12 months, since September of last year, did (you/anyone in this household) get or food stamp benefits? Sept 2020 CPS-FSS Split Panel, page 63 <1> Yes (GO TO SP2) <2> No (GO TO SP6CK) Blind or (GO TO SP6CK) NOTE: Since the test interview will be in September, it will change how months of SNAP receipt and receipt within 30 days of interview are asked about. SP2 and SP2DCK and SP2D below may need more revision. SP2 In which months since September of last year were or food stamp benefits received? DO NOT READ LIST. MARK ALL THAT APPLY <1> January 2020 <2> February 2020 <3> March 2020 <4> April 2020 <5> May 2020 <6> June 2020 <7> July 2020 <8> August 2020 <9> September 2020 <10> October 2019 <11> November 2019 <12> December 2019 <13> All ---------------------------------------------------------------------------------SP2DCK If SP2 = 8 AND ≠ 9 AND ≠ 13 go to SP2D else go to SP3 ---------------------------------------------------------------------------------SP2D If hhnum = 1 fill with first option else fill with second. On what date in August did (you/your household) receive or food stamp benefits? SP2D Blind or SP3 Day______ <1-31> If hhnum=1 fill with first option else fill with second. How much did (you/your household) receive the last time you got or food stamp benefits? Sept 2020 CPS-FSS Split Panel, page 64 $ _ _ _ .00 Blind or ------------------------------------------------------------SP3CK Store entry in SP3O. If SP3O is between $1.00 and $700.00 go to SP6CK otherwise go to SP3RC. ------------------------------------------------------------SP3RC *************DO NOT ASK THE RESPONDENT************* AMOUNT RECEIVED RECORDED AS: (entry in SP3O) IS THIS ENTRY CORRECT? <1> YES (GO TO SP6CK) <2> NO (GO TO SP3COR) SP3COR **********DO NOT ASK THE RESPONDENT************ INCORRECT ENTRY WAS RECORDED AS: (entry in SP3O) CORRECT ENTRY IS: $_ _ _.00 (store entry in SP3O) Items SP3 through SP3COR go into making the out variable SP3O. This is the amount received in food stamp benefits. ------------------------------------------------------------SP6CK If HHMEM=1 and AGE is 5 THROUGH 18 for anyone in the household ask SP6 else skip to SP7ACK. ------------------------------------------------------------SP6 If 1 or more children under 5 years old, fill parenthetical, else fill blank. During the past 30 days, did any children in the household (between 5 and 18 years old) receive free or reduced-price lunches at school? <1> Yes <2> No (GO TO SP7ACK) Blind or (GO TO SP7ACK) SP7 If 1 or more children under 5 years old, fill parenthetical, else fill blank. Sept 2020 CPS-FSS Split Panel, page 65 During the past 30 days, did any children in the household (between 5 and 18 years old) receive free or reduced-price breakfasts at school? <1> Yes <2> No Blind or NEW 1 If 1 or more children under 5 years old, fill parenthetical, else fill blank. During the past 30 days, did any children in the household (between 5 and 18 years old) receive a free or reduced-price meal or snack at an after school program? <1> Yes <2> No Blind or Note: Question “NEW 1” is a newly added question. It does not replace any previous item. ----------------------------------------------------------SP7ACK If HHMEM=1 and AGE is 0-6 for anyone in the household ask SP7A else skip to SP8CK. ----------------------------------------------------------SP7A If only 1 child under age 6 fill with first option else fill with second option During the past 30 days, did any children in the household (under 6 years old) receive free or reduced-price food at a day-care or Head Start program? <1> Yes <2> No Blind or ------------------------------------------------------------SP8CK If [(SEX=2 and AGE = 15-45) OR (AGE 0-4)] and HHMEM=1 for anyone in the household then ask SP8 else skip to “NEW 2”. ------------------------------------------------------------SP8 If [(SEX=2 and AGE=15-45) for any hh member and (AGE=0-4) for any hh member] then fill second option else if (SEX=2 and AGE=15-45) for any hh member and (no AGE=0-4) for any hh member then fill first option else fill third option. Sept 2020 CPS-FSS Split Panel, page 66 During the past 30 days, did any (women/women or children/children) in this household get food through the WIC program? <1> Yes <2> No (GO TO “NEW 2”) Blind or (GO TO “NEW 2”) SP9 If [(SEX=2 and AGE=15-45) for any hh member and (AGE=0-4) for any hh member] then fill second option else if (SEX=2 and AGE=15-45) for any hh member and (no AGE=0-4) for any hh member then fill first option else fill third option. How many (women/women or children/children) in the household got WIC foods? Number ______ Blind or Yes <2> No Blind or SC2 If more than one person in household fill with second option, else fill with first option. During the past 30 days, did (you/anyone in this household) go to a community program or senior center to eat prepared meals? <1> Yes <2> No Blind or NOTE: Items SC1 and SC2 will be deleted. These questions are incorporated into “NEW 3” below. For items “NEW 2” and “NEW 3”, if only 1 HHMEM = 1 and (AGE>=18 or PURRP <=3) in household then fill first parenthetical with first option else fill with second option. NEW 2 (Replaces SC3) In the last 12 months, did (you/you or anyone in your household) ever get free groceries from a food pantry, food bank, church, or other place that helps with free food? [NOTE: may revise parenthetical to “you or any other adults”] <1> Yes <2> No (GO TO SC3A) Blind or (GO TO SC4) SCF3 How often did this happen-almost every month, some months but not every Sept 2020 CPS-FSS Split Panel, page 68 month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SCM3 Did this happen in the last 30 days? <1> Yes (GO TO SC4) <2> No (GO TO SC4) SC3A Is there a food pantry, food bank, church, or other place in your community where you could get free groceries if you needed it? <1> Yes <2> No Blind or NEW 3 (Replaces SC4) In the last 12 months, have (you/you or anyone in your household) received a free meal from a church, shelter, home-delivered meal service like Meals on Wheels, or other place that helps with free meals? <1>Yes <2> No (GO TO NEW 4) Blind or (GO TO NEW 4) SCF4 How often did this happen-almost every month, some months but not every month, or in only 1 or 2 months? <1> Almost every month <2> Some months but not every month <3> Only 1 or 2 months Blind or SCM4 Did this happen in the last 30 days? <1> Yes <2> No Blind or Sept 2020 CPS-FSS Split Panel, page 69 NEW 4 Is there a church, shelter, home-delivery meal service like meals on Wheels, or other place in your community where you could get free meals if you needed it? <1> Yes <2> No Blind or NOTE: “NEW 4” is a newly added item. It does not replace any previous items. SSPCK1 (Interviewer query, do not read) Did you use the Spanish language version for none, some, or all of the questions about having adequate food? <1> None <2> Some <3> All *****END OF SUPPLEMENT*****
File Type | application/pdf |
Author | Coleman-Jensen, Alisha - REE-ERS, Washington, DC |
File Modified | 2022-01-12 |
File Created | 2022-01-12 |