2022 Appendix A_Web Survey Instrument

FSCRP—Year 5 Web-Based Survey
RTI International is conducting this survey with funding from the U.S. Department of
Agriculture (USDA). Your participation in this study is completely voluntary. All your
answers will be kept private. In our experience, answering the survey questions involves no
more risk of harm than you would experience in everyday life.
If you have any questions about the study, you may contact Jenna Brophy of RTI at
1-800-334-8571, extension 28881 or by email at [email protected].
[DISPLAY 2]
According to the Paperwork Reduction Act of 1995, an agency may not conduct or sponsor,
and a person is not required to respond to, a collection of information unless it displays a
valid Office of Management and Budget (OMB) control number. The valid OMB control
number for this information collection is 0583-0178, and the expiration date is 10/31/2023.
The time required to complete this information collection is estimated to average 20
minutes per response, including the time for reviewing instructions, searching existing data
sources, gathering and maintaining the data needed, and completing and reviewing the
collection of information.
[DISPLAY 3]
Privacy Act Notice
This statement serves to inform you of the purpose for collecting personal information
required by this system and how it will be used.
Authority: The USDA is generally authorized to collect information to support its mission
under Title 7, Chapter 55-2205 (7 U.S.C 2204) (which authorizes the Secretary of
Agriculture to collect information and employ any sampling or other statistical method
deemed appropriate); 21 U.S.C. 679c(a)(1)-(3) (which expressly authorizes the Secretary
to give high priority to enhancing the ability of Food Safety and Inspection Service [FSIS] to
conduct its mission); the Federal Meat Inspection Act (FMIA) (21 U.S.C. 601, et seq.), the
Poultry Product Inspection Act (PPIA) (21 U.S.C., et seq.), the Egg Products Inspection Act
(EPIA) (21 U.S.C. 1031, et seq.), and the Humane Methods of Livestock Slaughter Act of
1978 (7 U.S.C. 1901-1906).
Purpose: Findings from the survey will provide information on how FSIS communication
programs and materials affect consumer understanding of recommended safe food handling
practices and insight into how to effectively inform consumers of recommended practices.
The results of this research will be used to enhance communication programs and materials
to improve consumers’ food safety behaviors and help prevent foodborne illness.
Routine Uses: Not applicable.
Disclosure: Responses to any and all questions are completely voluntary. Panelists selected
to participate in this survey can choose to decline or can skip any questions that they prefer
not to answer. Additionally, panelists can decline to participate or withdraw their
participation at any point by closing their web browser before completing the survey. Those
who do so will not be included in the final data deliverable. Panelists who decline to
participate or withdraw participation are not penalized and remain eligible for future
surveys.
1

Screener and Quota Questions
The first questions ask about you and your cooking experience.
[PROMPT IF REFUSED]
[SP]
S1. How many times a week do you prepare and cook meals at home?
1.
2.
3.
4.

Less than once a week
Once or twice a week
About three times a week
Four or more times a week

[TERMINATE IF QS1≠4 OR REFUSED]
[PROMPT IF REFUSED]
[MP]
S2. In the past 30 days, which of the following have you used to prepare a meal at home?
Select all that apply.
1.
2.
3.
4.
5.
6.

Broccoli
Raw meat (for example, beef, pork)
Rice
Raw poultry (for example, chicken, turkey)
Raw fish
None of the above – EXCLUSIVE

[TERMINATE IF QS2=6 OR QS2≠2 OR 4 OR REFUSED]
[PROMPT IF REFUSED]
[SP]
S3. Which of the following best describes your age?
1. Under 18
2. 18 to 34
3. 35 to 44
4. 45 to 59
5. 60+
[Terminate if S3=1]
[SP]
S4. What is the highest grade or level of school you have completed?
1.
2.
3.
4.
5.
6.
7.

No high school diploma or GED
High school graduate or GED
Technical or vocational school
Some college or associate’s degree
Bachelor’s degree
Master’s degree or higher
Prefer not to answer

2

[SP]
S5. Are you …?
1. Hispanic or Latino
2. Not Hispanic or Latino
[MP]
S6. What is your race? Please select one or more.
1. American Indian or Alaska Native
2. Asian
3. Black or African American
4. Native Hawaiian or Other Pacific Islander
5. White
6. Other, please specify ________
[SP]
S7a. What state do you live in? [drop-down of 50 states plus, DC]
[SP]
S7b. What county do you live in? [drop-down of counties in each state of state
selected; if no county returns nothing then TERM; I don’t see my county listed =
TERM]
[programming to assign state, county to ERS urban/rural coding; spreadsheet
provided to vendor]
[SP]
S8. What sex were you assigned at birth on your original birth certificate?
1.
2.
3.
4.

Male
Female
Refused
I don’t know

[SP]
S9. Do you currently describe yourself as male, female, or transgender?
1.
2.
3.
4.

Male
Female
Transgender
None of these

[MP]
S10. Please select all of the following that describe you or any of the members of your
household.
1. 65 years of age or older
2. 5 years of age or younger
3. Pregnant
4. Diagnosed with diabetes or kidney disease
3

5. Diagnosed with a condition that weakens the immune system (for example, cancer,
HIV, or AIDS; recipient of a transplant; or receiving treatments such as
chemotherapy, radiation, or special drugs or medications to treat these conditions)
6. None of the above – EXCLUSIVE

USDA Awareness
Now we are going to ask what you know about different topics. Please answer the questions
based on your current knowledge.
[OPEN ENDED]
Unaided
1.

Which government agency do you think is responsible for ensuring the safety of
meat and poultry products in the United States?

[SP, Randomize]
Aided
2.

From the list below, select which government agency you think is responsible for
ensuring the safety of meat and poultry products in the United States.
1.
2.
3.
4.
5.
6.

U.S. Department of Agriculture (USDA)
Food and Drug Administration (FDA)
Centers for Disease Control and Prevention (CDC)
Food Safety and Inspection Service (FSIS)
Food Safety Administration (FSA)
Don’t know

Mark of Inspection: LTE
Note: Practice LTE
For the next question, assume you are at the grocery store/butcher shop or shopping online
and you are going to buy a package of frozen premade burger patties. On the next screen,
we are going to show you a package of frozen premade burger patties. You will see the
product for 20 seconds. Please carefully review the information on the product package
because we are going to ask you a few questions about what you saw.
When you are ready to see the product, click CONTINUE.
[DISPLAY FOOD PACKAGE LTE_practice.jpg]—20 seconds

4

You will automatically be moved to the next question after 20 seconds.

[DO NOT ALLOW RESPONDENT TO GO BACK IN SURVEY]
[TEXT; CODE EACH ROW AS SEPARATE VARIABLE; 5 VISIBLE ROWS, ADD UP TO 5
MORE ROWS]
3.

Please list everything you remember seeing on the product package. Please type
each thing you remember seeing, such as words, pictures, and symbols, on a
SEPARATE row. Click the MORE button to add more rows. Take as much time as you
need. Click the NEXT button when you are done.

[DISPLAY]

5

Now we are going to ask you if you remember seeing different words, pictures, or symbols
on the product package. Only click YES if you are sure you saw the words, pictures, or
symbols; otherwise, click NO.
[RANDOMIZE ORDER OF Q4-7; 2 hits and 2 misses]

[SP] (Hit – on package)
4.

Do you remember seeing “Hemby Farms”?

1. Yes
0. No
[SP] (Hit – on package)
5.

Do you remember seeing this image?

1. Yes
0. No
[SP] (Miss – not on package)
6.

Do you remember seeing “Premium Angus Beef”?

1. Yes
0. No
[SP] (Miss – not on package)
7.

Do you remember seeing this image?

1. Yes
0. No
[DISPLAY]
For the next question, assume you are at the grocery store/butcher shop or shopping online
and you are going to buy a package of frozen chicken tenders. On the next screen, we are
going to show you a package of frozen chicken tenders. You will see the package for 20
6

seconds. Please carefully review the information on the product package because we are
going to ask you a few questions about what you saw.
When you are ready to see the product, click CONTINUE.
[RANDOM ASSIGNMENT TO 1 OF 2 CONDITIONS; .jpg]—20 seconds

You will automatically be moved to the next question after 20 seconds.
1 = control – no mark, 2 = USDA Mark of Inspection]
[DO NOT ALLOW RESPONDENT TO GO BACK IN SURVEY]
[TEXT—CODE EACH ROW AS SEPARATE VARIABLE; 5 VISIBLE ROWS, ADD UP TO 2
SETS]
8.

Please list everything you remember seeing on the product package. Please type
each thing you remember seeing, such as words, pictures, and symbols, on a
SEPARATE row. Click the MORE button to add more rows. Take as much time as you
need. Click the NEXT button when you are done.

7

[DISPLAY]
Now we are going to ask you if you remember seeing different words, pictures, or symbols
on the product package. Only click YES if you are sure you saw the word, picture, or
symbol; otherwise, click NO.
[PROMPT IF REFUSED]
[RANDOMIZE ORDER OF Q9–Q16; 4 HITS AND 4 MISSES]
[SP] (HIT 1; MISS 4 FOR CONTROL GROUP)
9.

Do you remember seeing this image?

[insert inspection mark]

1. Yes
0. No

[SP] (HIT 2 – ON THE LABEL)
10. Do you remember seeing “Cloverfield Food”?
1. Yes
0. No
[SP] (HIT 3)
11. Do you remember seeing this image?

1. Yes
0. No

8

[SP] (HIT 4)
12. Do you remember seeing “Gluten Free”?
1. Yes
0. No
[SP] (MISS 1 – NOT ON THE LABEL)
13. Do you remember seeing “Natural”?
1. Yes
0. No
[SP] (MISS 2)
14. Do you remember seeing “Sustainably Raised”?
1. Yes
0. No
[SP] (MISS 3)
15. Do you remember seeing this image?

1. Yes
0. No
[If Version = 2 (USDA Mark of Inspection)]
[SP] (MISS 4)
16. Do you remember seeing this image?

1. Yes
0. No
[If Version = 1 (no Mark)]

9

[SP] (HIT 1 for control group)
14A. Do you remember seeing this image?
[Insert cloverleaf from product name]

1. Yes
0. No
Content Topics

Understanding the Science
Knowledge
[SP, randomize statements]
Please mark whether you think each statement is true or false, or you don’t know.
Statement

True

17. You can only get foodborne illness once. [incorrect]
18. There is a vaccine for foodborne illness. [incorrect]
19. Foodborne illness is caused by consuming foods or
beverages containing harmful bacteria or viruses
(germs). [correct]
20. Cooking meat and poultry until it looks done is a safe
way to determine doneness. [cook - incorrect]
21. Cooking chicken to 165°F ensures it is done and safe
to eat. [cook - correct]
22. Cross contamination (spreading bacteria) can happen
when washing raw chicken. [separate - correct]
23. Cleaning your countertops and sanitizing your
countertops are the same thing. [clean - incorrect]
24. The USDA conducts activities to educate people about
food safety. [correct]

10

False

Don’t
know

RANDOMIZE RESPONSES]
[SP]
25. Please look at this symbol.
[show picture of USDA mark of inspection]
To your knowledge, what does this symbol on meat products mean? Select all that
apply.
1. The meat was produced under federal inspection of the U.S. Department of
Agriculture (USDA). [Correct response]
2. The animals used to produce the meat were treated humanely from birth to
slaughter on farms that provide suitable living conditions that meet the animals'
needs.
3. The meat does not contain any bacteria (e.g., Salmonella) that can cause
foodborne illness.
4. The meat is a product of the United States.
5. Not sure/don’t know [exclusive]

11

Inspection Mark Attitudes
[RANDOMIZE]
[SP]
[show USDA mark of inspection]
On a scale of 1 to 3, with 1 being “Disagree” and 3 being “Agree,” please indicate your
level of agreement with each statement describing the USDA mark of inspection.
Statement

Disagree
(1)

Neither
Disagree
nor Agree

Agree
(3)

(2)
26. A meat product with this mark is
safe to eat.
27. A meat product with this mark is
of high quality.
28. A meat product with this mark
does not contain any harmful
bacteria or viruses (also called
germs).

[DISPLAY]
The U.S. Department of Agriculture, or USDA, is the government agency responsible for
protecting the public’s health by ensuring that the nation’s supply of meat and poultry
products is safe, wholesome, and correctly labeled and packaged.
All meat and poultry products produced for sale in the United States must be inspected by
the USDA, and the product must have the USDA mark of inspection on it. The USDA also
conducts activities to educate people about food safety to help prevent food
poisoning/foodborne illness.
-------------------------------------------------------------------------------------------------------

Perceived Risk of Food Safety 1
[Display]
The next questions ask how concerned you are about different illnesses.
[SP]
Adapted from Microsoft Word - Standard questionnaire risk perception ECOM November
2015 final.doc (ecomeu.info).
1

12

[Illness randomized to rotate each question through food poisoning/foodborne
illness, the flu, COVID-19]
29. How serious do you think [Illness] is? [perception of seriousness]
1.
2.
3.
4.
5.

Not at all serious
Not serious
Neutral
Serious
Very serious

30. What do you think is the likelihood (chance) that you will get [Illness] in the
following year? [perception of susceptibility]
1.
2.
3.
4.
5.

Very unlikely
Somewhat unlikely
Neutral
Somewhat likely
Very likely

31. How concerned are you about contracting [Illness]? [perception of susceptibility]
1.
2.
3.
4.
5.

Not at all concerned
Not concerned
Neutral
Concerned
Very concerned

[SP]
[rank order, randomize response options]
32. How worried are you about these things happening to you in the next year? Please
click to rank the following items with 1 being the most likely to happen and 6 being
the most unlikely to happen. You can unclick an item to reorder your choices.
•

Being in a car accident

•

Getting COVID-19

•

Getting food poisoning/foodborne illnesses

•

Getting the flu

•

Being struck by lightening

•

Being a victim of random violence

[SP]
33. For the first time you are cooking a frozen, processed meat or poultry product (like
chicken tenders or stuffed chicken breasts) that is new to you, how often do you
read the cooking instructions on the package before you start cooking?
1.
2.
3.
4.
5.
6.

Never
Rarely
Sometimes
Most of the time
Always
Do not buy frozen, processed meat or poultry products

13

Media Preferences Questions
The next questions ask how you like to get information on different topics.
[MP]
[RANDOMIZE; Select up to 3]
34. What are the three most important food safety topics about which you want to
receive information at this time? Select up to 3 responses.
1.
2.
3.
4.
5.
6.
7.
8.
9.

How foodborne illness is transmitted
The time between infection and symptoms
The symptoms of foodborne illness
How you can prevent foodborne illness
The chance that you will get foodborne illness
The chance that foodborne illness is serious
How foodborne illness is treated
Other, please specify [keep at bottom]
I do not need any information [keep at bottom; EXCLUSIVE]

[MP – UP TO 3]
[RANDOMIZE RESPONSE OPTIONS— KEEP ITEMS 2 AND 3 FOLLOWING EACH OTHER]
[MP]
35. What are the top three ways you would obtain information on health and wellness?
Select up to 3 responses.
1. Radio
2. Social media (for example, Facebook or Pinterest)
3. Websites (excluding social media)
4. Newspaper
5. Magazines
6. Television
7. App on smartphone or tablet
8. Healthcare providers
9. Other source [keep at bottom]
10. I do not want information on health and wellness – [keep at bottom;
EXCLUSIVE]
[MP – UP TO 3]
[RANDOMIZE RESPONSE OPTIONS—KEEP ITEMS 2 AND 3 FOLLOWING EACH OTHER, KEEP
ITEMS 7 AND 8 FOLLOWING EACH OTHER]
36. What are the top three ways you would obtain information on how to safely handle,
prepare, and store food? Select up to 3 responses.
1.
2.
3.
4.
5.
6.
7.
8.

Radio
Social media (for example, Facebook or Pinterest)
Websites (excluding social media)
Newspaper
Magazines
Cookbooks
Cooking shows
Television
14

9.
10.
11.
12.
13.

Contact food safety expert by phone, email, or chat
Food labels
App on smartphone or tablet
Other source [keep at bottom]
I do not want information on food safety – EXCLUSIVE

[IF SOCIAL MEDIA SELECTED]
[RANDOMIZE RESPONSE OPTIONS—KEEP ITEM 10 AT BOTTOM]
[MP]
37. Which social media platforms would be the most useful for getting information on
food safety? Select all that apply.
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.

Facebook
Twitter
YouTube
Pinterest
LinkedIn
Thunderclap
Chatbot
TikTok
Instagram
Other (please specify) __________

[SP]
38. In the past 30 days, how often have you used social media to get information on
health and wellness?
1.
2.
3.
4.
5.
6.

Always
Often
Sometimes
Rarely
Never
I do not use social media to get information on health and wellness

[SP]
39. In the past 30 days, how often have you used social media to get information on
food safety or foodborne illness?
1.
2.
3.
4.
5.
6.

Always
Often
Sometimes
Rarely
Never
I do not use social media to get information on food safety or foodborne
illness

15

[SP]
40. How likely are you to follow the USDA on social media to receive information about
food safety?
1.
2.
3.
4.
5.
6.

Very unlikely
Somewhat unlikely
Neither unlikely nor likely
Somewhat likely
Very likely
I currently follow the USDA on social media

Brand Perception
The last question asks about your opinions of the USDA. On a scale of 1 to 3, where 1 is
“Disagree” and 3 is “Agree,” how strongly do you agree or disagree with each
statement?
[GRID]
Click on word in blue to see a definition of what we mean.
[SP]
[RANDOMIZE LIST]

Statement
Disagree
(1)
41. The USDA is safety focused in its
approach to ensuring food safety.
[hover text: takes actions to protect
health or reduce danger]
42. The USDA is science based in its
approach to ensuring food safety.
[hover text: takes scientific methods,
facts, or results into account]
43. The USDA is a trustworthy source of
information. [hover text: can be
relied on as honest, truthful, and
transparent]
44. The USDA is collaborative in its
approach to ensuring food safety.
[hover text: works jointly with
others]
45. The USDA provides clear and
understandable information about
food safety. [hover text: is simple
and easy to understand, not
confusing]

16

Neither
Disagree
nor Agree
(2)

Agree
(3)

[Open ended]
46. Do you have any other comments, feedback, or suggestions you would like to share
about the USDA?

Thank you for completing the survey! Your efforts are greatly appreciated!

17