Appendix E-Pretest 1 Debriefing Protocol

Appendix E: Pretest 1 Debriefing Protocol

Thank you for participating in this study and recording the food items that your household got throughout the week and reporting your household’s income. Now, we would like to follow-up with a few questions about how things went for you.

1. About how often did you complete the meals and snacks question? Was it…

1. Every day

2. More than once but not every day

3. Once before the end of the week

4. Once at the end of the week

5. Did not complete at all

1A. Did you report meals and snacks on behalf of someone else in your household?

YES, THOUGHOUT THE WEEK. For whom did you report? (DETERMINE WHETHER THIS WAS FOR ADULTS AND MINORS)

YES, SOME DAYS OF THE WEEK. For whom did you report? (DETERMINE WHETHER THIS WAS FOR ADULTS AND MINORS)

NO

2. How often did you report the foods that you got yourself? Was it….

1. Every day

2. More than once but not every day

3. Once before the end of the week

4. Once at the end of the week

PROBE: Tell me about when you reported the food you got.

2A. Did you report the foods that someone else in your household got for themselves?

YES, THOUGHOUT THE WEEK. For whom did you report? (DETERMINE WHETHER THIS WAS FOR ADULTS AND MINORS) GO TO Q4

YES, SOME DAYS OF THE WEEK. For whom did you report? (DETERMINE WHETHER THIS WAS FOR ADULTS AND MINORS)

NO GO TO Q3B

3A. How often did you report the foods that other household members got? Was it…

1. Every day

2. More than once but not every day

3. Once before the end of the week

4. Once at the end of the week

PROBE: Tell me about when you reported the food you got.

GO TO Q4

3B. About how often would you say that other members of your household reported the foods that they got? Was it…

1. Every day

2. More than once but not every day

3. Once before the end of the week

4. Once at the end of the week

PROBE: Tell me about when you reported the food you got.

On a scale from 1 to 5, where 1 is “very easy”, 2 is “somewhat easy”, 3 is “neither easy nor difficult”, 4 is “somewhat difficult”, and 5 is “very difficult”, please tell us…

4. How easy or difficult was it to keep track of the foods you got?

____________

PROBE: Explain your answer.

5. [IF Q2A=YES: ] How easy or difficult was it for you to get information from other household members about the food or drinks they got during the data collection week?

____________

PROBE: Tell me about any difficulty you had getting other household members to take part.

6. [IF Q1A=YES: ] How easy or difficult was it for you to get information from other household members about the meals and snacks they got throughout the week?

____________

PROBE: Tell me about any difficulty you had getting other household members to take part in this study.

6B. What device did you use to report food and drinks you or someone else obtained throughout the week?

1.SMARTPHONE ONLYGO TO 6C

2.COMPUTER ONLYGO TO 10

3.BOTH SMARTPHONE AND COMPUTERGO TO 6C

6c. Did you use the smartphone to enter food items in the APP or through the browser?

IN THE APPGO TO Q7

THROUGH THE BROWERGO TO 7B

7. How easy or difficult was it for you to use the smartphone to enter food items in the App?

____________

7a. Did you have any issues or problems with the smartphone when entering food items or the details about each food item?

1. Yes

2. No

PROBE: [IF YES] Tell me about any problems that you had.

7B. What device did you use to scan barcodes? The smartphone or the scanner?

SMARTPHONE

SCANNER

8. How easy or difficult was it for you to use the (smartphone/scanner) to scan barcodes?

____________

8a. Did you have any issues or problems using the (smartphone/scanner) to scan barcodes?

1. Yes

2. No

PROBE: [IF YES] Tell me about any problems that you had.

8b. Did you use the smartphone to take pictures of receipts, food, or drinks you ate outside your home?

1. YESGO TO Q9

2. NOSKIP TO INSTRUCTION BEFORE Q10

9. How easy or difficult was it for you to use the smartphone to take pictures of receipts, food, or drinks you ate outside your home?

____________

9a. Did you have any issues or problems using the smartphone to take pictures of receipts, food, or drinks you ate outside your home?

1. Yes

2. No

PROBE: [IF YES] Tell me about any problems that you had.

IF Q6B =2 OR 3, ASK Q10. OTHERWISE GO TO Q11.

10. How easy or difficult was it for you to use the computer (desktop or laptop) to enter food items in the web-based reporting system?

____________

10a. Did you have any issues or problems with the computer when recording food items?

1. Yes

2. No

PROBE: [IF YES] Tell me about any problems that you had.

11. How easy or difficult was it for you to use the App on the cell phone or the web-based system on the computer to enter food or drinks you got?

11a. Did you have any issues or problems with the App or the web-based system to enter food or drinks you got? For instance, were you always able to find the food item description you were looking for?

1. Yes

2. No

PROBE: [IF YES] Tell me about any problems that you had.

12. In general, did you scan all the foods you got immediately when you got home or did you wait until later?

1. Scanned immediately

2. Waited until later.

PROBE: [IF R WAITED UNTIL LATER] Why did you wait? Is there anything we could change to make it easier to scan right away?

13. In general, did you enter the details about the food items you got right away when you scanned or did you come back and enter the details?

1. Entered details right away

2. Entered details later

PROBE: Tell me more about how you did this.

[IF R WAITED UNTIL LATER] Why did you wait? Is there anything we could change to make it easier to enter the details right away?

14. In general, how burdensome was it for you to record food or drinks you got on the cell phone App or in the computer’s web-based system? Would you say…

1. Very burdensome

2. Somewhat burdensome

3. A little burdensome

4. Not burdensome at all?

Which part is the most burdensome? What do you think we can do make the process less of a burden?

15. How much effort did it take you to record food or drinks you got on the App or in the web-based system? Would you say…

1. Almost no effort,

2. A little effort,

3. Some effort,

4. A lot of effort, or

5. Very much effort?

16. Did you receive the e-mail and text messages that were sent to you during the week?

1. Yes

2. No

PROBE: [IF YES] Did you pay attention to them? What messages did you find helpful? Why?

[IF NO] Would there be a better way to send messages to you about the tasks? How?

Would there be a better way to send messages to you about the amount of the incentives your household earned? How?

16. How helpful did you find the Progression report displayed in the food entry system? Would you say…

1. very helpful

2. somewhat helpful

3. a little helpful, or

4 not helpful at all?

PROBE: Which part(s) is most helpful? Which part(s) is the least helpful?

Would there be a better way to make the progress report helpful? How?

17. During the past week, did you (or other household members) do any of the following because you were taking part in this study? (CHECK ALL THAT APPLY)

1. ATE OUT MORE OFTEN

2. ATE OUT LESS OFTEN

3. DID MORE FOOD SHOPPING

4. DID LESS FOOD SHOPPING

5. BOUGHT A SPECIFIC ITEM JUST TO BE ABLE TO SCAN IT

6. AVOIDED SPECIFIC ITEM(S) SO YOU WOULDN’T HAVE TO SCAN THEM

7. OTHER CHANGES-PLEASE SPECIFY

18. Which of the following best describes how you felt about the training you received before the study started?

1. The training did NOT prepare me for the study.

2. Training was ok, but I still had a lot of questions.

3. I felt very prepared after the training to participate in the study.

18. What part of the study would you have liked more training or instruction on?

____________

18. Do you have any suggestions for other things we can do to make sure that participants like you are trained and prepared to participate in a study like this?

____________

9