Respondents- Individuals/Households (Parents/Children/Teens)

OMB Control No: 0584-0606 Expiration Date: 03/31/2019

Appendix H10. Teen Participant Survey Pretest Protocol

(PROTOCOL WILL NEED ADAPTION IF INTERVIEW IS CARRIED OUT ONSITE.)

INTERVIEWER NOTES:

THE INTERVIEW SHOULD TAKE ABOUT 30 MINUTES.

Bold red indicates probes you can read aloud. Non-bold red indicates points you may need/want to probe on.

PARENTAL CONSENT FOR TEEN (13-17) TO BE INTERVIEWED AND RECORDED SHOULD BE OBTAINED BEFORE TEEN INTERVIEW BEGINS. PARENT MAY ACCOMPANY TEEN DURING THE INTERVIEW BUT IDEALLY TEEN SHOULD BE INTERVIEWED WITHOUT THE PARENT.

IF “NO” TO INTERVIEW AT ANY POINT DURING CONSENT PROCESS, ASK: Is there anything you are worried about? Are there any questions you would like to ask me? REASSURE TEEN, ANSWER ANY QUESTIONS, IF NECESSARY, DISCUSS WITH PARENT TO ESTABLISH ANY CONCERNS. IF NECESSARY TERMINATE INTERVIEW: You don’t have to talk to me today if you don’t want to. That’s okay.

IF “NO” TO RECORDING ONLY - CONTINUE, BUT DO NOT RECORD THE INTERVIEW.

PROBING IS CONCURRENT. YOU MAY NEED TO ADAPT YOUR PROBING TO REFLECT THE AGE OR COGNITIVE ABILITY OF THE TEEN.

YOU MAY NEED TO ADMINISTER THE QUESTION AND READ IT TO THE TEEN IF THEY ARE UNABLE TO READ IT.

NOTE ANY VERBAL OR NONVERBAL REACTION WHEN TEEN COMPLETES EACH QUESTION. FOR ANY NON-VERBAL REACTIONS, MENTION THE REACTION OR ASK: What are you thinking?

NOTE ANY ISSUES WITH READING, COMPREHENSION OR ABILITY TO PROVIDE A RESPONSE, AS WELL AS HOW THE TEEN NAVIGATES AND COMPLETES THE QUESTIONNAIRE.

SUGGESTED GENERAL PROBES:

• Don’t forget to read the question out loud.

• Tell me what you are thinking…

• What were you thinking when you answered that question?

• Can you tell me a bit more about that?

• Was that easy or hard for you?

ADMINISTER TEEN ASSENT OR CONSENT FOR THOSE AGED 18

Before we start, I need to turn on the recorder.

Now we can look at the questions that are written on this piece of paper. Please answer each question one question at a time. After you have answered each question I may ask you about your answer. This is not a test. There are no right or wrong answers. It is what you are thinking when you answer each question that matters to me.

OK, let’s start with the first question. {Try to} read the question out loud for me and tell me your answer as you write it on the paper.

Q1. How old are you? ______________ Years

DO NOT PROBE UNLESS TEEN GIVES DIFFERENT ANSWER FROM THAT PROVIDED DURING SCREENING. TRY AND ESTABLISH REASON FOR DISCREPANCY: IF NEEDED: When is your birthday? How old will you be on your next birthday?

Notes and observations, including: Did R write in their age correctly on the line provided? If not note how R recorded their age.

Q2. Are you a boy or a girl?

Boy

Girl

DO NOT PROBE

Notes and observations, including: Any difficulties with question? Did R select the correct box? How did R select box - tick, cross, shade in or something else?

Q3. What grade will you go to when school begins this fall?

DO NOT PROBE UNLESS R DEMONSTRATES DIFICULTY ANSWERING QUESTION

IF NEEDED: What made this question difficult for you to answer? Using your own words, what do you think the question was asking? What grade were you when school closed for summer?

Notes and observations: Did R write their grade correctly on the line provided?

Q4. Besides the summer program at <SITE NAME>, are you attending any other summer program this year?

Yes

No

Have you heard of <SITE NAME> before? Do you use that name? IF NEEDED:What do you call it? What is a “summer program?”

IF NEEDED: Using your own words, what do you think the question was asking?

Notes and observations: What difficulties did R have with this question? Was R familiar with the site name and the term summer program?

Q5. On average, how many days each week did you attend the program at <SITE NAME> this summer?

1 day

2 days

3 days

4 days

5 or more days

How did you figure out your answer?

IF NEEDED: How often did you go to <SITE NAME>? Every week? Every day?

What does the term “on average” mean to you?

IF NEEDED: What is another word than means the same thing as “average”?

Notes and observations: What difficulties did R have with this question? On what basis did R calculate answer? Comprehension of “average”.

Q6. I attend the summer program at <SITE NAME> because … (CHECK ALL THAT APPLY)

my friends go here

there are interesting things to do

my parents thought it would be good for me

my school teacher thought it would be good for me

I like the food offered at this program

I like the program staff

I have nowhere else to go

I can get my homework done

Other (PLEASE SPECIFY):

What does the word “attend” mean to you?

Tell me what made you mark ________ (and ______).

IRRESPECTIVE OF OTHER RESPONSE: Are there any other reasons why you go to <SITE NAME>? IF NEEDED: Tell me more about why you go to <SITE NAME>

IF ONLY ONE SELECTION: Establish if R realized that they could check more than one box and understanding of “check all that apply.”

IF C OR D: What did your parents/school teacher say would be good about it?

Notes and observations: What difficulties did R have with this question? Comprehension of terms. Answering question in way intended by researcher.

Q7. On average, how many days each week did you eat <meal/snack # 1> served at <SITE NAME> this summer?

Never  GO TO QUESTION 8

1 day

2 days

3 days

4 days

5 or more days

IF “NEVER”: TALK ABOUT WHAT THE R DOES WHEN THEY ATTEND THE SITE AND WHY THEY DO NOT EAT A MEAL OR SNACK.

How did you figure out your answer?

IF NEEDED: How often did you eat a meal/snack at <SITE NAME> . Everytime you went to the site? How many times a day?

To you, what is the difference between this question and question 5?

NOTE IF R FOLLOWS CORRECT ROUTING.

Notes and observations: What difficulties did R have with this question? Comprehension of terms. Ability to calculate answer. Does R understand concept of eating more than one meal/snack each day and if the types of meal/snack they have varies on the days they attended. Understanding that question is different than question 5.

Q7a. Overall, the <meal/snack # 1> served is …

delicious

pretty good

okay

terrible

Tell me more about why you chose [ANSWER]. ASK FOR EXAMPLES.

NOTE IF R ANSWERS MORE THAN ONE AND ESTABLISH REASON.

What does it mean when we say something is delicious?

How would you describe the difference between “delicious” and “pretty good?”

What about “Okay” – what does that mean if you say the food is Okay? Terrible?

Notes and observations: What difficulties did R have with this question? Comprehension of terms. Differences between scale items.

Q8. On average, how many days each week did you eat <meal/snack # 2> served at <SITE NAME> this summer?

Never  GO TO QUESTION 9

1 day

2 days

3 days

4 days

Q8a. Overall, the <meal/snack # 2> served is …

delicious

pretty good

okay

terrible

IS TEEN ABLE TO DISTINGUISHED BETWEEN MEAL/SNACK 1 AND MEAL/SNACK 2 AND CALCULATE DIFFERENT AVERAGES WHERE APPLICABLE.

Notes and observations: What difficulties did R have with this question? Is teen able to distinguish between different meals and snacks and calculate differe averages where applicable.

Q9. There are many food choices on the daily menu …

all of the time

most of the time

some of the time

hardly ever

not really

Was this question easy or hard for you to answer? Why?

IF NEEDED: What did you think this question was asking of you?

What does the word “menu” mean to you?

What do you understand by “food choices”?

IF NEEDED: What made you choose [ANSWER]?

Is there a difference between “hardly ever” and “not really”?

NOTE IF R CHOOSES MORE THAN ONE RESPONSE CATEGORY.

Notes and observations: What difficulties did R have with this question?

Comprehension of terms. Differences between scale items.

Q10. There are many food choices on the weekly menu …

all of the time

most of the time

some of the time

hardly ever

not really

Is this question asking you something different from question 9? What is it asking you that is different from question 9.

Notes and observations: What difficulties did R have with this question?

Now I am going to let you complete questions 11 to 16 by yourself, without me interrupting you! When you have finished tell me what you thought about the questions and if there were any words you didn’t know or understand. You can still read the questions out loud.

Q11. The food tastes good …

all of the time

most of the time

some of the time

hardly ever

not really

Q12. The food looks fresh…

all of the time

most of the time

some of the time

hardly ever

not really

Q13. The food smells good …

all of the time

most of the time

some of the time

hardly ever

not really

Q14. I enjoy eating meals here …

all of the time

most of the time

some of the time

hardly ever

not really

Q15.There is enough food to satisfy my hunger …

all of the time

most of the time

some of the time

hardly ever

not really

Q16. The people serving the food are friendly.

Strongly agree

Agree

Disagree

Strongly disagree

I don't know

IF NEEDED: Did anything stand out to you when you were answering these questions?

Were any of the questions confusing or difficult to answer? Which and why?

Were there any words you didn’t know?

Did you have any trouble picking your answer choice(s)?

PROBE:

What about this question 15? How would you ask that question using your own words?

What about questions 16? How easy or hard was it for you to answer questions 16?

Notes and observations: What difficulties did R have with these questions?

Okay, we can move on to question 17. Take a look at question 17 and tell me how you would answer that question.

Q17. I like eating at <SITE NAME> because …

It is convenient

The food is good

I am hungry

I like the variety of foods served

I get to eat with my friends

I get to try different foods

My parents think the food is healthy

I think the food is healthy

Other (PLEASE SPECIFY):

I don’t eat meals served at <SITE NAME>

Are there any words you don’t know or find confusing?

IF NEEDED: What does the word “convenient” mean to you? What about “variety?” “Healthy?”

IF “parents think food is healthy”- Give me some examples of food that you eat at <name> that is “healthy” – Have your parents told you that they think the food is healthy? How do you know what they think about the food?

Notes and observations: What difficulties did R have with this question? Comprehension of terms.

Q18. Would you attend the summer program at <SITE NAME> again next year?

Yes

No

Q19. Would you tell your friends to attend the summer program at <SITE NAME> next year?

Yes

No

IF TIME: ASK WHY R ANSWERED Q18 AND Q19 THE WAY THEY DID.

Notes and observations: What difficulties did R have with these questions?

OTHER ISSUES

Is there anything else you would like to tell me about the food you eat at <name>?

Why do you think we are asking these questions of teens like you?

Using one word, how would you describe the way this <questionnaire> looks? Why do you say that?

Notes and observations, including: Did R attempt to read any of the information provided at the bottom of the page in the burden box? How did R check their answers, tick, cross, shade in or something else?

Closing and Incentive

IF OBSERVERS ARE PRESENT, CHECK TO SEE IF THEY HAVE FURTHER QUESTIONS.

Thank you. You did great today. Good job.

GIVE INCENTIVE TO TEEN AND HAVE THEM SIGN RECEIPT

STOP TAPE RECORDER.

Public reporting burden for this collection of information is estimated to average 35 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: U.S. Department of Agriculture, Food and Nutrition Services, Office of Policy Support, 3101 Park Center Drive, Room 1014, Alexandria, VA 22302 ATTN: PRA (0584-0606). Do not return the completed form to this address.