Respondents- Individuals/Households (Parents/Children/Teens)

OMB Control No: 0584-XXXX Expiration Date: 03/31/2019

Appendix H11. Teen Nonparticipant Survey Pretest Protocol

(PROTOCOL WILL NEED ADAPTION IF INTERVIEW IS CARRIED OUT ONSITE.)

INTERVIEWER NOTES:

THE INTERVIEW SHOULD TAKE ABOUT 30 MINUTES.

Bold red indicates probes you can read aloud. Non-bold red indicates points you may need/want to probe on.

PARENTAL CONSENT FOR TEEN (13-17) TO BE INTERVIEWED AND RECORDED SHOULD BE OBTAINED BEFORE TEEN INTERVIEW BEGINS. PARENT MAY ACCOMPANY TEEN DURING THE INTERVIEW BUT IDEALLY TEEN SHOULD BE INTERVIEWED WITHOUT THE PARENT.

IF “NO” TO INTERVIEW AT ANY POINT DURING CONSENT PROCESS, ASK: Is there anything you are worried about? Are there any questions you would like to ask me? REASSURE TEEN, ANSWER ANY QUESTIONS, IF NECESSARY, DISCUSS WITH PARENT TO ESTABLISH ANY CONCERNS. IF NECESSARY TERMINATE INTERVIEW: You don’t have to talk to me today if you don’t want to. That’s okay.

IF “NO” TO RECORDING ONLY - CONTINUE, BUT DO NOT RECORD THE INTERVIEW.

PROBING IS CONCURRENT. YOU MAY NEED TO ADAPT YOUR PROBING TO REFLECT THE AGE OR COGNITIVE ABILITY OF THE TEEN.

YOU MAY NEED TO ADMINISTER THE QUESTION AND READ IT TO THE TEEN IF THEY ARE UNABLE TO READ IT.

NOTE ANY VERBAL OR NONVERBAL REACTION WHEN TEEN COMPLETES EACH QUESTION. FOR ANY NON-VERBAL REACTIONS, MENTION THE REACTION OR ASK: What are you thinking?

NOTE ANY ISSUES WITH READING, COMPREHENSION OR ABILITY TO PROVIDE A RESPONSE, AS WELL AS HOW THE TEEN NAVIGATES AND COMPLETES THE QUESTIONNAIRE.

SUGGESTED GENERAL PROBES:

• Don’t forget to read the question out loud.

• Tell me what you are thinking…

• What were you thinking when you answered that question?

• Can you tell me a bit more about that?

• Was that easy or hard for you?

ADMINISTER TEEN ASSENT OR CONSENT FOR THOSE AGED 18

Before we start, I need to turn on the recorder.

Now we can look at the questions that are written on this piece of paper. Please answer each question one question at a time. After you have answered each question I may ask you about your answer. This is not a test. There are no right or wrong answers. It is what you are thinking when you answer each question that matters to me.

OK, let’s start with the first question. {Try to} read the question out loud for me and tell me your answer as you write it on the paper.

Q1. How old are you? ______________ Years

DO NOT PROBE UNLESS TEEN GIVES DIFFERENT ANSWER FROM THAT PROVIDED DURING SCREENING. TRY AND ESTABLISH REASON FOR DISCREPANCY: IF NEEDED: When is your birthday? How old will you be on your next birthday?

Notes and observations, including: Did R write in their age correctly on the line provided? If not note how R recorded their age.

Q2. Are you a boy or a girl?

Boy

Girl

DO NOT PROBE

Notes and observations, including: Any difficulties with question? Did R select the correct box? How did R select box - tick, cross, shade in or something else?

Q3. What grade will you go to when school begins this fall?

Was that question easy or hard for you to answer? Why?

IF NEEDED: Using your own words, what do you think the question was asking?

What grade were you when school closed for summer?

Notes and observations: Did R write their grade correctly on the line provided?

Q4. Have you ever attended the summer program at <SITE NAME>?

Yes

No  GO TO QUESTION 5

Have you heard of <SITE NAME> before? Do you use that name? What do you call it?

What is a “summer program?”

IF NEEDED: Using your own words, what do you think the question was asking?

What does the word “attended” mean to you?

Notes and observations: What difficulties did R have with this question? Was R familiar with the site name and the term summer program? R understood correctly the intent of the term “attended.”

4a. How many summers did you attend a summer program at <SITE NAME>?

1 summer

2 summers

3 summers

More than three summers

Don’t remember

How easy or hard was it for you to answer this question? Why?

IF NEEDED: Using your own words, what do you think the question was asking?

IF DON’T REMEMBER: What makes it difficult for you to remember?

ELSE: How did you figure out how many summers you went to <SITE NAME>?

Notes and observations: What difficulties did R have with this question? Did R understand what was meant by ”attend” and could they recall number of summers.

4b. When was the last time you attended the summer program at <SITE NAME>?

Last summer

2 summers ago

More than 2 summers ago

Don’t remember

IF NEEDED AND NOT ALREADY COVERED AT Q4A: How confident are you in the answer you gave? Why?

Notes and observations: What difficulties did R have with this question? Level of confidence.

4c. What did you like about the summer program at <SITE NAME>? (CHECK ALL THAT APPLY.)

My friends went here

There were interesting things to do

I liked the food offered at this program

I liked the program staff

I did not like the summer program at <SITE NAME>

Other (PLEASE SPECIFY):

Tell me what made you mark ________ (and ______).

IRRESPECTIVE OF OTHER RESPONSE: Are there any other things that you liked about going to <SITE NAME>?

IF NEEDED: Tell me more about why you went to <SITE NAME>

IF ONLY ONE SELECTION: Establish if R realized that they could check more than one box and understanding of “check all that apply.”

IF B: What interesting things are there to do?

IF E: Tell me more about why you did not like the summer program at <SITE NAME>.

Notes and observations: What difficulties did R have with this question?

4d. On average, how many days each week did you eat a meal or snack served at <SITE NAME>?

Never  GO TO QUESTION 5

1 day

2 days

3 days

4 days

5 or more days

How did you figure out your answer?

IF NEEDED: How easy or hard was it for you to remember?

IF NEEDED: How often did you eat a meal or snack at <SITE NAME>? Every week? Every day?

What does the term “on average” mean to you?

IF NEEDED: What is another word than means the same thing as “average”?

Notes and observations: What difficulties did R have with this question? On what basis did R calculate answer? Comprehension of “average” / “meal or snack”.

4e. Overall, would you say that the food served at <SITE NAME> was …

delicious

pretty good

okay

terrible

Tell me more about why you chose [ANSWER]. ASK FOR EXAMPLES What does it mean when we say something is delicious?

How would you describe the difference between “delicious” and “pretty good?”

What about “Okay” – What does that mean if you say the food is Okay? Terrible?

NOTE IF R ANSWERS MORE THAN ONE AND ESTABLISH REASON.

Notes and observations: What difficulties did R have with this question? Comprehension of terms. Differences between scale items.

5. Why didn't you attend the summer program at <SITE NAME> this summer?

The program schedule was not convenient

It was not easy to get there

Attended a different summer program

I didn’t like the activities there

There were no activities there

My friends didn’t go there

I didn’t like the facility

I didn’t like the food

I didn’t like the program staff

The meal times were not good for me

I wanted to stay home

The program was for children and teenagers in need

My parents did not want me to go there anymore

Did not know of the program at <SITE NAME>

Other (PLEASE SPECIFY):

_______________________

NOTE IF READ LIST AND LENGTH OF TIME – QUICK SCAN, TOOK TIME TO READ LIST ETC.

Tell me what made you mark ________ (and ______).

Are there any words you don’t know or find confusing?

What does it mean that the “program schedule was not convenient?”

What is the difference between this and the one that says “the meal times were not good for me?”

IF NEEDED: What does the word “convenient” mean to you? What about “activities?”

What about “the program was for children and teenagers in need?” What does that mean to you?

IF “parents did not want me to go there anymore”- What did your parents say about the program at <SITE NAME>?

IRRESPECTIVE OF OTHER RESPONSE: Are there any other reasons why you didn’t go to <SITE NAME> this summer? IF NEEDED: Tell me more about why you didn’t go to <SITE NAME> this summer?

IF ONLY ONE SELECTION: Establish if R realized that they could check more than one box and understanding of “check all that apply.”

Notes and observations: What difficulties did R have with this question? Comprehension of terms/items. Reading of list/ use of check all that apply.

6. Would you attend the summer program at <SITE NAME> next year?

Yes

No

7. Would you tell your friends to attend the summer program at <SITE NAME> next year?

Yes

No

IF TIME: ASK WHY R ANSWERED Q18 AND Q19 THE WAY THEY DID.

Notes and observations: What difficulties did R have with these questions?

OTHER ISSUES

Is there anything else you would like to tell me about <SITE NAME>.

Why do you think we are asking these questions of teens like you?

Using one word, how would you describe the way this <questionnaire> looks? Why do you say that?

Notes and observations, including: Did R attempt to read any of the information provided at the bottom of the page in the burden box? How did R check their answers, tick, cross, shade in or something else?

Closing and Incentive

IF OBSERVERS ARE PRESENT, CHECK TO SEE IF THEY HAVE FURTHER QUESTIONS.

Thank you. You did great today. Good job.

STOP TAPE RECORDER.

GIVE INCENTIVE TO PARENT/CAREGIVER AND HAVE THEM SIGN RECEIPT

Public reporting burden for this collection of information is estimated to average 35 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: U.S. Department of Agriculture, Food and Nutrition Services, Office of Policy Support, 3101 Park Center Drive, Room 1014, Alexandria, VA 22302 ATTN: PRA (0584-0606). Do not return the completed form to this address.