Evaluation of the E-STAR Training Grant Program

OMB Control No:  0584-0524

Expiration Date:  12/31/2022

Manager Interview – Year 1

Appendix B: School Nutrition Manager Process Study Year 1 Interview

Background (do not read to the participant):

Semi-structured phone interviews will take place with school nutrition managers (SNMs) at the end of the first year (Spring 2022) and at the end of the second year (Spring 2023) of E-STAR implementation. Targeted length for each interview is 45 minutes. Interviews are intended to be semi-structured and conversational to provide additional insight into school nutrition managers’ participation in E-STAR, beyond the information gathered in surveys. This protocol will be used to guide the conversation, and the suggested probes may be used as necessary, but we do not expect all probes to be asked of all interviewees.

Introduction

My name is [NAME], and I’m a researcher at Abt Associates. Thank you for speaking with me today.

As you may remember, our team is evaluating the E-STAR Training Program. E-STAR stands for the Enhanced Strategies, Training, Action Plans, and Resources Program, and you started this program in Summer 2021 when you attended the 2.5-day workshop in East Lansing, Michigan.

Our team is talking with all the school nutrition managers who are participating in E-STAR to get input about their experiences with the E-STAR workshops, virtual trainings, mentoring, and Action Plan implementation.

Today, I have a series of questions I’d like to ask you, and it will take approximately 45 minutes to get through these questions. If there are questions that you cannot answer or do not wish to answer, feel free to say you would like to skip the question. Please know that your participation in this interview is voluntary and you may choose to end the interview at any time. As a thank-you for your time today, we will send you a $20 gift card. After this interview, we will summarize your responses with those provided by other school nutrition managers, in a final report for US Department of Agriculture’s Food and Nutrition Service, the agency that funds E-STAR. We will not use names in the report or identify individual respondents.

With your permission, I would like to record our call to ensure that our notes accurately reflect your responses. Do I have your permission to record our conversation?

• Yes

• No

Great, thank you for speaking with me, [SNM NAME]. Before we begin, do you have any questions for me about the project in general or what we will be discussing today?

Questions

1. E-STAR Workshop

First, I’m going to ask you to think about the E-STAR workshop you attended in Summer 2021.

1. According to our records, you

   1. [HAVE/HAVE NOT] attended the full 2.5-day E-STAR workshop in Summer 2021. Is this correct?

2. During that workshop, you worked with your mentor to develop an Action Plan. How well did the E-STAR workshop prepare you to develop your Action Plan?

   1. Probe: What was most helpful?

   2. Probe: What could have been more helpful?

3. How well did the E-STAR workshop prepare you to implement your Action Plan?

   1. Probe: What was most helpful?

   2. Probe: What could have been more helpful?

2. Action Plan

Next, let’s talk about the Action Plan you developed. Remember, this is the plan you created when you attended the initial 2.5-day E-STAR workshop in Summer 2021. I’ll also ask you about the trainings you conducted for food service staff as part of this Action Plan.

4. Have you been able to implement your Action Plan as you initially planned? Why or why not?

   1. Probe with specific actions/SMART goals in plan and progress towards SMART goals-- if they are ahead or behind schedule, and the reasons why.

   2. Probe on whether they felt like they had the ability to make changes.

   3. Probe on interactions with Director and how that relates to their getting approval and support towards achieving the goals in the Action Plan. Also, ask if there has been a change in Director since they began participating in E-STAR and if that turnover affected support.

   4. Probe: Who has been supportive, who has been opposed or resistant to the implementation of the Action Plan?

   5. Probe: Did you partner or collaborate with anyone to implement the SMART goals in your plan? What were the facilitators/barriers to this collaboration? Was the collaboration helpful?

5. Have you had to make changes to your Action Plan since the E-STAR workshop? Why or why not?

   1. Probe for any changes due to food service staff or Director turnover.

   2. Probe: Which SMART goals were changed? Did you discuss these changes with your mentor? With your Director?

6. Our records show that you have delivered [X] Manager’s Corner trainings to your food service staff since you participated in the E-STAR workshop. Is this correct?

[NOTE TO INTERVIEWERS – IF THE SNM IS CONFUSED ABOUT THE MANAGER’S CORNERS HE/SHE DELIVERED, MAY NEED TO OFFER SOME EXAMPLES OF ONES HE/SHE DELIVERED. IF THE SNM DOESN’T THINK THE NUMBER IS CORRECT, PLEASE RECORD WHAT THE SNM SAYS.]

7. Did you deliver the trainings you had initially planned to deliver as described in your Action Plan?

   1. Probe: If yes, probe for facilitators.

   2. Probe: If no, probe for barriers (why are you behind schedule?).

8. How do you feel the trainings went? What made them go well? What challenges did you encounter in delivering the trainings?

[NOTE TO INTERVIEWERS – PROBE FOR FACILITATORS AND BARRIERS TO DELIVERING THE MANAGERS CORNER TRAININGS – SEE PROBES BELOW FOR EXAMPLES.]

1. Probe: Did you follow the Manager’s Corner training curricula exactly as prescribed without variation? Why or why not? If changes were made, what were the nature of the changes?

2. Probe: Were the curricula lessons easy or hard to use? Why? What would improve them?

3. Probe: In what location or environment did you conduct the trainings? How engaged or interested were your food service staff in the training and material presented? Do you think the food service staff are open to new ideas and ways of doing things? Or would you say they are resistant to changes?

3. Mentoring Sessions

We’re going to turn our attention to the mentoring part of E-STAR. Next, I’ll ask you some questions about your experiences with your mentor, [INSERT NAME OF MENTOR]. Please remember that your responses are confidential and we will not use your name, your mentor’s name, or any other potentially identifying information in the final report. To date, it sounds like you’ve completed a total of [XX] sessions with your mentor, is this correct?

[NOTE TO INTERVIEWERS – IF NOT CORRECT, DOCUMENT THE NUMBER THE SNM STATES.]

9. Can you start by providing a brief description of a typical mentoring session?

   1. Probe: What information do the sessions include? How are they structured? How long are they? Are they typically in person or virtual (by video conference, phone)? Are they always scheduled or do you ever have impromptu sessions?

   2. Probe on effectiveness of virtual and in-person mentoring sessions.

   3. Probe: Can you describe your relationship with your mentor?

10. Have you been able to have all of your meetings with your mentor? Why or why not?

    1. Probe: What has made it easier to attend mentoring sessions? What has motivated you to attend?

       1. Probe for both logistical and other motivating factors. Some possibilities are convenience of scheduling, convenience of location or technology used, ability to find coverage for work responsibilities, need to learn, meetings are helpful/interesting/engaging.

    2. Probe: What has made it more difficult to attend mentoring sessions? What has made you more resistant to attend?

       1. Probe for both logistical and other factors that may have made them more resistant to participate. Some possibilities are inconvenience of scheduling, inconvenience of location, technology difficulties (for virtual meetings), inability to find coverage for work responsibilities, did not find sessions useful or necessary to implement Action Plans, meetings were not interesting/engaging.

11. Please describe how the mentoring sessions have or have not been helpful to you.

    1. Probe: In what areas has mentoring been most helpful to you?

    2. Probe: In what areas could mentoring have been more helpful to you?

    3. Probe: Has your mentor been a good listener? Have they been able to help you with questions or solve problems that have come up?

12. What role has your mentor played in your Action Plans?

    1. Probe for help with developing, getting approval, making changes, helping to identify strategies to overcome any challenges in implementing Action Plans.

    2. Probe: Do your experiences with your mentor motivate you to continue implementing your E-STAR Action Plan? Why or why not?

4. Virtual Instructor-Led Trainings

[NOTE TO INTERVIEWERS – IF LESS THAN 7 MINUTES IS REMAINING, PLEASE SKIP THESE QUESTIONS AND MOVE TO SECTION E.]

Now, let’s talk about your experiences with the Virtual Instructor-Led Trainings or VILTs. To date, it sounds like you’ve completed [XX] VILTs, is that correct?

[NOTE TO ITNERVIEWERS - If THE SNM is confused about what a VILT is, may need to offer some examples that he/she has completed.]

13. What things made it easier or harder to participate in the VILTS?

    1. Probe for both logistical and other motivational factors. Some possibilities are convenience of scheduling, ease of technology, ability to find coverage for work responsibilities, found material helpful/interesting/engaging.

    2. Probe for both logistical and other factors that may have made them more resistant to participate. Some possibilities are inconvenience of scheduling, technical difficulties (online structure of the training), inability to find coverage for work responsibilities, already knew the material, did not find them interesting or engaging.

14. How helpful were the VILTs? Does participating in them motivate you to continue with E-STAR and implement your Action Plan?

    1. Probe: Which VILTs were the most/least helpful? Why?

    2. Probe: How were they useful? How did you incorporate what you learned into your work? Did they provide new information?

    3. Probe: How did the VILTs help you with carrying out your Action Plan?

    4. Probe: How did the VILTs help you with training your food service staff?

5. Conclusion

Finally, I have a couple of closing questions for you.

15. Thinking about E-STAR as a whole, which part of E-STAR have you found to be most useful? Why?

    1. Probe: Which of the three main elements of E-STAR were most useful: the workshop, VILTS, or mentoring sessions?

16. Which part of E-STAR have you found to be least useful? Why?

    1. Probe: Which of the three main elements of E-STAR were least useful: the workshop, VILTS, or mentoring sessions?

17. What has helped you stay engaged in the E-STAR Program?

1. Probe: What keeps you motivated to continue participating in E-STAR?

2. Probe: What things have kept you committed to implementing your Action Plan?

18. What things have made it difficult to continue to participate in E-STAR?

1. Probe: What discourages your participation (e.g., training format, content, competing job priorities, receptiveness of food service staff)?

19. What else about E-STAR do you want to share with me today?

1. Probe: Do you feel that participating in E-STAR has helped you improve meal service or meal quality at your school?

2. Probe: Do you feel that participating in E-STAR has helped you increase the amount and quality of training you provide to your food service staff?

3. Probe: Do you think that you will maintain or continue working towards the goals in your Action Plan after your participation in ESTAR has ended? Why or Why not?

Closing

Thanks for all your help today. It’s been a pleasure speaking to you and learning about your experience with E-STAR. We appreciate your insights and wish you continued success in this training program!

Before we end the conversation, can you provide me with your full name and e-mail address, so we can send you a gift card to thank you for your time?

[COLLECT INFORMATION]

Great, thanks again and enjoy your day!

This information is being collected to assist the Food and Nutrition Service in understanding the E-STAR training program as implemented. This is a voluntary collection and FNS will use the information to inform future iterations of E-STAR. This collection does not request any personally identifiable information under the Privacy Act of 1974. According to the Paperwork Reduction Act of 1995, an agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is 0584-0524. The time required to complete this information collection is estimated to average 45 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: U.S. Department of Agriculture, Food and Nutrition Service, Office of Policy Support, 1320 Braddock Place, 5th Floor, Alexandria, VA 22306 ATTN: PRA (0584-0524). Do not return the completed form to this address.

6