Evaluation of the E-STAR Training Grant Program

OMB Control No:  0584-0524

Expiration Date:  12/31/2022

Mentor Interview – Year 1

Appendix D: Mentor Interview Protocol Year 1 (Spring 2022)

Background (do not read to participant):

Mentor semi-structured phone interviews will take place at the end of year 1 of implementation and at the end of year 2 of implementation. Targeted length for each interview is 45 minutes. This is the script for the interview at the end of year 1. Interviews are intended to be semi-structured and conversational to provide additional insight into E-STAR mentoring. This protocol will be used to guide the conversation, and the suggested probes may be used as necessary, but we do not expect all probes to be asked of all interviewees.

Introduction

My name is [NAME], and I’m a researcher at Abt Associates. Thank you for speaking with me today.

As you may recall, my team is conducting an evaluation of the Team Nutrition Enhanced Strategies, Training, Action Plans, and Resources (or E-STAR) Program for the U.S. Department of Agriculture’s Food and Nutrition Service (FNS).

As part of this evaluation, my team is contacting E-STAR mentors, like you, to learn more about the E-STAR mentoring sessions, how the sessions work, and what made it easier or harder to provide effective mentoring to your school nutrition manager mentees.

As we go through this interview, if there are questions to which you do not know the answer, or you wish to not answer, feel free to say you would like to skip the question. Please know that your participation in this interview is voluntary and you may choose to end the interview at any time. As a thank-you for your time today, we will send you a $20 gift card.

After this interview, we will summarize your responses with those provided by other mentors, in a final report for FNS. We will not use names in the report or identify individual respondents.

This call should take about 45 minutes.

With your permission, we would like to record the discussion to ensure that our notes accurately reflect your responses. Do I have your permission to record our conversation?

• Yes

• No

Great, thank you for speaking with me, [MENTOR NAME]. Before we begin, do you have any questions about the project in general or what we will be discussing today?

Interview questions

First, think about the 1-day mentor orientation and 2.5-day E-STAR workshop that you attended last summer in East Lansing, Michigan. Let’s talk about how your experience at this orientation and workshop affected your mentoring over the past year.

1. How well did the 1-day mentor orientation prepare you to provide effective mentoring to the manager mentees?

   1. Probe for specific examples.

2. How could FNS improve the mentor orientation to provide more effective mentoring for manager mentees?

   1. Probe: Was there anything that should have been included in the orientation that was not?

3. How did the 2.5-day E-STAR workshop prepare you to provide effective mentoring to the manager mentees?

   1. Probe for specific examples.

4. How could FNS improve the E-STAR workshop to help you provide more effective mentoring for manager mentees?

   1. Probe: Was there enough time to build a relationship with your mentee?

   2. Probe: Was there anything that should have been included in the workshop that was not?

Now, let’s talk about how your experience as a mentor is going.

5. Tell me about your overall goals for the E-STAR mentoring.

   1. Probe: How do you see your role as a mentor in supporting manager mentees?

   2. Probe: What do you hope manager mentees will get out of the mentoring?

6. Can you provide a brief description of a typical session you held with your mentees?

   1. Probe: Have your mentoring sessions been held in person? Over the phone? Via webinar, skype, or video chat? If in-person, then where do you meet? Is one way more effective than another?

   2. Probe: Leave this very open ended, but probe about structure, length, frequency, topics covered; how they addressed the Action Plan goals – How do mentors track progress between sessions?

   3. Probe: Do you have specific goals for each session? How much preparation (if any) do you do prior to each session?

   4. Probe: How did you end each session? What were the expectations for the mentee?

   5. Probe: How much do sessions vary between mentees? How much do sessions vary from session-to-session for the same mentee? (Think of variation in terms of structure, length, frequency, topics covered, goals, etc.)

7. Were you able to meet with your manager mentees on the schedule you planned? Why or why not?

   1. Probe: How, if at all, did you need to adapt your schedule?

   2. Probe: Have you experienced any challenges related to adhering to the schedule; technical challenges?

   3. Probe: Have there been any challenges connecting with the manager mentees for mentoring sessions?

   4. Probe for facilitators and barriers on mentor’s end and on manager mentees’ end to holding mentoring sessions as planned.

8. What were some of the more common topics you covered during your mentoring sessions? What have your manager mentees needed the most help with?

   1. Probe for topics more related to content (e.g., meal quality knowledge/skills) vs. training their food service staff.

   2. Probe: How did you determine what manager mentees needed the most help with? When is this determined (e.g., at the first mentoring session, at the end of a session for the next session, as needed when mentee asks for help with something)?

   3. Probe: Have you been able to cover the topics you planned during your mentoring sessions?

      1. Probe: How, if at all, did you need to adapt your topics?

      2. Probe for facilitators and barriers on mentor’s end and on manager mentees’ end to covering topics during mentoring sessions as planned.

9. To what extent are your mentees engaged in the mentoring process?

   1. Probe: What does “engagement” look like? How do you know if a mentee is truly engaged?

   2. Probe: Did you engage with your mentees outside of regularly scheduled mentoring sessions? If so, please describe how and for what reasons.

   3. Probe: Does the extent to which mentees are engaged vary across the mentees you work with? If so, how? Why?

Now let’s think more specifically about your mentees’ Action Plans.

10. How focused were your mentoring sessions on those Action Plans? How was the content of your mentoring sessions directly linked to, or aligned with, the mentee’s Action Plan and SMART goals?

11. Are your mentees successfully implementing their Action Plans and working to achieve their SMART goals? Why or why not?

    1. Probe for facilitators and barriers to achieving goals and implementing Action Plans.

       1. Probe for examples of successful Action Plan implementation.

       2. Probe for any challenges mentees faced to execute Action Plans.

    2. Probe: How have the mentoring sessions helped mentees achieve their SMART goals, if at all (consider mentor session content, peer-to-peer learning, collaboration with partners)?

1. Probe: In what areas have mentees needed the most support in executing their Action Plans?

2. Probe for specific examples of when mentoring directly helped a mentee implement their Action Plan/reach a SMART goal.

3. Probe for specific examples when mentoring may not have been sufficient to overcome challenges related to the Action Plans/ SMART goals.

3. Probe: Do the mentees seem motivated to implement their Action Plans and train staff? Are they embracing change or are they resistant to it? Why or Why not?

12. Did your mentees’ Action Plans change after they were initially developed? Why or why not?

    1. Probe: What types of changes were made?

    2. Probe for whether response applies to all mentees. How common were changes to Action Plans?

    3. Probe: What role did your mentoring play in identifying when changes need to made, making the changes, and/or helping to implement the changes?

Now, I’m going to ask you to describe more specific experiences you’ve had as an E-STAR mentor. You don’t have to provide specific names when answering these questions, and please know that I will keep this information confidential to the fullest extent possible.

13. Describe a time when your mentoring session went very well. What do you credit with making it a positive session?

    1. Probe: Can you describe any other factors that have helped make your interaction with a mentee successful?

14. Describe a time when your mentoring session did not go well or as you planned. What went wrong? What might you try next time?

    1. Probe: Can you describe any other factors that make successful interaction with a mentee difficult? What challenges have come up with your mentees? How were they handled, and how was advice given?

15. Can you share any examples of how your mentees’ work practices have changed since you began the mentoring sessions?

1. Probe for examples of things that have changed – related to manager mentees’ responsibilities AND related to food service staff responsibilities.

2. Probe for examples of things that haven’t changed. – related to manager mentees’ responsibilities AND related to food service staff responsibilities.

3. Probe: [IF NO/DON’T KNOW] I understand that you may not have observed your manager mentees directly, but do you have any evidence from your conversations with them that would indicate that they’re doing things differently? If so, what?

We’d like to end by asking you to think about your E-STAR mentoring as a whole over the past year.

16. What have been the most successful aspects of the mentoring sessions?

17. What were the biggest barriers you faced when mentoring the manager mentees?

18. What other things about your E-STAR mentoring experience so far would you like to share today?

Closing

Thanks for all of your help today. It’s been a pleasure speaking to you and learning about your experience as an E-STAR mentor. We appreciate your insights and wish you continued success in this program! Before we end the conversation, can you provide me with your full name and e-mail address, so we can send you a gift card to thank you for your time?

[COLLECT INFORMATION]

Thank you again, and have a great day!

This information is being collected to assist the Food and Nutrition Service in understanding the E-STAR training program as implemented. This is a voluntary collection and FNS will use the information to inform future iterations of E-STAR. This collection does not request any personally identifiable information under the Privacy Act of 1974. According to the Paperwork Reduction Act of 1995, an agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is 0584-0524. The time required to complete this information collection is estimated to average 45 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: U.S. Department of Agriculture, Food and Nutrition Service, Office of Policy Support, 1320 Braddock Place, 5th Floor, Alexandria, VA 22306 ATTN: PRA (0584-0524). Do not return the completed form to this address.

5