REL Southwest, Usability, Feasibility, and Acceptability Study of the LEAD Intervention

Attachment 1

School leader and teacher interview protocols

School leader interview 1

The study team will use the following protocol to conduct one in-depth, 45-minute interview with school leaders after the first PLC session.

Participant name:		Interview date:
Participant school:		Start time:
Interviewer name:		End time:

Introduction

Thank you for agreeing to participate in this interview. The purpose of the interview is to collect information about your experiences with the LEAD project so far. Your feedback is important to us and will help the LEAD development team understand how the project is working and how the project might be improved.

In reporting the study’s results, your answers will be completely confidential; no information that identifies you or your organization will be reported. The researchers conducting this study follow the confidentiality and data protection requirements of the U.S. Department of Education’s Institute of Education Sciences (The Education Sciences Reform Act of 2002, Title I, Part E, Section 183). The reports prepared for the study will summarize findings across the sample and will not associate responses with a specific district, school, institution, or individual. All information you provide will be used only for statistical purposes and may not be disclosed, or used, in identifiable form for any other purpose except as required by law (20 U.S.C. §9573 and 6 U.S.C. §151).

We will not use your name, the name of your school, or any information that could be used to identify you in any written reports based on the data.

Do you have any questions before we begin?

I would like to record this interview to ensure we capture your responses. Your responses will be kept confidential, and the recording will not be shared with anyone outside the LEAD team. Do I have your permission to record? If yes, start the recorder and then state your name, the date, and the interview participant’s name and school before you begin. If no, ask if it’s okay for you to take notes and then state your name, the date, and the interview participant’s name and school before you begin.

Begin recording

I’m going to start by asking about your experience with each component of the LEAD project that you have completed so far. I will ask about the kickoff training, module 1, and PLC 1. I will conclude by asking questions about your experience with the LEAD project overall.

Questions

Research question number	Interview question/item
1, 5	What did you think about the content, including the materials and resources, included in the kickoff training? Probe: If you could change the content covered in the kickoff training to make it easier to understand, what would you do? Probe: What about the materials and resources you received during the kickoff training? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for the kickoff training easier to understand, access, and use? Probe: How relevant was the content in the kickoff training to you and your work with preK and kindergarten teachers? What is an example of something included in the content of the kickoff meeting that was particularly relevant for your school?
2	What did you think about the timing, duration, and form of the kickoff training? Probe: What did you think about the time of year the kickoff training was held? Probe: What did you think about the two-day duration of the kickoff training? Probe: What did you think about the kickoff training being in-person? Probe: What suggestions do you have to improve the timing, duration, and form of the kickoff training?
2	What did you think about the level of effort that was required to participate in the kickoff training? Probe: How easy was it for you to find the time to participate in the kickoff training? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in the kickoff training easier for busy school leaders?
1, 5	What did you think about the content, including the materials and resources, included in module 1? Probe: What, if anything, about the content included in module 1 did you find confusing or not clear? Probe: What about the materials and resources you received during Module 1? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 1 easier to understand, access, and use? Probe: How relevant was the content in module 1 to you and your work with preK and kindergarten teachers? What is an example of something included in module 1 that was particularly relevant for your school?
2	What did you think about the timing, duration, and form of module 1? Probe: What did you think about the time of year for starting module 1? Probe: What did you think about the length of time it took you to complete module 1? Probe: What did you think about the format of module 1 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 1?
2	What did you think about the level of effort that was required to participate in module 1? Probe: How easy was it for you to find the time to participate in module 1? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 1 easier for busy school leaders?
1,5	What did you think about the content, including the materials and resources, included in PLC 1? Probe: What, if anything, about the content included in PLC 1 did you find confusing or not clear? Probe: What about the materials and resources you received during PLC 1? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for PLC 1 easier to understand, access, and use? Probe: How relevant was the content in PLC 1 to you and your work with preK and kindergarten teachers? What is an example of something included in PLC 1 that was particularly relevant for your school?
2	What did you think about the timing, duration, and form of PLC 1? Probe: What did you think about the time of year for starting PLC 1? Probe: What did you think about the length of time devoted to PLC 1? Probe: What did you think about the Zoom meeting format of PLC 1? Probe: What suggestions do you have to improve the timing, duration, and form of PLC#1?
2	What did you think about the level of effort that was required to participate in PLC 1? Probe: How easy was it for you to find the time to participate in PLC 1? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in PLC 1 easier for busy school leaders?
2	What did you think about the cadence of the kickoff training, module 1, and PLC 1? Probe: Did you have enough time to prepare for and lead the associated CoP with teachers? Probe: Was there enough time in between the LEAD components for you to try out associated leadership practices learned during the kickoff training, module 1, and PLC 1? Probe: What suggestions, if any, do you have to improve the cadence or timing of the kickoff training, module 1, and PLC 1?
2	What district or school structures or initiatives do you think align with or compliment what you have learned about so far in the LEAD project? Probe: Do any district or school initiatives or structures align better than others with the LEAD project? Which ones? Probe: What about the leadership and classroom practices associated with the LEAD project? Do any district or school initiatives or policies align with the leadership and classroom practices associated with the LEAD project?
3	What helped make it possible for you to participate in the LEAD project? Probe: What school and district structures or initiatives helped make it possible for you to participate in the LEAD project?
3	What made it difficult for you to participate in the LEAD project? Probe: What school and district structures or initiatives made it difficult for you to participate in the LEAD project?
4	What helped make it possible for you to implement the leadership and classroom practices that you have learned about so far in the LEAD project? Probe: What school and district structures or initiatives helped make it possible for you to implement the leadership and classroom practices that you have learned so far in the LEAD project? Probe: What suggestions do you have to increase the likelihood that school leaders and teachers would implement the practices introduced in the LEAD project?
4	What made it difficult for you to implement the leadership and classroom practices that you have learned about so far in the LEAD project? Probe: What school and district structures or initiatives made it difficult for you to implement the leadership and classroom practices that you have learned so far in the LEAD project?
6	How, if at all, has the LEAD project contributed to changes in leadership or classroom practices at your school? Probe: If you have not made changes based on the LEAD project, why have you not made changes? Probe: What do you do differently now as a result of your participation in the LEAD project? What are your teachers doing differently?

School leader interview 2

The research team will use the following protocol to conduct one in-depth, 45-minute interview with school leaders after module 4.

Participant name:		Interview date:
Participant school:		Start time:
Interviewer name:		End time:

Introduction

Thank you for agreeing to participate in this interview. The purpose of the interview is to collect information about your experiences with the LEAD project. Your feedback is important to us and will help the LEAD development team understand how the project is working and how the project might be improved.

In reporting the study’s results, your answers will be completely confidential; no information that identifies you or your organization will be reported. The researchers conducting this study follow the confidentiality and data protection requirements of the U.S. Department of Education’s Institute of Education Sciences (The Education Sciences Reform Act of 2002, Title I, Part E, Section 183). The reports prepared for the study will summarize findings across the sample and will not associate responses with a specific district, school, institution, or individual. All information you provide will be used only for statistical purposes and may not be disclosed, or used, in identifiable form for any other purpose except as required by law (20 U.S.C. §9573 and 6 U.S.C. §151).

We will not use your name, the name of your school, or any information that could be used to identify you in any written reports based on the data.

Do you have any questions before we begin?

I would like to record this interview to ensure we capture your responses. Your responses will be kept confidential, and the recording will not be shared with anyone outside the LEAD team. Do I have your permission to record? If yes, start the recorder and then state your name, the date, and the interview participant’s name and school before you begin. If no, ask if it’s okay for you to take notes and then state your name, the date, and the interview participant’s name and school before you begin.

Begin recording

I’m going to start by asking about your experience with each component of the LEAD project that you have completed since our last interview. I will ask about module 2, module 3, module 4, and the PLCs. I will conclude by asking questions about your experience with the LEAD project overall.

Questions

Research question number	Interview question/item
1, 5	What did you think about the content, including the materials and resources, included in module 2? Probe: What, if anything, about the content included in module 2 did you find confusing or not clear? Probe: What about the materials and resources included in module 2? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 2 easier to understand, access, and use? Probe: How relevant was the content in module 2 to you and your work with preK and kindergarten teachers? What is an example of something included in module 2 that was particularly relevant for your school?
2	What did you think about the timing, duration, and form of module 2? Probe: What did you think about the time of year for starting module 2? Probe: What did you think about the length of time it took you to complete Module 2? Probe: What did you think about the format of module 2 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 2?
2	What did you think about the level of effort that was required to participate in module 2? Probe: How easy was it for you to find the time to participate in module 2? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 2 easier for busy school leaders?
1, 5	What did you think about the content, including the materials and resources, included in module 3? Probe: What, if anything, about the content included in module 3 did you find confusing or not clear? Probe: What about the materials and resources included in module 3? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 3 easier to understand, access, and use? Probe: How relevant was the content in module 3 to you and your work with preK and kindergarten teachers? What is an example of something included in module 3 that was particularly relevant for your school?
2	What did you think about the timing, duration, and form of module 3? Probe: What did you think about the time of year for starting module 3? Probe: What did you think about the length of time it took you to complete module 3? Probe: What did you think about the format of module 3 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 3?
2	What did you think about the level of effort that was required to participate in module 3? Probe: How easy was it for you to find the time to participate in module 3? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 3 easier for busy school leaders?
1, 5	What did you think about the content, including the materials and resources, included in module 4? Probe: What, if anything, about the content included in module 4 did you find confusing or not clear? Probe: What about the materials and resources included module 4? How easy to use were these materials? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 4 easier to understand, access, and use? Probe: How relevant was the content in module 4 to you and your work with preK and kindergarten teachers? What is an example of something included in module 3 that was particularly relevant for your school?
2	What did you think about the timing, duration, and form of module 4? Probe: What did you think about the time of year for starting module 4? Probe: What did you think about the length of time it took you to complete module 4? Probe: What did you think about the format of module 4 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 4?
2	What did you think about the level of effort that was required to participate in module 4? Probe: How easy was it for you to find the time to participate in module 4? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 4 easier for busy school leaders?
2	Overall, what did you think about the cadence of the LEAD project? Probe: Did you have enough time to prepare for and lead the associated CoP with teachers? Probe: Was there enough time in between the LEAD components for you to try out associated leadership practices learned during the modules and PLCs? Probe: What suggestions, if any, do you have to improve the cadence or timing of the LEAD project components?
2	What district and school structures or initiatives do you think align with or compliment what you have learned about in the LEAD project? Probe: Do any district or school initiatives or structures align better than others with the LEAD project? Probe: What about the leadership and classroom practices associated with the LEAD project? Do any district or school initiatives or structures align with the leadership and classroom practices associated with the LEAD project?
3	What helped make it possible for you to participate in the LEAD project? Probe: What school and district structures or initiatives have helped make it possible for you to participate in the LEAD project?
3	What has made it difficult for you to participate in the LEAD project? Probe: What school and district structures or initiatives made it difficult for you to participate in the LEAD project?
4	What helped make it possible for you to implement the leadership and classroom practices that you have learned about in the LEAD project? Probe: What school and district structures or initiatives helped make it possible for you to implement the leadership and classroom practices that you have learned so far in the LEAD project? Probe: What suggestions do you have to increase the likelihood that school leaders and teachers would implement the practices introduced in the LEAD project?
4	What made it difficult for you to implement the leadership and classroom practices that you have learned about in the LEAD project? Probe: What school and district structures and initiatives made it difficult for you to implement the leadership and classroom practices that you have learned so far in the LEAD project?
6	How, if at all, has the LEAD project contributed to changes in leadership or classroom practices at your school? Probe: If you have not made changes based on the LEAD project, why have you not made changes? Probe: What do you do differently now as a result of your participation in the LEAD project? What are your teachers doing differently?

Teacher interview 1

The research team will use the following protocol to conduct one in-depth, 45-minute interview with preK and kindergarten teachers after module 1.

Participant name:		Interview date:
Participant school:		Start time:
Interviewer name:		End time:

Introduction

Thank you for agreeing to participate in this interview. The purpose of the interview is to collect information about your experiences with the LEAD project thus far. Your feedback is important to us and will help the LEAD development team understand how the project is working and how the project might be improved.

In reporting the study’s results, your answers will be completely confidential; no information that identifies you or your organization will be reported. The researchers conducting this study follow the confidentiality and data protection requirements of the U.S. Department of Education’s Institute of Education Sciences (The Education Sciences Reform Act of 2002, Title I, Part E, Section 183). The reports prepared for the study will summarize findings across the sample and will not associate responses with a specific district, school, institution, or individual. All information you provide will be used only for statistical purposes and may not be disclosed, or used, in identifiable form for any other purpose except as required by law (20 U.S.C. §9573 and 6 U.S.C. §151).

We will not use your name, the name of your school, or any information that could be used to identify you in any written reports based on the data.

Do you have any questions before we begin?

I would like to record this interview to ensure we capture your responses. Your responses will be kept confidential, and the recording will not be shared with anyone outside the LEAD team. Do I have your permission to record? If yes, start the recorder and then state your name, the date, and the interview participant’s name and school before you begin. If no, ask if it’s okay for you to take notes and then state your name, the date, and the interview participant’s name and school before you begin.

Begin recording

I’m going to start by asking about your experience with module 1. I will conclude by asking questions about your experience with the LEAD project overall.

Questions

Research question number	Interview question/item
1, 5	What did you think about the content, including the materials and resources, included in module 1? Probe: What, if anything, about the content included in module 1 did you find confusing or not clear? Probe: What about the materials and resources included in Module 1? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 1 easier to understand, access, and use? Probe: How relevant was the content in module 1 to you and your work with preK and kindergarten students? What is an example of something included in module 1 that was particularly relevant for your school or classroom?
2	What did you think about the timing, duration, and form of module 1? Probe: What did you think about the time of year for starting module 1? Probe: What did you think about the length of time it took you to complete module 1? Probe: What did you think about the format of module 1 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 1?
2	What did you think about the level of effort that was required to participate in module 1? Probe: How easy was it for you to find the time to participate in module 1? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 1 easier for busy school leaders?
2	What district or school structures or initiatives do you think align with or compliment what you have learned about so far in the LEAD project? Probe: Do any district or school initiatives or structures align better than others with the LEAD project? Probe: What about the leadership and classroom practices associated with the LEAD project? Do any district or school initiatives or structures align with the leadership and classroom practices that are associated with the LEAD project?
3	What helped make it possible for you to participate in the LEAD project? Probe: What school and district structures or initiatives helped make it possible for you to participate in the LEAD project?
3	What made it difficult for you to participate in the LEAD project? Probe: What school and district structures or initiatives made it difficult for you to participate in the LEAD project?
4	What helped make it possible for you to implement the classroom practices that you have learned about so far in the LEAD project? Probe: What school and district structures or initiatives helped make it possible for you to implement the classroom practices that you have learned so far in the LEAD project? Probe: What suggestions do you have to increase the likelihood that school leaders and teachers would implement the practices introduced in the LEAD project?
4	What made it difficult for you to implement the classroom practices that you have learned about so far in the LEAD project? Probe: What school and district structures or initiatives made it difficult for you to implement the classroom practices that you have learned so far in the LEAD project?
6	How, if at all, has the LEAD project contributed to changes in leadership or classroom practices at your school? Probe: If you or others in your school have not made changes based on the LEAD project, why have you not made changes? Probe: What do you do differently now as a result of your participation in the LEAD project? What is/are your school leader(s) doing differently?

Teacher interview 2

The research team will use the following protocol to conduct one in-depth, 45-minute interview with preK and kindergarten teachers after module 4.

Participant name:		Interview date:
Participant school:		Start time:
Interviewer name:		End time:

Introduction

Thank you for agreeing to participate in this interview. The purpose of the interview is to collect information about your experiences with the LEAD project. Your feedback is important to us and will help the LEAD development team understand how the project is working and how the project might be improved.

In reporting the study’s results, your answers will be completely confidential; no information that identifies you or your organization will be reported. The researchers conducting this study follow the confidentiality and data protection requirements of the U.S. Department of Education’s Institute of Education Sciences (The Education Sciences Reform Act of 2002, Title I, Part E, Section 183). The reports prepared for the study will summarize findings across the sample and will not associate responses with a specific district, school, institution, or individual. All information you provide will be used only for statistical purposes and may not be disclosed, or used, in identifiable form for any other purpose except as required by law (20 U.S.C. §9573 and 6 U.S.C. §151).

We will not use your name, the name of your school, or any information that could be used to identify you in any written reports based on the data.

Do you have any questions before we begin?

I would like to record this interview to ensure we capture your responses. Your responses will be kept confidential, and the recording will not be shared with anyone outside of the LEAD team. Do I have your permission to record? If yes, start the recorder and then state your name, the date, and the interview participant’s name and school before you begin. If no, ask if it’s okay for you to take notes and then state your name, the date, and the interview participant’s name and school before you begin.

Begin recording

I’m going to start by asking about your experience with each component of the LEAD project that you have completed since our last interview. I will ask about module 2, module 3, and module 4. I will conclude by asking questions about your experience with the LEAD project overall.

Questions

Research question number	Interview question/item
1, 5	What did you think about the content, including the materials and resources, included in module 2? Probe: What, if anything, about the content included in module 2 did you find confusing or not clear? Probe: What about the materials and resources you were provided during module 2? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 2 easier to understand, access, and use? Probe: How relevant was the content in module 2 to you and your work with preK and kindergarten students? What is an example of something included in module 2 that was particularly relevant for your school or classroom?
2	What did you think about the timing, duration, and form of module 2? Probe: What did you think about the time of year for starting module 2? Probe: What did you think about the length of time it took you to complete module 2? Probe: What did you think about the format of module 2 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 2?
2	What did you think about the level of effort that was required to participate in module 2? Probe: How easy was it for you to find the time to participate in module 2? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 2 easier for busy school leaders?
1, 5	What did you think about the content, including the materials and resources, included in module 3? Probe: What, if anything, about the content included in module 3 did you find confusing or not clear? Probe: What about the materials and resources you were provided during module 3? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 3 easier to understand, access, and use? Probe: How relevant was the content in module 3 to you and your work with preK and kindergarten students? What is an example of something included in module 3 that was particularly relevant for your school or classroom?
2	What did you think about the timing, duration, and form of module 3? Probe: What did you think about the time of year for starting module 3? Probe: What did you think about the length of time it took you to complete module 3? Probe: What did you think about the format of module 3 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 3?
2	What did you think about the level of effort that was required to participate in module 3? Probe: How easy was it for you to find the time to participate in module 3? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 3 easier for busy school leaders?
1, 5	What did you think about the content, including the materials and resources, included in module 4? Probe: What, if anything, about the content included in module 4 did you find confusing or not clear? Probe: What about the materials and resources you were provided during module 4? How would you change or add to these materials to make them easier to use or to apply them in your school context? Probe: What suggestions, if any, do you have to make the content or materials for module 4 easier to understand, access, and use? Probe: How relevant was the content in module 4 to you and your work with preK and kindergarten students? What is an example of something included in module 4 that was particularly relevant for your school or classroom?
2	What did you think about the timing, duration, and form of module 4? Probe: What did you think about the time of year for starting module 4? Probe: What did you think about the length of time it took you to complete module 4? Probe: What did you think about the format of module 4 being hosted in an online Learning Management System? Probe: What suggestions do you have to improve the timing, duration, and form of module 4?
2	What did you think about the level of effort that was required to participate in module 4? Probe: How easy was it for you to find the time to participate in module 4? What made it easier? What made it more difficult? Probe: What suggestions do you have that might make participating in module 4 easier for busy school leaders?
2	Overall, what did you think about the cadence of the LEAD project? Probe: Was there enough time in between the modules for you to try out associated instructional practices learned during the modules? Probe: What suggestions, if any, do you have to improve the cadence or timing of the LEAD modules?
2	What district or school structures or initiatives do you think align with or compliment what you have learned about in the LEAD project? Probe: Do any district or school initiatives or structures align better than others with the LEAD project? Probe: What about the leadership and classroom practices associated with the LEAD project? Do any district or school initiatives or structures align with the leadership and classroom practices associated with the LEAD project?
3	What helped make it possible for you to participate in the LEAD project? Probe: What school and district structures or initiatives helped make it possible for you to participate in the LEAD project?
3	What made it difficult for you to participate in the LEAD project? Probe: What school and district structures or initiatives made it difficult for you to participate in the LEAD project?
4	What helped make it possible for you to implement the classroom practices that you have learned about so far in the LEAD project? Probe: What school and district structures or initiatives helped make it possible for you to implement the classroom practices that you have learned so far in the LEAD project? Probe: What suggestions do you have to increase the likelihood that school leaders and teachers would implement the practices introduced in the LEAD project?
4	What made it difficult for you to implement the classroom practices that you have learned about so far in the LEAD project? Probe: What school and district structures or initiatives made it difficult for you to implement the classroom practices that you have learned so far in the LEAD project?
6	How, if at all, has the LEAD project contributed to changes in leadership or classroom practices at your school? Probe: If you or others in your school have not made changes based on the LEAD project, why have you not made changes? Probe: What do you do differently now as a result of your participation in the LEAD project? What is/are your school leader(s) doing differently?

A9