Study of Title I Schoolwide and Targeted Assistance Programs

Appendix E: Principal (SWP School) Interview Protocol and Consent Form

Principal Interview Protocol (SWP School)

School: District: State:	Interviewer:
Interviewee(s):	Date/Time:
Interviewee(s’) Role(s): (select all that apply) ᴏ Principal ᴏ Other ____________________________________

Information for the Interviewer

For more than 50 years, Title I of the Elementary and Secondary Education Act has aimed to improve the prospects of children in high-poverty schools by providing additional funding for their schools to develop educational services that will improve student outcomes.

Although the Title I policy began by targeting services to eligible students—low achievers in high-poverty schools—the program has increasingly emphasized schoolwide services based on research showing that schools can improve student outcomes by adopting whole-school strategies. Title I’s schoolwide program (SWP) provisions allow schools the flexibility to serve all students in the school and thereby design whole-school reforms. Unlike their targeted assistance (TA) counterparts, SWP schools also are allowed to commingle Title I funds with funds from other federal, state, and local programs. This study aims to obtain a better understanding of how SWP flexibility may translate into programs and services that can improve student performance.

PAY ATTENTION TO:

• Title I Interventions. How SWP school uses Title I funds to select and implement interventions (RQ1)

• Resource Allocation. How Title I funds are allocated to the school (RQ2)

• Decision Making. How decisions are made about how to use and allocate Title I funds and who is involved (RQ2)

• Schoolwide Programs. How SWP school uses Title I funds in ways that would not be permissible in TAP schools (RQ3)

• Professional Development. State and district supports to school leaders on Title I (RQ2)

• Policy Context. Relevant state and district policy factors that affect Title I implementation (RQ2, RQ3)

By the end of this interview, you should have details and examples for each of these areas.

Introduction

Key points to convey to the respondent:

• This is a study conducted by American Institutes for Research on behalf of the U.S. Department of Education. The purpose of the study is to explore the implementation of Title I programs, focusing on the interplay among school decision making, use of funds, and implementation of educational practices supported by Title I and other funds.

• This is not a compliance study; our purpose is solely to provide policymakers and the general public with insight regarding local experiences with Title I programs.

• We are conducting case studies of Title I schools in a subset of the nation’s states and districts. We also are administering nationally representative surveys of district officials and school principals to collect data from a wider range of respondents. In addition to the case studies and surveys, our team is reviewing state and district resources and policy documents available to guide the implementation of Title I schoolwide and targeted assistance programs.

• The study’s results will be discussed in a final report that will be available publicly. The main purpose of this study is to share your perspectives and experiences with policymakers as they continue to refine policy and technical assistance on important issues related to Title I.

• We will not include any information in our public reporting that identifies your district. However, officials at the U.S. Department of Education will know that districts in your state participated in this study. In addition, staff from the U.S. Department of Education will see notes from our interview, but the notes we share will be reviewed and edited to ensure we do not include any information that could identify you or your district.

• We know that you are very busy, and we appreciate your time. We anticipate that this interview will take approximately 60–90 minutes.

• We would like to record this conversation so that we can be sure we have an accurate record of our conversation. We will not share this recording with anyone outside the research team, and we will delete the recording after the final report is complete. Is that okay with you?

• You may discontinue your participation in this interview at any time. Throughout the course of the interview, if we touch on topics that you believe to be sensitive for any reason, please bring that to our attention, and we will not include these comments either in public reporting or in discussions with the U.S. Department of Education.

If asked why or how the district was selected for the study:

• The districts and schools for the study were selected on the basis of a number of factors. We wanted to include larger and smaller districts and schools that are located in different regions of the country and include both Title I schoolwide and targeted assistance programs. We also selected schools on the basis of school characteristics, including school level (elementary, middle, and high), enrollment, and demographics, to ensure variation in the sample.

School Context

I would like to start with some questions about your school’s context and history so that I can understand your school better.

Question
How would you describe your school to someone who has never been here before, including your school’s strengths and challenges?	Probe for: What are the demographics of your school? What are the school’s recent successes? How would you describe the degree of teacher and staff turnover? How would you describe parent and community involvement in your school? For a rural school: What challenges does being in a rural setting present?
How would you describe the surrounding community and the neighborhoods that your students live in?	Listen for: Is the community stable? Is the neighborhood safe?
It is my understanding that your school is designated as a [list possible designations based on state accountability system] (pull from survey data) for the 2016–17 school year. Is this correct?	Probe for: For how many years has your school held this status?

Efforts to Improve Student Outcomes

Note to Interviewer (for reference only, NOT to be read to respondent): Review the school’s Title I plan prior to the interview. Keep the improvement efforts listed in the plan in mind in proceeding with this line of questioning and probe as appropriate.

Question
Generally speaking, what do you think your school needs to improve student performance?	Listen for: SPECIFIC EXAMPLES More funding, resources, state or district support Greater expertise among staff Staff capacity to serve needs of students Other
Could you describe the specific services or strategies your school is implementing to improve student outcomes?	Probe for: How have you prioritized these strategies? Are these long-standing or newly initiated approaches to improving student outcomes in your school? SPECIFIC EXAMPLES Academic or non-academic interventions to address needs of low-performing students Personnel such as content specialists or coaches Personnel to reduce student-teacher ratios (e.g., aides or paraprofessionals) Other personnel like school counselors or behavior specialists Extended day programs Social-emotional support or wraparound services Academic and/or non-academic interventions to address needs of English learners, students with disabilities Other supplies, materials, technology Community or family programs Facilities improvements
Why did your school prioritize… (list the efforts that the respondent described as a priority)?	Probe for: State initiative or mandate District initiative or mandate School needs-assessment results Knowledge of research or evidence base
Can you talk to me about how all of these strategies fit together?	Probe for: Do the strategies provide a coherent approach to improving outcomes for students? Do the strategies complement one another? Are there tensions among the strategies?
Thinking about the services and strategies we’ve just discussed, how does Title I support these efforts?	Probe for: Does Title I enable the school to better support student achievement? How? Listen for: Title I provides extra resources to fund/support services and strategies Title I encourages coherent needs assessment and planning Title I allows for the commingling/coordination of funds to support improvement efforts

Use of Funds and Decision-Making Process

I would like to now talk more about the use of Title I funds at your school and the Title I planning process, including how decisions are made related to use of Title I funds.

Question
Do you know the amount of your total Title I allocation for 2015-16?	Probe for: If yes, how does the district communicate this information to you? If no, do you know how you could access that information if you wanted it?
I understand that this total amount includes a portion of funds that the district controls and a portion of funds that you can use at your discretion (see survey data). Is this correct?
Are you aware of the amount of funds controlled by the district? If yes, how are you informed of this amount?	Probe for: Do you know how the district determines this amount?
Are you familiar with what the district-controlled funds are used for?	Probe for: From your perspective, to what extent do these services or supports benefit your school’s Title I program and efforts to improve student outcomes?
I understand your district allocated X funds for your school to use at your discretion (pull from survey data). Is this correct?	Probe for: How does the district communicate to you this amount?
I’d like to now talk more about how Title I funds, including those controlled by the district and those at your discretion are used in your school.
I understand X staff in your school are supported by Title I funding this school year (pull from survey data). Is this correct?	Probe for: The types of staff that were reported on the survey, including: Teachers Paraprofessionals Instructional coaches EL specialists Curriculum coordinators Assessment coordinators Administrative staff Data analysts or technology support staff
Could you please describe the roles and activities of each of these personnel.	Probe for: Which teachers and/or students do they support? What kind of supports do they provide? Direct instruction to students Social/emotional support to students PD or other support to teachers Parental or community engagement Who hires them and oversees their work?
I understand that Title I funds are used to fund other types of resources or services to support your improvement efforts (pull from survey data). Can you please describe what these types of non-personnel supports are?	Probe for: The type of non-personnel supports reported in the survey: Instructional approaches or curricula for reading/ELA Instructional approaches or curricula for math Instructional approaches or curricula for other subjects Instructional approaches or curricula for special populations of students (EL students, students with disabilities) Extended day activities Parental engagement Supports for data use Other? Who is responsible for purchasing these materials and supplies? How are they distributed to staff or accessed by staff? How are they used to support your school’s efforts to improve student outcomes?
Next, could you please walk me through the planning and budgeting process for Title I, from when it begins to when key decisions are made for the use of funds?	Probe for: What are the key activities? When does the district notify you of your Title I budget for the coming year? Are Title I spending decisions made prior to the start of the school year or throughout the school year? How long after learning of your budget do you have to complete your Title I plan and budget?
How would you describe the involvement of district, school, and parents or community in this process?	Probe for: The involvement and influence of the following stakeholders at key points in the process: Yourself? School improvement team members? Other school staff? District officials? Non-school personnel, such as parents or community members?
To what extent does the Title I planning process rely on data?	Probe for: What specific types of data are used (e.g., student performance data, teacher evaluation data, attendance, graduation rates, etc.)? Does your school conduct a needs-assessment? How are the needs of your school communicated to the district?
For the 2015-16 school year, what did the data tell you about the needs of your school?	Probe for: Was there anything in the data that surprised you? How were Title I funds leveraged to help you address these needs?
Overall, how would you describe the flexibility you have at the school level to make decisions about how Title I funds will be spent?
In your experience, what do you think works well about the current decision-making process? What challenges have you encountered?	Probe for: What factors support the process? What factors challenge or constrain the process?

Commingling and Coordination of Title I Funds

Notes to Interviewer (for reference only, NOT to be read to respondent):

• Re-emphasize that this is not a compliance study and that the study’s purpose is solely to provide policymakers and the general public with insight regarding local experiences with Title I programs.

• Review extant data about the school’s use of funds, including the school’s Title I plan. Look for whether Title I funds are used in conjunction with any other federal categorical program funding, such as Title III, IDEA, Title II, or any state funding streams with similar purposes.

• Review guidance on how SWP schools can use Title I funds. SWP schools are expected to use the flexibility available to them to integrate services and programs with the aim of upgrading the entire educational program and helping all students reach proficient and advanced levels of achievement. In addition to coordinating and integrating services, SWP schools may combine most federal, state, and local funds to provide those services. By combining (sometimes referred to as commingling) funds from federal, state, and local sources, an SWP school can address its needs using all of the resources available to it. This gives a school more flexibility in how it uses available resources to meet the specifically identified needs of its students. Exercising this option is intended to maximize the impact use of the resources available to carry out the SWP.

I would now like to learn more about how Title I funds may be coordinated with other state, local, or federal funds, or commingled with other funding sources to support efforts to improve student outcomes and meet the needs of your students.

Question
At your school, could you describe how Title I funds are used together with funds from other sources to support your efforts to improve student outcomes (for example, are Title I funds coordinated or commingled with other federal, state, or local funds)?	Probe for: What are the other sources of funding? Are these funds coordinated or are they commingled? If funds are not coordinated or commingled, why not?
Have you experienced any challenges related to using Title I funds, or trying to coordinate or commingle Title I and other funds?	Probe for: If yes, have you been able to address these challenges? What would need to be in place for you to address or mitigate these challenges in the future?

State and District Support for Title I

Question
Please describe any technical assistance or professional development you have received from the state on Title I?	Probe for: SPECIFIC EXAMPLES Online resources Guidance documents Trainings or workshops Focus of support (for example, decision making, use of funds, selecting interventions) How widely available are these supports? What other supports would be helpful?
Please describe any technical assistance or professional development you have received from the district on Title I.	Probe for: SPECIFIC EXAMPLES Online resources Guidance documents Trainings or workshops Focus of support (for example, decision making, use of funds, selecting interventions) How widely available are these supports? What other supports would be helpful?
Are there any other supports from the state or the district that would be helpful? If yes, on what topics? Does your district conduct any monitoring of your school’s use of Title I funds?	If yes: Please describe these activities. Does the district conduct site visits to the school? How are the results of the monitoring activities communicated to you? Do you know how the district uses the results of the monitoring?

Conclusion

Question
Is there anything else you would like to share about your school’s Title I program?

Thank you so much for your assistance with this important project!

Purpose

American Institutes for Research (AIR), under contract with the Policy and Program Studies Service (PPSS) of the U.S. Department of Education, is conducting a study of school decision making, use of Title I funds, and implementation of education practices in Title I Schoolwide (SWP) and Targeted Assistance (TAP) programs. Specifically, the proposed study will provide a comparative analysis of SWP and TAP schools that looks at the school-level decision-making process, implementation of strategic interventions, and corresponding resources that support these interventions. To this end, the study will employ multiple data collection strategies.

To assist with the study, we are asking principals to participate in interviews. You will be asked about the following topics: the process by which decisions concerning educational resource allocation are made; how funding flexibility under Title I policy is used; the interventions and educational resources used that are supported by Title I and other funding sources; and, how state and district policies affect both how funds are used to support the subsequent strategies and the resources that are used at schools. The interview is designed to last approximately 60 minutes.

Risks and Discomfort

There are few anticipated or known risks in participating in this study.

Benefits

Your participation in the study will contribute to an understanding of the interplay between school decision-making, use of funds, and implementation of educational practices supported by Title I and other funding sources.

Participation

Participation of Title I districts and their schools in this study is required under Section 8306(a)(4) of the Elementary and Secondary Education Act. However, you may choose not to respond to certain questions or discontinue the interview at any time.

Privacy

Responses to this data collection will be used only for research purposes. No part of the study involves evaluation of any individual. The reports prepared for the study will summarize findings across the sample and will not associate responses with a specific district, school, or individual. We will not provide information that identifies you, your school, or your district to anyone outside the study team, except as required by law. If there is information that you do not want shared directly in any reporting, please let me know.

We would like your consent to record the interview. Recordings will be kept in a secure location and will not be accessed by anyone outside of the study team. The audio recordings will be destroyed at the conclusion of the study. You can participate in the interview but decline to have it recorded. Additionally, if you elect to have the interview recorded, you may stop the recording at any time.

More Information

If you would like more information about this study, you may contact the Project Director, Kerstin Carlson Le Floch, at the American Institutes for Research at 202–403–5649 or at [email protected]. For questions regarding your rights as a subject participating in this research, please contact the Institutional Review Board (IRB) at [email protected] or toll free at 1–800–634–0797.

Informed Consent

I have read the above information. I have asked questions and received answers. I consent to participate in the study.

Signature: ________________________________ Date: ________________________

Print Name: ______________________________ Position: _____________________

District/School: ____________________________

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB number. The valid OMB control number of this information collection is XXXX-XXXX. The time required to complete this information collection is estimated to average 60 minutes. If you have any comments concerning the accuracy of the time estimates(s) or suggestion for improving this form, please write to: U.S. Department of Education, Washington, 20202-4651. If you have comments or concerns regarding the status of your individual submission of this form, write directly to:

Policy and Program Studies Service, Office of Planning, Evaluation and Policy Development, U.S. Department of Education, 400 Maryland Avenue, SW, Washington, DC 20202.

OMB No. ####-####; Approval Expires on MM/DD/YYYY 7