Summary of School Pilot Test

Summary of Pilot Results

RtI School Survey

Overview

In general, the respondents to the school survey found it fairly easy to complete. The two respondents had different opinions about the items, but the major issue identified was terminology referring to disabilities (e.g. learning disability vs. specific learning disability), which may need clarification.

The exhibit below contains the summarized comments and questions by item as well as the recommended changes (in some cases, no recommendations for changes were made).

Exhibit 1: RtI School Survey

Item Number	Number Of Respondents	School Staff Questions	Response
A1a	1	Item is a little unclear.	Add “If so, what program does your school use?” Added -What commercial reading program does your school currently use?
A1b	2	With Common Core standards coming, there is no straightforward reading curriculum. We cobble resources that we pull together from different sources. Also may not know publication year.	If cobbled resources together then would answer No for A1a Removed publication year Added K option
A4	1	There may be a lot of turnover at the leadership level, so people may not know the answer to these questions.	Added person/persons knowledgeable in instructions for who should answer. Don’t want a DK option as then respondents may not try to find the answer.
A7	1	In the instructions, commented that it might be difficult to “exclude writing” from reading comprehension as students are often asked to demonstrate their comprehension through writing, e.g. short answer responses.	No changes
B1	1	“Electronic student data system” is confusing terminology. In her school, for example, they primarily use a giant, sophisticated Excel spreadsheet to keep track of this data. If Excel spreadsheet is a kind of electronic student data system, respondents may not think of them as such.	Suggests adding an e.g.? Added excel sheet as an example
B2	1	Hard to read the response options.	Can format response options to be clearer
B14-18	1	The movement now in data-driven decision-making (DDDM) is to work in teams	Modified item stem In your school, which individuals have the primary responsibility for analyzing data from the following student assessments
B20	1	In the first option, “Wait a few weeks, consult…”, but then nothing about an immediate consult.	Revised B20 to refer to consultation without specifying time frame
B21	1	In the first option, “Wait a few weeks, consult…”,	Revised B20 to refer to consultation without specifying time frame
D1	1	The wording of the stem question is too long and confusing. Did not understand that we were asking about how the district was supporting the school without reading and re-reading the question.	Reworded and simplified item stem
RtI Definition	2	Too long. There is a lot of extraneous information. The most important points to her were “intensive intervention and monitoring within the general education setting” and the idea of a tiered system.	Italicized key components of RtI definition
D8 and D10		Too many answer options	Removed options above 120 minutes and combined in answer response More than 120 minutes
D11	1	Had some concerns about whether we would get honest answers to D11f,g, and h. School leaders may be reluctant to admit to a deficiency in knowledge among their teachers as they might see that it is a reflection on their own job performance, e.g. they are not committed to getting the teachers the support they need, they made a mistake in hiring, etc.	Revised response items
D12	1	Noted that often communication sent home is not effective because parents are not literate in English.	Add option for “Communication translated into home language”.