The study population for this data collection is the universe of TTT projects that will be submitting interim and final performance and evaluation reports during the approval period (anticipated to be approximately April 2012 through April 2017). This universe consists of 93 current projects funded from three funding cycles: FY 2007 (42 projects), FY 2009 (21 projects) and FY 2011 (30 projects). FY 2007 projects would complete the survey only once. FY 2009 and FY 2011 projects would complete the survey twice because both their interim and final performance reporting dates would fall within the three-year approval period. The total number of respondents for the five survey administrations would be 144.
A contractor determined by using the Department’s contract process administers the survey to the entire population so that we can aggregate data across projects and accurately describe to the Secretary and Congress the extent of program implementation. Because the total population of projects from each funding cycle is small (between 21 and 42 projects) selecting a sample of projects from each cycle would eliminate categories of participants and projects of interest to the evaluation and the TTT program. Further, the estimated sample size that would be needed to accurately describe such a relatively small popualtion of projects is close to the size of the population itself, meaning any proposed sampling strategies would only minimally reduce the cost and burden associated with this data collection.
The Project Director or designee, will serve as the primary contact person for each project and will be responsible for submitting the project’s performance report, and completing the survey. The survey will be administered during the interim year (third year) and in the final year of the project. The survey will complement the annual performance report and the project evaluation.
Project Directors/designee will complete the electronic survey. Once the contractor is selected, they will be responsible for securing a web-based site and securing a secure server for the survey. Additionally, the contractor will be required to provide direction to the website and explain the procedures for completing and submitting the survey. These support and notification materials will be provided to projects well in advance of the reporting period, to allow respondents to prepare for data collection and to request additional information or assistance.
During the data collection and reporting period, the TTT program staff will be available to assist respondents. We will also designate an email address, [email protected], to allow respondents to ask questions, report problems, or request assistance. The telephone number of staff and e-mail address will be featured on all pages of the survey and in any related correspondence to grantees.
We expect a response rate of 100% for the data collection, and will provide information and support before and during the data collection process to facilitate project participation. TTT staff will provide advance notice of the survey prior to data collection to allow respondents to gather the necessary information. The supporting documents that accompany this advance notice will also explain the purpose and importance of the survey for the program evaluation. Presentations planned for TTT Project Directors Meetings will further highlight the program evaluation and the contribution projects will make to the program evaluation report.
The electronic administration of the survey allows for instant access to the data and also allows for instant identification of non-respondents. TTT staff will send reminder emails to all respondents ten days after the initial survey administration, and send targeted emails to non-respondents three weeks after initial administration. At the end of the fourth week of data collection. TTT staff will also contact the Project Director for those projects that have been identified as non-respondent to determine the reason for nonparticipation and to offer additional technical assistance as necessary.
In cases where the response rate is unexpectedly low, or where issues are identified regarding the validity of the initial responses, TTT staff will discuss the matter with the contractor to make any necessary amendments to the data collection plan.
The TTT survey instrument has gone through a series of reviews before being used in the field. WestEd, the contractor that developed the survey worked very closely with TTT staff throughout the design and revision process to ensure that survey items adhere to the components of the TTT program and provide the necessary information to accurately describe the extent of program implementation. Please note, that three of the TTT funded cohorts have completed the survey as part of their interim and/or final evaluation.
The TTT program evaluation, using this data collection instrument was led by John Flaherty, a Senior Research Associate in the Evaluation Research program at WestEd. Flaherty and his team of WestEd staff were responsible for developing the data collection instruments, collecting and analyzing the survey data, and reporting the results to TTT program and project staff for TTT FY 2002, 2004, 2006, and 2007. Our expectation is to have a contractor in place by the time we need to collect the data, please note that at this time no specific contractor has been determined.
Transition to Teaching (TTT)
Program Evaluation and Assistance page
| File Type | application/msword |
| File Title | PART B |
| Author | Tomakie.Washington |
| Last Modified By | Authorised User |
| File Modified | 2012-04-04 |
| File Created | 2012-01-23 |