MSAP Evaluator Key Informant Interview (Telephone)

MSAP Evaluator Key Informant Interview

(Telephone)

Public Burden Statement:

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. Public reporting burden for this collection of information is estimated to average 15 minutes per response, including time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. The obligation to respond to this collection is voluntary. Send comments regarding the burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: U.S. Department of Education, 400 Maryland Ave., SW, Washington, DC 20210-4537 or email [email protected] and reference the OMB Control Number 1800-0011. Note: Please do not return the completed MSAP Evaluator Key Informant Interview to this address.

Interviewer ID: ___ ___

Interview Date: ___ ___ / ___ ___ / ___ ___ ___ ___ Interview Time: ___ ___: ___ ___ AM PM

Grantee Name:

Evaluator: Telephone: (__ __ __) __ __ __ - __ __ __ __

Thank you for taking the time to participate in this interview. It will take 30 minutes. We are assessing the 2010 Magnet Schools Assistance Program (MSAP) grantees’ current technical assistance needs, and these interviews are part of our initial data collection effort. There are no right or wrong answers. We are interested in identifying your client and your needs in program implementation and management in order to provide you with the most relevant and focused technical assistance.

Do you have any questions before we begin?

1. Based on your observations and interactions with your MSAP grantee, how would you characterize their progress towards implementing their magnet program?

• Program installation

• Initial implementation

• Full operation

2. How would you characterize your MSAP grantee’s knowledge and experience in the following MSAP activities, and how helpful would it be for (grantee name) to receive technical assistance in these areas?

Knowledge

1= Limited

2= Some gaps

3= Strong

Technical Assistance

1= Not helpful

2= Somewhat helpful

3= Very helpful

	Knowledge			Technical Assistance
	1	2	3	1	2	3
Hiring and retaining key staff for the MSAP project
Providing professional development and support for the magnet school staff
Developing performance measures for fidelity of implementation
Using performance measures to ensure fidelity of implementation
Assessing the development of magnet themed curriculum
Assessing the integration of the magnet theme throughout the program
Assessing the instructional delivery of magnet teachers
Providing meaningful feedback to magnet staff
Collecting data
Reporting program-level data
Reporting project-level data
Using evaluation findings

3. Based on your observations and interactions with your MSAP grantee, what are their top three challenges to implementing their MSAP project?

4. What technical assistance can the MSAP Center provide to your MSAP grantee?

5. How would you characterize your knowledge and experience in the following MSAP activities, and how helpful would it be for you to receive technical assistance in these areas?

Knowledge

1= Limited

2= Some gaps

3= Strong

Technical Assistance

1= Not helpful

2= Somewhat helpful

3= Very helpful

	Knowledge			Technical Assistance
	1	2	3	1	2	3
Understanding program-level reporting
Understanding project-level reporting
Understanding what information needs to be collected each year of the MSAP grant
Developing appropriate data collection plans
Identifying the appropriate data collection processes
Assessing data collection processes
Providing the district with recommendations, insights, and strategies for improvement
Assessing fidelity of implementation plans
Developing performance measures for fidelity of implementation
Conducting periodic reviews using performance measures
Assessing magnet program’s fidelity of implementation

6. What are the top three challenges to reporting (grantee name) project-level performance data?

7. Please select your top three preferred methods for receiving technical assistance.

• Conference workshops

• Email

• Fact sheet

• Newsletter

• Telephone conference

• Toolkits

• Webinar

• Website

• Other, specify:

• Other, specify:

Glossary of terms

Full operation- the program becomes integrated into practitioner, organizational, and community practices, policies, and procedures. At this point, the implemented program becomes fully operational with full staffing complements and all of the realities of “doing business” impinging on the newly implemented magnet program. Once fully operational, practitioners carry out the magnet program with proficiency and skill, administrators support and facilitate new practices, and the community has adapted to the presence of the magnet program.

Initial implementation- requires attempts to implement new practices effectively and make changes in the overall magnet environment. Changes in skill levels require education, practice, and time to mature. The program is struggling to begin and confidence in the decision to adopt the program is being tested during this stage of implementation.

Program installation- after a decision is made to begin implementing MSAP, there are tasks that need to be accomplished; these activities define the installation stage of implementation. Resources are being consumed in active preparation for actually doing things differently in keeping with the tenets of MSAP and structural supports necessary to initiate the program are put in place.

(Definitions adapted from The National Implementation Research Network at: http://www.fpg.unc.edu/~nirn/implementation/06/06d_fullopera.cfm)

MSAP Evaluator Interview 8