Evaluation Site Visit Topic Guide, government sector respondents, 2nd and 3rd Round Visits

3

Workforce Innovation in Regional Economic Development (WIRED) Initiative

Evaluation Site Visit Topic Guide: Second and Third Round Visits

Background Information: Respondents cannot be promised confidentiality but interviewers will advise them that opinions and impressions they provide during the interviews will be used only for analyzing the general trends and directions of strategic planning, implementation, collaboration and partnership development within their respective regions and across regions. Individual respondents will not be identified in study reports except with their express permission. The information they provide will be kept in confidence unless required by the Freedom of Information Act or necessary for litigation or legal proceedings.

Public reporting burden for the collection of information is estimated to average 45 minutes per response, including the time for discussing the procedures for the interview and responding to the questions. The obligation to respond is voluntary. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to the Department of Labor, Employment and Training Administration, Office of Policy Development and Research, Room N-5641, attn: Eileen Pederson, 200 Constitution Avenue, N.W., Washington, D.C. 20210.

The site visit questions are organized by the 12 key topics outlined below. The first section includes only the overarching questions for each topic. The second section includes more detailed questions and/or probes, as well as the interview respondents for whom each question is appropriate.

Interviewer to Respondent: Thank you for participating in this data collection effort. We will use the opinions and impressions you provide only for analyzing the general trends and directions of strategic planning, implementation, collaboration and partnership development within your respective region and across regions. You will not be identified in study reports except with your express permission. However, you should understand that we cannot promise confidentiality of the information you share with us due to our need to comply with provisions of the Freedom of Information Act and also in the event of unlikely but possible litigation or legal proceedings. Now let us proceed.

1. Context of the WIRED Initiative

   1. Have the characteristics of the region’s population and economy changed in the last year?

   2. What part does your organization play in the WIRED initiative? (for new partners)

   3. What is the structure of the Workforce Investment System in the region?

2. Goals of the WIRED Initiative

   1. Have the goals of your region’s WIRED initiative changed over time?

   2. How has your view of what it means to have “transformation” as the ultimate goal of the WIRED initiative changed over time?

3. Planning the WIRED Initiative

   1. Has planning for the initiative changed in the last year? Process? Substance?

4. Structure of the WIRED Initiative

   1. Has the structure of the WIRED initiative changed over time?

5. Partnerships Within the WIRED Initiative

   1. Who are the key partners in the region’s WIRED initiative? (e.g., workforce investment system; state, county, and local government agencies; local elected officials; Tribal nations; universities and colleges; K-12 schools and districts; employers; business and industry organizations; private training providers; labor organizations; banks and other investors; philanthropists; providers of business services such as accountants, law firms, etc]; economic development organizations; entrepreneurs; representatives from the arts community; the media)

   2. How have the roles of existing partners changed over the last year?

6. Collaboration Within the WIRED Initiative

   1. How do the partners in the WIRED initiative work together towards achieving the goals of the initiative?

   2. (Social Networking) Who do you interact with in the areas of economic development, workforce development, education, etc., as a result of the WIRED initiative?

7. Activities of the WIRED Initiative

   1. What strategies and activities have you developed to achieve the goals of the WIRED initiative?

7. Funding for Regional Transformation

   1. In addition to the WIRED funding, what are the sources of funding for regional transformation, and how are these funds spent?

7. Challenges and Successes of the WIRED Initiative

   1. What challenges has the region met and what successes has it achieved?

7. Innovations of the WIRED Initiative

   1. What innovations has the WIRED initiative accomplished or supported?

7. Evaluating Success of the WIRED Initiative

   1. How is the region assessing and documenting the success of its efforts?

   2. What, if any, signs of progress do you see?

7. Sustainability of WIRED Efforts

   1. What plans does the region have for long-term sustainability of the goals, activities and strategic planning of the WIRED initiative?

Evaluation of the WIRED Initiative

Follow-up Site Visit Questions

Context of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
Have the characteristics of the region’s population and economy changed in the last year?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
Have the boundaries of the region changed? If so, how and why? What new governmental entities are included in the region? (states, counties, cities, Tribal nations)	X		X
What is the current state of the general economy in the region? Is this a significant change from last year?	X		X	X			X
What are the current conditions in both the dominant and targeted industries (market share, economic health of businesses)? Have these conditions significantly changed since last year?	X		X			X	X	X	X	X	X	X	X	X	X
Are any new policy initiatives (federal, state, or local) competing for the attention of the partners? If yes, to what extent?	X	X	X			X	X	X	X	X	X	X	X	X	X

Context of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
What part does your organization play in the WIRED initiative? (for new partners)	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
What is the role of your organization in the WIRED initiative?	X	X	X			X		X	X	X	X	X	X	X	X
How does your organization's mission relate to the mission of the WIRED initiative?	X	X	X			X		X	X	X	X	X	X	X	X
Describe your organization's experience with workforce investment and/or economic development.	X	X	X			X		X	X	X	X	X	X	X	X
Describe your organization's experience with partnership efforts in the region.	X	X	X			X		X	X	X	X	X	X	X	X
When and how did your organization become involved in the WIRED initiative?	X	X	X			X	X	X	X	X	X	X	X	X	X
Was there general support for your participation in the WIRED initiative? If there was opposition, how was this resolved?	X	X	X			X		X	X	X	X	X	X	X	X
What obstacles, if any, did your organization face when deciding to participate in the WIRED initiative? How were these obstacles resolved?	X	X	X			X		X	X	X	X	X	X	X	X
What is your title/position?	X	X	X	X	X	X		X	X	X	X	X	X	X	X
What is your role in the WIRED initiative? (Probe on roles, responsibilities, understanding of the partnership)	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
When and how did you become involved with WIRED?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Please describe your personal experience with workforce investment and/or economic development.	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Please describe your personal experience with partnership efforts in the region.	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X

Context of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
What is the structure of the Workforce Investment System in the region?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
How many local Workforce Investment Boards (WIBs) are active in WIRED?	X		X	X		X		X	X	X	X	X	X	X	X
What organizations staff the local WIBs?	X			X				X
How many comprehensive One-Stop Career Centers are in the region?	X			X				X	X			X
Who operates the One-Stop Career Centers, and how are operators selected?								X
(for regions with K-12 talent development activities) What organizations provide WIA youth services? Where are these services provided?	X			X				X		X
Have WIBs in the region collaborated with each other in the past? With other entities? On what types of efforts?	X			X				X
How many WIA customers enrolled in training in each of the local areas in the region during the three years before WIRED was implemented? How has that changed since WIRED started?								X
What were the predominant types of training that local WIBs supported in the three years before WIRED was implemented? How has that changed since WIRED started?								X
Does the state Workforce Investment Agency have any policies that specifically impact the implementation of WIRED? What are they and how do they affect WIRED?	X			X				X
Do the local WIBs in the region have any policies that specifically impact the implementation of WIRED? What are they and how do they affect WIRED?	X			X				X

Goals of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
Have the goals of your region’s WIRED initiative changed over time?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
If the region’s goals changed over time, which ones changed, and why? Were most partners in agreement about how the goals should or should not be changed? How were disagreements about goals resolved?	X	X	X	X		X	X	X	X	X	X	X	X	X
Are future reassessments of the initiative's goals planned? Who would be involved in doing such a reassessment?	X	X	X				X
How has your view of what it means to have "transformation" as the ultimate goal of the WIRED Initiative changed?
What does "economic transformation" mean to you?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
What does "workforce transformation" mean to you?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
What does "successful transformation" mean to you? What do you expect "successful transformation” to look like?	X	X	X	X		X	X	X	X	X	X	X	X	X	X

Planning the WIRED Initiative

CATEGORY OF RESPONDENT

Project/Program

Leaders / Members of Partnership

Has planning for the Initiative changed in the past year? Process? Substance?

Project Director/ Manager

Director/CEO of Grantee

Board/ Oversight

Project Staff

Fiscal Staff

Govt. Agencies

Local Elected Officials

Workforce & Training

Economic Development

Education (K-12, College)

University/ Research

Business & Industry

Labor

Investors

Other Stakeholders

If plans changed, was the implementation plan revised?

X

X

X

X

If so, what was the process for writing the revised implementation plan for the WIRED initiative? Who was involved?

X

X

X

X

Did the revised plan represent a reorientation of goals and activities, or was it an opportunity to bring the plan into line with what the WIRED partners were already doing?

X

X

X

X

Structure of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
Has the structure of the WIRED initiative changed over time?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
Has the organizational structure of the WIRED initiative changed over time? How?	X		X			X	X	X	X	X	X	X
Has the number of staff paid by the grant changed? Have staff responsibilities changed?	X		X		X
Has the governance structure of the WIRED initiative changed over time? How?	X	X	X	X	X	X	X	X	X	X	X	X
Has the membership of the steering committee or other oversight body for the WIRED grant changed over time? How?	X	X	X	X	X	X	X	X	X	X
Has the size or membership of the steering committee changed? How?	X		X		X
Have the responsibilities of the steering committee changed? How?	X		X		X
Has the schedule of meetings changed? How?	X		X		X
Has the “chain of command” changed? How?	X	X	X			X	X	X	X	X	X
Has the committee’s relationship to the project manager changed? How?	X		X		X
Have the roles of other structural committees or organizations changed over time? How?	X		X		X

Partnerships Within the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
Who are the key partners in the region’s WIRED Initiative?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
How does the region define who is a “partner?”	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Who are the key partners in the region’s WIRED initiative? Have the partners changed over time? Why?	X	X	X	X			X	X	X	X	X	X
If new organizations have joined the partnership, how were they identified as potential partners? Why weren't they included in initial planning? Why have they been added? What was the process for incorporating new organizations into the partnership? Have new partners affected the way WIRED operates? Why and how?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
If organizations have left, why did they leave? How have these departures affected the partnership? Do partners that left the Initiative still otherwise participate in workforce investment and/or economic development in the region?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Have the roles of the various partners in the WIRED initiative changed over time? How?	X		X	X				X	X
Have the WIRED partners maintained their contributions of time and resources to the WIRED initiative? If not, how have these changed?	X		X	X	X
Has the involvement of partners from the workforce investment system changed over time? Why and how?	X		X	X				X
What are the specific roles of the local WIBs in the WIRED initiative? Have they changed over time? Have changes supported talent development in the WIRED framework?	X		X	X				X
Have WIB structures changed in any way under this Initiative, to operate on a more regional basis? Are they composed of regional strategic partners? If so, do they align spending with a regional economic vision for talent development?	X		X	X				X
What are the specific roles of the local One-Stop Centers? Have they changed over time? Have changes supported talent development in the WIRED framework?	X		X	X				X
Are WIRED training providers required to be on the state’s Eligible Training Provider List? If not, are these providers already on the ETPL?	X		X	X				X
Have new training providers, focused on new industries or processes, been brought into the WIRED Network? Do they use new, innovative training approaches?	X		X	X				X				X
Have new approaches for training entrepreneurs been developed? If so, who provides this training?	X		X	X				X				X
Has the workforce investment system changed its processes for funding training activities and services? How and why?	X		X	X				X
Does the workforce investment system use workforce, economic and education data for strategic planning purposes? Does it use outcome measures or other benchmarks to support strategic planning?	X		X	X				X
Has the workforce investment system increased opportunities for post-secondary education for lifelong learning opportunities? How and why? Are they aligned with the region’s talent development strategy? How and why?	X		X	X				X		X
Have WIRED partners developed a shared vision of the Initiative and its goals? Has this changed over time? How?	X	X	X	X			X	X	X	X	X	X	X	X	X
Do the WIRED partners have, or are they developing, an identity as a region? How has this manifested itself?	X	X	X	X			X	X	X	X	X	X	X	X	X

Collaboration Within the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
How do the partners in the WIRED Initiative work together towards achieving the goals of the Initiative?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
Have the WIRED communications mechanisms changed over time?	X		X	X	X	X	X	X	X	X	X	X	X	X	X
In what forms of collaboration do project staff and partners engage? How well do the project partners work together? Is there general agreement as to the activities proposed? Is there general agreement as to how to spend the money? How are disagreements resolved?	X		X	X	X	X	X	X	X	X	X	X	X	X	X
Have the types of collaboration in which partners engage changed over time? How?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Does the partnership currently have mechanisms in place to support or increase collaboration? To stimulate and reward collaborative work? Have partnership agreements, protocols, and/or policies changed over time?? How? What organizational development activities have taken place to date?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Have new leaders emerged among the initiative’s partners? Have new teams or combinations of partners formed?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Do you communicate more with some partners than others? If so, why? Under what circumstances? Have the WIRED communications structures changed over time? How?	X	X	X	X	X	X		X	X	X	X	X	X	X	X
How are project staff and partners communicating the Initiative's issues and goals among and to key stakeholders, business and industry, potential funders, the media, etc.?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
What challenges and opportunities have emerged with the various partners? How do partner relationships affect the work of the partnership? Describe any problems experienced in the roles or relationships among the partners. How have problems been addressed?	X	X	X	X		X		X	X	X	X	X	X	X	X
Social Networking
Who do you interact with in the areas of economic development, workforce development, education, etc., as a result of the WIRED initiative?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
What new partnerships have you developed?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
What new cross-profession or cross-industry networks or linkages have you developed in the past year as a result of the WIRED initiative?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Have there been changes in your relationships with individuals or organizations with which you interacted prior to WIRED?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Please name 5 individuals (outside of your own organization) with whom you now have significant contact as a result of the WIRED initiative (i.e., outside your own organization, the most important people for WIRED in terms of getting things done, or changing the way that organizations function and work together)	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Organizational affiliation	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Job title	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Frequency of contact	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Geographic location	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X

Activities of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
What strategies and activities have you developed to achieve the goals of the WIRED Initiative?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
What techniques are project staff using to accurately assess assets and gaps, vis-à-vis economic/job growth sectors and decline sectors?	X	X		X
Have the WIRED activities in the region changed over time? How?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Economic development/transformation activities.	X	X	X	X		X	X	X	X	X	X	X	X		X
Workforce training and retraining efforts. How have industry representatives influenced the content and delivery of these programs? Does the training provided under the WIRED initiative reflect a range of jobs with varying skill levels?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Talent development (which is different from training.)	X	X	X	X		X	X	X	X	X	X	X	X		X
Outreach activities to educate residents about new economy and job skills needed. What audiences have been targeted? What methods used?	X	X	X	X		X	X	X	X	X	X	X	X		X
Outreach activities to build a new sense of the future in the region. What audiences have been targeted? What methods used?	X	X	X	X		X	X	X	X	X	X	X	X		X
Efforts to support technology transfer.	X	X	X	X		X	X	X	X	X	X	X	X		X
Strategies to develop a regional identity.	X	X	X	X		X	X	X	X	X	X	X	X		X
Efforts to encourage and support entrepreneurship. What efforts have been launched to assist existing enterprises to secure new customers or upgrade technology or attract investment?	X	X	X	X		X		X	X	X	X	X	X	X	X
Efforts to improve region’s infrastructure.	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Efforts to increase coordination between targeted industries and the education and talent development systems?	X		X	X		X	X	X	X	X	X	X	X	X	X
Efforts to increase leadership development?	X		X	X		X	X	X	X	X	X	X	X	X	X
Efforts to increase coordination with the education system?	X		X	X		X	X	X	X	X	X	X
Capacity-building activities.	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Is the region working with any of the WIRED Initiative’s national partners that have been introduced through WIRED Academies or ETA Leads? (e.g., MEP, NIST, Departments of Defense and Energy national labs, NSF’s Advanced Technical Education program, the Agricultural Research Service, Department of Transportation, etc.)	X		X	X	X	X	X	X	X	X	X	X

Funding for the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
In addition to the WIRED funding, what are the sources of funding for regional transformation, and how are these funds spent?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
Has the region secured funding or other resources for the WIRED Initiative beyond the DOL grant? If so, what are the sources, value, and use of these funds?	X	X	X		X		X
What is the region’s definition of “leveraged” funds?	X		X	X	X
Are any additional funds considered to be leveraged? What funds are they leveraged with? For what purpose(s)?	X	X	X		X		X
If additional resources are in-kind contributions, what type of contributions were made?	X	X	X		X
How are WIRED funds being budgeted?	X	X	X		X
Is the WIRED initiative currently on target for expenditure of WIRED funds? If not, why not?	X	X	X	X	X
What mechanisms are used to align the Initiative's resources with its goals, strategies, and activities?	X	X	X	X	X		X
Has the region secured the services of any new vendors (i.e., sub-grants or subcontracts) since the last evaluation visit? With whom, and for what? Are any such agreements currently in progress?	X	X	X	X	X
Have the region’s application procedures for WIRED vendors changed over time? How?	X	X	X	X	X
What plans has the region made to secure additional funds in the future to support the goals and activities of the WIRED initiative?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Has the region formally or informally leveraged funding or resources beyond those of each individual partner's networks? Please describe.	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
Have any pre-existing funds in the region been refocused as a result of WIRED? If so, what are the sources, purposes, and value of these funds?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X

Challenges and Successes of the WIRED

CATEGORY OF RESPONDENT

Initiative

Project/Program

Leaders / Members of Partnership

What challenges has the region met and what successes has it achieved?

Project Director/ Manager

Director/CEO of Grantee

Board/ Oversight

Project Staff

Fiscal Staff

Govt. Agencies

Local Elected Officials

Workforce & Training

Economic Development

Education (K-12, College)

University/ Research

Business & Industry

Labor

Investors

Other Stakeholders

What are the most significant challenges to the progress of your WIRED initiative that you have encountered to date?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Is there currently public support or opposition for the WIRED initiative in your region? Do you currently face any particular obstacles? What is being done to resolve these obstacles?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Please describe any particular challenges your WIRED initiative has had with regard to:

Building a regional identity

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Developing a shared vision and goals

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Securing stakeholders and investors

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Distribution of WIRED funds and resources

X

X

X

X

X

X

X

Working with federal agencies

X

X

X

X

X

X

X

Measuring progress and outcomes; developing metrics

X

X

X

X

X

Other

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Please describe any issues for which you have received or requested technical assistance since the last evaluation visit. Has the assistance helped? Hindered? How?

X

X

X

X

X

How successful have you been in meeting the challenges faced by the WIRED initiative?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

What do you consider to be the initiative's greatest successes to date? Why?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Innovations of the WIRED Initiative

CATEGORY OF RESPONDENT

Project/Program

Leaders / Members of Partnership

What innovations has the WIRED Initiative accomplished or supported?

Project Director/ Manager

Director/CEO of Grantee

Board/ Oversight

Project Staff

Fiscal Staff

Govt. Agencies

Local Elected Officials

Workforce & Training

Economic Development

Education (K-12, College)

University/ Research

Business & Industry

Labor

Investors

Other Stakeholders

(for new partners, or those not asked before) How do WIRED partners and staff define innovation?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Has the initiative’s definition of innovation changed over the last year? How and why?

Please describe any innovative strategies that the WIRED initiative has accomplished or that are currently underway.

X

X

X

X

X

X

X

X

X

X

X

X

X

X

How does the region support adoption of innovative strategies or technologies by partners?

X

X

X

X

X

X

X

X

X

X

X

X

X

How does the region measure the progress, success, or impact of innovation?

X

X

X

Evaluating Success of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
How is the region assessing and documenting the success of its efforts?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
Has the region changed any of its measures of progress or success since the last evaluation visit?	X		X	X
What data collection instruments, instructions, and/or analysis plans does the partnership use to evaluate success in achieving the Initiative's goals?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
At what point is the region in implementing its measures? Has data been collected? Which types?	X		X	X				X
Is other data collected? What kinds of data? At what point in the process is data collected? Are you required to collect data for purposes other than reporting to DOL?	X		X	X
What staff is responsible for collecting and analyzing data?	X		X	X
What arrangements has the region made to ensure that data on training participants is entered into the WIASRD?	X		X	X				X
In what form are the data currently available? How should our evaluation team go about obtaining these data?	X	X	X	X
Have you generated any reports, proposals, or self- evaluations? How can we get copies of these?	X	X	X	X
How do you use the data you collect? How does the data analysis affect your work?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X
What other methods do you use to evaluate success in achieving the Initiative's goals?	X	X	X	X
Are there any data that aren't being collected that would help you better measure your success?	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X

Evaluating Success of the WIRED Initiative	CATEGORY OF RESPONDENT
	Project/Program					Leaders / Members of Partnership
What, if any, signs of progress do you see?	Project Director/ Manager	Director/CEO of Grantee	Board/ Oversight	Project Staff	Fiscal Staff	Govt. Agencies	Local Elected Officials	Workforce & Training	Economic Development	Education (K-12, College)	University/ Research	Business & Industry	Labor	Investors	Other Stakeholders
What signs of progress do you see in partners developing a shared understanding of their problems and opportunities? Provide examples.	X	X	X	X		X	X	X	X	X	X	X	X	X	X
What signs of progress do you see in forming new partnerships that have promise? Provide examples.	X	X	X	X		X	X	X	X	X	X	X	X	X	X
What signs of shifting emphases in policy issues and priorities do you see? What signs of changing investment priorities? What signs of shifts in what is taught in existing institutions and organizations? Give examples.	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Are new organizations/networks emerging? On what specifically are they focused? How do they measure their progress?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Are new forms of internal and external investments in business development, workforce development, and general education emerging in the region? Provide examples and dollars.	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Have new companies or partnerships been formed? Has there been new business development or expansion of existing business operations?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Has the structure and operations of the workforce investment system changed? Funding procedures? Regional strategic planning? Coordination with economic development, business and education? Using data for strategic planning? Increased emphasis on post-secondary education for life-long learning? More emphasis on high-skill jobs sector? Aligned with growth industries in region?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Has job retention increased and/or business grown in existing industries?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Has the number of jobs grown as a result of new enterprises or business attraction?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Have average wages changed? How much?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Have changes in the number of professional support firms (such as law and accounting) occurred?	X	X	X	X		X	X	X	X	X	X	X	X	X	X
Have changes occurred in how leaders and citizens talk/feel about or describe the region? Examples?	X	X	X	X		X	X	X	X	X	X	X	X	X	X

Sustainability of WIRED Efforts

CATEGORY OF RESPONDENT

Project/Program

Leaders / Members of Partnership

What plans does the region have for long-term sustainability of the goals, activities, and strategic planning of the WIRED Initiative?

Project Director/ Manager

Director/CEO of Grantee

Board/ Oversight

Project Staff

Fiscal Staff

Govt. Agencies

Local Elected Officials

Workforce & Training

Economic Development

Education (K-12, College)

University/ Research

Business & Industry

Labor

Investors

Other Stakeholders

How are you planning to sustain efforts begun by WIRED after the grant ends?

X

X

X

X

X

X

X

X

X

X

X

Are sustainable new organizations or units within existing organizations in place for the long haul?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Is WIRED facilitating new kinds of partnerships, programs, investment, and funding? Specify and provide examples.

X

X

X

X

X

X

X

X

X

X

X

X

X

Have regional or state civic institutions and elected officials embraced WIRED, and do they understand the new challenges and opportunities? Describe.

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Does the workforce investment system factor in future sustainability efforts? If yes, how?

What efforts have been launched to assist existing enterprises to secure new customers or upgrade technology or attract investment?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

What plans do you have for transferability of technology and other innovations that the Initiative will have developed?

X

X

X

X

X

X

X

X

Are you seeking investment capital? For what activities or products?

X

X

X

X

X

X

X

X

X

In your opinion, why are some programs or strategies sustained and others are not?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X