WIOA Survey Instrument

Workforce Innovation and Opportunity Act Implementation Evaluation—Survey Instrument

WIOA Survey Instrument - ROCIS rev

WIOA Survey Instrument

OMB: 1290-0024

Document [pdf]
Download: pdf | pdf
OMB NO. 1290-0NEW
EXP. DATE XX/XX/XXXX

INTRODUCTION TO THE SURVEY
Dear [STATE REPRESENTATIVE],
As you know, the Workforce Innovation and Opportunity Act (WIOA) was signed into law on July 22,
2014 and aims to transform and modernize the public workforce system. WIOA’s overarching goals
include improving the quality and outcomes of workforce services; ensuring that workforce services are
evidence-based and guided by the needs of business and workers; and increasing access to the public
workforce system, especially among individuals with significant barriers to employment.
The U.S. Department of Labor is conducting an important evaluation to better understand the
implementation of WIOA, the variations in implementation across states and localities, and the need for
further technical assistance, administrative guidance, regulations, and policy.
As a critical part of this evaluation, we are asking for your help in completing a survey about WIOA
implementation in your state.
Your state’s participation is completely voluntary. You do not have to answer any questions. The survey
responses from your state will never be linked to your name or your state’s name in any evaluation report
of survey findings.
This survey is broken into modules, by topic area, to facilitate your state’s response across multiple staff
if necessary. In the first module, you will be able to provide contact information for the person within
your state who is best able to complete each of the other modules. We will send notifications to those
individuals that their assistance is requested in completing the survey.
Thank you in advance for your assistance in completing this survey.

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such
collection displays a valid OMB control number. Public reporting burden for this collection of information is estimated to average 3
hours per response, including time for reviewing instructions, searching existing data sources, gathering and maintaining the data
needed, and completing and reviewing the collection of information. The obligation to respond to this collection is voluntary. Send
comments regarding the burden estimate or any other aspect of this collection of information, including suggestions for reducing this
burden, to [email protected] and reference the 0MB Control Number 1290-0NEW. Comments can also be mailed to:
U.S. Department of Labor, Chief Evaluation Office, 200 Constitution Ave., NW, S-2312, Washington, DC 20210. Note: Please do
not return the completed interview guide to the email or mailing address.

OMB NO. 1290-0NEW
EXP. DATE XX/XX/XXXX

For your reference, we are including a WIOA implementation timeline:

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such
collection displays a valid OMB control number. Public reporting burden for this collection of information is estimated to average 3
hours per response, including time for reviewing instructions, searching existing data sources, gathering and maintaining the data
needed, and completing and reviewing the collection of information. The obligation to respond to this collection is voluntary. Send
comments regarding the burden estimate or any other aspect of this collection of information, including suggestions for reducing this
burden, to [email protected] and reference the 0MB Control Number 1290-0NEW. Comments can also be mailed to:
U.S. Department of Labor, Chief Evaluation Office, 200 Constitution Ave., NW, S-2312, Washington, DC 20210. Note: Please do
not return the completed interview guide to the email or mailing address.

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

MODULE STATUS SCREEN
MODULE 1: STATE WORKFORCE LEAD
[STATUS] [MODULE 1 CONTACT NAME]
To complete this module and enter or correct the contact names for the other modules, click HERE.
Please complete this module first.

MODULE 2: STATE, REGIONAL, AND LOCAL PLANNING AND GOVERNANCE
[STATUS] [MODULE 2 CONTACT NAME]
To complete this module, click HERE.

MODULE 3: AMERICAN JOB CENTER (AJC) OPERATIONS
[STATUS] [MODULE 3 CONTACT NAME]
To complete this module, click HERE.

MODULE 4: IMPROVED SERVICES FOR EMPLOYERS AND ADULT JOB SEEKERS
[STATUS] [MODULE 4 CONTACT NAME]
To complete this module, click HERE.

MODULE 5: IMPROVED SERVICES FOR YOUTH
[STATUS] [MODULE 5 CONTACT NAME]
To complete this module, click HERE.

MODULE 6: PERFORMANCE INDICATORS AND REPORTING SYSTEMS
[STATUS] [MODULE 6 CONTACT NAME]
To complete this module, click HERE.

1

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

MODULE 1: STATE WORKFORCE LEAD
This first module of the survey will help to identify the best point of contact within your state for
completing each of the other modules.
It also includes some background questions about the state’s workforce system.
If you are completing this module, please confirm or update your contact information below. If you are
not the correct person to complete this module, please provide contact information for the person within
your state best suited to complete this module.
-First Name (specify)
-Last Name (specify)
-Agency (specify)
-Title (specify)
-Email address (specify)
-Telephone number (work) (specify)
-Additional telephone number (specify)
Next, please provide contact information for each of the remaining WIOA survey modules.
MODULE 2: STATE, REGIONAL, AND LOCAL PLANNING AND GOVERNANCE
[STATUS] [MODULE 2 CONTACT NAME]
Module 2 pertains to state, regional, and local planning; designation of regions and local areas; and
composition and structure of state and local workforce development boards.
Please provide contact information for the person within your state best suited to complete this
module.
-First Name (specify)
-Last Name (specify)
-Agency (specify)
-Title (specify)
-Email address (specify)
-Telephone number (work) (specify)
-Additional telephone number (specify)

MODULE 3: AMERICAN JOB CENTER (AJC) OPERATIONS
[STATUS] [MODULE 3 CONTACT NAME]
Module 3 pertains to selection of AJC operators and partners, certification of AJCs, AJC
improvement, resource sharing, and branding.
Please provide contact information for the person within your state best suited to complete this
module.
-First Name (specify)
-Last Name (specify)
-Agency (specify)
2

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

-Title (specify)
-Email address (specify)
-Telephone number (work) (specify)
-Additional telephone number (specify)

MODULE 4: IMPROVED SERVICES FOR EMPLOYERS AND ADULT JOB SEEKERS
[STATUS] [MODULE 4 CONTACT NAME]
Module 4 pertains to employer engagement strategies; use of apprenticeship, career pathways,
sector-focused and other strategies to promote training and employment; use of labor market data;
serving individuals with barriers to employment; and identification of training providers.
Please provide contact information for the person within your state best suited to complete this
module.
-First Name (specify)
-Last Name (specify)
-Agency (specify)
-Title (specify)
-Email address (specify)
-Telephone number (work) (specify)
-Additional telephone number (specify)

MODULE 5: IMPROVED SERVICES FOR YOUTH
[STATUS] [MODULE 5 CONTACT NAME]
Module 5 pertains to the provision of services for and participation of in-school and out-of-school
youth, including changes to guidelines on spending for different types of youth customers, and
changes to the elements of youth services.
Please provide contact information for the person within your state best suited to complete this
module.
-First Name (specify)
-Last Name (specify)
-Agency (specify)
-Title (specify)
-Email address (specify)
-Telephone number (work) (specify)
-Additional telephone number (specify)

MODULE 6: PERFORMANCE INDICATORS AND REPORTING SYSTEMS
[STATUS] [MODULE 6 CONTACT NAME]
Module 6 pertains to the primary indicators of performance under WIOA, integration of state data
systems across partners, and combined performance reporting across the core programs.
The WIOA performance indicators are:
1. Employment Rate, 2nd Quarter After Exit

3

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

2. Employment Rate, 4th Quarter After Exit
3. Median Earnings, 2nd Quarter After Exit
4. Credential Attainment
5. Measurable Skill Gains
6. Effectiveness in Serving Employers
Please provide contact information for the person within your state best suited to complete this
module.
-First Name (specify)
-Last Name (specify)
-Agency (specify)
-Title (specify)
-Email address (specify)
-Telephone number (work) (specify)
-Additional telephone number (specify)
Next, we have a few questions about guidance and technical assistance in your state.
1. Has your state provided guidance or technical assistance to the local areas on the following WIOArelated topics? (check one per row)
Guidance or technical assistance topic

No, not
provided
to local
areas

Yes,
provided
to some
local areas

Yes,
provided to
all local
areas

Regional and local planning or governance
AJC operations
Services for job seekers
Services for employers
Youth program requirements
Primary indicators of performance
Other topics (specify)
2. What WIOA-related topics should be addressed in future federal guidance or technical assistance?
(check all that apply)
- Regional and local planning or governance
- AJC operations
- Services for job seekers
- Services for employers
- Youth program requirements
- Primary indicators of performance
- Other topics (specify)
Thank you for completing this survey module. Would you like to provide additional information about
the general implementation of WIOA in your state? (Y/N)
If yes, please specify.

4

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

MODULE 2: STATE, REGIONAL, AND LOCAL PLANNING AND GOVERNANCE
1. When did your state begin developing its first unified or combined state plan for WIOA, which was
due in March 2016? (month/year)
2. How involved were representatives from each of the following entities or programs in developing the
state’s first unified or combined state plan for WIOA? (select one per row)
[Hover over text for “Not at all involved”: These entities or programs did not contribute ideas, did
not provide content for the plan, did not attend meetings, did not review drafts, and did not provide
staff or other resources for the planning process.]
[Hover over text for “Somewhat involved”: These entities or programs may have contributed to plan
ideas, meetings, plan drafting, or provided staff or other resources, but were not consistently involved
in the planning process from beginning to end.]
[Hover over text for “Consistently involved”: These entities or programs were critical to developing
the state plan and were involved throughout the process.]
Entity or program

Not at all
involved

Required core programs
Title IB programs (Adult, Dislocated Worker and
Youth)
Title II Adult Education and Family Literacy Act
Title III Wagner Peyser Act Employment Service (ES)
Title IV Vocational Rehabilitation
Additional partner programs
[Hover over text: Even if your state did not submit a
combined plan, representatives from the following
programs may have been involved in your state’s
WIOA planning.]
Unemployment Insurance
Trade Adjustment Assistance for Workers
Jobs for Veterans State Grants
Senior Community Service Employment Program
Reentry Employment Opportunities (formerly
Reintegration of Ex-Offenders)
Career and technical education programs authorized
under the Perkins Act
Temporary Assistance for Needy Families
Employment and training programs under the
Supplemental Nutrition Assistance Program
Employment and training programs under the
Department of Housing and Urban Development
Employment and training programs under the
Community Services Block Grant
Additional entities or programs
Governor’s office
5

Somewhat
involved

Consistently
involved

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

Entity or program

Not at all
involved

Somewhat
involved

Consistently
involved

State’s labor market performance/data division (LMI)
State workforce development board (WDB)
Local workforce development boards (WDBs)
Regional planning committees
[Hover over text: By regional planning committee, we
mean entities convened to coordinate workforce
planning for a region comprised of two or more local
areas.]
Economic development organizations
Title I National programs (Job Corps, YouthBuild,
Indian and Native American, National Farmworker
Jobs/Migrant and Seasonal Farmworker Programs)
Justice or correctional programs other than Reentry
Employment Opportunities
Other entities or programs (specify)
2a. Survey will prepopulate for each required core or additional partner program that was not at all
involved: What is the main reason the [ENTITY] is not involved?
(check one)
- Time constraints
- Staff constraints
- Input not needed
- Input requested, but not provided
- Unknown
- Other (specify)
3. To what extent was the process of developing your state’s first unified/combined plan for WIOA
helpful for…
(select one per row)
Not at all
helpful

Somewhat
helpful

Very
helpful

a. Ensuring the state plan reflects the interests of multiple
stakeholders, such as the Governor’s office?
b. Developing a strategic framework to guide the state’s
overall implementation of WIOA?
c. Developing a strategic framework to guide the state’s
overall workforce system?
d. Building long-term relationships with partners?
e. Something else? (specify)

4. When did your state begin developing its second unified/combined state plan for WIOA, which is due
in 2020?
- Month/year
- Haven’t started yet

6

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

5.
6.

7.

How many regions does your state currently have? (number)
How has your state designated regions since WIOA took effect?
(check all that apply)
- Continued to use WIA-designated regions
- Used local workforce area geographic definitions as regions
- Used other defined regions such as transportation planning, higher education, community or
economic development regions (specify)
- Created new regions based on labor market information
- Some other method (specify)
How involved were the following local entities in helping your state determine regions?
Not at all
involved

Somewhat Consistently
involved
involved

a. Local workforce development boards (WDBs)?
b. Local chief elected officials?
c. Other local entities?
8. Does your state anticipate revising your regional designations under WIOA at any point between now
and the submission of your state’s second WIOA plan? (Y/N)
9. Did your state have designated regions (for the purpose of planning and coordination of services)
before WIOA took effect? (Y/N)
9a. If yes, how many designated regions did your state have before WIOA took effect? (number)
10. How many local areas does your state currently have? (number)
10a. How many of your state’s local areas have the same geographic border as the designated state
regions?
- None
- Less than half
- About half
- More than half
- All or nearly all
11. How many board members are currently on your state workforce development board (WDB)? This
number may differ from your state’s 2016 WIOA plan. (number)
12. Which types of entities are currently represented on your state WDB? These entities could differ from
the entities in your state’s 2016 WIOA plan. (check all that apply)
Required entities
- Governor
- State legislature
- WIOA core programs
- Businesses
- Labor organizations
- Registered Apprenticeship programs
- Local elected officials
7

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

Additional entities
- Temporary Assistance for Needy Families (TANF)
- Additional partner programs
[Hover over text: These programs include:
•
Unemployment Insurance
•
Trade Adjustment Assistance for Workers
•
Jobs for Veterans State Grants
•
Senior Community Service Employment Program
•
Reentry Employment Opportunities (formerly Reintegration of Ex-Offenders)
•
Career and technical education programs authorized under the Perkins Act
•
Employment and training programs under the Supplemental Nutrition Assistance
Program
•
Employment and training programs under the Department of Housing and Urban
Development
•
Employment and training programs under the Community Services Block Grant]
- State economic development programs
- Community-based organizations with employment, training, or education expertise
- Justice programs
- Community college or technical education programs
- Other higher education programs
- K-12 education programs
- Native American tribe or tribal organization
- Local workforce development boards
- Other (specify)
13. Has the size (number of seats) of the state WDB changed since WIOA took effect?
(Y/N)
13a. If yes, How has the size (number of seats) of the state WDB changed since WIOA took effect?
- State WDB size has increased
- State WDB size has decreased
14. Has the composition of the state WDB changed since WIOA took effect? By composition, we mean
the proportion of seats held by various types of entities. (Y/N)
14a. If yes, How has the composition of the board changed since WIOA took effect? For each of the
following entities, please indicate whether the entity’s representation on the state WDB has
increased, decreased, or remained the same since WIOA took effect. (select one option per row)
State WDB Entity

Required entities
Governor
8

More board
representation
now

Less board
representation
now

[Hover over text:
By this, we mean
the proportion of
seats held by the
entity has
increased.]

[Hover over text:
Including no
representation
currently if there
was
representation
prior to WIOA.]

No change in
representation

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

State WDB Entity

State legislature
WIOA core programs
Businesses
Labor organizations
Registered Apprenticeship programs
Local elected officials
Additional entities
Temporary Assistance for Needy Families
(TANF)
Additional partner programs
[Hover over text: These programs include:
• Unemployment Insurance
• Trade Adjustment Assistance for Workers
• Jobs for Veterans State Grants
• Senior Community Service Employment
Program
• Reentry Employment Opportunities
(formerly Reintegration of Ex-Offenders)
• Career and technical education programs
authorized under the Perkins Act
• Employment and training programs
under the Supplemental Nutrition
Assistance Program
• Employment and training programs
under the Department of Housing and
Urban Development
• Employment and training programs
under the Community Services Block
Grant]
State economic development programs
Community-based organizations with
employment, training, or education experience
Justice programs
Community college or technical education
programs
Other higher education programs
K-12 education programs
Native American tribe or tribal organization
Local workforce development boards
9

More board
representation
now

Less board
representation
now

[Hover over text:
By this, we mean
the proportion of
seats held by the
entity has
increased.]

[Hover over text:
Including no
representation
currently if there
was
representation
prior to WIOA.]

No change in
representation

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

State WDB Entity

More board
representation
now

Less board
representation
now

[Hover over text:
By this, we mean
the proportion of
seats held by the
entity has
increased.]

[Hover over text:
Including no
representation
currently if there
was
representation
prior to WIOA.]

No change in
representation

Other (specify)
15. Please indicate which standing committees your state WDB has currently and whether that committee
existed before WIOA took effect. (check all that apply)
Type of standing committee

Standing
committee
currently
exists

Executive
AJC certification
Apprenticeship
Career pathways
Accessibility/Americans with Disabilities Act Compliance
Individuals with barriers to employment
[Hover over text: The term ‘‘individual with a barrier to
employment’’ means a member of one or more of the following:
(A) Displaced homemakers.
(B) Low-income individuals.
(C) Indians, Alaska Natives, and Native Hawaiians
(D) Individuals with disabilities, including youth who are
individuals with disabilities.
(E) Older individuals.
(F) Ex-offenders.
(G) Homeless individuals, or homeless children and youths
(H) Youth who are in or have aged out of the foster care system.
(I) Individuals who are English language learners, individuals
who have low levels of literacy, and individuals facing substantial
cultural barriers.
(J) Eligible migrant and seasonal farmworkers
(K) Individuals within 2 years of exhausting lifetime eligibility
under part A of title IV of the Social Security Act (42 U.S.C. 601 et
seq.).
(L) Single parents (including single pregnant women).
(M) Long-term unemployed individuals.
(N) Such other groups as the Governor involved determines to
have barriers to employment.]
Performance
Planning

10

Standing
committee
existed before
WIOA (before
July 2015)

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

Type of standing committee

Standing
committee
currently
exists

Standing
committee
existed before
WIOA (before
July 2015)

Sector Strategies
Skills/credentials
Transportation
Youth
Other (specify)
16. Does your state have any requirements for local WDB membership beyond the federal minimum?
The federally required representation for local WDBs includes: business, workforce/labor, Registered
Apprenticeship, adult education and literacy provider, higher education, economic and community
development, employment services, and vocational rehabilitation. (Y/N)
16a. If yes: What additional requirements for local WDB membership have been established? (check
all that apply)
- Community-based organizations that have expertise in addressing the employment,
training or education needs of individuals with barriers to employment
- Community-based organizations that have expertise in addressing the employment,
training or education needs of youth
- Local education agencies that have expertise in addressing the employment, training or
education needs of individuals with barriers to employment
- Local education agencies that have expertise in addressing the employment, training or
education needs of youth
- Government or other entities that represent transportation
- Government or other entities that represent housing
- Government or other entities that represent public assistance
- Government or other entities that represent economic and community development,
beyond the federal minimum requirements
- Philanthropic organizations
- Other requirements (specify)
17. Does your state require all local WDBs to have a youth committee? (Y/N)
17a. If no is selected: What percent of local WDBs have a youth committee? If your state only
has one local area, please respond by selecting None.
- None
- Less than half
- About half
- More than half
- All or nearly all
18. Does your state require local WDBs to have any other specific types of committees? (Y/N)
18a. If yes, what kinds of committees are required? (check all that apply)
- Executive
- AJC certification
- Apprenticeship
11

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

-

Career pathways
Accessibility/Americans with Disabilities Act Compliance
Individuals with barriers to employment
Performance
Planning
Sector Strategies
Skills/credentials
Transportation
Youth
Other (specify)

19. How many of your state’s local WDBs have introduced pay-for-performance (PFP) under WIOA? If
your state only has one local area, please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
20. Has your state provided guidance or technical assistance to the local areas on any of the following
WIOA regional/local planning and governance topics? (check one per row)
Guidance or technical assistance topic

No, not
provided
to local
areas

Yes,
provided
to some
local areas

Yes,
provided to
all local
areas

Regional planning
Local board composition
Local board committees
Local planning and development of local plans
Other topics (specify)

21. What topics related to regional and local planning and governance do you think should be addressed
in future federal guidance or technical assistance? (check all that apply)
- Regional planning
- Local board composition
- Local board committees
- Local planning and development of local plans
- Other topics (specify)
Thank you for completing this survey module. Would you like to provide additional information about
the state, regional, or local planning and governance in your state? (Y/N)
If yes, please specify.

12

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

MODULE 3: AMERICAN JOB CENTER (AJC) OPERATIONS
1. What percent of your state's local areas had competitively procured American Job Center (AJC)
operators by July 1, 2017 (the WIOA deadline for completing competitive procurement)? Your best
estimate is fine. If your state only has one local area, please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
- Not sure
2. What percent of your state’s local areas had competitively procured AJC operators prior to WIOA?
- None
- Less than half
- About half
- More than half
- All or nearly all
- Not sure
3. What percent of your state's local areas have changed their AJC operators through competitive
procurement since WIOA took effect? Your best estimate is fine. If your state only has one local
area, please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
- Not sure
4. Has the WIOA requirement to use a competitive procurement process affected how your state’s AJCs
operate or serve customers?
- Yes
- No
- Too soon to tell
4a. If yes is selected: Please describe the effect in your state of this new requirement.
- Positive effect in general on AJC operations or services
- Negative effect in general on AJC operations or services
- Neutral
- Not sure

13

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

5. What percent of local areas in your state currently have consortia operators? By consortia we mean a
group of three or more partners that jointly operate one or more AJCs. Your best estimate is fine. If
your state only has one local area, please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
6. What percent of local areas in your state had consortia operators prior to WIOA? By consortia we
mean a group of three or more partners that jointly operate one or more AJCs. Your best estimate is
fine. If your state only has one local area, please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
- Not sure
7. What percent of local areas in your state currently have more than one AJC operator? Your best
estimate is fine. If your state only has one local area, please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
8. What percent of your state’s local workforce development boards (WDBs) are currently AJC
operators? Your best estimate is fine. If your state only has one local area, please respond by
selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
9. How many comprehensive AJCs does your state currently have? (number)
10. How has the number of comprehensive AJCs in your state changed since WIOA took effect?
- Increased
- Decreased
- Stayed the same
- Do not know
11. How many affiliate (or satellite) AJCs does your state currently have? (number)
[Hover over text: Affiliate AJCs may also be known as satellite AJCs]

14

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

12. How has the number of affliate (or satellite) AJCs in your state changed since WIOA took effect?
- Increased
- Decreased
- Stayed the same
- Do not know
13. For which types of AJCs does your state have a defined certification? (check all that apply) By
defined certification we mean state-imposed requirements to certify AJCs as meeting the
requirements of their AJC type.
- Comprehensive AJCs
- Affiliate (or satellite) AJCs
[Hover over text: Affiliate AJCs may also be known as satellite AJCs]
- Other types of AJCs (specify)
- None, all AJCs receive the same level of certification
14. Has your state added or revised criteria for the certification of comprehensive and/or affiliate AJCs
since WIOA took effect? (Y/N) [Hover over text: Affiliate AJCs may also be known as satellite
AJCs.]
14a. If yes, which of the following are new or revised criteria for the certification of comprehensive
and/or affiliate AJCs ? (check all that apply)
[Hover over text: Affiliate AJCs may also be known as satellite AJCs.]
- Job seeker services integration
- Business and employer services integration
- Job seeker satisfaction
- Employer satisfaction
- Cost efficiency
- Physical or programmatic accessibility for job seekers
- Continuous improvement processes
- Negotiated levels of performance
- Regular professional development for staff
- System to identify and respond to technical assistance needs
- System to capture and respond to specific customer feedback
- Other (specify)
15. What percent of your state’s AJCs (comprehensive and affiliate) are currently meeting the state’s
certification criteria? [Hover over text: Affiliate AJCs may also be known as satellite AJCs]
- None
- Less than half
- About half
- More than half
- All or nearly all

15

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

16. What strategies does your state use to improve or maintain compliance by AJCs with the state’s
certification system? (check all that apply)
- Publish guidance
- Provide technical assistance
- Provide incentives
- Impose sanctions
- Decertify AJCs
- None
- Other (specify)
17. What percent of your state’s AJCs are currently meeting the state’s certification requirements related
to physical or programmatic accessibility for job seekers?
- None
- Less than half
- About half
- More than half
- All or nearly all
18. What strategies does your state use to improve or maintain compliance by AJCs with the state’s
certification requirements related to physical or programmatic accessibility for job seekers? (check all
that apply)
- Require third party evaluation of whether the Americans with Disability Act (ADA)
requirements are met
- Standardize policies for meeting criteria (such as use of specific assistive technology during
workshops)
- Publish guidance on accessibility criteria
- Provide technical assistance on accessibility criteria
- Provide incentives
- Impose sanctions
- Decertify AJCs
- None
- Other (specify)
19. Does your state use AJC-level data to measure the efficiency and effectiveness of AJCs in your state?
(Y/N)
19a. If yes, What AJC-level data does your state use to measure AJC efficiency and effectiveness?
(check all that apply)
- Primary indicators of performance
- Customer volume in the AJC
- How long a customer spends in an AJC
- How often a customer returns to an AJC
- Average referrals per customer
- Job seeker satisfaction
- Employer satisfaction
- AJC website metrics
- Other (specify)

16

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

20. Does your state require any partner staff (other than one required WIOA Title I staff person) to be
physically colocated at comprehensive AJCs? (check all that apply)
-

No other requirements for physical colocation

WIOA Core Programs
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
WIOA Optional Partner Programs
- Unemployment Insurance
- Trade Adjustment Assistance for Workers
- Jobs for Veterans State Grants
- Senior Community Service Employment Program
- Reentry Employment Opportunities (formerly Reintegration of Ex-Offenders)
- Career and technical education programs authorized under the Perkins Act
- Temporary Assistance for Needy Families
- Employment and training programs under the Supplemental Nutrition Assistance
Program
- Employment and training programs under the Department of Housing and Urban
Development
- Employment and training programs under the Community Services Block Grant
Other Programs
- Indian and Native American
- Job Corps
- YouthBuild
- National Farmworker Jobs/Migrant and Seasonal Farmworker Programs
- Other (specify)
21. Has your state Title IB agency negotiated infrastructure funding agreements (IFAs) with other
partners, on behalf of local areas? (Y/N)
21a. If yes, With which other partners has your state Title IB agency negotiated IFAs?
(check all that apply)
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
- Temporary Assistance for Needy Families (TANF)
22. Has your state used the state funding mechanism (SFM) to execute infrastructure funding agreements
(IFAs) in any local areas since WIOA took effect?
(Y/N)
[Hover over text: The SFM is triggered by the failure of the required partners to reach consensus in a
local area on the sharing of infrastructure costs in the IFA.]

17

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

22a. If yes, What percent of your state's local areas have required implementation of the state funding
mechanism (SFM) to execute infrastructure funding agreements (IFAs) since WIOA took effect?
If your state only has one local area, please respond by selecting All or nearly all.
[Hover over text: The SFM is triggered by the failure of the required partners to reach consensus
in a local area on the sharing of infrastructure costs in the IFA.]
- Less than half
- About half
- More than half
- All or nearly all
22b. If yes, What were the calculated statewide caps for each partner's contribution? Include the
value of any in-kind contributions made by the partner. (indicate percentage of program funds for
each program)
WIOA Core Programs
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
WIOA Optional Partner Programs
- Unemployment Insurance
- Trade Adjustment Assistance for Workers
- Jobs for Veterans State Grants
- Senior Community Service Employment Program
- Reentry Employment Opportunities (formerly Reintegration of Ex-Offenders)
- Career and technical education programs authorized under the Perkins Act
- Temporary Assistance for Needy Families
- Employment and training programs under the Supplemental Nutrition Assistance
Program
- Employment and training programs under the Department of Housing and Urban
Development
- Employment and training programs under the Community Services Block Grant
Other Programs
- Indian and Native American
- Job Corps
- YouthBuild
- National Farmworker Jobs/Migrant and Seasonal Farmworker Programs
- Other (specify)
23. Please characterize your state’s development of the SFM.
- Not at all challenging
- Moderately challenging
- Extremely challenging

18

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

23a. If moderately or extremely challenging, What made it challenging to develop your state’s SFM?
(check all that apply)
- Insufficient staff resources
- Insufficient time
- Difficulty engaging partners
- Other (specify)
24. Does your state currently use the “Proud Partner of the American Job Center Network” brand? (Y/N)
24a. If yes, How has your state incorporated the American Job Center brand into its marketing?
(check all that apply)
- AJC signage
- Marketing materials
- Web design
- Customer forms
- Other (specify)
24b. Which partners currently use your state's common branding? (check all that apply)
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
- Temporary Assistance for Needy Families (TANF)
- Other (specify)
24c. If no, Is your state planning on adopting the “Proud Partner of the American Job Center
Network” brand? (Y/N)
25. Has your state provided guidance or technical assistance to the local areas on any of the following
WIOA AJC topics? (check one per row)
Guidance or technical assistance topic

No, not
provided
to local
areas

Competitive procurement of AJC operators
AJC certification
Physical and programmatic accessibility of AJCs
Measuring AJC performance
Measuring customer satisfaction
Partner colocation
MOU development
IFA development
SFM implementation
AJC branding
Other topics (specify)

19

Yes,
provided
to some
local areas

Yes,
provided to
all local
areas

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

26. What topics related to AJC operations do you think should be addressed in future federal guidance or
technical assistance? (check all that apply)
- Competitive procurement of AJC operators
- Certification of AJCs
- Physical and programmatic accessibility of AJCs
- Measuring performance of AJCs
- Measuring customer satisfaction
- Partner colocation
- Development of MOUs
- Development of IFAs
- Implementation of the SFM
- AJC branding
- Other topics (specify)
Thank you for completing this survey module. Would you like to provide additional information about
AJC operations in your state? (Y/N)
If yes, please specify.

20

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

MODULE 4: IMPROVED SERVICES FOR EMPLOYERS AND ADULT JOB
SEEKERS
1. Since WIOA took effect, what strategies has your state prioritized to help employers hire and train
staff? (select up to three)
- Sector planning and engagement
- Coordination and knowledge sharing across public agencies that serve employers
- Expanding on-the-job and customized training
- Increasing maximum employer reimbursement rate for on-the-job and customized training
- Expanding apprenticeships
- Expanding incumbent worker training
- Other (specify)
2. Since WIOA took effect, how has your state adjusted its resources for helping employers hire and
train staff? (check one)
- No change in resources
- More available resources
- Fewer available resources
- Don’t know
3. What strategies has your state prioritized to encourage the use of Registered Apprenticeship since
WIOA took effect? (select up to three)
[Hover over text: Registered Apprenticeship is a model of job preparation that combines paid on-thejob training (OJT) with related instruction to progressively increase workers’ skill levels and wages.]
- Increasing funding for Registered Apprenticeship programs
- Increasing coordination with the state apprenticeship director
- Increasing outreach to employers and employer associations
- Increasing Registered Apprenticeship programs on the eligible training providers (ETP) list
- Increasing Registered Apprenticeship representation on the state and local workforce
development boards (WDBs)
- Increasing coordination with Registered Apprenticeship representatives on state and local
WDBs
- Educating state and local WDB leaders about apprenticeship
- Educating AJC frontline staff about apprenticeship
- Promoting Registered Apprenticeship as a career pathway for Job Corps and other programs
- Promoting Registered Apprenticeship for YouthBuild
- Other (specify)
- None
4. What strategies has your state prioritized to encourage the use of pre-apprenticeship since WIOA took
effect? (select up to three)
[Hover over text: Pre-apprenticeship programs provide instruction and/or training to increase
math, literacy, and other vocational and pre-vocational skills needed to gain entry into a
Registered Apprenticeship program.]
- Increasing funding for pre-apprenticeship programs
- Increasing coordination with the state apprenticeship director
- Educating state and local WDB leaders about pre-apprenticeship
- Educating AJC frontline staff about pre-apprenticeship
- Increasing pre-apprenticeship as a Youth program service

21

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

-

Promoting pre-apprenticeship for YouthBuild
Increasing outreach to community-based organizations that could develop pre-apprenticeship
programs
Other (specify)
None

5. What strategies has your state prioritized to encourage the use of other apprenticeship approaches,
such as industry-sponsored apprenticeship, since WIOA took effect? (select up to three)
- Increasing coordination with the state apprenticeship director
- Increasing outreach to employers and employer/industry associations
- Educating state and local WDB leaders about other apprenticeship approaches
- Educating AJC frontline staff about other apprenticeship approaches
- Increasing funding or other financial incentives
- Other (specify)
- None
6. Has your state instituted new career pathway programs since WIOA took effect?
6a.

(Y/N)

-

If yes: In which industries are you instituting new career pathway programs? (check all that
apply)
Agriculture
Arts, entertainment, and recreation
Business management
Construction
Education
Finance and insurance
Healthcare
Hospitality/food services
Information Technology
Manufacturing
Professional/Legal/Scientific
Public Administration
Real estate
Retail
Transportation and warehousing
Utilities
Wholesale trade
Any others (specify)

-

If yes, In which industries have new career pathway programs instituted since WIOA took
effect been most successful in your state? (select up to three)
[Display options selected above]
Agriculture
Arts, entertainment, and recreation
Business management
Construction
Education
Finance and insurance
Healthcare

6b.

22

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

6c.

6d.

Hospitality/food services
Information Technology
Manufacturing
Professional/Legal/Scientific
Public Administration
Real estate
Retail
Transportation and warehousing
Utilities
Wholesale trade
Any others (specify)
Don’t know
Too early to determine
If yes, In which industries have new career pathway programs instituted since WIOA took
effect been least successful in your state? (select up to three)
[Display all options selected in 6a but not selected in 6b]
Agriculture
Arts, entertainment, and recreation
Business management
Construction
Education
Finance and insurance
Healthcare
Hospitality/food services
Information Technology
Manufacturing
Professional/Legal/Scientific
Public Administration
Real estate
Retail
Transportation and warehousing
Utilities
Wholesale trade
Any others (specify)
Don’t know
Too early to determine
If yes, Does your state use any data or performance indicators to measure the success of its
career pathways programs? (Y/N)
6e. If yes to 6d, Please specify what data or performance indicators your state uses to
measure success with its career pathway programs. (open)

23

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

7. If yes to 6, With which organizations is your state partnering to institute new career pathway
programs? (check all that apply)
- Community and technical colleges
- High schools
- Career and technical schools
- Employers
- Non-profit or for-profit training providers
- Chambers of Commerce
- Unions
- Industry associations
- Other (specify)
7a. With which types of organizations have new career pathway programs instituted since
WIOA took effect been most successful overall? (select up to three)
[Display options selected above]
- Community and technical colleges
- High schools
- Career and technical schools
- Employers
- Non-profit or for-profit training providers
- Chambers of Commerce
- Unions
- Industry associations
- Other (specify)
- None of the above
7b.

-

With which types of organizations have new career pathway programs instituted since
WIOA took effect been least successful overall? (select up to three)
[Display all options selected in 7 but not selected in 7a]
Community colleges
High schools
Career and technical schools
Employers
Non-profit or for-profit training providers
Chambers of Commerce
Unions
Industry associations
Any others (specify)
None of the above

24

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

8. Has your state instituted new sector-based strategies or partnerships since WIOA took effect? (Y/N)
8a.
-

If yes, In which industries are you instituting new sector-based strategies or partnerships?
(check all that apply)
Agriculture
Arts, entertainment, and recreation
Business management
Construction
Education
Finance and insurance
Healthcare
Hospitality/food services
Information Technology
Manufacturing
Professional/Legal/Scientific
Public Administration
Real estate
Retail
Transportation and warehousing
Utilities
Wholesale trade
Any others (specify)

-

If yes, In which industries have new sector-based strategies or partnerships instituted since
WIOA took effect been most successful? (select up to three)
[Display options selected above]
Agriculture
Arts, entertainment, and recreation
Business management
Construction
Education
Finance and insurance
Healthcare
Hospitality/food services
Information Technology
Manufacturing
Professional/Legal/Scientific
Public Administration
Real estate
Retail
Transportation and warehousing
Utilities
Wholesale trade
Any others (specify)
Don’t know
Too early to determine

8b.

25

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

8c.

8d.

If yes, In which industries have new sector-based strategies or partnerships instituted since
WIOA took effect been least successful? (select up to three)
[Display all options selected in 8a but not selected in 8b]
Agriculture
Arts, entertainment, and recreation
Business management
Construction
Education
Finance and insurance
Healthcare
Hospitality/food services
Information Technology
Manufacturing
Professional/Legal/Scientific
Public Administration
Real estate
Retail
Transportation and warehousing
Utilities
Wholesale trade
Any others (specify)
Don’t know
Too early to determine
If yes, Does your state use any data or performance indicators to measure the success of its
sector-based strategies or partnerships? (Y/N)
8e. If yes to 8d, Please specify what data or performance indicators your state uses to
measure success with its sector-based strategies or partnerships. (open)

9. Since WIOA took effect, for which of the following work-based learning strategies has your state
instituted new policies or procedures? (check all that apply)
- Transitional jobs
- On-the-job training
- Customized training
- Incumbent worker training
- Other (please specify)
10. For what purposes does your state currently use labor market data? (check all that apply)
- Identify in-demand industry sectors or occupations
- Project levels of demand for new hires
- Project salary levels for new hires
- Other (specify)
- None
10a. Has your state’s use of labor market data changed since WIOA took effect?
- Yes, the state increased use of labor market data
- Yes, the state decreased use of labor market data
- No change

26

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

11. What policies or procedures does your state currently use to target workforce services toward
individuals with barriers to employment? (check all that apply)
- Shared intake process across programs that serve these customers
- Expedited intake process
- Bridge programs to make it easier to enter training programs
[Hover over text: Bridge programs focus on baseline skill development to improve success
with later training programs.]
- Tracking referrals for adults who are basic skills deficient
- Setting service targets for adults who are basic skills deficient
- Other (specify)
- None
11a. Which of these policies or procedures were introduced after WIOA took effect? [Display
selected options from above] (check all that apply)
12. How are remediation services provided to adults who are basic skills deficient and who seek
workforce services (via AJCs or virtually)? Remediation services could include high school diploma
or equivalency programs or English as a second language programs. (select all that apply)
- e-learning
- On-site AJC staff-provided services
- Referral to off-site service providers/educational partners
- Varies by local area
- Other (specify)
13. How many training providers are currently on your state’s list of eligible training providers (ETPs)?
(number)
14. Which types of ETPs are currently on your state’s list? (check all that apply)
- Community and technical colleges
- Universities
- Private for-profit training providers
- Registered Apprenticeship programs
- Private non-profit training providers
- Other (specify)
15. Has the number of providers on your state's ETP list changed since the new ETP eligiblity
requirements under WIOA took effect? Please consider both ETP initial and continued eligibility
requirements.
- Number of providers increased
- Number of providers decreased
- Number of providers did not change
16. Has the number of training programs offered by providers on your state's ETP list changed since
WIOA’s ETP eligibility requirements took effect?
- Number of programs increased
- Number of programs decreased
- Number of programs did not change

27

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

17. What proportion of local areas in your state maintain ETP lists that are separate from the state list?
Your best estimate is fine. If your state only has one local area, please respond by selecting either
None or All.
- None of the local areas
- Some
- About half
- Most
- All or nearly all of the local areas
17a. If>none, Why do local areas in your state maintain lists of ETPs separate from the state’s
list? (check all that apply)
- To limit training programs to those occupations in demand in the local area
- To provide more localized performance or cost information on providers
- To assess whether training providers are meeting local eligibility requirements
- Other reasons (specify)
- Not sure
18. Has your state provided guidance or technical assistance to the local areas on any of the following
WIOA topics related to serving employers or job seekers? (check one per row)
Guidance or technical assistance topic

No, not
provided
to local
areas

Employer engagement and services
Registered Apprenticeship
Pre-apprenticeship
Industry-sponsored apprenticeship
Career pathways
Sector-based strategies or partnerships
Work-based learning strategies
Use of labor market analysis
Serving individuals with barriers to employment
Eligible training providers
Other topics (specify)

28

Yes,
provided
to some
local areas

Yes,
provided to
all local
areas

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

19. What topics or issues should be addressed in future federal guidance or technical assistance on
serving employers and adult job seekers? (check all that apply)
- Employer engagement and services
- Registered Apprenticeship
- Pre-apprenticeship
- Industry-sponsored apprenticeship
- Career pathways
- Sector-based strategies or partnerships
- Work-based learning strategies
- Use of labor market analysis
- Serving individuals with barriers to employment
- Eligible training providers
- Other (specify)
Thank you for completing this survey module. Would you like to provide additional information about
the services for employers or job seekers in your state? (Y/N)
If yes, please specify.

29

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

MODULE 5: IMPROVED SERVICES FOR YOUTH
1. What percent of local areas in your state currently face challenges in spending at least 75% of their
youth funding on out-of-school youth? Your best estimate is fine. If your state only has one local
area, please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
1a. If >None, What are the three biggest challenges that local areas in your state face in meeting the
requirement to spend 75% of youth formula grants funds on out-of-school youth? If your state
received a waiver for meeting the 75% requirement, please select the top three challenges your
local areas face in meeting the requirements of the approved waiver. (select up to three)
- Identifying and recruiting eligible youth
- Identifying qualified service and training providers
- Engagement and retention of youth in services
- Identifying suitable work experiences
- Lack of resources for work experience and internships
- Lack of transportation
- Lack of childcare
- Restrictions on how to use formula funds (e.g. for food) and incentives
- Need for more guidance on out-of-school youth strategies
- Other (specify)
2. What percent of local areas in your state currently face challenges in spending at least 20% of their
youth funding on work experiences for out-of-school youth? If your state only has one local area,
please respond by selecting either None or All.
- None
- Less than half
- About half
- More than half
- All or nearly all
2a. If>None, What are the three biggest challenges that local areas in your state face in meeting the
requirement to spend at least 20% of their youth funding on work experience? (select up to three)
- Identifying and recruiting employers
- Finding age-appropriate work experience opportunities
- Youth populations who need other services before they are ready for work experience
- Retention of youth in work experience
- Insufficient resources at the local level
- Need for more guidance on work experience strategies
- Need for more guidance on balancing work experience with other youth services
- Other (specify)

30

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

3. How has participation in the following youth services changed since WIOA took effect? (select one
option per row)
Youth Service
Fewer youth More youth
No
Do
receiving
receiving
change
not
service
service
know
Entrepreneurial skills training
Financial literacy training
Career guidance on in-demand occupations

4. What have been the three biggest challenges for local areas in your state in providing entrepreneurial
skills training to youth participants? (select up to three)
- Identifying service providers that can provide high-quality entrepreneurial skills training
- Engaging and retaining youth in training
- Insufficient resources at the local level
- Services are not cost-effective
- Need for more guidance
- No challenges
- Other (specify)
5. What have been the three biggest challenges for local areas in your state in providing financial
literacy training to youth participants? (select up to three)
- Identifying service providers that can provide high-quality financial literacy training
- Engaging and retaining youth in training
- Insufficient resources at the local level
- Services are not cost-effective
- Need for more guidance
- No challenges
- Other (specify)
6. What have been the three biggest challenges for local areas in your state in providing career guidance
on in-demand occupations to youth participants? (select up to three)
- Identifying service providers that are able to provide high-quality career guidance on indemand occupations
- Engaging and retaining youth in career guidance services
- Insufficient resources at the local level
- Services are not cost-effective
- Need for more guidance
- No challenges
- Other (specify)
7. How has the provision of youth case management by local workforce development boards (rather
than contracting out for youth case management) changed in your state since WIOA took effect?
- More boards providing youth case management directly
- Fewer boards providing youth case management directly
- No change

31

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

8. How has the provision of youth services other than case management by local workforce
development boards (rather than contracting out for such services) changed since WIOA took effect?
- More boards providing youth services directly
- Fewer board providing youth services directly
- No change
9. How has the provision of youth services on-site at American Job Centers (AJCs) changed since
WIOA took effect?
- More AJCs offering youth services on-site
- Fewer AJCs offering youth services on-site
- No change
10. Has your state provided guidance or technical assistance to the local areas on any of the following
WIOA topics related to serving youth? (check one per row)
Guidance or technical assistance topic

No, not
provided
to local
areas

Yes,
provided
to some
local areas

Yes,
provided to
all local
areas

Spending on out-of-school youth
Spending on work experience
Required youth services (entrepreneurial skils,
financial literacy, and career guidance on in-demand
occupations)
Identifying or recruiting service providers
Engaging and retaining youth
Restrictions on the use of formula funds
Other topics (specify)

11. What topics related to serving youth do you think should be addressed in future federal guidance or
technical assistance? (check all that apply)
- Spending on out-of-school youth
- Spending on work experience
- Types of required youth services
- Identifying or recruiting service providers
- Engaging and retaining youth
- Restrictions on the use of formula funds
- Other (specify)
Thank you for completing this survey module. Would you like to provide additional information about
the youth services in your state? (Y/N)
If yes, please specify.

32

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

MODULE 6: PERFORMANCE INDICATORS AND REPORTING SYSTEMS (WIPS)
WIOA establishes primary indicators of performance to assess the effectiveness of states and local areas
in achieving positive outcomes for individuals and employers served by the workforce system’s core
programs. These performance indicators are:
1. Employment Rate, 2nd Quarter After Exit
2. Employment Rate, 4th Quarter After Exit
3. Median Earnings, 2nd Quarter After Exit
4. Credential Attainment
5. Measurable Skill Gains
6. Effectiveness in Serving Employers
1. What challenges, if any, did your state encounter in reporting on the primary indicators of
performance for your core programs? (check all that apply)
- Implementing changes to how participants are defined across partner programs
- Implementing changes to how entry or exit dates are defined across partner programs
- Matching data for participants across partner data systems
- Access to wage records across partner programs
- Use of supplemental information to document earnings
- No challenges
- Other (specify)
2. Does your state have a shared management information system for customer case management among
WIOA core and other partners? (Y/N)
2a. If yes, Which partners can enter data (read and write access) into the primary system used for
Title I programs? (check all that apply)
WIOA Core Programs
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
WIOA Optional Partner Programs
- Unemployment Insurance
- Trade Adjustment Assistance for Workers
- Jobs for Veterans State Grants
- Senior Community Service Employment Program
- Reentry Employment Opportunities (formerly Reintegration of Ex-Offenders)
- Career and technical education programs authorized under the Perkins Act
- Temporary Assistance for Needy Families
- Employment and training programs under the Supplemental Nutrition Assistance
Program
- Employment and training programs under the Department of Housing and Urban
Development
- Employment and training programs under the Community Services Block Grant
Other Programs
- Indian and Native American
- Job Corps

33

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

-

YouthBuild
National Farmworker Jobs/Migrant and Seasonal Farmworker Programs
Other (specify)

2b. Which of the other partners have the ability to view data (read-only access)? (check all that apply)
[ONLY DISPLAY OPTIONS NOT SELECTED IN ABOVE QUESTION]
WIOA Core Programs
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
WIOA Optional Partner Programs
- Unemployment Insurance
- Trade Adjustment Assistance for Workers
- Jobs for Veterans State Grants
- Senior Community Service Employment Program
- Reentry Employment Opportunities (formerly Reintegration of Ex-Offenders)
- Career and technical education programs authorized under the Perkins Act
- Temporary Assistance for Needy Families
- Employment and training programs under the Supplemental Nutrition Assistance
Program
- Employment and training programs under the Department of Housing and Urban
Development
- Employment and training programs under the Community Services Block Grant
Other Programs
- Indian and Native American
- Job Corps
- YouthBuild
- National Farmworker Jobs/Migrant and Seasonal Farmworker Programs
- Other (specify)
2c. Which partners have access/rights to acquire participant wage records for performance reporting?
(check all that apply)
WIOA Core Programs
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
WIOA Optional Partner Programs
- Unemployment Insurance
- Trade Adjustment Assistance for Workers
- Jobs for Veterans State Grants
- Senior Community Service Employment Program
- Reentry Employment Opportunities (formerly Reintegration of Ex-Offenders)
- Career and technical education programs authorized under the Perkins Act
- Temporary Assistance for Needy Families

34

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

Employment and training programs under the Supplemental Nutrition Assistance
Program
- Employment and training programs under the Department of Housing and Urban
Development
- Employment and training programs under the Community Services Block Grant
Other Programs
- Indian and Native American
- Job Corps
- YouthBuild
- National Farmworker Jobs/Migrant and Seasonal Farmworker Programs
- Other (specify)
-

3. Does your state currently use a shared unique identifier for job seekers across programs? (Y/N)
3a. If yes, Which programs use this unique identifier? (check all that apply)
WIOA Core Programs
- Title IB programs (Adult and Dislocated Worker)
- Title IB programs (Youth)
- Title II Adult Education and Family Literacy Act
- Title III Wagner Peyser Act/Employment Service (ES)
- Title IV Vocational Rehabilitation
WIOA Optional Partner Programs
- Unemployment Insurance
- Trade Adjustment Assistance for Workers
- Jobs for Veterans State Grants
- Senior Community Service Employment Program
- Reentry Employment Opportunities (formerly Reintegration of Ex-Offenders)
- Career and technical education programs authorized under the Perkins Act
- Temporary Assistance for Needy Families
- Employment and training programs under the Supplemental Nutrition Assistance
Program
- Employment and training programs under the Department of Housing and Urban
Development
- Employment and training programs under the Community Services Block Grant
Other Programs
- Indian and Native American
- Job Corps
- YouthBuild
- National Farmworker Jobs/Migrant and Seasonal Farmworker Programs
- Other (specify)
4. What system(s) does your state use to collect and report on WIOA performance data to WIPS?
(check all that apply)
- Custom-built state system
- Third party vendor
- None (manual process)
- Other (specify)

35

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

WIOA revised the process for negotiating levels of performance to include the use of a statistical
adjustment model (SAM) during negotiations and at the end of the program year, to adjust the negotiated
levels of performance to reflect characteristics of participants served and economic conditions. [Hover
over text: WIOA requires that levels of performance be negotiated for each of the primary indicators of
performance at the state level. State-level actual performance outcomes are a function of (a) the
characteristics of the participants being served, as well as (b) the labor market conditions in which those
participants are being served.]
5. What effect did the use of a SAM have on your state’s negotiated levels of performance? Please
consider the changes across all primary indicators of performance.
- It required higher levels of performance
- It required lower levels of performance
- Some levels of performance are higher and some are lower
- No substantial change
6. In your state, what effect did the use of a SAM have on your local areas’ negotiated levels of
performance?
- It required higher levels of performance
- It required lower levels of performance
- Some levels of performance are higher and some are lower
- No substantial change
7. What was challenging about implementing the SAM? (check all that apply)
- Collecting data more frequently
- Collecting new data variables
- Training staff on the SAM
- Applying the SAM to negotiations
- Fully capturing customer characteristics at intake
- Other (open)
- No challenges implementing the SAM
WIOA’s state research and evaluation strategies include coordinating and consulting with other core
programs and local workforce boards; conducting evaluations and research for workforce programs; and
cooperating with Federal evaluations to provide data, respond to surveys, and allow site visits as
practicable.
8. Please describe your state’s capacity to conduct research on and evaluate the effectiveness of WIOA’s
core programs under Title I (Adult, Dislocated Worker and Youth) and Title III (Wagner Peyser Act
Employment Service):
- Very adequate (can implement most priority research and evaluation projects)
- Adequate (can implement many priority research and evaluation projects)
- Fair (can implement some of the priority research and evaluation projects)
- Inadequate (can implement very few priority research and evaluation projects)
- Nonexistent (cannot implement research and evaluation at this time)
9. Approximately how many FTE state staff work on WIOA-related research and evaluation activities?
(number)

36

WIOA IMPLEMENTATION EVALUATION: STATE SURVEY

10. Has your state provided guidance or technical assistance to the local areas on any of the following
WIOA topics related to performance? (check one per row)
Guidance or technical assistance topic

No, not
provided
to local
areas

Yes,
provided
to some
local areas

Yes,
provided to
all local
areas

Recording data used to calculate employment and
earnings indicators
Recording data used to calculate credential attainment
indicator
Recording data used to calculate skills gains indicator
Recording data used to calculate effectiveness in
serving employers indicator
Defining participation, entry, and exit across partners
Matching data for participants across partners
Accessing wage records data
Implementing an integrated management information
system across partners
Protecting personally identifiable data
Implementing the statistical adjustment model
Using data for research and evaluation purposes
Other topics (specify)

11. What topics related to WIOA performance do you think should be addressed in future federal
guidance or technical assistance? (check all that apply)
- Recording data used to calculate employment and earnings indicators
- Recording data used to calculate credential attainment indicator
- Recording data used to calculate skills gains indicator
- Recording data used to calculate effectiveness in serving employers indicator
- Defining participation, entry, and exit across partners
- Matching data for participants across partners
- Accessing wage records data
- Implementing an integrated management information system across partners
- Protecting personally identifiable data
- Implementing the statistical adjustment model
- Using data for research and evaluation purposes
- Other (specify)
Thank you for completing this survey module. Would you like to provide additional information about
performance indicators or reporting systems in your state? (Y/N)
If yes, please specify.

37


File Typeapplication/pdf
File Modified0000-00-00
File Created0000-00-00

© 2024 OMB.report | Privacy Policy