National Center on Subsidy Innovation and Accountability Feedback Surveys

Status: Original and derived artifacts are available for this document.

Download: docx | pdf | html

National Center on Subsidy Innovation and Accountability
Generic Data Collection Bank of Questions

Overview: This document, using constructs and format developed by the Office of Head Start and NORC to facilitate data aggregation and analysis across events of the National T/TA Centers and reviewed by the Office of Child Care (OCC), outlines a bank of data collection questions to assess customer feedback to technical assistance. It identifies five constructs and related survey questions to be used by the National Center on Subsidy Innovation and Accountability (NCSIA) to evaluate the delivery of universal, targeted, tailored, and intensive technical assistance (TA). These constructs are Content Quality, Content Fit, Increased Knowledge, Intended Application of Knowledge, and Diversity, Equity, and Inclusion (DEI). 
This bank of questions is for poll, discussion, pre and post surveys and other customer feedback surveys for the NCSIA’s training and TA offerings. Most universal and short-term TA engagements will include a post-survey only. A pre-post survey will likely be used for intensive, targeted, and long-term individualized engagements. NCSIA will select the most appropriate questions from this bank of questions based on the specific technical assistance event. 
All information collection requests will include the follow statement: 
PAPERWORK REDUCTION ACT OF 1995 (Public Law 104-13) STATEMENT OF PUBLIC BURDEN: The purpose of this information collection is to obtain feedback regarding technical assistance received. Public reporting burden for this collection of information is estimated to average 3 minutes per respondent, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. The OMB # is 0970-0401 and the expiration date is 5/31/2027. If you have any comments on this collection of information, please contact …

Construct
Survey Question
Optional or Recommended
Responses
Example Type of TA for Use of Question
Content Quality
The content of the session was relevant to my work.
Recommended
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

The technical assistance provided was useful to my work.
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

The resources provided during the technical assistance/session/event were useful for my work.	
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

The identified goals and outcomes of the technical assistance/session/event were met.
Optional 
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Individualized, Targeted, Intensive
Content Fit
Please let us know whether you found the content presented in this technical assistance/session/event to be too simple, too advanced, or just about right.
Recommended
Scaled item
Far too advanced (1)
A bit too advanced (2)
About right (3)
A bit too simple (4)
Far too simple (5)
Individualized, Targeted, Intensive

What outcome or desired result, if any, was achieved with the support of this technical assistance?
Optional
Open Response
Individualized, Targeted, Intensive

The TA increased your agency’s access to examples of best practices and innovations implemented by other CCDF grantees.
Optional 
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Targeted, Intensive
Increased Knowledge and Skill
How much did the event increase your knowledge of (specific topics) presented?	
Recommended
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Universal, Individualized, Targeted, Intensive

How much did the event increase your comfort with communicating about (specific topic(s) presented)?	
Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Individualized, Targeted, Intensive

How much did the technical assistance/event/session increase your skill level in planning and implementing related policies and practices?
Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Individualized, Targeted, Intensive

How much did the technical assistance increase your agency’s awareness and use of high-quality training or technical assistance opportunities?

Optional 
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Individualized, Targeted, Intensive

How much did the technical assistance increase your agency’s access to and use of training or technical assistance resources and tools designed to support (specific topic area) staff orientation and ongoing training?
Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Targeted, Intensive

How much did the technical assistance increase your agency’s compliance with CCDF rules and policies? 

Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Universal, Individualized, Targeted, Intensive

How much did the technical assistance increase your agency’s use of CQI techniques?
Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Targeted, Intensive

How much did the technical assistance increase integration of your agency’s functions (e.g., administrative, technological, policy)?
Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Targeted, Intensive

How much did the technical assistance increase your Tribal agency’s access to TA support in establishing agreements with states?
Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Targeted, Intensive

How much did the technical assistance increase your agency’s ability to establish and leverage partnerships to improve coordination and collaboration with other agencies?
Optional
Scaled item
No Increase (1)
Small Increase (2)
Moderate Increase (3)
Large Increase (4)
Universal, Individualized, Targeted, Intensive

BEFORE this technical assistance, my knowledge of (specific content/topics addressed) can best be described as …	

AFTER this technical assistance, my knowledge of (specific content/topics addressed) can best be described as …	
Optional
Scaled item
No knowledge (1)
Minimal knowledge (2)
Moderate knowledge (3)
High level of knowledge (4)
Individualized, Targeted, Intensive

BEFORE this technical assistance, my comfort with communicating about (specific content/topics addressed) can best be described as …	

AFTER this technical assistance, my comfort level with communicating about (specific content/topics addressed) can best be described as …	
Optional
Scaled item
No comfort (1)
Minimal comfort (2)
Moderate comfort (3)
High level of comfort (4)
Individualized, Targeted, Intensive

The TA provided increased your agency’s use of audits to identify and address policy and procedural gaps.

Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Individualized, Targeted, Intensive

The TA increased your agency’s use of process mapping and/or systems analysis to identify and address policy and procedural gaps.
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Individualized, Targeted, Intensive
Intended Application of Knowledge
I learned something during this event that I plan to use in my work.	
Recommended
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

BEFORE this technical assistance, my comfort with implementation efforts related to (specific content/topics addressed) can best be described as …	

AFTER this technical assistance, my comfort level with implementation efforts related to (specific content/topics addressed) can best be described as …	
Optional
Scaled item
No comfort (1)
Minimal comfort (2)
Moderate comfort (3)
High level of comfort (4)
Individualized, Targeted, Intensive
Diversity, Equity, and Inclusion 
The information presented was respectful, nonjudgmental, and supportive of diverse populations (i.e., free from stereotypes or bias).		
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

The content of the presentation was inclusive of diverse cultural experiences and backgrounds.
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

How could this technical assistance/session/event be more inclusive of or responsive to diverse audiences?	
Optional
Open response
Universal, Individualized, Targeted, Intensive

Optional Constructs: The following four constructs and related questions are optional, designed for planning future technical assistance, providing internal feedback to presenters, and improving technical assistance delivery. These constructs are Satisfaction, Presenter Quality, Formative Assessment, and Barriers to Application of Knowledge. 

Construct
Question
Type
Responses
Type of TA for Use of Question
Satisfaction
I was satisfied with the quality of this technical assistance/session/event.
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

I was satisfied with the timeline of this technical assistance/session/event.
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Targeted, Intensive

I would recommend this technical assistance/session/event to my colleagues
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Targeted, Intensive

What is your preferred way of learning virtually?
Optional
Choices
Small Group Discussions
Large Group Discussions
Presentations
Working Session
Combination of Above
Universal, Individualized, Targeted, Intensive

What is your preferred technical assistance session length?
Optional
Choices
Less than 60 minutes
60 minutes
90 minutes
More than 90 minutes
Universal, Individualized, Targeted, Intensive

What is your preferred meeting schedule for ongoing technical assistance?
Optional
Choices
Every Two Weeks 
Once per Month
Quarterly
Other _____
Universal, Individualized, Targeted, Intensive
Presenter Quality
The presenters were knowledgeable in the content area.	
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

The presenters were effective in engaging participants.
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)
Universal, Individualized, Targeted, Intensive

The presenters were responsive to participants' questions.
Optional
Scaled item
Strongly Disagree (1)
Disagree (2)
Agree (3)
Strongly Agree (4)

Formative Assessment
How can we improve this technical assistance/session/event?
Optional
Open response
Individualized, Targeted, Intensive

What topics would you like to learn more about in the future?
Optional
Open response
Universal, Individualized, Targeted, Intensive

What type(s) of follow-up support or resource(s) would be most useful to you on (this specific topic?	
Optional
Open response
Universal, Individualized, Targeted, Intensive

What is the likelihood you or your staff would participate in a peer learning opportunity on this topic?
Optional
Scaled item
Very unlikely (1)
Unlikely (2)
Likely (3)
Very likely (4)
Universal, Individualized, Targeted, Intensive

What additional T/TA opportunities would help you further improve your policies or practices?	
Optional
Open response
Individualized, Targeted, Intensive

Would you be willing to share the work of your Lead Agency related to this technical assistance opportunity?
Optional
Yes (1)
No (2)
Universal, Individualized, Targeted, Intensive

How did you find out about this event?
Optional 
Open response
Universal, Individualized, Targeted, Intensive

What are you most interested in learning about (this specific topic)?
Optional
Open response
Universal, Individualized, Targeted, Intensive
Barriers to Application of Knowledge
What factors, if any, may prevent you from using what you learned?	
Optional
Open response
Individualized, Targeted, Intensive