Form Survey

OMB No. 0930-0197

Expiration Date: 1/31/2017

Survey of Grantee Data Technical Assistance (GDTA)

Learning Communities

Substance Abuse and Mental Health Services Administration (SAMHSA)

This survey is intended to collect qualitative information about the changes in your organization associated with participation in a Grantee Data Technical Assistance (GDTA) Learning Community. Individual responses will not be released to federal staff or individual TA providers. The results of the survey will only be presented in aggregate form so that individual responses cannot be identified.

The survey will require no more than 10 minutes to complete. Participation in the survey is entirely voluntary.

For questions regarding this survey, please contact the GDTA Evaluator, Dr. Steven T. Sullivan, by telephone at 301-385-6693 or by email at [email protected].

For further information regarding GDTA activities, please go to: https://gdta.samhsa.gov/

Public Burden Statement: An agency may not conduct or sponsor, and a person is not required to respond to a collection of information unless it displays a currently valid OMB control number. The control number for this project is 0930-0197. Public reporting burden for this collection of information is estimated to require 10 minutes per response if all items are answered, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information.. Send comments regarding this burden estimate or any other aspect of this collection of information to SAMHSA Reports Clearance Officer, Room 8-1099, 1 Choke Cherry Road, Rockville, MD 20857.

Learning Communities Technical Assistance (TA) Survey

Please complete this survey if you have participated in one or more GDTA Learning Community activities during the last six months. Examples of activities include webinars, workshops, and Learning Community group meetings.

Please do not complete this survey if you have not been a part of one or more GDTA Learning Community activities during the last six months.

The following questions ask about any changes related to participating in the GDTA Learning Community over the last six months.

Understanding of Data-Driven Culture

Based on your experiences in the GDTA Learning Community, did you increase your understanding of any of the following areas?

Mark all that apply.

Collection of data

Management of data

Utilization of data

Other areas  Please specify:

Your Focus Areas

Which of the following are focus areas of your GDTA Learning Community?

Mark all that apply and flip to each of the corresponding pages.

Building a Culture of Evidence  PLEASE FILL OUT SECTION A ON THE NEXT PAGE

Institutionalizing Performance Improvement with Data  PLEASE FILL OUT SECTION B ON PAGE 4

Data Collection and Data Quality Standards  PLEASE FILL OUT SECTION C ON PAGE 5

Data Integration and Data Reporting  PLEASE FILL OUT SECTION D ON PAGE 6

Data Use and Data Visualization  PLEASE FILL OUT SECTION E ON PAGE 7

Section A

Building a Culture of Evidence

The next questions ask about changes in your organization’s relationship to performance and outcome data.

A1. As a result of participating in GDTA activities over the past six months, has your organization...

	Yes	No	Don’t know/ not sure
a. Increased its capacity to measure the relative impact of agency/program services?
b. Increased its understanding of how to link data outcomes with goal-setting objectives that are Specific, Measurable, Attainable, Realistic, and Timely?
c. Increased its capacity to communicate inter-related complex data findings in easy-to-digest formats to funders, program leaders, staff, and strategic partners?
d. Increased its capacity to use data for mid-course corrections as well as statements of need and planning for new interventions?
e. Changed policies to promote greater use of performance or impact data?

Section B

Institutionalizing Performance Improvement with Data

The next questions ask about any changes in organizational roles or responsibilities as they relate to data.

B1. As a result of participating in GDTA activities over the past six months, has your organization established or changed functional roles and core competencies for performance improvement staff and/or goal leaders in the following:

	Yes	No	Don’t know/ Not sure
a. Information management
b. Organizational performance analysis
c. Problem solving
d. Bringing evidence-based practices to scale
e. Performance measurement planning and reporting
f. Monitoring strategic goals and objectives with data
g. Evaluating program performance
h. Assessing stakeholder engagement
i. Monitoring system impacts with data

Section C

Data Collection/Data Quality Standards

The next questions ask about any changes to organizational standards relating to data.

C1. As a result of participating in GDTA activities over the past six months, has your organization...

	Yes	No	Don’t know/ not sure
a. Increased internal understanding of the link between program activities and performance outcomes?
b. Increased internal understanding of the purpose of requirements for follow-up and timely reporting?
c. Increased internal understanding of why quality performance measurement depends on quality of data input?
d. Increased visibility and accessibility of data-related performance measures?
e. Managed data analysis with more transparent and more consistent methods?
f. Developed and implemented effective performance measurement review systems relying on hard data?

Section D

Data Integration and Data Reporting

The next questions ask about any changes in tying together internal and external data, adopting a holistic approach to data, or expanding the intersection of stakeholders and data.

D1. As a result of participating in GDTA activities over the past six months, has your organization...

	Yes	No	Don’t know/ not sure
a. Increased its understanding of the relationship between outcomes, performance measures, service activities, outputs, and inputs (i.e., Logic Models/Theory of Change)?
b. Expanded use of secondary data sources, including CDC, CMS, Health Claims, Epidemiology and Surveillance datasets?
c. Expanded its ability to communicate complex statistical findings to non-statisticians?
d. Expanded analysis techniques to understand the impact of intervention and external factors in relation to secondary/environmental datasets?
e. Expanded the use of client satisfaction surveys to understand customer-focused outcomes?
f. Developed data analysis reports for program design/strategic decision-making?
g. Linked performance outcomes with budget inputs?
h. Increased its understanding of data warehouse capacities to unify the collection, storage, analysis, and sharing of data?

Section E

Data Use/Data Visualization

The next questions ask about any changes in financing.

E1. As a result of participating in GDTA activities over the past six months, has your organization...

	Yes	No	Don’t know/ Not sure
a. Used performance measures that assess progress towards strategic aims for program initiatives?
b. Developed a decision-making process for sharing performance or evaluation results with key decision-makers?
c. Presented performance measurement results within specific timeframes?
d. Used case studies to present a human story behind metrics?
e. Learned how to share difficult and challenging performance results for system-impact mid-course corrections?
f. Used summary data points that are easily digestible and useful for decision-makers?
g. Learned to tell its story with data outcomes, data visualization tools, and brief case studies?
h. Created dynamic visualizations, dashboards, or geospatial maps to communicate easy-to-understand results to decision-makers and stakeholders?
i. Learned how to use performance results to guide scenario planning for future goals, objectives, and/or new initiatives?

Closing Questions

Did you feel that you learned something from participation in the Learning Community?

CL1. Please indicate your agreement or disagreement with the following statements.

	Strongly agree	Agree	Neither agree nor disagree	Disagree	Strongly disagree
a. The Learning Community presented ideas that are useful to me in my current job
b. I would present ideas from the Learning Community to other people in my organization
c. I would present ideas from the Learning Community to other people in my community

Thank you for participating in our survey!
We look forward to serving you at future GDTA events.