Form Implementation Int Implementation Int Implementation Interview Guides

National Evaluation of SAMHSA's Youth Programs

Attachment 2 Implementation Interview Guides

Implementation Interviews

OMB: 0930-0366

Document [docx]
Download: docx | pdf

Attachment 2:
Implementation Interview Guides



OMB No 0930-0XXX

Exp. Date XX/XX/XXXX



Public Burden Statement: An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB control number for this project is 0930-0XXX. Public reporting burden for this collection of information is estimated to average 1 hour per respondent per year, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to SAMHSA Reports Clearance Officer, 5600 Fishers Lane, Room 15E57-B, Rockville, Maryland, 20857.



Cross-Site Evaluation of SAMHSA’s FY 2012 – FY 2015 PORTFOLIO of

Cooperative Agreements for State Adolescent and Transitional Aged Youth Treatment Enhancement and DISSEMINATION

Discretionary Grant Programs



[SYT-ED/SYT-I] Grantee IMPLEMENTATION/ONGOING Interview Guide

November 2015



Introduction



Thank you for taking the time to speak with us today. The Substance Abuse and Mental Health Services Administration (SAMHSA) has contracted with RTI International and its partners—the University of Arizona’s Southwest Institute for Research on Women (SIROW) and the Health and Education Research, Management, and Epidemiologic Services, LLC (HERMES)—to conduct an evaluation of SAMHSA’s portfolio of Cooperative Agreements for State Adolescent and Transitional Aged Youth Treatment Enhancement and Dissemination discretionary grant programs.



As you know, these programs provide funding to states/territories/tribes to improve treatment for youth with substance use disorders and co-occurring mental health disorders by strengthening existing treatment infrastructure and developing a learning laboratory with local community-based treatment provider sites to help disseminate evidence-based practices.

Information gathered from this interview will help us gain insight into the substance abuse treatment system for youth in your state/territory/tribe as well as the facilitators and challenges of implementing the [SYT-ED/SYT-I] program. Although we are funded by SAMHSA, we are not part of that federal agency (or any other federal agency). We are independent evaluators of SAMHSA’s youth treatment discretionary grant programs. Participation in this interview is completely voluntary. We greatly value any information you may be able to provide. Your name and title will not appear in any report unless we specifically ask for and receive your approval. Although we are taking detailed notes, we would also like to tape record the interview in case we need to verify our notes with the interview dialogue. This recording will only be used to ensure that our notes are complete and that we are accurately capturing your input. Recordings will be deleted after our notes are assembled. Is this OK with you?



We expect this interview may take about an hour. Do you have any questions before we begin? If not, let’s get started.

Involvement/Overview


  1. Please describe your position/role at [GRANTEE NAME].


  1. How long have you worked at [GRANTEE NAME]?


  1. What is your involvement with the [SYT-ED/SYT-I] program?


  1. How long have you been in this role?


Treatment and Service Delivery System


  1. How would you describe the youth treatment and service system environment in your state/territory/tribe youth substance?


PROBE with:

    • Prior to your [SYT-ED/SYT-I] grant award, did your state/territory/tribe’s treatment and service delivery system support evidence-based approaches for adolescents and/or transitional aged youth?

    • Have you implemented any changes to your state/territory/tribe’s treatment and service delivery system to expand evidence-based care for adolescents and/or transitional aged youth as part of your [SYT-ED/SYT-I] program? What needs or gaps in the treatment and service delivery system for adolescents and/or transitional aged youth does your [SYT-ED/SYT-I] program respond to?

    • What changes, if any, to the treatment system were introduced by your agency to implement the [SYT-ED/SYT-I] program?

    • What are the new models that have been adopted or implemented in your state/territory/tribe?


  1. What needs or gaps in the treatment and service system does the [SYT-ED/SYT-I] program respond to?



  1. What other needs or gaps in your state/territory/tribe’s treatment and service delivery system for youth are not being addressed by your [SYT-ED/SYT-I] program? How could these gaps be addressed?




SYT-ED/SYT-I Program Implementation


  1. Please describe the [SYT-ED/SYT-I] program that you have implemented in your state/territory/tribe.


Interviewer—follow-up with:

  • As proposed, the [SYT-ED/SYT-I] program’s target population is <<insert target population for specific grantee >>. Has this target population changed since implementation of the [SYT-ED/SYT-I] program? If so, how?

  • According to our records, the local community-based treatment provider sites for the [SYT-ED/SYT-I] program are <<insert provider sites for specific grantee >>. Have the provider sites changed since implementation of the [SYT-ED/SYT-I] program? If so, why?

  • [For SYT-I only: How has your program’s provider collaborative helped in implementing service delivery components of your SYT-I program and/or your program’s EBP dissemination practices?]

  • According to our records, the evidence based practices (EBPs) selected for the [SYT-ED/SYT-I] program are <<insert EBPs for specific grantee >>. Have the EBPs changed since implementation of the SYT-ED/SYT-I program? If so, why?


  1. How do you disseminate and monitor EBP assessments and treatments to the local providers involved in your program’s learning laboratory?


PROBE with:

  • How do you ensure that provider sites reach and maintain certification/licensure and “train-the-trainer” capability for the EBPs?

  • Do you monitor provider fidelity to EBPs? If so, how?

  • Has your agency assisted the provider sites in promoting abstinence from tobacco products (except with regard to accepted tribal traditional practices) and integrating tobacco cessation strategies and services? If so, how?


  1. How have your provider partnerships identified barriers or solutions to widen the use of effective EBPs for adolescents and/or transitional aged youth and their families or primary caregivers?



  1. What efforts have been made to disseminate the evidence-based practices (EBPs) in your [state/territory/tribe] beyond the local provider sites?


  1. Does your agency and/or the provider sites use an Electronic Health Records (EHR) system for the [SYT-ED/SYT-I] program?


    • IF YES, is your HER system certified? Did you achieve certification as part of the [SYT-ED/SYT-I] program?

    • IF YES, does the use of this EHR aid in billing or program planning processes? If so, how?

    • IF NO, Are you working towards certification?


  1. How has implementation of the [SYT-ED/SYT-I] program differed than originally planned, and why?


  1. What are the other key activities that your agency engages in to implement the [SYT-ED/SYT-I] program?


Infrastructure and Development


Next we would like to ask you about the state/territory/tribe-level infrastructure that was in place prior to your [SYT-ED/SYT-I] grant, as well as any infrastructure development activities you have engaged in as part of your [SYT-ED/SYT-I] grant. Examples of what we mean by infrastructure include workforce training and recruitment, credentialing/licensing standards, a state/territory/tribe centralized all payer billing system, technical assistance resources for providers, and the sharing of data.


  1. What existing infrastructure was in place at the state/territory/tribe-level prior to receiving your [SYT-ED/SYT-I] grant award?


PROBE with:

  • What workforce development strategies or initiatives did you have in place?

  • Did you create a new interagency council, or add to an existing one?

  • [For SYT-I only: Did you create a new provider collaborative, or add to an existing one?]

  • What was the level of coordination across agencies/stakeholders in your state/territory/tribe?

  • Did you have an understanding of the financial resources available to support family-informed treatment for adolescents and/or transitional aged youth, and had you developed strategies for leveraging those resources to provide family-informed treatment?

  • Did you have an EHR system to manage client-level clinical data?

  • Did you have a system of care that linked clients to ancillary services/programs in the community?

    • Did you engage youth and their families in making policies and formulating strategies at the state/territory/tribe-level?


  1. Did your agency hire additional staff to administer the [SYT-ED/SYT-I] program?


    • IF YES, what type and approximately how many staff members?


PROBE with:

    • Does your agency use volunteers or rely heavily on in-kind labor (i.e., donated time) to implement the [SYT-ED/SYT-I] program?


  1. What infrastructure and workforce development activities have been conducted as part of your [SYT-ED/SYT-I] program?]


Interviewer—probe with:

  • Policies/procedures—have you developed any new or modified existing state/territorial/tribal policies or procedures to help you better serve adolescents and/or transitional aged youth?

  • Workforce development—what activities have you engaged in to develop and/or retain the substance use workforce for adolescents and/or transitional aged youth in your state/territory/tribe (e.g., continuing education events, licensing/credentialing)?

  • Interagency collaboration—who are the members of the interagency council, and what are their roles in the youth treatment and service delivery system? Are there additional important agencies or organizations that haven’t been engaged by your interagency council?

  • Financial mapping—have these activities produced any funding innovations to support the goals of your [SYT-ED/SYT-I] program?

  • Health information sharing—Do you, or your local provider sites, use health information technology or management information systems to coordinate substance use disorder treatment, wraparound, and recovery support services for adolescents and/or transitional aged youth? If so, please describe.

  • Youth and family involvement—how have youth and their families been involved in the planning and implementation of the treatment and service delivery aspects of your [SYT-ED/SYT-I] program?



  1. Are there any infrastructure and/or workforce development goals that you have not been able to accomplish yet? If so, what are they and why?



Funding


  1. What other sources of funding does your agency utilize to provide treatment and services for youth and their families in your [state/territory/tribe]?

PROBE with:

  • Medicaid

  • Substance Abuse Prevention and Treatment Block Grant

  • Community Mental Health Services Block Grant

  • Other federal, state, local, or private sources


  1. Which of these sources support the wider treatment for adolescents and/or transitional aged youth in [state/territory/tribe]?


  1. Are there other strategies, programs, or initiatives at the federal, state/territory/tribe, or local levels that your state/territory/tribe employs to support care for youth and their families? If so, please describe?



Facilitators and Challenges


  1. What are your biggest challenges that you have faced in implementing your [SYT-ED/SYT-I] program, and how have you overcome these challenges?


Interviewer—probe for more than one (e.g., top five).


PROBE with:

  • Have there been any challenges with implementing the treatment and service delivery components of your [SYT-ED/SYT-I] program?

  • Have there been any challenges with infrastructure activities?

  • Collaborating with stakeholders?

  • Partnering with provider sites?


  1. What have been the biggest facilitators supporting the implementation of your [SYT-ED/SYT-I] program?


  1. Who are the critical partners that have helped your implementation? Who are other stakeholders (e.g., youth and family champion organizations) that have helped your implementation?


Impact and Utility


  1. How well is the [SYT-ED/SYT-I] program addressing the needs or gaps in the treatment and service system that influenced its implementation?


  1. Based on your understanding of the [SYT-ED/SYT-I] program, overall how successfully has it been implemented in your [state/territory/tribe], scored on a scale of 1 to 5, with 1 being not successfully at all and 5 being very successfully?


PROBE with:

  • What makes you choose this score?

  • What were the key aspects that have made it successful or not successful so far?

  • If respondent indicates <4, what would it take to get you to a 4?


  1. Has your [SYT-ED/SYT-I] program helped move your state/territory/tribe to a more coordinated treatment system for adolescents and/or transitional aged youth and their families or primary caregivers? If so, please describe in what ways?


  1. What recommended improvements would you suggest to more successfully implement the [SYT-ED/SYT-I] program?


End of Interview


  1. Are there other issues that you think are important that have not been covered? If yes, please describe.


  1. Are you aware of data sources not currently reported to SAMHSA that we should be considering for the cross-site evaluation?



OMB No XXXX-XXXX

Exp. Date XX/XX/XXXX



Public Burden Statement: An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB control number for this project is XXXX-XXXX. Public reporting burden for this collection of information is estimated to average 1 hour per respondent per year, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to SAMHSA Reports Clearance Officer, 1 Choke Cherry Road, Room 7-1044, Rockville, Maryland, 20857.





Cross-Site Evaluation of SAMHSA’s FY 2012 – FY 2015 PORTFOLIO of

Cooperative Agreements for State Adolescent and Transitional Aged Youth Treatment Enhancement and DISSEMINATION

Discretionary Grant Programs



[SYT-ED/SYT-I] PROVIDER IMPLEMENTATION/ONGOING Interview Guide

NOVEMBER 2015



Introduction



Thank you for taking the time to speak with us today. The Substance Abuse and Mental Health Services Administration (SAMHSA) has contracted with RTI International and its partners—the University of Arizona’s Southwest Institute for Research on Women (SIROW) and the Health and Education Research, Management, and Epidemiologic Services, LLC (HERMES)—to conduct an evaluation of SAMHSA’s portfolio of Cooperative Agreements for State Adolescent and Transitional Aged Youth Treatment Enhancement and Dissemination discretionary grant programs.



As you know, these programs provide funding to states/territories/tribes to improve treatment for youth with substance use disorders and co-occurring mental health disorders by strengthening existing treatment infrastructure and developing a learning laboratory with local community-based treatment provider sites to help disseminate evidence-based practices.

Information gathered from this interview will help us gain insight into the substance abuse treatment system for youth in your state/territory/tribe as well as the facilitators and challenges of implementing the [SYT-ED/SYT-I] program. Although we are funded by SAMHSA, we are not part of that federal agency (or any other federal agency). We are independent evaluators of SAMHSA’s youth treatment discretionary grant programs. Participation in this interview is completely voluntary. We greatly value any information you may be able to provide. Your name and title will not appear in any report unless we specifically ask for and receive your approval. Although we are taking detailed notes, we would also like to tape record the interview in case we need to verify our notes with the interview dialogue. This recording will only be used to ensure that our notes are complete and that we are accurately capturing your input. Recordings will be deleted after our notes are assembled. Is this OK with you?



We expect this interview may take about an hour. Do you have any questions before we begin? If not, let’s get started.

Overview

  1. Please describe your position at [ORGANIZATION NAME], and tell us how long you have been in this position.



  1. How would you describe your organization (e.g., community-based, school-based)?



  1. How would you classify the ownership structure of your organization (e.g., public, private, for-profit, not-for-profit)?



  1. Approximately how long has your organization been part of the [SYT-ED/SYT-I] Program?



  1. Did your organization have a previous relationship with [SYT-ED/SYT-I Grantee] prior to your involvement in the program? If yes, please describe.



[SYT-ED/SYT-I] Program Implementation

  1. Our records indicate that your site provides the following clinical treatment and/or medical services:

<< Pre-populate a table of clinical treatment and/or medical services based on web survey results, including those funded through [SYT-ED/SYT-I] program and those not funded through [SYT-ED/SYT-I] program. >>

Is this correct? Are there any other clinical treatment and/or medical services that you provide?



  1. Our records also indicate that you provide the following recovery support services:

<< Pre-populate a table of clinical treatment and/or medical services based on web survey results, including those funded through [SYT-ED/SYT-I] program and those not funded through [SYT-ED/SYT-I] program. >>

Is this correct? Are there any other recovery support services that you provide?



  1. Do you provide any trauma-informed services? If so, what services do you provide?







  1. Our records also indicate that you target the following client populations:



<< Pre-populate a list of target client populations from web survey results. >>



Is this correct?



  1. How did your organization decide to become part of the [SYT-ED/SYT-I] program?


PROBE with:

      • How did you learn about the [SYT-ED/SYT-I] grant?

      • What were the deciding factors to join?

      • How was the decision made?

      • Were provider staff involved in the decision?

      • What were your concerns about joining and how were these concerns addressed?



  1. Can you please describe how you implemented your [SYT-ED/SYT-I] program at your site?



PROBE with:

  • How are [SYT-ED/SYT-I] services integrated into the larger organization?

  • Have you added treatment and/or recovery support services because of your participation in the [SYT-ED/SYT-I] Program?

  • What EBP assessments and treatments does your organization provide?

  • Has your client population changed because of the [SYT-ED/SYT-I] Program?



  1. Please describe, if any, the involvement of the family members of your [SYT-ED/SYT-I] clients.

PROBE with:

  • Do you provide services do you provide for parents/caregivers? If so, what?

  • In what other ways do you involve parents/caregivers?



  1. Are you meeting your projected targets for the number of clients served overall, and across those special populations that you target to reduce health disparities? What factors affect your ability to engage and recruit clients from your target population(s)? Where are the disparities?



  1. How do [SYT-ED/SYT-I] clients access your organization for services? In other words, what are the portals used by your organization to reach [SYT-ED/SYT-I] clients?

PROBE with:

  • Juvenile justice system referrals?

  • Social service agency referrals?

  • Primary care referrals?

  • Self-referrals?

  • Other?



  1. Please describe the client flow and service delivery process for your organization; that is, what are the processes that an [SYT-ED/SYT-I] client undergoes to receive services?

PROBE with:

  • How are clients identified, engaged, and recruited?

  • How are clients screened/assessed?

  • How do you determine eligibility?

  • What is the typical length of treatment?

  • Are there bottlenecks in the client flow, where clients drop out or terminate services?

  • How are clients transitioned from treatment to aftercare services?



Infrastructure and Development

  1. What start-up or ongoing infrastructure development activities have you engaged in because of your participation in the [SYT-ED/SYT-I] program?



Interviewer—probe with:

  • Did your organization hire additional staff due to participation in the [SYT-ED/SYT-I] Program? If so, what type and approximately how many staff members did your organization hire to work with [SYT-ED/SYT-I] clients and/or administer the [SYT-ED/SYT-I] Program?

  • [For SYT-I only: How has your involvement on the SYT-I provider collaborative helped in start-up or ongoing implementation?]

  • Did you provide any additional training for new or existing staff? What type of training did staff receive? Who provides training and technical assistance support?

  • Did your organization use any financial resources beyond those provided through the [SYT-ED/SYT-I] program to expand your organizations capacity (e.g., add building space)?

  • Did your organization need to acquire additional resources (e.g., computer equipment) to join the [SYT-ED/SYT-I] Program?

  • Did you expand your use of health information technology or management information systems? In what ways do you use your EHR system to participate in the [SYT-ED/SYT-I] Program (e.g., billing, clinical decision making, program planning, communicating with outside partners)?

Facilitators and Challenges

  1. What factors have supported or challenged the successful implementation (i.e., start-up) of [SYT-ED/SYT-I] within your organization?

PROBE with:

  • Training?

  • Technical assistance?

  • Staff buy-in/lack of staff buy-in?

  • Budgets or other available resources?

  • Management/leadership support/lack of support?

  • Provider requirements?

  • Competing priorities within the organization?

  • Meeting client targets?

  • Other issues?



  1. What solutions or changes have you implemented to overcome these challenges?

PROBE with:

Did you change…

  • Billing procedures?

  • Data collection and reporting systems?

  • Screening and intake procedures?

  • Contracting procedures?

  • Administrative procedures?

  • Other changes?



  1. Please describe the role that outside partnerships play in helping you serve your [SYT-ED/SYT-I] client population.

PROBE with:

  • What services are provided by other partner organizations?

  • What linkages do you leverage to recruit and engage clients?



Outcomes

  1. Can you describe the intended goals of the [SYT-ED/SYT-I] Program for your client population?



  1. Based on your understanding of the [SYT-ED/SYT-I] Program, overall how successfully has it been implemented, scored on a scale of 1 to 5, with 1 being not successfully at all and 5 being very successfully?

PROBE with:

  • What makes you choose this score?

  • What are the key aspects that have made it successful or not successful so far?

  • If respondent indicates <4, what would it take to get you to a 4?



  1. Has the existing treatment system prior to the [SYT-ED/SYT-I] Program changed since the implementation of [SYT-ED/SYT-I]? If so, how has it changed?

PROBE with:

  • Has the [SYT-ED/SYT-I] Program impacted health disparities?

  • Increased access to and use of EBPs?

  • Increased family/caregiver involvement?

  • Do gaps in the system of care still remain?



End of Interview

  1. Do you have any recommendations or best practices that you could share with us that could help future providers more successfully implement an [SYT-ED/SYT-I] program?



  1. Are there other issues that you think are important that have not been covered? If yes, please describe.





OMB No XXXX-XXXX

Exp. Date XX/XX/XXXX



Public Burden Statement: An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB control number for this project is XXXX-XXXX. Public reporting burden for this collection of information is estimated to average 1 hour per respondent per year, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to SAMHSA Reports Clearance Officer, 1 Choke Cherry Road, Room 7-1044, Rockville, Maryland, 20857.



Cross-Site Evaluation of SAMHSA’s FY 2012 – FY 2015 PORTFOLIO of

Cooperative Agreements for State Adolescent and Transitional Aged Youth Treatment Enhancement and DISSEMINATION

Discretionary Grant Programs



SYT-P Grantee IMPLEMENTATION/ONGOING Interview Guide

NOVEMBER 2015



Introduction



Thank you for taking the time to speak with us today. The Substance Abuse and Mental Health Services Administration (SAMHSA) has contracted with RTI International and its partners—the University of Arizona’s Southwest Institute for Research on Women (SIROW) and the Health and Education Research, Management, and Epidemiologic Services, LLC (HERMES)—to conduct an evaluation of SAMHSA’s portfolio of Cooperative Agreements for State Adolescent and Transitional Aged Youth Treatment Enhancement and Dissemination discretionary grant programs.


As you know, the SYT-Planning—or SYT-P—program provides funding to states/territories/tribes to develop a comprehensive strategic plan to improve treatment for youth with substance use disorders and co-occurring substance use and mental disorders. These cooperative agreements support state/territory/tribe infrastructure development only; and therefore do not include grant funds for the provision of direct treatment services.


Information gathered from this interview will help us gain insight into the substance abuse treatment system for youth in your state/territory/tribe as well as the facilitators and challenges to developing a strategic plan that will support future efforts to increase access to and improve the quality of treatment for youth and their families. Although we are funded by SAMHSA, we are not part of that federal agency (or any other federal agency). We are independent evaluators of the SYT-P program. We greatly value any information you may be able to provide. Your name and title will not appear in any report unless we specifically ask for and receive your approval. Although we are taking detailed notes, we would also like to tape record the interview in case we need to verify our notes with the interview dialogue. This recording will only be used to ensure that our notes are complete and that we are accurately capturing your input. Recordings will be deleted after our notes are assembled. Is this OK with you?


We expect this interview may take about an hour. Do you have any questions before we begin? If not, let’s get started.  



Involvement/Overview


  1. Please describe your position/role at [STATE/TRIBE/TERRITORY AGENCY NAME]


  1. How long have you worked at [STATE/TRIBE/TERRITORY AGENCY NAME]?


  1. What is your role in the SYT-P program?


  1. How long have you been in this role?



Treatment and Service Delivery System


  1. What are the strengths and challenges of your state/territory/tribe’s existing treatment and service delivery system in terms of its ability to support substance abuse services for adolescents and/or transitional aged youth?


Interviewer follow-up with:


  • What treatment, recovery support services, and evidence-based practices are available? What is missing?

  • What are common barriers in accessing services?

  • Are there disparities in access, service use, or outcomes across subpopulations?


  1. What is the existing infrastructure in place in your state/territory/tribe’s treatment and service delivery system for adolescents and/or transitional aged youth?


PROBE with:

  • What workforce development strategies or initiatives are in place?

  • What is the level of coordination across agencies/stakeholders in your state/territory/tribe?

  • Do you have a system of care that links clients to ancillary services/programs in the community?

  • Are families, adolescents, and transitional aged youth involved in informing policy, program, and effective practice at the state/tribal/territorial level?


  1. What are the service gaps and other infrastructure development needs that your SYT-P strategic planning is designed to address?







Funding


  1. What sources of funding does your agency utilize to provide treatment and services for youth and their families in your [state/territory/tribe]?

PROBE with:

  • Medicaid

  • Substance Abuse Prevention and Treatment Block Grant

  • Community Mental Health Services Block Grant

  • Other federal, state, local, or private sources


  1. Which of these sources support evidence-based treatment for adolescents and/or transitional aged youth?


  1. Are there other strategies, programs, or initiatives at the federal, state/territory/tribe, or local levels that your state/territory/tribe employs to support substance abuse services for youth and their families? If so, please describe?


SYT-P Program Implementation


  1. Did your agency hire additional staff to administer the SYT-P program?


    • IF YES, what type and approximately how many staff members?


PROBE with:

    • Does your agency use volunteers or rely heavily on in-kind labor (i.e., donated time) to implement the SYT-P program?



  1. Describe the interagency council and its purpose as it relates to the SYT-P program.

PROBE with:

    • Did you create or add to an existing interagency council for the SYT-P grant?

    • Who are the members, and what are their roles in the youth treatment and service delivery system?

    • Are there additional important agencies/organizations/representatives that haven’t been engaged by your interagency council?

    • How does the council—including its SYT-P Subcommittee and Substance Abuse Financing Subcommittee—support strategic planning efforts?





  1. What are the key activities that your agency engages in to implement the SYT-P program’s strategic planning efforts?


Interviewer follow-up with:

  • How does the interagency council help in these strategic planning efforts?

  • How have you involved youth and their families in this process?

  • [If applicable] How have you collaborated with the current state-level SAMHSA-funded Comprehensive Community Mental Health Services for Children and their Families Program (CMHI) grantee?


  1. What, if any, changes were made to the originally proposed SYT-P program? What led to the changes in the original plan?



  1. Does your agency use a data infrastructure/management information system (MIS) to assist in collecting and analyzing qualitative and quantitative data for continuous quality improvement?



Planned Infrastructure and Development


Next we would like to ask you about planned infrastructure development activities identified as part of your SYT-P grant. Examples of what we mean by infrastructure include workforce training and recruitment, credentialing/licensing standards, a state/territory/tribe centralized all payer billing system, technical assistance resources for providers, and the sharing of data.



  1. What infrastructure and workforce development activities have been identified as part of your SYT-P program’s strategic planning efforts to expand substance abuse services for adolescents and/or transitional aged youth?


Interviewer—follow-up with:

  • Policies/procedures—developing any new or modifying existing state/territorial/tribal policies or procedures to help you better serve adolescents and/or transitional aged youth?

  • Workforce development—activities to support the training and development of the substance use workforce for adolescents and/or transitional aged youth in your state/territory/tribe (e.g., delivery of curricula in college/education settings, continuing education events, licensing/credentialing, promoting coordination/collaboration with family support organizations)? How has workforce mapping aided in this?

  • Financingactivities to support the creation of new or the modification of existing state-wide financing policies? How has financial mapping aided in this?

  • Youth and family involvement—strategic communications plan and other SYT-P planning efforts to promote youth and family involvement?

  • Interagency Collaboration- Future cross-system linkages or coordinated efforts to provide a comprehensive continuum of services?

  • Provider Collaborative – planning efforts to create or expand an existing provider collaborative that will support improving treatment and recovery support service delivery for youth.

  • EBPs—selecting evidence-based assessments and treatment interventions for future dissemination in your [state/territory/tribe]?



  1. Are there any additional infrastructure or workforce development goals that you hope to accomplish? If so, what are they and why?



Facilitators and Challenges


  1. What are your biggest challenges that you have faced during your SYT-P program strategic planning efforts, and how have you overcome these challenges?


Interviewer—probe for more than one (e.g., top five).


PROBE with:

  • Identifying future infrastructure development activities that are practical and doable?

  • Collaborating with and engaging stakeholders?


  1. What have been the biggest facilitators supporting your SYT-P program strategic planning efforts?


  1. Who are the critical partners or other stakeholders (e.g., youth and family champion organizations) that have helped your strategic planning efforts?



Impact and Utility


  1. Which activities identified through the SYT-P program’s strategic planning efforts do you think will be most useful for strengthening the existing infrastructure system and addressing the needs or gaps in the treatment and service system?

  1. What factors may contribute to, or impede, successfully implementing planned efforts to increase access to and improve the quality of treatment for youth and their families/primary caregivers?


  1. In what ways do you think the SYT-P program will help move your state/territory/tribe to a more coordinated treatment system for adolescents and/or transitional aged youth and their families or primary caregivers?


  1. What outcomes will be used to assess the effectiveness and sustainability of the strategic plan’s future implementation?



  1. Based on your understanding of the SYT-P program, overall how successfully have strategic planning efforts been implemented in your [state/territory/tribe], scored on a scale of 1 to 5, with 1 being not successfully at all and 5 being very successfully?


PROBE with:

  • What makes you choose this score?

  • What were the key aspects that have made it successful or not successful so far?

  • If respondent indicates <4, what would it take to get you to a 4?


  1. What recommended improvements would you suggest to more successfully implement the SYT-P program’s strategic planning efforts?


End of Interview


  1. Are there other issues that you think are important that have not been covered? If yes, please describe.


  1. Are you aware of data sources not currently reported to SAMHSA that we should be considering for the cross-site evaluation?



File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
AuthorOrme, Stephen
File Modified0000-00-00
File Created2021-01-23

© 2024 OMB.report | Privacy Policy