Building Evidence Training (BET) Project Usability Testing

OMB # 0970-0401

Expiration Date: 05/31/2021

PAPERWORK REDUCTION ACT OF 1995 (Pub. L. 104-13) STATEMENT OF PUBLIC BURDEN: The purpose of this information collection is to gain feedback on the course content and delivery. Public reporting burden for this collection of information is estimated to average .12 hours per response, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. If you have any comments on this collection of information, please contact the Building Evidence Training Project at: [email protected]

Designing and Implementing Evidence-Supported Interventions in Child Welfare

Unit 4 PRE/POST TEST:

Selecting, Adapting, and/or Developing the Intervention

Questions

1. Which of the following is not a key factor for teams to consider when implementing an intervention?

1. Evidence demonstrating improvement in outcomes

2. Fit with the agency’s structure and circumstances

3. Readiness of the intervention for implementation

4. Assessment of the community’s human resources 

2. An agency is preparing to implement a new intervention. Identify one of the implementation supports that should be in place to facilitate the process.

1. Staff recruitment and selection processes 

2. Peer reviewed and professional journals

3. Resources for procurement of evaluation consultants

4. A team of substance abuse specialists

3. What is used to help determine whether the staff is implementing the intervention as intended?

1. Community stakeholders

2. Kinship navigator programs

3. Fidelity assessments 

4. Communications protocols

4. Why is it critical to include frontline workers and supervisors on teams? (modified cumulative question)

1. They perform the role of preparing the evaluation plan.

2. They have important knowledge about clients and the community. 

3. They can do most of the planning work so other staff can focus on their jobs.

4. They conduct effective web searches for evidence-supported interventions.

5. All of the above.

4. The training and coaching of staff on intervention related activities is an example of:

1. An adaptation of the intervention

2. A cost barrier

3. A root cause

4. An implementation support 

4. The Diamond County team learned that the intervention they selected was evaluated through rigorous random control trial (RTC) studies in two different jurisdictions that found improved permanency outcomes for children in foster care. This means that:

1. With the proper implementation supports, the program will improve outcomes in Diamond County.

2. Diamond County is prepared to implement this intervention.

3. The intervention has fit with the agency’s structure, staff, and community.

4. The intervention has supporting evidence. 

5. All of the above

7. Which of the following is a component of a theory of change? (new cumulative question)

1. Short and long-term outcomes 

2. Teaming charter

3. Readiness of the intervention for implementation

4. Agency leaders or program managers

8. What is important for teams to understand when deciding whether to select or adapt an existing intervention or to develop a new intervention?

1. Making major changes to an existing intervention may reduce confidence that any supporting evidence is still applicable.

2. Adaptation can be made to an intervention to respond to the needs of the population being served or the agency’s context.

3. Agencies that find they cannot successfully select or adapt an intervention may decide that developing a new intervention is the best path forward.

4. All of the above. 

9. Which of the following is not a key component of an implementation plan?

1. Definition of the problem and the target population that will benefit

2. Description of agency leaders’ enthusiasm for the principles of the intervention 

3. Description of the theory of change

4. Description of the selected intervention including the philosophy, values, and principles

5. Description of anticipated challenges and ways to address them

10. True or False: Identifying the Problem & Understanding the Population is part of the Exploration Phase of the Development, Implementation and Assessment Approach. (new cumulative question) A. True B. False

Unit 4 Pre/Post Test Questions 3