Building Evidence Training (BET) Project Usability Testing

OMB # 0970-0401

Expiration Date: 05/31/2021

PAPERWORK REDUCTION ACT OF 1995 (Pub. L. 104-13) STATEMENT OF PUBLIC BURDEN: The purpose of this information collection is to gain feedback on the course content and delivery. Public reporting burden for this collection of information is estimated to average .12 hours per response, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. If you have any comments on this collection of information, please contact the Building Evidence Training Project at: [email protected]

Designing and Implementing Evidence-Supported Interventions in Child Welfare

Unit 5 PRE/POST TEST: Installation and Initial Implementation

Note: These questions will be assembled to create both the pretest and posttest for Unit 5.

Questions

1. Practice profiles describe:

1. How an intervention will work in everyday practice 

2. The skills and expertise of the implementation team members

3. Protocols for collecting data

4. Strategies for engaging key partners and stakeholders on implementation teams

2. Even when an intervention is provided by an outside agency, frontline workers and supervisors typically play important roles in referring children and families to the intervention, supporting their participation, and observing their response.

1. True 

2. False

3. A theory of change: (modified cumulative question)

1. Identifies the problems in a client’s life that require treatment.

2. Is developed after an intervention is selected to communicate to stakeholders how it will address the problem.

3. Operationalizes the intervention by providing criteria for measuring fidelity.

4. Is a hypothesis that describes the root cause of the problem, the desired outcome(s), and how to reach those outcomes. 

4. The stage of the Development, Implementation, and Assessment Approach when an agency prepares for implementation by making sure the intervention is clearly defined and will be well supported is the:

1. Sustainability Stage

2. Full Implementation Stage

3. Exploration Stage

4. Installation Stage 

5. Initial Implementation Stage

5. When Diamond County workers and supervisors identified a potential challenge in talking to parents and relatives who had concerns about Medication Assisted Treatment, this was an example of:

1. How usability testing could help the implementation team understand how families in the community will respond to the intervention. 

2. Practice profiles demonstrating that the intervention was not being implemented as intended.

3. A communications protocol lacking adequately specific behavioral indicators for working with families.

4. Confirmation that Diamond County should select a different intervention.

6. Data to guide decision-making throughout implementation will be needed on:

1. Implementation supports

2. Fidelity

3. Utilization

4. Short- and long-term outcomes

5. All of the above 

7. An agency is preparing to enter the Initial Implementation stage of implementation. By this time the following should already be in place: (Cumulative question)

1. Teaming Charter, Communications Protocol, Theory of Change, Practice Profiles, Implementation Supports 

2. Communications Protocol, Theory of Change, Adapted Intervention, Implementation Supports, Usability Testing Results

3. Parent Training, Theory of Change, Selected Intervention, Implementation Supports, Practice Profiles

4. Teaming Charter, Communications Protocol, Theory of Change, Adapted Intervention, Implementation Supports, Evaluation Results

5. Teaming Charter, Communications Protocol, Selected Intervention, Implementation Supports, Full Implementation of Intervention

8. Which answer is an example of a specific contribution of leadership in supporting implementation during the Installation Stage?

1. Enforcing strict adherence to manuals provided by the intervention developers

2. Reviewing data to remove outliers that will skew the evaluation results

3. Ensuring the provision of resources needed for the intervention and implementation supports 

4. Discussing the intervention with individual families during usability testing

9. The recruitment and hiring of staff to implement an intervention is an example of: (modified cumulative question)

1. An adaptation of the intervention

2. An implementation support 

3. Data collection

4. A fidelity assessment

10. The ___________ Stage follows the Installation stage and includes _____________.

1. Full Implementation . . . . . usability testing.

2. Full Implementation . . . . . preparation of implementation supports.

3. Initial Implementation . . . . . usability testing. 

4. Initial Implementation . . . . . revision of the theory of change.

5. Exploration . . . . . teaming protocols.

6. Exploration . . . . theory of change development.

Unit 5 Pre/Post Test Questions 4