Building Evidence Training (BET) Project Usability Testing

OMB # 0970-0401

Expiration Date: 05/31/2021

PAPERWORK REDUCTION ACT OF 1995 (Pub. L. 104-13) STATEMENT OF PUBLIC BURDEN: The purpose of this information collection is to gain feedback on the course content and delivery. Public reporting burden for this collection of information is estimated to average .12 hours per response, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. If you have any comments on this collection of information, please contact the Building Evidence Training Project at: [email protected]

Designing and Implementing Evidence-Supported Interventions in Child Welfare

Unit 3 PRE/POST TEST:

Identify the Problem and Understand the Target Population

Questions

1. Which statement best describes the relationship between evidence-supported interventions (ESIs) and evidence-based practice (EBP)?

   1. A third party determines whether an ESI has sufficient evidence to be used in EBP.

   2. A social worker using EBP should always select the ESI that is supported by the most rigorous evidence.

   3. A social worker using EBP integrates clinical expertise with knowledge of ESIs and family preferences in the selection of interventions.  (Correct answer)

   4. All of the above.

2. True or False: The implementation framework used for this course includes performing a root cause analysis before selecting and implementing an intervention.

3. A theory of change:

   1. Explains the psychological process for creating enduring changes in a client’s life.

   2. Is developed after an intervention is selected to communicate to stakeholders how it will address the problem.

   3. Is part of the team charter that should be developed at the implementation team’s first meeting.

   4. Is a hypothesis that describes the root cause of the problem, the desired outcome(s), and how to reach those outcomes.  (Correct answer)

4. Which of the following is an important reason for including child welfare frontline workers and supervisors on a team assigned to study the population at risk for a problem and develop a theory of change?

1. Day-to-day interactions with children and families receiving services gives frontline workers and supervisors important insights into understanding the population at risk.  (Correct answer)

2. Frontline workers need to learn about implementation science in order to properly complete child safety assessments.

3. If frontline workers are included on teams, data gathering and analysis will not be necessary.

4. Frontline workers’ schedules are more flexible than those of high level administrators.

5. Which of the following is not an element of a theory of change?

   1. Desired ultimate outcome

   2. Steps to bring about the outcome

   3. Hypothesized causal pathway

   4. Specification of the communications protocol  (Correct answer)

   5. Measurable intermediate outcomes

6. Which of the following are not criteria useful for assessing a theory of change?

   1. The logic of the change pathway is realistic.

   2. There are sufficient resources to make the change happen.

   3. It relies on a teaming structure that draws from all branches of an organization.  (Correct answer)

   4. Its outcomes are measurable.

   5. Its outcomes align with the agency’s values.

7. Which of the following is consistent with the sequence of steps recommended in the Development, Implementation and Assessment Approach?

   1. Select a theory of change  Understand the population at risk  Identify the problem

   2. Identify the problem  Understand the population at risk Develop a theory of change  (Correct answer)

   3. Conduct a root cause analysis Understand the population at risk  Identify the problem  Develop a theory of change

   4. None of the above

8. Select the answer that best defines “evidence-supported intervention.”

1. The integration of the best available research evidence with clinical and child welfare practice expertise and child and family characteristics, culture, and preferences.

2. The complete process of identifying, describing, and analyzing strengths and problems and then testing, implementing, learning from, and revising strategies to improve performance.

3. A research study that employs treatment and comparison groups to determine the effectiveness of interventions.

4. A well-defined program, practice, policy, or other strategy that has shown the potential, through rigorous evaluation, to improve outcomes for children and families.  (Correct answer)

9. Select the answer that best describes an important function of a communications protocol:

1. It describes how to implement an intervention with fidelity--the way it was designed.

2. It provides the action-planning model to systematically develop, manage, and evaluate interventions.

3. It specifies the frequency and methods of communication among associated teams to ensure a coordinated effort.  (Correct answer)

4. It identifies the mission, goals, objectives, and deliverables of the implementation team.

9. Select the accurate statement about teaming.

1. A team that includes frontline staff and supervisors, with an understanding of the population at risk for a problem and the root causes, can identify potential target populations for an intervention and develop one or more theories of change.  (Correct answer)

2. The value of teaming is unique to the process of implementing child welfare interventions.

3. The teaming structure developed for one implementation team will work for any intervention or agency.

4. Teaming is only important during the exploration stage.

5. All of the above.

Unit 3 Pre/Post Test Questions 3