Ss_b

Using Evaluation Results for Decision-Making

ASPE Generic Information Collection Request

OMB No. 0990-0421

Supporting Statement – Section B

Submitted: May 23, 2018

Contracting Officer Representative

Amanda Cash, DrPH, MPH

Senior Advisor

U.S. Department of Health and Human Services

Office of the Assistant Secretary for Planning and Evaluation

200 Independence Avenue SW, Washington DC 20201

202.260.0352

[email protected]

Section B – Data Collection Procedures

1. Respondent Universe and Sampling Methods

Critical to the success of this project will be the identification of a diverse pool of subject matter experts (SMEs) and their successful recruitment to participate in the study. SMEs will be drawn from academia, non-governmental organizations, and the government.

They may include people with substantive experience in evidence-based policymaking, methodological experts, and evaluators or data producers who have worked within and outside government. As described in this section the contractor will work closely with ASPE to identify and assess a broad pool of potential SMEs, taking a systematic approach to develop the pool of experts. The contractor identified a preliminary list based on their literature review and a review of gray literature. ASPE staff reviewed the list and also provided feedback. This literature review examined the use of evaluation results for health and human services programs at federal and state levels. A summary of the review will be included in the final report with a summary of findings from the key informant interviews. We anticipate conducting 20 interviews, but we may conduct up to 25 interviews with SMEs.

2. Procedures for the Collection of Information

With guidance from ASPE, the contractor developed an interview protocol, which focuses on the following topics regarding use of evaluation results for decision-making: feedback on barriers and facilitators to using evidence; opportunities to improve the use of evidence for decision-making; and models demonstrating the successful use of evidence in practice.

3. Methods to Maximize Response Rates Deal with Nonresponse

We will recruit participants via email and will send follow up emails if there is no response. We do not anticipate problems with response rate or nonresponse given that we have developed a list of SMEs that is sufficient to accommodate a reasonable amount of attrition. In the event that a subject matter expert does not respond or chooses not to participate, we will seek out another individual that is representative of a similar background.

4. Test of Procedures or Methods to be Undertaken

The subject matter expert interview protocol was developed by the contractor and the government study project team. The contractor then used internal SMEs to build initial summary questions and confirm that 60 minutes will be adequate time for the interview.

5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data

The study project team (Drs. Amanda Cash and Kathleen Sullivan) is comprised of doctoral-level researchers trained in quantitative and qualitative data analyses. The study team has extensive knowledge of the subject matter. This is an information gathering exercise among experts, which will provide important insight into their view of using evaluation results and evidence to drive decision-making. It is not designed to be representative of national opinion nor of the full potential range of expertise as this area is rapidly evolving.