Evaluating the Implementation of Products to Help Learning Health Systems Use Findings from AHRQ Evidence Reports

Forms and Documents

Document	Type	Status	Availability
Form 4 Implementation check-ins:	Form and Instruction	New	Available
Form 4 Interview scheduling and other staff assistance	Form and Instruction	New	Available
Form 4 Review of materials prior to interviews	Form and Instruction	New	Available
Form 4 Review of materials prior to BOTH preliminary and follow-up interviews	Form and Instruction	New	Available
Form 3 Attachment C -- Remote Follow-up Interview Guide for Clinical Staff	Form and Instruction	New	Available
Form 2 Attachment B -- Remote Follow-up Interview Guide for LHS Leaders	Form and Instruction	New	Available
Form 1 Attachment A -- In-person Preliminary Interview Guide for LHS Leaders	Form and Instruction	New	Available
Supporting Statement Part A_ eb 04162020.docx	Supporting Statement A	Uploaded 2020-04-16	Available
Attachment E.docx	Supplementary Document	Uploaded 2020-04-15	Available

IC Document Collections

IC ID	Collection	Type	Status	Form
241356	Implementation check-ins:	Form and Instruction	New
241355	Interview scheduling and other staff assistance	Form and Instruction	New
241354	Review of materials prior to interviews	Form and Instruction	New
241352	Review of materials prior to BOTH preliminary and follow-up interviews	Form and Instruction	New
241351	Attachment C -- Remote Follow-up Interview Guide for Clinical Staff	Form and Instruction	New
241350	Attachment B -- Remote Follow-up Interview Guide for LHS Leaders	Form and Instruction	New
241348	Attachment A -- In-person Preliminary Interview Guide for LHS Leaders	Form and Instruction	New

ICR Details

OMB Control No: 0935-0251	ICR Reference No: 202004-0935-003
Status: Active	Previous ICR Reference No:
Agency/Subagency: HHS/AHRQ	Agency Tracking No:
Title: Evaluating the Implementation of Products to Help Learning Health Systems Use Findings from AHRQ Evidence Reports
Type of Information Collection: New collection (Request for a new OMB Control Number)	Common Form ICR:  No
Type of Review Request: Regular
OIRA Conclusion Action: Approved without change	Conclusion Date: 07/21/2020
	Date Received in OIRA: 04/16/2020
Terms of Clearance: AHRQ will ensure that respondents receive the information on the PRA burden statement, including where to address comments on the estimate of the burden and suggestions for reducing burden.

	Inventory as of this Action	Requested	Previously Approved
Expiration Date	07/31/2023	36 Months From Approved
Responses	308	0	0
Time Burden (Hours)	216	0	0
Cost Burden (Dollars)	0	0	0

---

Abstract: AHRQ’s Evidence-based Practice Center (EPC) Program has 20 years of experience in synthesizing research to inform evidence-based health care practice, delivery, policies, and research. The AHRQ EPC program is committed to partnering with organizations to make sure its evidence reports can be used in practice. Historically, most of its evidence reports have been used by clinical professional organizations to support the development of clinical practice guidelines or Federal agencies to inform their program planning and research priorities. To improve uptake and relevance of the AHRQ EPC’s evidence reports, specifically for health systems, AHRQ has funded the American Institutes for Research (AIR) to convene a panel of learning health systems (LHSs) to provide feedback to the AHRQ EPC program in developing and disseminating evidence reports that can be used to improve the quality and effectiveness of patient care. Even if an EPC evidence report topic addresses LHS-specific evidence needs, the density of the information in an evidence report may preclude its easy review by busy LHS leaders and decisionmakers. AHRQ understands that to facilitate use by LHSs, complex evidence reports must be translated into a format that promotes LHS evidence-based decision making and can be contextualized within each LHSs’ own system-generated evidence. Such translational products, for the purposes of this supporting statement, are referred to simply as “products”. The purpose of this information collection is to support a process evaluation of decisionmaking around, and use and implementation of, two such products into LHS decision processes, workflows, and clinical care. The evaluation has the following goals: 1. Document how LHSs prioritize filling evidence gaps, make decisions about using evidence, and implement tools to support and promote evidence use in clinical care. 2. Assess the contextual factors that may influence implementation success; associated implementation resources, barriers and facilitators; and satisfaction of LHS leaders and clinical staff. 3. Provide the AHRQ EPC program with necessary insights about the perspectives, needs, and preferences of LHS leaders and clinical staff as related to decisions and implementation of products into practice.

---

Authorizing Statute(s): US Code: 42 USC 299 Name of Law: Healthcare Research and Quality Act of 1999
  

Citations for New Statutory Requirements: None

---

Associated Rulemaking Information
RIN:	Stage of Rulemaking:	Federal Register Citation:	Date:
	Not associated with rulemaking

---

Federal Register Notices & Comments
60-day Notice:	Federal Register Citation:	Citation Date:
	85 FR 6194	02/04/2020
30-day Notice:	Federal Register Citation:	Citation Date:
	85 FR 20497	04/13/2020
Did the Agency receive public comments on this ICR? No

---

Number of Information Collection (IC) in this ICR: 7

IC Title	Form No.	Form Name
Attachment A -- In-person Preliminary Interview Guide for LHS Leaders	1	Attachment A -- In-person Preliminary Interview Guide for LHS Leaders
Attachment B -- Remote Follow-up Interview Guide for LHS Leaders	2	Attachment B -- Remote Follow-up Interview Guide for LHS Leaders
Attachment C -- Remote Follow-up Interview Guide for Clinical Staff	3	Attachment C -- Remote Follow-up Interview Guide for Clinical Staff
Review of materials prior to BOTH preliminary and follow-up interviews	4	Review of materials prior to BOTH preliminary and follow-up interviews – LHS leaders/decisionmakers
Review of materials prior to interviews	4	Review of materials prior to interviews – clinical staff
Interview scheduling and other staff assistance	4	Interview scheduling and other staff assistance
Implementation check-ins:	4	Implementation check-ins:

---

ICR Summary of Burden

	Total Approved	Previously Approved	Change Due to New Statute	Change Due to Agency Discretion	Change Due to Adjustment in Estimate	Change Due to Potential Violation of the PRA
Annual Number of Responses	308	0	0	308	0	0
Annual Time Burden (Hours)	216	0	0	216	0	0
Annual Cost Burden (Dollars)	0	0	0	0	0	0

Burden increases because of Program Change due to Agency Discretion: Yes

Burden Increase Due to: Miscellaneous Actions

Burden decreases because of Program Change due to Agency Discretion: No

Burden Reduction Due to:

Short Statement: This is a new data collection.

---

Annual Cost to Federal Government: $230,615

Does this IC contain surveys, censuses, or employ statistical methods? No

Does this ICR request any personally identifiable information (see OMB Circular No. A-130 for an explanation of this term)? Please consult with your agency's privacy program when making this determination.     Yes

Does this ICR include a form that requires a Privacy Act Statement (see 5 U.S.C. §552a(e)(3))? Please consult with your agency's privacy program when making this determination.     No

Is this ICR related to the Affordable Care Act [Pub. L. 111-148 & 111-152]? No

Is this ICR related to the Dodd-Frank Wall Street Reform and Consumer Protection Act, [Pub. L. 111-203]? No

Is this ICR related to the American Recovery and Reinvestment Act of 2009 (ARRA)? No

Is this ICR related to the Pandemic Response? No

---

Common Form ICR:  No

---

On behalf of this Federal agency, I certify that the collection of information encompassed by this request complies with 5 CFR 1320.9 and the related provisions of 5 CFR 1320.8(b)(3).

The following is a summary of the topics, regarding the proposed collection of information, that the certification covers:

(a) It is necessary for the proper performance of agency functions;

(b) It avoids unnecessary duplication;

(c) It reduces burden on small entities;

(d) It uses plain, coherent, and unambiguous language that is understandable to respondents;

(e) Its implementation will be consistent and compatible with current reporting and recordkeeping practices;

(f) It indicates the retention periods for recordkeeping requirements;

(g) It informs respondents of the information called for under 5 CFR 1320.8 (b)(3) about:

(i) Why the information is being collected;

(ii) Use of information;

(iii) Burden estimate;

(iv) Nature of response (voluntary, required for a benefit, or mandatory);

(v) Nature and extent of confidentiality; and

(vi) Need to display currently valid OMB control number;

(h) It was developed by an office that has planned and allocated resources for the efficient and effective management and use of the information to be collected.

(i) It uses effective and efficient statistical survey methodology (if applicable); and

(j) It makes appropriate use of information technology.

If you are unable to certify compliance with any of these provisions, identify the item by leaving the box unchecked and explain the reason in the Supporting Statement.

Certification Date: 04/16/2020

---