Attachment M: 60-Day Federal Register Notice

Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices
check www.regulations.gov,
approximately two to three days after
submission to verify posting (except
allow 30 days for posting of comments
submitted by mail).
FOR FURTHER INFORMATION CONTACT: Mr.
Michael O. Jackson, Procurement
Analyst, Office of Acquisition Policy, at
telephone 202–208–4949 or via email to
[email protected].
SUPPLEMENTARY INFORMATION:
A. Purpose
To enable contracting officers to
verify that pass-through charges are not
excessive, the provision at 52.215–22
requires offerors submitting a proposal
for a contract, task order, or delivery
order to provide the following
information with its proposal: (1) The
percent of effort the offeror intends to
perform and the percent expected to be
performed by each subcontractor. (2) If
the offeror intends to subcontract more
than 70 percent of the total cost of work
to be performed—(i) The amount of the
offeror’s indirect costs and profit/fee
applicable to the work to be performed
by the subcontractor(s); and (ii) A
description of the value added by the
offeror as related to the work to be
performed by the subcontractor(s). (3) If
any subcontractor intends to
subcontract to a lower-tier subcontractor
more than 70 percent of the total cost of
work to be performed under its
subcontract—(i) The amount of the
subcontractor’s indirect costs and profit/
fee applicable to the work to be
performed by the lower-tier
subcontractor(s); and (ii) A description
of the value added by the subcontractor
as related to the work to be performed
by the lower-tier subcontractor(s).

sradovich on DSK3TPTVN1PROD with NOTICES

B. Annual Reporting Burden
Respondents: 4,638.
Responses per Respondent: 8.7.
Total Responses: 40,347.
Hours per Response: 2.
Total Burden Hours: 80,694.
Frequency of Collection: On Occasion.
Affected Public: Businesses or other
for-profit and not-for-profit institutions.
C. Public Comments
Public comments are particularly
invited on: Whether this collection of
information is necessary for the proper
performance of functions of the FAR,
and whether it will have practical
utility; whether our estimate of the
public burden of this collection of
information is accurate, and based on
valid assumptions and methodology;
ways to enhance the quality, utility, and
clarity of the information to be
collected; and ways in which we can
minimize the burden of the collection of

VerDate Sep<11>2014

18:00 May 26, 2016

Jkt 238001

information on those who are to
respond, through the use of appropriate
technological collection techniques or
other forms of information technology.
Obtaining Copies of Proposals:
Requesters may obtain a copy of the
information collection documents from
the General Services Administration,
Regulatory Secretariat Division (MVCB),
1800 F Street NW., Washington, DC
20405, telephone 202–501–4755. Please
cite OMB Control No. 9000–0173,
Limitations on Pass-Through Charges, in
all correspondence.
Dated: May 23, 2016.
Lorin S. Curit,
Director, Federal Acquisition Policy Division,
Office of Governmentwide Acquisition Policy,
Office of Acquisition Policy, Office of
Governmentwide Policy.
[FR Doc. 2016–12554 Filed 5–26–16; 8:45 am]
BILLING CODE 6820–EP–P

DEPARTMENT OF HEALTH AND
HUMAN SERVICES
Agency for Healthcare Research and
Quality
Agency Information Collection
Activities: Proposed Collection;
Comment Request
Agency for Healthcare Research
and Quality, HHS.
ACTION: Notice.
AGENCY:

This notice announces the
intention of the Agency for Healthcare
Research and Quality (AHRQ) to request
that the Office of Management and
Budget (OMB) approve the proposed
information collection project:
‘‘Eisenberg Center Voluntary Customer
Survey Generic Clearance.’’ In
accordance with the Paperwork
Reduction Act, 44 U.S.C. 3501–3521,
AHRQ invites the public to comment on
this proposed information collection.
DATES: Comments on this notice must be
received by July 26, 2016.
ADDRESSES: Written comments should
be submitted to: Doris Lefkowitz,
Reports Clearance Officer, AHRQ, by
email at [email protected].
Copies of the proposed collection
plans, data collection instruments, and
specific details on the estimated burden
can be obtained from the AHRQ Reports
Clearance Officer.
FOR FURTHER INFORMATION CONTACT:
Doris Lefkowitz, AHRQ Reports
Clearance Officer, (301) 427–1477, or by
email at [email protected].
SUPPLEMENTARY INFORMATION:
SUMMARY:

PO 00000

Frm 00022

Fmt 4703

Sfmt 4703

33675

Proposed Project
Eisenberg Center Voluntary Customer
Survey Generic Clearance
The Agency for Healthcare Research
and Quality (AHRQ) requests that the
Office of Management and Budget
(OMB) renew under the Paperwork
Reduction Act of 1995 AHRQ’s Generic
Clearance to collect information from
users of work products and services
produced by AHRQ’s John M. Eisenberg
Center for Clinical Decisions and
Communications Science (Eisenberg
Center). The Eisenberg Center is an
innovative effort aimed at improving
communication of findings to a variety
of audiences (‘‘customers’’), including
consumers, clinicians, and health care
policymakers. The Eisenberg Center
compiles research results into a variety
of useful formats for stakeholders.
This effort has the following goals:
(1) Conduct research into effective
communication of research findings in
order to improve the usability and rapid
incorporation of findings into medical
practice and decision making.
(2) Conduct research into effective
strategies for disseminating evidencebased products, tools, and resources to
consumers, clinicians, and other health
care professionals, and policymakers.
(3) Evaluate outcomes reported by
clinicians and other health care
professionals resulting from
participation in continuing medical
education (CME) initiatives and
activities.
(4) Conduct research into factors
associated with successful collaboration
between AHRQ and partnering
institutions and organizations in
synthesizing, translating, and
disseminating evidence-based research.
Clearance is being requested to cover
a three-year period in which differing
numbers of products and research
activities may be conducted during each
year. The collections proposed include
activities to assist in the development of
materials to be disseminated through
the Eisenberg Center and to provide
feedback to AHRQ on the extent to
which these products meet customer
needs. These materials include
summary documents that summarize
and translate the findings of research
reports for various decision-making
audiences, such as consumers,
clinicians, and policymakers. The
summaries are designed to help these
decision makers use research evidence
to maximize the benefits of health care,
minimize harm, and optimize the use of
health care resources. In addition, each
year, a unique research project will be
undertaken to study successful
approaches to disseminating AHRQ

E:\FR\FM\27MYN1.SGM

27MYN1

33676

Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices

sradovich on DSK3TPTVN1PROD with NOTICES

products in various health care settings
and clinical environments. Also, each
year, the Eisenberg Center will develop
one interactive decision aid for clinical
problems identified from selected
research reports. The intent is for the
decision aid to increase the decision
maker’s knowledge of the health
condition, options, and risk/benefits;
lead to greater assurance in making a
decision; increase the congruence
between values and choices; and
enhance involvement in the decision
making process. Information collections
conducted under this generic clearance
are not required by regulation and will
not be used to regulate or sanction
customers. Data collections will be
entirely voluntary, and information
provided by respondents will be
combined and summarized so that no
individually identifiable information
will be released.
This study is being conducted by
AHRQ through its contractor, Baylor
College of Medicine, pursuant to
AHRQ’s statutory authority to conduct
and support research on health care and
on systems for the delivery of such care,
including activities with respect to the
quality, effectiveness, efficiency,
appropriateness and value of health care
services and with respect to quality
measurement and improvement. 42
U.S.C. 299a(a)(1) and (2).
Method of Collection
The data collections listed below will
be implemented to achieve project
goals. Note: Assessments such as
interviews and surveys are here denoted
formative if conducted prior to product
development or determination of
dissemination channels; usability
testing or pretesting if conducted while
reviewing a draft product, proposed
dissemination approach, or other
proposed content/strategy; and
evaluation if conducted for summative
evaluation or to assess satisfaction after
the product has been in use or the
dissemination campaign, learning
activity, or other initiative undertaken.
Data collections will include the
following:
(1) Interviews for Product and
Decision Aid Development, Testing, and
Use. Individual interviews will be
conducted with clinical professionals,
patients, or other health care consumers,
or health policymakers. In some cases
focus groups may be substituted for
patient interviews. These formative and
pretesting/cognitive interviews will
allow for (1) collecting input from target
audiences regarding the development of
summary products and decision aids;
(2) determining if intended information
and messages are being delivered

VerDate Sep<11>2014

18:00 May 26, 2016

Jkt 238001

effectively through products that are
developed and disseminated through
the Eisenberg Center; (3) assessing
whether changes in topical knowledge
levels can be identified following
exposure to Eisenberg Center
informational or instructional products
or aids; (4) identifying product strengths
and weaknesses to facilitate
improvements that are practical and
feasible; and (5) assessing decision
support from the perspective of each
audience. In addition, the Eisenberg
Center will conduct a new research
project annually to inform the
enhancement of existing health
information products, beyond what is
currently being provided. The
accompanying assessments will likely
consist of interviews conducted with
target audience members and may be
integrated into the existing product
interviews discussed above.
(2) Interviews for Dissemination
Activities. Interviews will be conducted
with leadership and staff of health
systems, hospitals, and/or clinics in
which dissemination activities are
conducted to explore, prior to initiating
the project, those pathways holding the
greatest potential for successful uptake
of the AHRQ materials. Interviews will
be conducted again after project
conclusion with administrators and
product users (e.g., consumers,
clinicians) to assess success of
dissemination efforts, perceptions
around product access, challenges that
arose, and strategies to facilitate future
successful dissemination initiatives.
(3) Survey for Decision Aids.
Following delivery of the decision aid,
a user survey will be completed to
explore subjects’ impressions of the
tool, including ease of use, clarity of
presentation, length, balance of
information, rating of interactive
features, and overall satisfaction. Both
clinicians and patients/consumers will
be surveyed. For patients, the customer
satisfaction survey may include
decisional outcome measures (e.g.,
decisional conflict, desire for
involvement in decision-making),
measures of attitudes and self-efficacy,
and indicators of choice intention or
actual choice made. If the aid is
evaluated within a clinical context,
measures of physician-patient
interaction will also be considered.
Additionally, clinicians may be
interviewed about the impact of the aid
on decision making, clinical flow, and
patient outcomes.
(4) Survey for Summary Products
(initial, follow up). Very brief surveys
will be offered to health care
professionals, consumers, and
policymakers that use the online

PO 00000

Frm 00023

Fmt 4703

Sfmt 4703

summaries. Immediately upon accessing
the summaries, visitors will be asked to
complete a brief survey assessing for
whom they were seeking information,
how the product might be used, and an
email address for a follow-up survey.
Respondents will subsequently be sent
an email asking them to complete a
follow-up online survey assessing how
the information has been used, whether
it influenced health care practices, and
any barriers to use or suggestions for
improvement.
(5) Survey of Patient and Consumer
Advocacy Organizations. Each project
year, representatives from consumer and
patient advocacy organizations will be
invited to attend a meeting and
participate in ongoing activities to
facilitate engagement in AHRQ
systematic review, translation, and
dissemination activities. Surveys by
phone or online questionnaire will be
used to assess the quality of the inperson meeting and ongoing activities,
the impact and value of engaging with
AHRQ, the value of research and
translation products for the target
audiences, how partners and their
constituents are using the products, and
ways to make the products and
partnerships with AHRQ more useful
for partners and have a broader reach.
(6) Survey of AHRQ Partners. AHRQ,
through the Evidence-based Practice
Center (EPC) Program and Eisenberg
Center, works in partnership with
organizations when developing,
translating, and/or disseminating
research reports and related products.
AHRQ’s partners include developers of
clinical practice guidelines, payers,
other Government agencies, private
companies, consumer and patient
advocacy groups, and health care
systems. Surveys by phone or online
questionnaire, followed by targeted
interviews, will be used to assess the
impact and value of AHRQ research
products for the target audiences,
determine how partners are using the
products, and identify ways to make the
products and partnerships more useful
for partners and have a broader reach.
(7) CME Outcomes Survey. AHRQ
through the Eisenberg Center will offer
AMA PRA Category 1 CME credit for
certain products that it develops.
Clinicians wishing to claim credit must
complete an outcome assessment survey
delivered online two months after
completing the activity.
(8) Interviews and Surveys for
Dissemination Research Project. Each
project year the Eisenberg Center will
propose and conduct a unique research
project aimed at disseminating
products. As part of that project,
formative interviews and potentially

E:\FR\FM\27MYN1.SGM

27MYN1

33677

Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices
cognitive testing will be conducted with
consumers, clinicians, and
administrators from participating health
systems, hospitals, and/or clinics for
purposes of assessing current
dissemination initiatives, similar
products available to their consumers,
ways to optimize dissemination, and
other indicators as determined by the
project aims. These three audiences may
also be asked to complete follow-up
surveys and/or participate in interviews
to document project outcomes and
lessons learned from the study.
The information will be used to
develop, improve and/or maintain high
quality health care informational
products and services for the lay public
and health care professionals. Each
product previously developed by the
Eisenberg Center was proposed, drafted,
tested, and revised with heavy reliance
on data collected in a manner similar to
those approaches described in this
clearance. This includes data collected
at the formative stage when ideas for the
product and its information parameters
are being developed, through draft
testing and revisions, and finally
product implementation and evaluation
of its usefulness in practice. Work on
implementing and evaluating
dissemination strategies and approaches
will complement the development
activities in optimizing delivery to the
targeted audiences.
Estimated Annual Respondent Burden
Exhibit 1 shows the estimated total
burden for the respondents’ time to
participate in this research. These
estimates assume a maximum of 141
Summary products over 3 years with
separate products developed for
clinicians, policymakers, and
consumers.
Formative interviews, and in some
cases focus groups, will be used to
conduct needs assessment and will be

held with clinicians and consumers for
development of the products and
decision aids, and additionally with
policymakers for those products in
which policy recommendations are
applicable. Interviews will be
conducted with no more than 2,115
persons for product development, 180
persons for decision aid development,
and 180 persons for development of
dissemination initiatives over 3 years,
and each will last about 60 minutes.
Once the products are developed they
will be subjected to in-person or
telephone interviews for purposes of
usability and product testing with
clinicians, policymakers and
consumers. In-person/telephone
interviews will be conducted with about
2,115 persons for products and 180
persons for decision aids over 3 years
and will take about 60 minutes on
average. A second round of interviews
will be conducted only occasionally
with one or more of the targeted
populations if necessary due to
substantial product revisions. These
interviews may also be used to inform
product enhancements in relation to the
annual enhancement study. Because
these specifications cannot be
determined in advance, clearance is
being requested for two testing rounds
with every product and every audience.
Evaluation surveys will be conducted
with approximately 6,000
representatives across the targeted
audiences (i.e., consumer, clinician,
policymaker) for the health information
products and 2,400 persons who have
used the decision aids over the 3-year
period. The product surveys will take
about 5 minutes to complete, and the
decision aid surveys about 10 minutes.
A follow-up survey will be completed
for the product evaluations, which will
also last about 5 minutes, while a subset
of 180 of those having used the decision
aids will be asked to participate in a

follow-up evaluation interview lasting
an hour.
Those involved in or targeted by the
dissemination initiatives will be asked
to participate in evaluation interviews,
which will include up to 480 persons
completing interviews across the 3
project years. Note: Because the timing
of interviews with persons at the 6 total
partner organizations has not yet been
finalized, AHRQ is requesting that all
dissemination-related interviews be
approved for the first project year. For
simplicity, the interviews are presented
as annualized in Exhibits 1 and 2.
The unique dissemination research
project to be proposed and completed
annually will include 135 formative
interviews with consumers, clinicians,
and administrators, with each lasting 1
hour. Follow-up evaluation surveys and
interviews will be conducted with 360
and 180 persons, respectively.
AHRQ partners will be asked to
complete surveys and interviews in
relation to their prior or ongoing
collaborative work with AHRQ. These
will include 150 people completing
surveys and 60 follow-up interviews.
Similar types of surveys designed with
the goal of improving products and
expanding their research will be
completed by 90 representatives of
advocacy organizations across the 3
years, with each survey lasting about 10
minutes.
Clinicians that have completed CME
accrediting requirements and are
requesting CME credit will be asked to
complete a follow-up outcomes survey
two months following completion of the
online activity. These will be completed
by no more than 27,000 clinicians over
3 years and will require 5 minutes to
complete.
The total burden hours are estimated
to be 13,875 annually or 41,625 over 3
years. The total annual cost burden is
$237,604.

EXHIBIT 1—ESTIMATED ANNUALIZED BURDEN HOURS
Number of
respondents

sradovich on DSK3TPTVN1PROD with NOTICES

Form name
Product Formative Interviews ..........................................................................
Product Pretesting Interviews ..........................................................................
Product Evaluation Surveys ............................................................................
Dissemination Formative Interviews ................................................................
Dissemination Evaluation Interviews ...............................................................
Decision Aid Formative Interviews ..................................................................
Decision Aid Pretesting Interviews ..................................................................
Decision Aid Evaluation Interviews ..................................................................
Decision Aid Evaluation Surveys .....................................................................
Research Project Formative Interviews ...........................................................
Research Project Evaluation Surveys .............................................................
Research Project Evaluation Interviews ..........................................................
Partnership Evaluation Surveys ......................................................................
Partnership Evaluation Interviews ...................................................................

VerDate Sep<11>2014

18:00 May 26, 2016

Jkt 238001

PO 00000

Frm 00024

Fmt 4703

Sfmt 4703

Number of
responses per
respondent

705
705
2,000
40
120
60
60
60
800
45
120
60
50
20

E:\FR\FM\27MYN1.SGM

1
2
2
1
1
1
1
1
1
1
1
1
1
1

27MYN1

Hours per
response
1
1
5/60
1
1
1
1
1
10/60
1
10/60
1
10/60
1

Total
burden
hours
705
1,410
333
40
120
60
60
60
133
45
20
60
8
20

33678

Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices
EXHIBIT 1—ESTIMATED ANNUALIZED BURDEN HOURS—Continued
Number of
respondents

Form name

Number of
responses per
respondent

Total
burden
hours

Hours per
response

Advocacy Meeting Evaluation Surveys ...........................................................
CME Outcomes Surveys .................................................................................

30
9,000

1
1

10/60
5/60

5
750

Total ..........................................................................................................

13,875

na

na

3,830

* For the 3-year contract period, product formative interviews and product testing interviews will each comprise 300 consumers, 300 clinicians,
and 105 policymakers; product evaluation surveys will include 800 consumers, 800 clinicians, and 400 policymakers; dissemination-related formative interviews will include 40 health system/hospital/clinic administrators; dissemination-related evaluation interviews will include 40 consumers,
40 clinicians, and 40 administrators; formative interviews, pretesting interviews, and evaluation interviews for the decision aids will each include
30 consumers and 30 clinicians; evaluation surveys for the decision aids will include 400 consumers and 400 clinicians; formative interviews for
the annual dissemination research project will include 15 consumers, 15 clinicians, and 15 administrators; evaluation surveys for the research
project will include 50 consumers, 50 clinicians, and 20 administrators; evaluation interviews for the research project will include 20 consumers,
20 clinicians, and 20 administrators; the AHRQ partner surveys will include 50 partners; the AHRQ partner evaluation interviews will include 20
partners; the health advocates surveys will include 30 participants; and CME outcomes surveys will include 500 clinicians for each of 18 CME
activities.

EXHIBIT 2—ESTIMATED ANNUALIZED COST BURDEN
Number of
respondents

Form name

Total
burden
hours

Average
hourly wage
rate *

Total cost
burden

Product Formative Interviews ..........................................................................
Product Pretesting Interviews ..........................................................................
Product Evaluation Surveys ............................................................................
Dissemination Formative Interviews ................................................................
Dissemination Evaluation Interviews ...............................................................
Decision Aid Formative Interviews ..................................................................
Decision Aid Pretesting Interviews ..................................................................
Decision Aid Evaluation Interviews ..................................................................
Decision Aid Evaluation Surveys .....................................................................
Research Project Formative Interviews ...........................................................
Research Project Evaluation Surveys .............................................................
Research Project Evaluation Interviews ..........................................................
AHRQ Partner Evaluation Surveys ..................................................................
AHRQ Partner Evaluation Interviews ..............................................................
Advocacy Meeting Evaluation Surveys ...........................................................
CME Outcomes Surveys .................................................................................

705
705
2,000
40
120
60
60
60
800
45
120
60
50
20
30
9,000

705
1,410
333
40
120
60
60
60
133
45
20
60
8
20
5
750

a $54.81

e 91.66

$38,641
77,282
17,982
1,994
6,568
3,431
3,431
3,431
7,606
2,463
1,119
3,284
436
1,090
106
68,745

Total ..........................................................................................................

13,875

3,830

na

237,604

a 54.81
a 54.00
a 49.84
a 54.74
a 57.19
a 57.19
a 57.19
a 57.19
b 54.74
b 55.96
b 54.74
c 54.50
c 54.50
d 21.21

* National Compensation Survey: Occupational wages in the United States May 2014, ‘‘U.S. Department of Labor, Bureau of Labor Statistics.’’
a Based on the mean and/or weighted mean wages for various combinations of consumers (00–0000 all occupations), clinicians (29–1060 physicians and surgeons, 29–1062 family and general practitioners), and health policymakers (11–0000 management occupations, 11–3111 compensation & benefits managers, 13–1141 compensation, benefits & job analysis specialists, 11–9111 medical and health service managers, 13–
2053 insurance underwriters and 15–2011 actuaries).
b Based on the mean and/or weighted mean wages for various combinations of consumers (00–0000 all occupations), clinicians (29–1060 physicians and surgeons, 29–1062 family and general practitioners), and health system/hospital/clinic administrators (11–9111 medical and health
services managers).
c Based on the mean wages for AHRQ partners (25–1071 health specialties teachers, postsecondary, 11–1021 general and operations managers, 21–0091 health educators, 21–1093 social and human service assistants, 11–9111 medical and health services managers).
d Based on the mean wages for health advocacy organizations (21–1093 social and human service assistants [social advocacy organizations],
21–0091 health educators).
e Based on the mean wages for clinicians (29–1060 physicians and surgeons, 29–1062 family and general practitioners).

Exhibit 2 depicts the estimated total
cost burden associated with the
respondents’ time to participate in this
research. The cost burden is estimated
to be $237,604 annually.

sradovich on DSK3TPTVN1PROD with NOTICES

Request for Comments
In accordance with the Paperwork
Reduction Act, comments on AHRQ’s
information collection are requested
with regard to any of the following: (a)
Whether the proposed collection of
information is necessary for the proper
performance of AHRQ health care
research and health care information

VerDate Sep<11>2014

18:00 May 26, 2016

Jkt 238001

dissemination functions, including
whether the information will have
practical utility; (b) the accuracy of
AHRQ’s estimate of burden (including
hours and costs) of the proposed
collection(s) of information; (c) ways to
enhance the quality, utility, and clarity
of the information to be collected; and
(d) ways to minimize the burden of the
collection of information upon the
respondents, including the use of
automated collection techniques or
other forms of information technology.
Comments submitted in response to
this notice will be summarized and

PO 00000

Frm 00025

Fmt 4703

Sfmt 9990

included in the Agency’s subsequent
request for OMB approval of the
proposed information collection. All
comments will become a matter of
public record.
Sharon B. Arnold,
Deputy Director.
[FR Doc. 2016–12532 Filed 5–26–16; 8:45 am]
BILLING CODE 4160–90–P

E:\FR\FM\27MYN1.SGM

27MYN1