sub study for Fall 2022 Mixed Meeting Format Reviews

Request for Approval under the “Generic Clearance for NIH Citizen Science and Crowdsourcing Projects”

(OMB#: 0925-0766 Exp., date: 04/2023)

TITLE OF INFORMATION COLLECTION: 2022 Survey to Assess Review Quality and Mixed Meeting Format Reviews Among NIH Reviewers

PURPOSE: NIH depends on an objective and robust peer review process to ensure that all NIH grant applications receive fair, independent, expert, and timely reviews that are free from inappropriate influences. To help assess and maintain the quality and efficiency of peer review, NIH has developed a new process that includes, among other measures, surveys to hear reviewers’ opinions about the quality of the review in which they participated in. Because of the COVID-19 pandemic NIH had to shift all their review meetings online. For the fall 2022 review meetings, CSR is transitioning back to in-person review meetings and is holding 1/3 of its standing study sections, small business, and fellowship review meetings in person, with the expectation that the remaining 2/3 of such meetings will be held in-person later in the year. This will be CSRs first opportunity to hold a substantial amount of its regular review meetings both virtually and in-person at the same time. The purpose of this data collection is to assess the quality of the review and determine whether there was any impact on the quality of the review due to the meeting format. Moreover, the survey will help assess whether there has been any significant change in the quality of virtual review meetings given CSRs latest efforts to enhance virtual reviews, and since many reviewers are now more experienced and more comfortable with virtual review meetings (since our summer 2020 survey). Feedback from reviewers will also help NIH further understand reviewers’ attitudes and experiences with transitioning back to in-person review meetings and on how virtual and in-person review meetings can be improved to ensure high quality reviews and reviewer satisfaction.

DESCRIPTION OF RESPONDENTS: Respondents will be approximately 5,000 NIH grant reviewers serving on fall 2022 review meetings. Most of these individuals are research scientists who work at academic universities across the U.S.

TYPE OF COLLECTION: (Check one)

[ ] Data Catalogue [ ] Repository of Tools and Best Practices

[ ] Recommendations of scientific reviewers [ ] Resources

[ ] Call for Nominations [X] Other: Opinions of Review Experience

CERTIFICATION:

I certify the following to be true:

1. The collection is voluntary.

2. The collection is low-burden for respondents and low-cost for the Federal Government.

3. The collection is non-controversial and does not raise issues of concern to other federal agencies.

4. Information gathered will not be used for the purpose of substantially informing influential policy decisions.

5. The collection is targeted to the solicitation of opinions from respondents who have experience with the program or may have experience with the program in the future.

Name: Hope Cummings________________________________________________

To assist review, please provide answers to the following question:

Personally Identifiable Information:

1. Is personally identifiable information (PII) collected? [ ] Yes [X] No

2. If Yes, is the information that will be collected included in records that are subject to the Privacy Act of 1974? [ ] Yes [ ] No

3. If Applicable, has a System or Records Notice been published? [ ] Yes [ ] No

Gifts or Payments:

Is an incentive (e.g., money or reimbursement of expenses, token of appreciation) provided to participants? [ ] Yes [X] No

ESTIMATED BURDEN HOURS and COSTS

Category of Respondent	No. of Respondents	No. of Responses per Respondent	Time per Response (in hours)	Total Burden Hours
NIH CSR Grant Reviewers	5,000	1	5/60	417
Totals		5,000		417

COST TO RESPONDENT

Category of Respondent	Total Burden Hours	Hourly Wage Rate*	Total Burden Cost
Individuals	417	$38.81	$16,183.77
Totals			$16,183.77

*The wage rate was obtained from https://www.bls.gov/oes/2021/may/oes_nat.htm#19-0000

FEDERAL COST: The estimated annual cost to the Federal government is 2,945.44

Staff	Grade/Step	Salary*	% of Effort	Fringe (if applicable)	Total Cost to Gov’t
Federal Oversight
Health Scientist Administrator	GS-14/6	147,272	2%		2,945.44
Contractor Cost					N/A
Travel					N/A
Other Cost					N/A
Total					2,945.44

*the Salary in table above is cited from https://www.opm.gov/policy-data-oversight/pay-leave/salaries-wages/salary-tables/pdf/2022/DCB.pdf

If you are conducting a focus group, survey, or plan to employ statistical methods, please provide answers to the following questions:

The selection of your targeted respondents

1. Do you have a customer list or something similar that defines the universe of potential respondents and do you have a sampling plan for selecting from this universe? [X] Yes [ ] No

If the answer is yes, please provide a description of both below (or attach the sampling plan)? If the answer is no, please provide a description of how you plan to identify your potential group of respondents and how you will select them?

The customer list will consist of individuals who served the NIH as reviewers on select review meetings for the fall of 2022. The rosters from the review meetings will be used as the participant list. Most of these individuals are research scientists who work at academic universities across the U.S.

Administration of the Instrument

1. How will you collect the information? (Check all that apply)

[X] Web-based or other forms of Social Media

[ ] Telephone

[ ] In-person

[ ] Mail

[ ] Other, Explain

2. Will interviewers or facilitators be used? [ ] Yes [X] No

Please make sure that all instruments, instructions, and scripts are submitted with the request.

5