OMB approval memo

FDA DOCUMENTATION FOR GENERIC CLEARANCE

“TESTING COMMUNICATIONS ON DRUG PRODUCTS”

(0910-0695)

TITLE OF INFORMATION COLLECTION: Exploring healthcare providers’ practices, perspectives, and experiences prescribing and co-prescribing benzodiazepines and opioid analgesics.

DESCRIPTION OF THIS SPECIFIC COLLECTION

1. Statement of Need

The Food and Drug Administration’s Center for Drug Evaluation and Research (CDER) has an ongoing responsibility to communicate about the medical products it approves or authorizes for use in medical emergencies (Sections 564, 564A, and 564B of the Federal Food, Drug, and Cosmetic Act [FD&C Act].

The purpose of FDA’s qualitative social science research study through a contract with Lake Research Partners (LRP) is to enhance understanding regarding healthcare providers’ (HCPs’) prescribing of benzodiazepines and their co-prescription with opioids. The understanding to be gained from this study is necessary to inform FDA’s communication decisions, especially given that benzodiazepine prescribing has continued to be problematic despite FDA warnings about the serious risks associated with these medicines, including abuse, addiction, physical dependence, and withdrawal reactions alone and especially with concomitant use of prescription opioids, ¹ and advising healthcare professionals to prescribe both these medications only in patients for whom alternative treatment options are inadequate and then only at the lowest dosages and duration possible.² However, studies have shown that co-prescribing of these two drug classes is still prevalent, putting patients using both at higher risk of visiting an emergency room, being admitted to a hospital, or dying from a drug-related emergency.

As a result, FDA will conduct this study employing online focus groups followed by online individual in-depth interviews (IDIs) with healthcare providers (HCPs) across the United States to better understand their motivations, decision-making, perspectives, experiences, and practices related to prescribing benzodiazepines alone and in conjunction with opioids.

2. Intended Use of Information

This qualitative study is exploratory and will offer the opportunity for HCPs to provide diverse and in-depth input and reactions in their own words about a variety of topics of FDA interest, including how HCPs think and talk about risks and benefits of prescribing and co-prescribing the widely used benzodiazepine and opioid medications, misperceptions they may have, and barriers and challenges they face. The study will also help FDA identify trends and consistencies in participants’ knowledge and decision-making processes and help ensure the Agency has elicited an appropriate range of opinions, beliefs and perceptions about benzodiazepine and opioid prescribing. The information and insights gained from this study will enhance FDA’s understanding, allow it to determine whether and/or what additional areas of research may be needed, and help inform communication decisions in the shorter term. Thus, this work is critical to strengthening FDA’s ability to fulfill its public health mission³ by raising awareness of and better educating HCPs about benzodiazepine and opioid prescribing and the risks associated with co-prescribing these medications.

3. Description of Respondents:

Respondents for both the focus groups and the subsequent IDIs will be HCPs (physicians, nurse practitioners [NPs] and physician assistants [PAs]) who have prescribed benzodiazepines either alone or in conjunction with opioids in the past 90 days and to an average of at least five (5) patients a month. Participants will be recruited from the following medical fields, which were selected based on data showing they had the highest levels of benzodiazepine and/or opioid prescribing levels:

• Primary Care (Family Practice, Internal or General Medicine, Osteopathic Medicine, General Practice, and Geriatric Medicine)

• Specialists in Mental Health (Psychiatry, Geriatric Psychiatry, and Psychology)

• Specialists in Neurology

• Specialists in Emergency Medicine

• Specialists in Pain Medicine

• Specialists in Addiction Medicine

In addition to the medical fields of practice noted above, participants will be recruited to reflect a mix of professional characteristics, including number of years in practice, extent of opioid and benzodiazepine prescribing, and practice location (US Census 9-way region and urban/suburban/rural). We will also recruit participants based on personal demographic characteristics, including gender (goal will be to have at least half of participants be female), race, ethnicity (goal will be to have at least a third of participants who are HCPs of color), and age. HCPs who participate in the focus groups will not be allowed to participate in the IDIs.

Focus Group Participants

In total, we expect 144 participants to participate across the 16 focus groups. We will recruit 12 HCPs to achieve the desired goal of 9 participants per group. The groups will be segmented by type of provider and by specialty, with 12 groups conducted with primary care physicians (PCPs), and two each with PAs and NPs. (See Focus Group Recruitment Screener in Appendix A.)

The 12 physician focus groups will be segmented as follows:

• Five (5) focus groups with PCPs who have NOT prescribed buprenorphine or other opioid medications used to treat opioid use disorder (MOUD).

• One (1) focus group with PCPs who have prescribed MOUD.

• Six (6) focus groups with physician specialists:

  • 1 focus group of Mental Health specialists who have NOT prescribed MOUD.

  • 1 focus group of Psychiatrists who have prescribed MOUD.

  • 1 focus group of Neurology specialists who have NOT prescribed MOUD.

  • 1 focus group of Emergency Medicine specialists who have NOT prescribed MOUD.

  • 1 focus group of Pain Medicine specialists, some of whom may have prescribed MOUD in the past 3 months.

  • 1 focus group of Addiction Medicine specialists who have prescribed MOUD in the past 3 months.

• Two (2) focus groups with PAs and NPs:

  • 1 focus group with PCPs who have NOT prescribed MOUD.

  • 1 focus group with a mix of specialists across Mental Health, Neurology, Emergency Medicine, Pain, and Addiction Medicine specialties who have NOT prescribed MOUD.

In-Depth Interview Participants

Thirty (30) IDIs among HCPs who meet the same recruitment characteristics as the focus groups will be conducted following the groups. The IDIs, which will be informed by the findings gained from the groups, will consist of 24 interviews with PCPs and three (3) each with PAs and NPs. Two (2) additional each of PCPs, PAs and NPs will be recruited to ensure a total of 30 interviews (in anticipation of potential no-shows and schedule changes). (See Interview Recruitment Screener in Appendix B.)

The 24 physician IDIs will consist of:

• 12 with PCPs, three (3) of which will be with those who have prescribed MOUD.

• 12 interviews with specialists:

  • Four (4) with Mental Health specialists, two (2) of which will be with psychiatrists who have prescribed MOUD.

  • Two (2) each with specialists in Neurology, Emergency Medicine, Pain Medicine and Addiction Medicine.

  • Three (3) each with PAs and NPs, including two (2) among those who practice in primary care and one (1) with a Mental Health specialist.

4. Date(s) for Research to be Conducted:

Scheduling of the 16 focus groups began within two (2) days after approvals were obtained from OMB, which was received on 9/23/2021 (0910-0695; ICR# 202101-0910-007), and FDA’s Office of the Chief Scientist Human Subjects Protection Officer (OCSHSPEO), and were expected to be completed within eight (8) weeks (4 weeks beyond recruitment). However, despite extensive recruiting efforts that occurred in October and November 2021, several focus groups had to be canceled due to HCPs, particularly physicians and PAs in medical specialties, refusing to participate because of incentive rates they felt were too low. Due to these significant challenges, the remaining three focus groups required to fulfill the N=144 participants. This will, by necessity, significantly delay the timeline for completion of these groups (expected to be completed by mid-November 2021) and this phase of the research, originally scheduled for completion by April 15, 2022. The wait for pre-OMB review of the updated package requesting increased incentives submitted on December 10, 2021, and review and approval of this newest package and memo containing additional pre-OMB-required updates, will delay completion of these remaining focus groups to at least the end of April, putting completion of this phase of the research following qualitative data analysis and reporting to July 2022. The IDIs will be conducted following the data analysis and reporting of the focus groups.

5. How the Information is Being Collected

Sixteen (16), 90-minute virtual focus groups will be conducted followed by thirty (30), 60-minute virtual IDIs. For each focus group we will recruit 12 HCPs for the desired turnout of nine (9) participants. In total, we expect 144 participants to participate across the 16 focus groups. These groups will be segmented by type of provider and by specialty as noted previously. The 30 IDIs among HCPs nationwide who meet the same characteristics as those in the focus groups (but who did not participate in the groups) will be conducted following the data analysis and reporting of the focus groups. The IDIs will include 24 interviews with PCPs, and three (3) each with PAs and NPs. To fulfill the goal of 30 interviews, we will over-recruit by two physicians, two PAs, and two NPs (to account for schedule changes and no-shows).

The topics explored in the focus groups and IDIs will be similar; however, there will be fewer questions posed to respondents in the IDIs, which will focus on the specific topics about which we want to gather additional information based on the findings and insights generated in the focus groups. Focus group dynamics animate discussion and stimulate creativity and broader responses among participants, while IDIs allow each respondent to discuss topics one-on-one with an interviewer and in much greater detail, typically resulting in increased clarity and greater depth of understanding. Thus, these two methods build on each other when used sequentially, providing a more rigorous methodology and more robust findings to inform FDA understanding and future communications.

The Schlesinger/2020Research will recruit participants for the focus groups and IDIs. They will first send an initial invitation and then a confirmation email to qualified participants. This correspondence is identical for both the focus groups and IDIs (See Recruitment Outreach for Focus Groups and Interviews in Appendix C). Schlesinger/2020Research has recruited for many health care professional groups and interviews in the past, and their US panel includes more than 39,500 physicians, PAs, and NPs. All participants will be required to sign an electronically administered informed consent form prior to participation in the study. With their consent, we will audio record each session, produce a written transcript of the discussion, and use the transcript to supplement the team’s notes. No participants will be allowed to participate in the study without a signed consent form. Both the focus groups and interviews will begin with an introduction, including a review of some of the key information from the consent form, and ground rules.

Some areas to be explored through the semi-structured moderator and interview guides include:

• General prescribing practices

• Perceptions about benefits

• Decision-making related to benzodiazepine and opioid prescribing

• Prescribing experiences and practices, beliefs, and concerns

• Consideration of alternatives, tapering, or discontinuation

• Knowledge and use of FDA warnings and other clinical guidelines

• Provider-patient communication

• Resource and training needs

(See Focus Group Moderator Guide in Appendix D and the Individual Interview Guide in Appendix E.)

For each 90-minute focus group, one of the two professional, trained moderators with extensive experience who are working on this project will lead the discussion from her computer and a separate note-taker and logistics coordinator will assist. Once connected, the participants and moderator will be able to see one another on screen. The moderator will lead the discussion using a semi-structured moderator guide that ensures consistency in major topics but allows flexibility in probing each group depending on the discussion. The note-taker, who will not be visible to participants, will observe and document the major themes that surface in each session. FDA staff will be able to observe unobtrusively and will not be visible to or able to interact directly with the participants.

Both the focus groups and the IDIs will be conducted online using Schlesinger/2020Research as the virtual platform. Schlesinger/2020Research is user-friendly for participants and was selected because of the following capabilities:

• It will allow the research team to gather insights in real time using webcam technology and video streaming.

• It provides technical assistance to participants, researchers and observers before the live session begins to ensure participants are prepared. Schlesinger/2020Research will conduct “tech rehearsals” with participants 15-30 minutes prior to each focus group and will remain online and available throughout the duration of the group to address any technical issues by participants, researchers, or observers.

• It has a virtual ‘backroom’ to which members of the FDA and LRP research team can observe in real time and provides a “chat” function on which they can interact in writing with the moderator, e.g., to ask clarifying questions.

• It produces both high-resolution video and audio recordings available immediately after each group and interview ends. Verbatim, time-stamped transcripts of each focus group and interview will be developed and linked to each video recording so it is easy to move back-and-forth between the transcripts and recordings. An electronic copy of the transcripts shall be submitted to the FDA Project Manager within two (2) weeks following completion of the 16 focus groups and two (2) weeks following completion of the 30 interviews.

• It has security measures in place to prevent data breaches, including project-specific links, waiting rooms monitored by an assigned technician to ensure the correct actors (moderator, observers, and participants) have access to the study, and limited screen sharing capabilities.

• It will also act as a video portal to the research team, enabling LRP analysts to view, download files and transcripts, and enable search capabilities to find clips within each video recording.

6. Confidentiality of Respondents:

Each participant will receive a link to an online consent form at the time of recruitment and scheduling for the focus groups (see Focus Group Consent Form in Appendix F) and interviews (see Individual Interview Consent Form in Appendix G). Participants will electronically sign the programmed version of the consent form so that a date/time stamp of consent is collected by Schlesinger/2020Research.

Schlesinger/2020Research will store screening and consent data on a password-protected computer for no more than 90 days to invite respondents and send them reminder emails and phone calls the day before their scheduled focus group. Only Schlesinger/2020Research staff assigned specifically to this project will have access to this information. Neither LRP nor FDA will have access to the consent forms or the full names or any other personally identifiable information (PII) about the participants.

To ensure the required participant diversity, Schlesinger/2020Research will provide LRP with the screening data for the participants via daily updates, which will include first names and last initials only, and answers to the study’s recruitment screening questions. The daily updates will not include contact information or other PII. Only LRP and FDA staff assigned specifically to this project will have access to the daily recruitment grids. PII and contact information will not be provided to the FDA at any point throughout the study. This information will be removed from all documents shared with FDA, including, but not limited to, recruitment information, audio and video recordings, transcripts, and reports and raw data.

At the beginning of each focus group and IDI, the moderators will reiterate the information contained in the informed consent that participants previously signed, and participants will be instructed to use only their first names. Participants will also be told that no full names or any PII will be used in any notes, reports, or subsequent materials created as part of this research study, that only anonymized information reported in aggregate will be provided to the FDA, and that participants’ information will be kept secure to the extent permitted by law. Participants will be asked not to share anything discussed during the group with anyone else.

Schlesinger/2020Research also has security measures in place to prevent data breaches, including project-specific links that are provided only to approved participants, waiting rooms monitored by an assigned technician to ensure the correct actors (moderator, observers, and participants) have access to the study, and limited screen sharing and chatting capabilities during the focus group or IDI.

Audio and video recordings and all other study materials and files will be stored on password-protected servers at LRP and FDA accessible only to the research team assigned to this study. LRP and FDA will retain these files for 10 years and then delete them. LRP will check all transcripts, audio/video files, reports, and other materials for PII and remove it before providing the files and documents to FDA.

7. Amount and Justification for Any Proposed Incentive

The respondents for this national study are physicians, PAs and NPs in a variety of specialties who are difficult to recruit, in part because they have demanding schedules working long and/or irregular schedules, including responding to emergencies, so they may not be able to attend research focus groups, particularly at a scheduled time or may be no-shows even when they do agree to participate. Increasing this difficulty is that this study also very specific recruitment requirements based on such factors as area of specialization, prescribing certain drugs or a combination of drugs in a typical month to at least five patients, further limiting the number of providers who will qualify. In addition, others will be ineligible because they have worked for a pharmaceutical company or have ever consulted with one, or any US Department of Health and Human Services agency or entity.

Little academic research is available that provides guidance on appropriate incentive levels for physicians and/or other HCPs for national online qualitative research involving lengthy and detailed discussions, and we were unable to identify any studies more directly related to projects like this one in which we are recruiting focus group participants for a government agency with the findings intended to inform public policy and regulatory decision-making. However, we found one study that is sufficiently rigorous and recent to provide insight for this study related to the reasons healthcare professionals, specialists in particular, might be conditioned to expect higher incentive levels for participating in studies. This is especially relevant given so many studies must rely on obtaining participants through companies that spend significant time, effort, and money to recruit those who will agree to be involved in their participant panels. Although typically developed for use for commercial purposes, government researchers are increasingly forced to rely on these companies’ panels because of the lack of staff and funding to cover the costs of doing it internally, and the ability to use these existing panels saves the agencies and US tax-payers significant expense.

This study⁴ was conducted online among primary care physicians, cardiologists, neurologists, oncologists, and orthopedists. Of the 625 physicians who clicked on the link via the survey invitation, 425 completed the survey (a 68% completion rate) to test the incentives needed for willingness to participate in five different types of research, ranging from a 15-minute quantitative survey to a 60-minute qualitative interview. For each study type, respondents were shown a description of the study they’d be participating in, one of the five incentive amounts (randomized), and asked if they would participate. If they responded “yes”, they were shown a lower amount, if they said “no”, they were shown a higher amount.

The authors provided an estimate of appropriate incentives for specialists and PCPs sufficient to assure an average 75% response rate for an individual qualitative interview. However, this must be qualified by the nature of the research since response rates vary by specialty, topic, and many other factors. Based on the authors’ findings, the estimates of appropriate incentives for 90-minute discussions with specialists can be extrapolated to range from $382.50 to $515.70 based on the specialist type (e.g., the incentive for a 90-minute discussion with a neurologist is estimated at $397.80, the incentive for a 90-minute discussion with an orthopedist is estimated at $416.70, and the incentive for a 90-minute discussion with an oncologist is estimated at $515.70). Note that the amounts from this 2019 study have not been adjusted for inflation, which is projected to be as much as 8% in 2022 alone.

Thus, the estimates drawn from this research exceed our initially proposed incentives of $275 for physicians and $250 for NPs and PAs for their participation in the 90-minute focus groups, and $225 for physicians and $200 for NPs and PAs for their participation in the 60-minute individual depth interviews and also exceed the $375 increased incentive rate we are requesting for the remaining specialists for the 90-minute focus groups.

In addition, these incentives are lower than the $300 incentive that OMB approved for the previous FDA research project titled “Testing Communications on Biological Products” approved in 2014 under generic clearance 0910-0687. In addition, the FDA was allowed to increase this incentive an additional $100 if specialists declined to participate based on their stated reason that the $300 incentive is too low. A similar tiered strategy was approved by OMB in 2017 for the Centers for Disease Control and Prevention’s “Formative Research to Develop HIV Social Marketing Campaigns for Healthcare Providers” (OMB No. 0920-1182). Similarly, specialists received $250 incentives for participating in a 60-minute focus group as part of FDA’s “Generic Drug Substitution in Special Populations” study (OMB No. 0910-0677; 2017) and in 60-minute telephone interviews for “Studies to Enhance FDA Communications Addressing Opioids and Other Potentially Addictive Pain Medications” (OMB No. 0910-0695; 2016), an incentive rate that would have amounted to $375 for 90 minutes.

The initially proposed incentives were based on the principles set forth in OMB’s guidance on factors that may justify provision of an incentive. These factors include the need to (1) assure data quality by using incentives to increase ability to recruit the diversity of desired subgroups and reduce sample bias, (2) compensate for respondent burden, (3) facilitate respondent recruitment when the target group is difficult to recruit, and (4) improve coverage of specialized respondents or rare groups. All these factors are involved in the current FDA study among HCPs. However, the approved incentive amounts of $250/$225 for physicians and PAs has been a significant barrier to the successful recruitment of specialists practicing in the medical specialties necessary for this study and meeting the project’s required sociodemographic diversity. Recruiters have documented responses from providers indicating that they will not respond to the invitation and screening for the group because of the low incentive. Two example responses are shown below. Other potential recruits have responded to the initial outreach stating, “Increase the honorarium” or have cancelled their participation after initially agreeing to participate saying, “My time is worth more.” Even after we increased the prominence of FDA’s involvement in the notification that the study is being sponsored by the U.S. Food and Drug Administration in the first line of the invitation, which also specifically states the incentive amount for the 90-minute length of time, potential participants did not respond to the invitation to the participate. This may be because the target population of HCPs believes that taking on additional work in their already busy schedules should be more highly valued and/or they may have become conditioned to receive higher incentives for their time spent participating in research studies, especially those funded by private companies. This is reflected in both firsthand experiences recruiting for this project, the literature (as described above), and in the examples described below showing comparable, current and recently completed studies with similar HCP populations receiving incentive rates of $350 achieved significantly higher response rates over significantly shorter recruitment periods of two or three weeks than has been achieved in this FDA project under current incentives of $275 and $250.

Example One

From: [PII REMOVED FOR EMERGENCY MEDICINE SPECIALIST]
Sent: Tuesday, November 16, 2021 9:31 AM
To: Rebecca Hanner <[email protected]>
Subject: Re: You’re Invited: Benzodiazepine and Opioid Medications research happening Between 09-Nov-2021 and 07-Dec-2021

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.

Thanks for the opportunity but for a 1.5 hours, I would need to get $400 to make it feasible.  Thanks again.

[PII REMOVED]

Dear [PII REMOVED],

We are currently offering $275 to our members who qualify and complete a research study sponsored by the FDA on Benzodiazepine and Opioid Medications.

Pre-Qualification Questionnaire: 
If you qualify for this study, we will contact you within the next 48 hours to verify your participation. 
Please click on the following link or copy and paste it into your internet browser bar to see if you qualify.

Link: https://www.survey321.com/1f9vy

Study Honorarium:  $275.00

Study Location: Online Focus Group

Study Date(s): Between 09-Nov-2021 and 07-Dec-2021

Study Duration: 90 minutes

Topic: Benzodiazepine and Opioid Medications

Reference #: TIG21800905

Example Two

From: [email protected] <[email protected]>
Sent: Tuesday, November 30, 2021 6:51 PM
To: Rebecca Hanner <[email protected]>
Subject: Job Alert - Respondent Cancelled: TIG21800905

The following respondent cancelled from the Confirmation Page:

Job Number:	TIG21800905
Event Date:	Wednesday, December 1, 2021
Event Time:	6:00 PM (EST)
Topic:	Benzodiazepine and Opioid Medications
Respondent:	[PII OF MENTAL HEALTH HCP REMOVED]
Cancelled On:	11/30/2021 9:50:32 PM(EST)
Reason:	I feel the honorarium of $275 for 90 minutes of my professional time is too little and unfair

Specifically, we have struggled to recruit mental health physician specialists who have not prescribed MOUD/buprenorphine, physician specialists in neurology who have not prescribed MOUD/buprenorphine, and PAs in the required mix of specialties who have not prescribed MOUD/buprenorphine to 1) respond to the initial outreach, 2) complete the screening survey, and 3) agree to participate. Inclusion of all of these specialists is necessary for FDA to collect the diversity of opinions required for the successful implementation of this study. Response rates from potential participants in these groups, particularly the mental health specialties, has been dismal despite extensive outreach; as of November 30, 2021, we were able to recruit only seven of the 36 required specialists at the current incentive amount as follows: 0/12 mental health, 3/12 neurology, and 4 PA specialist mix.

We were able to recruit and complete all of the required focus groups among HCPs practicing in primary care and the specialties of pain medicine, emergency medicine, and addiction medicine. However, despite delaying, rescheduling, and ultimately canceling the remaining three groups among specialists, we have been unable to recruit enough of those in these three groups to successfully conduct research among each cohort. As a result, completion of data collection, which was planned to occur within 8 weeks of the start of recruitment, i.e., no later than the first week of December, has been delayed. By necessity, this has impacted data analysis, including of the required comparisons across all 16 groups, as well as reporting of the findings. This has prevented the research team from meeting the timelines required under the contract.

HCP Type	# Reached	# Responded to Outreach	% Response Rate	Qualified	Not qualified	Did not complete screening	Agreed to Participate
All Mental Health	6272	298	4.8%	49	197	52	0/12
Pain Medicine	574	48	8.3%	22	23	3	17/24 (filled & 2 FGs completed)
Neurology	4005	16	.04%	5	8	3	3/12
Emergency Medicine	2845	55	2.0%	18	30	7	17/24 (filled & 2 FGs completed)
Addiction Medicine	125	25	.20%	12	12	1	12/12 (filled & 1 FG completed)
Specialist PAs	773	57	.07%	14	39	4	4/12
Primary Care	15,668	783	5.0%	129	615	39	72/72 (filled & 6 FGs completed)

Examples of comparable, current and recently completed recruitment by Schlesinger/2020Research conducted among HCPs in the same medical specialties achieved significantly higher response rates over a significantly shorter recruitment periods of two or three weeks than has been able to be achieved in this FDA project. Recruitment data shows is likely attributable to the higher incentives being offered in other autumn 2021 studies. For example:

• In one recent study, whose recruitment period was September 9^-24, psychologists, primary care physicians, NPs, and PAs were recruited for just 60 minutes of their time and the response rate was 15.5% with incentive amounts of $350 for psychologists and $250 each for NPs, PAs, and PCPs.

• For another study (recruitment period September 8-30) recruiting neurologists for 60 minutes of time, the response rate was 14.3% with a $350 incentive.

• Another study (recruitment period October 18^-26) recruiting emergency medicine physician specialists for 60 minutes of time achieved a response rate of 20% with an incentive of $350.

Thus, to obtain the needed specialists and ensure the required sociodemographic diversity, FDA proposes increasing the incentive for specialists to increase the likelihood they will agree to participate, actually attend the real time research groups and interviews, and provide their focused attention and active participation. Given the recruiting challenges we have experienced to date with the focus groups, we anticipate similar difficulties in recruiting specialists for the subsequent in-depth interviews to be scheduled in 2022.

Therefore, we request an increase to the incentive amounts for HCPs in the required medical specialties to $375 to be utilized in recruiting the remaining specialists for the 90-minute focus groups. This proposed rate still falls below the $428.40 the research conducted by Clement et al. (2019) described above identified as appropriate for specialists overall.

In the event we have similar difficulties recruiting specialists for the 30, 60-minute interviews after attempts using the currently approved $225/$200 rates, we request an increase to the physician incentives to $300 for the specialties of pain medicine, emergency medicine, and addiction medicine; and $325 for specialist in mental health and neurology. The incentives for non-specialist primary care physicians, NPs, and PAs will remain at the currently approved rates.

The increased incentives for both the remaining focus groups and for the interviews would be offered only to specialists who initially decline to participate because the initial incentive amounts are too low. Also note that recruiter, Schlesinger/2020Research, will bear any increased cost resulting from the increased incentives.

Based on the research study and justifications noted above, we are proposing the following incentive amounts for specialists:

Specialist Types	Current FG Incentive Amount	Proposed FG Incentive Amount	Difference	Current Interview Incentive Amount	Proposed Interview Incentive Amount	Difference
All Mental Health	$275	$375	+$100	$225	$325	+$100
Pain Medicine	$275	N/A	N/A	$225	$300	+$75
Neurology	$275	$375	+$100	$225	$325	+$100
Emergency Medicine	$275	N/A	N/A	$225	$300	+$75
Addiction Medicine	$275	N/A	N/A	$225	$300	+$75

8. Questions of a Sensitive Nature

Neither the focus group guide nor the IDI moderator’s guide contain any questions of a sensitive nature. The respondents are all HCPs who have experience working with patients and prescribing the medications they will be asked to discuss. The types of questions will probe their regular prescribing practices and are similar to those that might be discussed in an in-house meeting of colleagues or a medical conference or seminar. Nevertheless, the focus group and IDI consent forms state that participants are not required to answer any question they choose not to, and this is reiterated as part of the introduction at the beginning of the groups and IDIs.

9. Description of Statistical Methods

Traditional qualitative analysis, that is thematic coding analysis conducted by humans, will be employed to analyze the findings from this research in addition to analysis facilitated by computer software designed specifically to support qualitative research studies. The two moderators will also be the chief qualitative analysts; thus, they will begin the analytical task with some grounding in common themes and questions that emerge during the focus group session or IDI they conducted. These themes and questions will be addressed in the subsequent analysis after being checked against other supporting sources, such as the video recordings, transcripts, and observer notes.

The analysis will also be facilitated by computer software called NVivo that facilitates the categorization, organization, storage in a variety of formats, and convenient retrieval of qualitative data for analysis. NVivo is a platform where various stages of a project can be housed, and data files can then be efficiently coded by theme, topic, or other case differentiator. Information from transcripts, audio and video recordings, and moderator and observer notes will be coded and categorized for analysis by the moderator/analysts. The software will enable and expedite this process in the following way:

1. Import interview transcripts, recordings (audio and video), moderator notes, and observer notes to a single stand-alone system.

2. Allow the analysts to use coding tools available within the platform to facilitate the organization of clips, quotes, notes, and other research materials gathered into conceptually similar themes.

3. Provide query and charting tools for the analysts to explore the connections between themes.

4. Use an algorithm to independently verify coding categories for no fewer than 20% of the transcripts for the focus groups (not less than 4) and interviews (not less than 6) by each of two coders.

5. Calculate Inter-Rater Reliability (IRR) for the two coders using Cohen’s Kappa Coefficient) for no fewer than 20% of the transcripts for the focus groups (not less than 4) and interviews (not less than 6).

   • The Kappa coefficient will be calculated individually for each combination of node and source. If the two users are in complete agreement, Kappa will be 1. If they are in complete disagreement, Kappa will be ≤ 0. A Kappa value of 0.8 or higher is considered high agreement and will be used for these analyses.

Burden Hour Computation

Due to the focus group recruiting difficulties detailed above, even with the higher $375 incentive rates, an increase in the total number of potential participants to be screened and the related burden hours will be needed. So far, 1,282 of the original 2,880 have been screened with 1,598 remaining, and we estimate needing to screen an additional 1,958 respondents to fill the remaining specialist focus groups. This would increase the total burden hours needed to screen for the remaining focus groups by 60 to 326 as noted in the below table.

For the interview screening at the higher proposed incentive rates, refusals due to low incentives are expected to be minimal so the number of participants and the burden hours for those will remain unchanged. Therefore, at the higher focus group incentive rate for specialists, the total remaining burden hours needed for this study are 471.5.

(Number of responses (X) estimated response or participation time in minutes (/60) = annual burden hours):

Types of Respondents	Number of Respondents	Minutes for Each Respondent	Total Minutes	Burden (Hours)
Focus Group Screening	1,958	10	19,580	326
Focus Groups	27	90	2,430	40.5
Interview Screening	450	10	4,500	75
Interviews	30	60	1800	30
TOTAL				471.5

REQUESTED APPROVAL DATE: March 2022

NAME OF PRA ANALYST & PROGRAM CONTACT:

PRA Contact:

Ila S. Mizrachi

Paperwork Reduction Act Staff

[email protected]

301-796-7726

Program Contact:

Paula Rausch, PhD, RN

CDER Office of Communications

301-325-4662

[email protected]

FDA CENTER: Center for Drug Evaluation and Research

1US Food and Drug Administration. Drug Safety Communication: https://www.fda.gov/drugs/drug-safety-and-availability/fda-requiring-boxed-warning-updated-improve-safe-use-benzodiazepine-drug-class

2US Food and Drug Administration. Drug Safety Communication: FDA warns about serious risks and death when combining opioid pain or cough medicines with benzodiazepines; requires its strongest warning. https://www.fda.gov/drugs/drug-safety-and-availability/fda-drug-safety-communication-fda-warns-about-serious-risks-and-death-when-combining-opioid-pain-or

3FDA Mission: https://www.fda.gov/about-fda/what-we-do#mission

4Clement, Lynn and Claeys, Chris. What’s fair? The fair market value dilemma in health care research. Quirk’s Market Research Review. April-May, 2019.

10