Att 6_Concept Testing Guide

Form Approved

OMB No. 0920-xxxx

Expiration Date XX/XX/XXXX

“Formative Research to Develop HIV Social Marketing Campaigns for Healthcare Providers”

Attachment 6: Concept Testing Guide

Public reporting burden of this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to CDC/ATSDR Reports Clearance Officer; 1600 Clifton Road NE, MS D-74, Atlanta, Georgia 30333; Attn: OMB-PRA (0920-New)

I. Welcome

Thank you for coming here today. Your participation is very important. I’m _______ and I’m from _________________________ (insert contractor name). The Centers for Disease Control and Prevention (CDC) is sponsoring this research. The purpose of this interview is hear your reactions to materials currently being developed by the CDC for health care providers who deliver care to people at risk for or living with HIV. Your insights are very important to us and your time today is appreciated. We will have about 1 hour for our discussion.

[Interviewer gives participant the consent form] Here is an informed consent form. Take a moment to review it and if you agree to it, please sign it.

[Interviewer gives participant 5 minutes to review and sign consent form]

• The consent form states that you have agreed to be part of a study about HIV.

Before we begin, I want to review a few ground rules for our discussion.

• Your participation is voluntary and you have the right to withdraw from the study at any time.

You have probably noticed the microphones in the room. They are here because we are audio taping. [If applicable: and we have a live video stream]. I want to give you my full attention and not have to take a lot of notes. At the end of our discussion, I have to write a report and will refer to the tape when writing the report.

Behind me is a one-way mirror OR we are video streaming. Some of the people working on this project are observing this discussion so that they can hear your opinions directly from you and take notes so that your opinions are accurately captured.

• However, your identity and anything you personally say here will remain private. Your name, address, and phone number will not be given to anyone and no one will contact you after this interview is over.

• The informed consent has contact information for the project director, in case you have questions about the study or questions about your rights as a participant.

• Most importantly, there are no right or wrong answers. We want to know your opinions and what you think about the issues we will be discussing. I do not work for the people who are sponsoring this research, so don’t hold back from giving me your honest opinions.

• Please turn your cell phone or beeper to vibrate or silent mode. The interview will last no more than 1 hour.

• If you need to go to the restroom during the discussion, please let me know.

• Do you have any questions before we begin?

II. Warm up

I would like to begin our discussion by asking you to introduce yourself and tell me:

• your first name

• number of years in practice

• professional affiliations (HIV Medicine Association (HIVMA); American Academy of HIV Medicine (AAHIVM); American College of Physicians (ACP); American Academy of Family Physicians (AAFP); Society for General Internal Medicine (SGIM); National Medical Association (NMA); and National Hispanic Medical Association (NHMA); state and local organizations)

• a description of your practice (size, number of patients with HIV seen per month)

• your patients’ insurance coverage (Medicare, Medicaid, HMO, private insurance, self-pay)

• about the patients you see in your practice (men, women, diverse populations, age range)

III. Questions

Now, I would like to show you concepts that are meant to present information to providers about [INSERT TOPIC HERE].

I’ll show you a concept and then we’ll discuss it. We will repeat this same process with each of the concepts. For now, I would like you to avoid comparing the concepts. Instead, consider each concept based on its own merits.

[Interviewer: Alternate the order that you present the concepts across interviews]

[Interviewer: Repeat the next set of questions for each of the concepts]

1. What is your initial reaction to this concept?

   • How relevant is the concept to you as a provider?

2. What do you like about this concept? What do you dislike?

3. What are the strengths of this concept? What are its weaknesses or challenges?

4. What aspects of the concept are confusing or unclear? Why do you say that?

5. What parts of this concept do you think are critically important? Why do you say that?

6. What could be added or changed about this concept to make it stronger or more motivating?

   • Is there any key piece of information that we’d need to add to this concept in order for you to use it with your patients? What is it?

7. What could be done to improve this concept?

   • Do you think there are any prevention strategies that should be included in the concept that we have not included or that deserve more emphasis?

   • PROBE: Was the appropriate level of science referenced in the concept?

8. [If applicable] What do you think of the image/visual/infographic?

   • How does what you see affect you?

   • Would you describe the visual as powerful? Why/why not?

   • Is the image distinct or does it remind you of something you’ve seen before? What does it remind you of?

   • Do you think you would remember the image later? Why/why not?

9. [If applicable] How well does the text relate to the image? Why do you say that?

   • Are there any words or phrases that you think are particularly important?

   • Are there any words or phrases that you object to or don’t like?

10. What impact would this concept have to convince or encourage you to make discussing [insert topic here] a routine part of care? How?

    • If you saw this in a journal would you stop and read it?

Rating of Ads

11. Now I’m going to show you some ads and ask you to rate them. The response scale is 1 (strongly disagree) to 5 (strongly agree).

Interviewer note: Repeat for each message.

	Strongly disagree	Disagree	Neither agree nor disagree	Agree	Strongly agree
Overall, I liked this ad
This ad grabbed my attention.
This ad was confusing.
This ad was convincing.
This ad said something important.
This ad gave me good reasons to [insert behavior].
This ad speaks to me.
This ad [insert descriptor here].

Ranking of Ads

Now that we have had a chance to review and discuss the concepts for encouraging you or your patients to [INSERT BEHAVIOR HERE], please think about which concept is the most motivating to you.

12. If you were to rank the concepts from most to least motivating at [INSERT BEHAVIOR], which would you rank as most motivating at [INSERT BEHAVIOR]?

    • What is it about this concept that you find most motivating?

13. Which would you rank as least most motivating? Why is that?

Usability

14. Are these concepts something that you would find useful for yourself? What about other staff you work with?

    • After reviewing the concepts how confident are you in your ability to implement the recommendations provided?

    • How could it be improved to make it more useful for providers such as yourself?

Use

15. For clinical/professional purposes, how would you prefer to access these concepts (electronically via desktop, laptop, or tablet; through mobile application; or hard copy)?

16. How do you think most providers would like to access these concepts?

17. We are interested in hearing about what you currently use with your patients. What devices, if any, do you currently use during patient consultations?

    • Smartphones, lap tops, desktops, tablet?

    • Do you think one is more useful or effective than another?

Patient Concepts

These next concepts, unlike the others we have talked about today, are written for patients. I would like you to also take a look at them and tell us what you think.

18. What are your overall reactions to these concepts?

• In general, are the concepts written at the right reading comprehension level for your patients?

• How credible would you say the concepts are?

• How would you use them in your practice?

19. What do you think about the content of the concept?

• Is there anything that needs to be added or deleted?

• Is there anything that is offensive or potentially stigmatizing?

• Is the information included here too simplistic, too complicated or just right.

• Would your patients find these concepts useful?

Dissemination Preferences

Now, I’d like to ask you about ways to best communicate concepts like these to providers.

20. What would be some good ways for CDC to share information about [INSERT TOPIC HERE] with you and your colleagues?

21. Please select the top 5 ways that you would like to receive information about [INSERT TOPIC HERE]. Why do you prefer these ways?

Interviewer note: Probe first and then hand out the list

List of possible tactics

• Mailing

• Fax

• Email

• Website

• Medical journal advertisement

• Rx pad ads

• Medical meeting exhibit

• Medical conference symposium

• Clinical update courses at local or regional hospitals

• Continuing Medical Education (CME) course (in person)

• CME course (online)

• CME course (by mail)

• Article in medical journal

• Article written by a well-known leader in the field

• Provider Social Media Site (Sermo, Epocrates, Doximity)

• Non-Provider Social Media Site (Facebook, Twitter, etc.)

• Professional association publication

Which association? ____________________

• Other ___________________________

22. Please select the top 5 ways that you would least like to receive information about [INSERT TOPIC HERE]. Why do you not like to receive information this way?

23. Are there particular concepts that you think would help facilitate providers [INSERT BEHAVIOR HERE]? What are they?

24. Are there any other concepts, apart from the ones we’ve discussed, that would be helpful?

IV. Closing

Okay, we are pretty much out of time.

25. Do you have any last thoughts?

[Moderator will check with observers for additional questions or comments.]

I would like to thank you for coming today and providing important feedback to CDC. This has been very useful in helping us to develop concepts about [insert topic here] for providers to discuss with patients a routine part of care.

AT THE END OF THE INTERVIEW, THE INTERVIEWER SHOULD HAVE THE FOLLOWING FROM EACH PARTICIPANT:

• RESCREENER

• Brief Survey Instrument

• SIGNED CONSENT FORM

1