Attachment H: Pretesting Interview Script_Decision Aid

PRETesting Interview Guide:

PROSTRATE CANCER DECISION AID

Study ID: _____________________

Date of Interview: _____________________

Instructions to interviewer are in bold and italics

Task 1: Introduction

Thank you for your interest in this study. First, I am going to review the informed consent form to you to be sure that you understand what the study is about. Next, I will ask if you have any questions or concerns about this study. Once your questions are answered, I will ask you to complete an informed consent form. After we complete the consent process, I’ll ask you some general demographic questions and some questions about prostate cancer. Then will begin the interview where you review a website and I will be asking you questions about how easy or difficult it was to use. At the end, I’ll ask you some more questions about prostate cancer.

Task 2: Informed Consent Process

Go over the informed consent form with the participant. Ask if the participant has any questions and answer any questions they have. If they agree, have them sign and date the consent form. Sign and date it as the person obtaining consent, and give the participant a copy to keep. Also complete the informed consent documentation.

Task 3: Demographic Questionnaire

Now, let’s go over some general demographic questions. This will take less than 5 minutes.

These questions are for research purposes only and your answers will be kept strictly confidential.

1. How old are you?

______ Years

2. What is your race? (Please check all that apply.)

• American Indian or Alaska Native

• Asian

• Black or African American

• Native Hawaiian or Other Pacific Islander

• White

• Other: _______________

3. What is your ethnicity?

• Hispanic or Latino

• Not Hispanic or Latino

4. What is the highest grade/level of education that you have completed?

• Not a high school graduate

• High school graduate

• Some college

• College graduate

• Post-graduate degree

Thank you for providing your demographic information.

Task 4: Pretesting Interview

We have created a web-based decision aid to educate people about the different treatments for early stage prostate cancer. We want you identify any inconsistencies or usability problems with our website. We will ask about the website’s navigation, presentation, and control. Our goal is to learn how easy or difficult you think the site is to use and to identify ways we can improve it. We also want to know if the website helps people learn about prostate cancer, so we’ll ask some questions about that before and after you visit the website.

Ask pretest knowledge questions.

Here are some questions about prostate cancer. Tell me if you think the answer is “yes” or “no.” If you do not know, please say “not sure.”

	Yes	No	Not Sure
Do most men diagnosed with prostate cancer have cancer that has not spread outside the prostate gland?	[ ]	[ ]	[ ]
Is surgery the only treatment for prostate cancer?	[ ]	[ ]	[ ]
Is a biopsy is necessary to determine if a man has prostate cancer?	[ ]	[ ]	[ ]
Are sexual, urinary, and bowel problems possible side effects of treatment for prostate cancer?	[ ]	[ ]	[ ]
Do most men with localized prostate cancer eventually die from it?	[ ]	[ ]	[ ]
Do most men with localized prostate cancer have few or no symptoms at all?	[ ]	[ ]	[ ]
Are PSA test and the digital rectal exam used to test for prostate cancer?	[ ]	[ ]	[ ]
Is the main benefit of active surveillance or watchful waiting that you can avoid the side effects of active treatment?	[ ]	[ ]	[ ]
Is brachytherapy a kind of treatment for prostate cancer?	[ ]	[ ]	[ ]
Do patients have fewer problems from surgery if their surgeon has more experience?	[ ]	[ ]	[ ]

Now direct the participant to the website and have them review it on their own. Ask the usability questions when they are done.

Next I’m going to ask about how whether you thought it was easy to use and understand our website. I am going to read some statements, and I want you to tell me how much you agree or disagree with each statement. You can say “strongly agree, somewhat agree, not sure, somewhat disagree, or strongly disagree.”

Statement	Strongly Agree		Somewhat Agree	Not sure	Somewhat Disagree	Strongly Disagree
It was easy to find the information I wanted.		[ ]	[ ]	[ ]	[ ]	[ ]
The number of steps it took to get me where I wanted to go was acceptable.		[ ]	[ ]	[ ]	[ ]	[ ]
The navigation was logical.		[ ]	[ ]	[ ]	[ ]	[ ]
If I clicked on the wrong link, I knew how to retrace my path.		[ ]	[ ]	[ ]	[ ]	[ ]
The site is well organized.		[ ]	[ ]	[ ]	[ ]	[ ]
The links are well labeled.		[ ]	[ ]	[ ]	[ ]	[ ]
When I clicked on a link, I ended up where I expected.		[ ]	[ ]	[ ]	[ ]	[ ]
The search results for key words were useful.		[ ]	[ ]	[ ]	[ ]	[ ]
The search results for key words were well organized.		[ ]	[ ]	[ ]	[ ]	[ ]
The program helped me understand the various treatments for early stage prostate cancer.		[ ]	[ ]	[ ]	[ ]	[ ]
I am satisfied with my experience using this web-based decision aid.		[ ]	[ ]	[ ]	[ ]	[ ]
This web-based decision aid meets my expectations.		[ ]	[ ]	[ ]	[ ]	[ ]
I would recommend this website to others.		[ ]	[ ]	[ ]	[ ]	[ ]
I would return to this website.		[ ]	[ ]	[ ]	[ ]	[ ]
How could this website be improved?		___________________________________________
Do you have any additional comments?		___________________________________________

Next, ask acceptability questions.

Please help us evaluate the decision aid you completed.

1. How would you rate the amount of information given in the decision aid?

[ ] Much less than wanted

[ ] Little less than wanted

[ ] About right

[ ] Little more than wanted

[ ] Much more than wanted

2. How would you rate the length of the decision aid?

[ ] Much too long

[ ] Little too long

[ ] About right

[ ] Should have been a little longer

[ ] Should have been much longer

3. How clearly were the issues presented in the decision aid?

[ ] Everything clear

[ ] Most things clear

[ ] Some things unclear

[ ] Most things unclear

4. How would you rate the presentation?

[ ] Clearly slanted to certain treatments

[ ] Slightly slanted to favor screening

[ ] Completely balanced

[ ] Slightly slanted to favor not screening

[ ] Clearly slanted to favor not screening

5. Would you recommend this decision aid to other people facing this decision?

[ ] Yes

[ ] No

[ ] Unsure

6. Was the decision aid you viewed interesting?

[ ] Yes

[ ] No

[ ] Unsure

7. Did the decision aid you viewed help you understand prostate cancer treatments?

[ ] Yes

[ ] No

[ ] Unsure

8. Did the decision aid you viewed hold your interest?

[ ] Yes

[ ] No

[ ] Unsure

9. Did the decision aid you viewed give you information that was useful?

[ ] Yes

[ ] No

[ ] Unsure

10. Would you like to view the decision aid again?

[ ] Yes

[ ] No

[ ] Unsure

11. Does the decision aid use language that you understand?

[ ] Yes

[ ] No

[ ] Unsure

12. Would you like to ask questions about what you viewed?

[ ] Yes

[ ] No

[ ] Unsure

13. Would you like to have the opportunity to ask questions while you are going over the decision aid?

[ ] Yes

[ ] No

[ ] Unsure

14. Did you feel the decision aid related to you and persons like you?

[ ] Yes

[ ] No

[ ] Unsure

15. Would you like decision aids similar to this one for other health care decisions you face?

[ ] Yes

[ ] No

[ ] Unsure

Ask post-test knowledge questions.

Here are some questions about prostate cancer. Tell me if you think the answer is “yes” or “no.” If you do not know, please say “not sure.”

	Yes	No	Not Sure
Do most men diagnosed with prostate cancer have cancer that has not spread outside the prostate gland?	[ ]	[ ]	[ ]
Are sexual, urinary, and bowel problems possible side effects of treatment for prostate cancer?	[ ]	[ ]	[ ]
Is the main benefit of active surveillance or watchful waiting that you can avoid the side effects of active treatment?	[ ]	[ ]	[ ]
Do most men with localized prostate cancer eventually die from it?	[ ]	[ ]	[ ]
Is a biopsy is necessary to determine if a man has prostate cancer?	[ ]	[ ]	[ ]
Do most men with localized prostate cancer have few or no symptoms at all?	[ ]	[ ]	[ ]
Are PSA test and the digital rectal exam used to test for prostate cancer?	[ ]	[ ]	[ ]
Is brachytherapy a kind of treatment for prostate cancer?	[ ]	[ ]	[ ]
Is surgery the only treatment for prostate cancer?	[ ]	[ ]	[ ]
Do patients have fewer problems from surgery if their surgeon has more experience?	[ ]	[ ]	[ ]

That concludes our interview. Thank you for sharing your experiences and thoughts. Thank you very much for your time!!

Provide the participant compensation.

PI or Delegate Signature Date and Time

PI or Delegate Printed Name PI or Delegate Employee ID#

Page 11 of 11