Att 1 - Instructions and introductory materials

Attachment 1. Introduction to the Usability Test/Cognitive Interview and Usability Interview Guide

Introduction to the Usability Test/Cognitive Interview:

Thank you for agreeing to participate in this study today. You have read the Informed Consent and you have chosen to take part in this research study. Is that correct? [Interviewer waits for verbal acknowledgment]. You have given your permission for me to tape record your interview today, and to play it to other people working on this study. Is that correct? [Interviewer waits for verbal acknowledgment].

I have in front of me a short questionnaire that asks questions on your background, including your sexual identity, education, income, race and ethnicity and alcohol use. These questions will be used on large-scale health surveys to help us understand more about patterns of health access and utilization in the United States. Before they are used on these surveys, we are testing the questions out to see whether they are phrased well, whether they are too difficult to answer, and whether they make sense to people.

What we are doing today is divided into two parts. In the first part, I will ask you to answer the questions we are testing. Answering the questions involves using this computer— which I will help you get started. You will put the head phones over your ears, and the computer will ask you the questions. You will use the keyboard to give your answer. This will take approximately 10-15 minutes.

In the second part— after you answer the questions on the computer— I will ask you about your experience answering the questions— how you understood certain questions, interpreted certain words, and whether any of them were difficult to answer.

Do you understand what I am asking you to do? (Explain again if needed). Do you have any (more) questions? (If no questions) OK, let’s begin.

Interviewer Instructions – instruct respondent to put the headphones on and to begin the practice questions on the ACASI. If respondent has no questions following the practice questions, they may begin. Once respondent completes the ACASI, print off their responses and begin usability testing, and then cognitive interview.

Usability Interview Guide

Next, I’d like to ask you a few questions about your experience with answering the questions on the computer.

1. Please describe your experience using the computer to answer the questions.

2. What did you like about answering the questions on the computer?

3. What did you not like about answering the questions on the computer?

4. Did you listen to the audio when answering the questions? If not, why?

5. Did you have any difficulty hearing or understanding the audio? Please describe the difficulty you had.

6. Did you have any difficulty reading the words on the screen? Please describe the difficulty you had.

7. Did you experience any problems using the computer? If so, can you tell me more about these problems?

8. Did you have problems answering the questions or moving from question to question? If so, can you tell me more about these problems?

9. Were any of the instructions confusing to you? If so, can you tell me more about this?

10. Did you feel you could answer the questions honestly? Tell me more about this.

11. Do you have any other comments about your experience using the computer to answer the questions?

2