4 DCPDIV #21 Facilitator's Guide

U ser-Centered Design, Inc. 20548 Deerwatch Place Ashburn, VA 20147 (703) 729-0998

Attachment 3.

DCP Website Usability Testing

Facilitator’s Guide

October 2012

OMB #: XXXXX, Expiration Date:  XXXXX

Submitted to:

Kara Smigel Croker

Submitted by:

User-Centered Design, Inc.

20548 Deerwatch Place

Ashburn, VA 20147

(703) 729-2370

www.user-centereddesign.com

OMB No.: XXXXX

Expiration Date: XXXXX

PRIVACY ACT NOTIFICATION STATEMENT

Collection of this information is authorized by The Public Health Service Act, Section 412 (42 USC 285 a-1). Rights of study participants are protected by The Privacy Act of 1974. Participation is voluntary, and there are no penalties for not participating or withdrawing from the study at any time. Refusal to participate will not affect your benefits in any way. The information collected in this study will be kept private under the Privacy Act. Names and other identifiers will be separated from information provided and will not appear in any report of the study. Information provided will be combined for all study participants and report as statistical summaries. You are being contacted by phone (or in person) to complete this instrument so that we can evaluate the website.

NOTIFICATION TO RESPONDENT OF ESTIMATED BURDEN

Public reporting burden for this collection of information is estimated to average 60 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to: NIH, Project Clearance Branch, 6705 Rockledge Drive, MSC 7974, Bethesda, MD 20892-7974, ATTN: PRA (0925-0642). Do not return the completed form to this address.

[Note: The purpose of this document is to guide the moderator.  The questions and tasks contained herein may not be asked as written.  The facilitator often draws on participant comments and the natural flow of the testing process to determine the flow of the session.  While the facilitator will try to follow the order of the guide, many times tasks will come up ahead of time or in different order.  The facilitator may allow the order of the tasks to change in order to let the process flow naturally.]

Pre-Test

[Administer the informed consent.]

Introduction

Thank you for agreeing to participate in this study.

NCI’s Division of Cancer Prevention (DCP) is looking to improve their website, so today we are conducting a usability evaluation of the design. As a participant, you will explore the website and be given a set of tasks to do.

As we go through the tasks, feel free to offer any comments or suggestions that occur to you. We are looking for things about the design that are working well as well as things that could be improved. There are two important things you should keep in mind while you work with the website:

• First, I did not create the design so you can’t hurt my feelings with any criticisms you might have. If there are problems with the design I would like to discuss them with you to see if we can find a way to improve the design.

• Second, we are evaluating the website and not you, so you cannot make any mistakes. The site is supposed to be intuitive and easy to use. If it isn’t, that’s a problem with the website – not with you.

I’d like you to know that there are some observers with us today helping me by taking notes, but don’t worry about them. You and I will work on this together and they’ll just watch and listen.

Do you have any questions for me before we get started?

Background

We have invited persons with a variety of backgrounds to participate in this activity so I’d like you to tell me:

1. Where do you work and what is your role there?

2. [Grantee Researchers only]

   1. What type of research do you do?

   2. What type of grant are you working on?

3. [Research Staff only]

   1. What type of research do you do?

   2. How long have you been doing this research?

4. What type of information do you usually look for on the DCP website? [Probe for information on research groups, CCOPs, information topics, etc. Note P’s answers to guide their exploration of the website during the tasks.]

Tasks

1. You mentioned previously looking at {topic} on the DCP website. Can you show me how you accessed that information? [Note the areas where the P goes and what information they access. Repeat for each topic they mentioned earlier.]

2. You mentioned before that you were interested in {topic}. Does this website have information on this topic? Let’s explore this area. [Direct P to explore the area with the information.]

3. Are there any other areas on the page that interest you? [Explore all additional areas of the site the P mentions. Direct P to look further if P did not notice an area of the site that has information related to the interests they mentioned earlier.]

4. [If the participant has not explored all areas of the site:] There are a few other areas of the website. Can you describe the other areas of the website and think about the content that might be there and the people who would be interested in that content? [After P describes one area:] Let’s look at the content now. How does this content compare to what you expected to find? [Repeat with all other major parts of the site.]

Follow-up Questions

1. I’d like you to reflect on the things you liked and didn’t like about the website. What are three things you liked? What are three things you disliked?

2. How easy or difficult was it for you to find out what was on the DCP website?

3. Were there any confusing links or headings on the DCP website that we didn’t discuss earlier?

4. Was there anything missing – any information or topics that you expected to see but didn’t?

5. Is there anything about the organization of the web pages that you would change?

Wrap up

OK, we’re done. Do you have any further questions or comments?

Thanks again for your participation.

4