4 Support Person Protocol

B rightOutcome – Patient Portal Web Site

06/05/2012

Attachment 7

BrightOutcome

Usability Testing for the Patient Centered Communication Web Site

Evaluation Plan for Support Persons

June 5, 2012

OMB No.: 0925-0648

Expiration Date: 1/31/2015

NOTIFICATION TO RESPONDENT OF ESTIMATED BURDEN

Public reporting burden for this collection of information is estimated to average 60 minutes per interview, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to: NIH, Project Clearance Branch, 6705 Rockledge Drive, MSC 7974, Bethesda, MD 20892-7974, ATTN: PRA (0925-0648). Do not return the completed form to this address.

Purpose of Usability Testing

Introduction

BrightOutcome has developed a web site to help female patients with cancer undergoing chemotherapy manage their treatment, communicate with their care team, and involve their support network in their progress.

Because the completion of tasks and terminology is critical to a usable web site, Sandstorm Design Inc. is conducting a usability test focusing on key tasks for each user group.

Evaluation Objectives

The primary objective is to determine whether or not users can complete a series
of key tasks.

Schedule

The testing will be conducted at Sandstorm Design the week of July 30, 2012. Each test will last approximately 60 minutes.

Participant Criteria

The test participants will be 10 female cancer patients with chemotherapy experience, and 10 individuals (support persons) who have experience being part of a cancer patient’s personal support network and have not had cancer themselves. All participants will be scheduled by Sandstorm Design.

Evaluation Process

Twenty participants will take part in this usability evaluation. Each evaluation
will consist of:

• General impressions

• Unaided task completion

• Additional insight discussion

Orientation (5 minutes)

Each participant will be greeted and given a brief description of the purpose and objective of the evaluation. They will also be assured that the evaluation is of the web site, not them and that they should perform the tasks in a typical and comfortable manner. The participants will be informed they are being observed and recorded on audio and video.

General Site Impressions (5 minutes)

The participant and the facilitator of the research will discuss an overall impression
of the general site, layout and navigation.

Task Completion (40 minutes)

The task completion portion of the evaluation requires participants accomplish a
variety of scenario-driven tasks. The participant will attempt to accomplish the task
with no aid from the facilitator.

Additional Insights (10 minutes)

After the tasks are completed or time expires, each participant will have a brief discussion with the facilitator. The discussion will be centered on overall impressions, ease of completing the tasks, and suggested changes.

Logistics and Requirements

Evaluations will be conducted at Sandstorm Design and all sessions will be scheduled by Sandstorm Design.

Usability Test Briefing Document

Thank you for offering your time to help us today. My name is ___________ and
I will be facilitating this usability study. Please feel free to be completely open with
your responses.

Today you will take part in a usability study. The purpose is to identify how user-friendly the web site is. You will be working through a series of tasks. I will read each task out loud. While you are working on the task, I would like for you to talk aloud. By talk aloud, I mean that I would like for you to say out loud everything that you are saying to yourself.

Ask any questions that come to mind and comment freely about the organization of the site. The more comments and questions you provide, the more valuable your feedback. Please indicate when you feel you are finished with a task then move on to the next task. If at any time you feel you are unable to complete a task, indicate the reason why, and then move on to the next task.

Feedback gathered today will help highlight areas for improvement. We will take this information back to the designers as recommendations to implement that will ultimately improve the web site.

Please note that there is a web camera in the room. We will be recording the session so that I can review your feedback in detail.

Please keep in mind that the web site is being tested, not you. During the test, if something is unclear, or you feel uncertain, please vocalize the concern you are having. If for any reason you feel uncomfortable please let me know and you can stop at any time.

The first part of the evaluation consists of you and I discussing your general impressions of the web site. I’ll then have you complete a few tasks on your own.
We’ll finish with a follow-up discussion about the tasks in general. Do you have
any questions?

Let’s get started.

Orientation and General Site Impressions (10 minutes):

Home Page Discussion

Upon visiting the Patient Portal landing page please answer the following questions.

1. What are your overall impressions of the design of this web site?

2. What draws your attention?

3. What do you feel is the purpose of this web site?

4. Who do you think this web site is for?

5. What would you do first?

Navigation Discussion

Without clicking on the tabs at the top, describe what you would expect to find under each section:

1. Community

2. Education

3. Account Sign-up (Landing Page)

Task Scenarios (40 minutes):

Task 1 – Account Settings

1. A close family member has recently been diagnosed with cancer. She has invited you to join her support network on the Patient Portal web site.

1. Create an account on the Patient Portal site.

Task 2 – Patient Interaction

1. You would like to see if there are any updates on your family member’s treatment progress.

1. Locate your family member (Jane Doe).

2. Comment on her latest update.

3. Send her a private message.

4. Respond to her help request.

Task 3 – Education

1. You would like to learn more about your family member’s diagnosis.

1. What’s available for learning about your family member’s diagnosis?

2. Find nutrition information.

3. Find games.

4. Find patient stories.

2. Find a video about cancer treatment.

1. Share this video with a friend.

3. Find an article detailing natural ways to fight nausea.

1. Print this page.

Task 4 – Forum

1. You would like to see what else you could be doing to support your family member.

1. Find information about what others are doing to support their family members with cancer.

2. Add your own story to the conversation.

2. You’ve had a hard time helping your family member balance their treatment and work life.

1. Create a new topic on this issue.

Additional Insights (10 minutes):

Discussion Questions:

1. Do you use a smart phone? If so, which one and what do you use it for?

2. Do you use any social media networks? If so, which ones and how often?

3. How many hours per week do you use a computer?

4. How would you describe finding what you were looking for within this web site today?

5. How would you describe the tasks you were asked to complete on this web site today?

6. If you were designing the web site, what would be the first thing you would do to improve the site?

7. Is there any specific functionality or web sites that would make the tasks you completed today easier?

8. If time permits, take survey: (7 point scale with extremely easy (1) and extremely difficult (7) as anchors)

   1. How easy or difficult was it to find your way around the web site?

   2. How easy or difficult was it to set up your account?

   3. How easy or difficult was it to interact with your family member?

   4. How easy or difficult was it to find educational materials?

   5. How easy or difficult was it to participate in the forum?

   6. Overall the site… (fails/falls below expectations/meets expectations/exceeds expectations/is perfect)

CONFIDENTIAL ©2012 SANDSTORM DESIGN, INC. 8