B
rightOutcome
– Patient Portal Web Site
06/05/2012
Attachment 6
BrightOutcome
Usability Testing for the Patient Centered Communication Web Site
Evaluation Plan for Patients
June 5, 2012
OMB
No.: 0925-0648 Expiration
Date: 1/31/2015 NOTIFICATION
TO RESPONDENT OF ESTIMATED BURDEN Public
reporting burden for this collection of information is estimated to
average 60 minutes per interview, including the time for reviewing
instructions, searching existing data sources, gathering and
maintaining the data needed, and completing and reviewing the
collection of information. An
agency may not conduct or sponsor, and a person is not required to
respond to, a collection of information unless it displays a
currently valid OMB control number.
Send comments regarding this burden estimate or any other aspect of
this collection of information, including suggestions for reducing
this burden to: NIH, Project Clearance Branch, 6705 Rockledge Drive,
MSC 7974, Bethesda, MD 20892-7974, ATTN: PRA (0925-0648). Do not
return the completed form to this address.
BrightOutcome has developed a web site to help female patients with cancer undergoing chemotherapy manage their treatment, communicate with their care team, and involve their support network in their progress.
Because the completion of tasks and terminology is critical to a usable web site, Sandstorm Design Inc. is conducting a usability test focusing on key tasks for each user group.
The primary
objective is to determine whether or not users can complete a series
of key tasks.
The testing will be conducted at Sandstorm Design the week of July 30, 2012. Each test will last approximately 60 minutes.
Participant Criteria
The test participants will be 10 female cancer patients with chemotherapy experience, and 10 individuals (support persons) who have experience being part of a cancer patient’s personal support network and have not had cancer themselves. All participants will be scheduled by Sandstorm Design.
Evaluation Process
Twenty
participants will take part in this usability evaluation. Each
evaluation
will consist of:
General impressions
Unaided task completion
Additional insight discussion
Each participant will be greeted and given a brief description of the purpose and objective of the evaluation. They will also be assured that the evaluation is of the web site, not them and that they should perform the tasks in a typical and comfortable manner. The participants will be informed they are being observed and recorded on audio and video.
The
participant and the facilitator of the research will discuss an
overall impression
of the general site, layout and navigation.
The
task completion portion of the evaluation requires participants
accomplish a
variety of scenario-driven tasks. The participant
will attempt to accomplish the task
with no aid from the
facilitator.
After the tasks are completed or time expires, each participant will have a brief discussion with the facilitator. The discussion will be centered on overall impressions, ease of completing the tasks, and suggested changes.
Evaluations will be conducted at Sandstorm Design and all sessions will be scheduled by Sandstorm Design.
Usability Test Briefing Document
Thank
you for offering your time to help us today. My name is ___________
and
I will be facilitating this usability study. Please feel
free to be completely open with
your responses.
Today you will take part in a usability study. The purpose is to identify how user-friendly the web site is. You will be working through a series of tasks. I will read each task out loud. While you are working on the task, I would like for you to talk aloud. By talk aloud, I mean that I would like for you to say out loud everything that you are saying to yourself.
Ask any questions that come to mind and comment freely about the organization of the site. The more comments and questions you provide, the more valuable your feedback. Please indicate when you feel you are finished with a task then move on to the next task. If at any time you feel you are unable to complete a task, indicate the reason why, and then move on to the next task.
Feedback gathered today will help highlight areas for improvement. We will take this information back to the designers as recommendations to implement that will ultimately improve the web site.
Please note that there is a web camera in the room. We will be recording the session so that I can review your feedback in detail.
Please keep in mind that the web site is being tested, not you. During the test, if something is unclear, or you feel uncertain, please vocalize the concern you are having. If for any reason you feel uncomfortable please let me know and you can stop at any time.
The
first part of the evaluation consists of you and I discussing your
general impressions of the web site. I’ll then have you
complete a few tasks on your own.
We’ll finish with a
follow-up discussion about the tasks in general. Do you have
any
questions?
Let’s get started.
Orientation and General Site Impressions (10 minutes):
Home Page Discussion
Upon visiting the Patient Portal landing page please answer the following questions.
What are your overall impressions of the design of this web site?
What draws your attention?
What do you feel is the purpose of this web site?
Who do you think this web site is for?
What would you do first?
Navigation Discussion
Without clicking on the tabs at the top, describe what you would expect to find under each section:
Care
Team
Community
Education
Calendar
Account Sign-Up (Landing Page)
Task Scenarios (40 minutes):
1. You are a patient currently undergoing cancer treatment and you heard about the Patient Portal web site from a friend.
Create an account on the Patient Portal site.
1. You would like to contact the nurse who worked with you at your appointment yesterday.
a. Locate your care team.
c. Email your nurse.
1. You are a patient currently undergoing cancer treatment and your provider has set up an account for you on the Patient Portal web site. You would like to keep your friends and family informed about your treatment progress.
Connect with a friend through the web site.
2. Suppose you’ve added a few friends and family members to your support network on the web site. You would like to inform them of your progress.
Find your list of friends and family members.
Communicate your treatment progress to your friends and family.
Post a photo to share with your friends and family.
3. You need a ride to an appointment this week.
Ask your support network to help you get to your appointment.
1. You are interested in participating in a support group to learn about living with cancer.
Where would you find this information?
Add this support group meeting to your calendar.
2. You would like to see what classes you have signed up for.
Were would you find this information?
How would you add this to your personal calendar in iCal?
1. During your last visit with your provider, your physician mentioned some upcoming clinical trials that you might be interested in learning more about
Find more information about clinical trials that might work for you.
1. Your physician has asked you to track your treatment progress.
a. Where would you go to see your progress?
2. Today you are feeling extremely tired, and have a very upset stomach.
Where would you go to record what you are feeling?
Enter your symptoms.
3. You can’t remember when your next appointment is scheduled.
a. Find your appointment schedule.
4. At your appointment last week, your physician ordered a blood test.
a. Check your test results from the blood test.
1. You were diagnosed with cancer and don’t know what to expect.
Where would you go to get advice from other cancer patients?
Additional Insights (10 minutes):
Discussion Questions:
Do you use a smart phone? If so, which one and what do you use it for?
Do you use any social media networks? If so, which ones and how often?
How many hours per week do you use a computer?
How would you describe finding what you were looking for within this web site today?
How would you describe the tasks you were asked to complete on this web site today?
If you were designing the web site, what would be the first thing you would do to improve the site?
Is there any specific functionality or web sites that would make the tasks you completed today easier?
If time permits, take survey: (7 point scale with extremely easy (1) and extremely difficult (7) as anchors)
How easy or difficult was it to find your way around the web site?
How easy or difficult was it to set up your account?
How easy or difficult was it to contact your Care Team?
How easy or difficult was it to connect with your Support Network?
How easy or difficult was it to add events to your calendar?
How easy or difficult was it to find clinical trials?
How easy or difficult was it to report symptoms?
How easy or difficult was it to find the forum?
Overall the site… (fails/falls below expectations/meets expectations/exceeds expectations/is perfect)
CONFIDENTIAL
©2012 SANDSTORM DESIGN, INC.
File Type | application/msword |
File Title | Caremark RX, Inc |
Author | Laura Anhalt |
Last Modified By | Vivian Horovitch-Kelley |
File Modified | 2012-06-22 |
File Created | 2012-06-05 |