T ITLE OF INFORMATION COLLECTION:
Evaluation of DCEG online newsletter Linkage
PURPOSE:
Linkage
is one of the major communications tools that Division of Cancer
Epidemiology & Genetics (DCEG) uses to inform its various target
audiences about its research and attract qualified graduate students
and other scientists. The online version of Linkage
is being redesigned to make it easier for visitors to choose and read
articles, as well as find associated information on the web site. Two
usability tests will assess the new design in terms of ease of use
and navigation.
Reports
on each session of usability testing will be delivered and discussed
with the project leadership, DCEG Linkage
editor and webmaster. The testing will help inform possible changes
to the site including labeling, visual treatment, positioning or
navigation.
DESCRIPTION OF RESPONDENTS:
Three user groups will be included in testing:
Outside collaborators (scientists and/or clinicians) at academic institutions and cancer centers. These collaborators will be career scientists and clinicians, working in the field of epidemiology, biostatistics, or genetics.
Graduate students, 21-34 years of age, who are studying epidemiology, biostatistics, or medicine. They will be identified through the DCEG Office of Education.
Cancer advocates, preferably affiliated with organizations that deal with cancer as it relates to populations – familial cancer, genetic diseases, health disparities, etc. Cancer advocates will be identified through the Office of Advocacy Research.
TYPE OF COLLECTION: (Check one)
[ ] Customer Comment Card/Complaint Form [ ] Customer Satisfaction Survey
[x] Usability Testing (e.g., Website or Software [ ] Small Discussion Group
[ ] Focus Group [ ] Other: ______________________
CERTIFICATION:
I certify the following to be true:
The collection is voluntary.
The collection is low-burden for respondents and low-cost for the Federal Government.
The collection is non-controversial and does not raise issues of concern to other federal agencies.
The results are not intended to be disseminated to the public.
Information gathered will not be used for the purpose of substantially informing influential policy decisions.
The collection is targeted to the solicitation of opinions from respondents who have experience with the program or may have experience with the program in the future.
Name: _______Cheryl Burg_________________________________________
To assist review, please provide answers to the following question:
Personally Identifiable Information:
Is personally identifiable information (PII) collected? [ x ] Yes [ ] No
If Yes, will any information that is collected be included in records that are subject to the Privacy Act of 1974? [ x ] Yes [ ] No
If Yes, has an up-to-date System of Records Notice (SORN) been published? [x] Yes [ ] No
During recruitment, PII is collected in the form of name and contact information solely for the purpose of reminding the respondents of the usability test the day before and mailing out the incentive.
A Privacy Impact Assessment (PIA) has been completed and published by HHS on 8/30/2011. The name of the IT system is “NIH NCI OCE Office of Market Research and Evaluation Surveys.”
Gifts or Payments:
Is an incentive (e.g., money or reimbursement of expenses, token of appreciation) provided to participants? [ x ] Yes [ ] No
Describe and justify: Participants will receive an incentive of $35 as thanks for participating. Other NCI OMB-approved IC’s have included incentives around this amount, for this population, for web-based responses, including usability testing which included:
Students and the general public incentivized at $50 for in-person or on-line responses (0925-0589-04, approved 8/2010, SEER).
Listserv participants incentivized at the $30 rate for on-line responses (0925-0589-05, approved 8/2010, EGRP).
Website users and non-users incentivized at the rate of $60 for on-line responses (0925-0589-08, approved 1/2011; NeXT).
When one averages the above amounts the result is $46. This is well above the proposed $35 that we are proposing to give to participants and in-line with OMB’s Supporting Statement A.
BURDEN HOURS
Category of Respondent |
No. of Respondents |
Participation Time |
Burden |
Individuals or households |
18 |
40/60 (0.67) |
12 |
Totals |
18 |
40/60 (0.67) |
12 |
Total Burden Hours used for IC’s to date: 4
Total Burden Hours Approved for IC’s under 0925-0642: 8750
Total Burden Hours currently requested: 12
FEDERAL COST: The estimated annual cost to the Federal government is $32,787.00.
If you are conducting a focus group, survey, or plan to employ statistical methods, please provide answers to the following questions:
The selection of your targeted respondents
Do you have a customer list or something similar that defines the universe of potential respondents and do you have a sampling plan for selecting from this universe? [ ] Yes [x] No
If the answer is yes, please provide a description of both below (or attach the sampling plan)? If the answer is no, please provide a description of how you plan to identify your potential group of respondents and how you will select them?
The outside collaborators (scientists and/or clinicians) at academic institutions and cancer centers who will participate in the usability testing will be found through personal contacts of DCEG staff. Those who agree to participate and can be scheduled will be included, up to the maximum number needed.
The graduate students will be identified through the DCEG Office of Education. Those who agree to participate and can be scheduled will be included, up to the maximum number needed.
The Cancer advocates will be identified through the Office of Advocacy Research. Those who agree to participate and can be scheduled will be included, up to the maximum number needed.
Potential respondents will initially be contacted by email. At the time of testing, a statement of informed consent will be read to respondents and consent will be collected verbally. As part of the usability testing, the System Usability Scale will be conducted.
Administration of the Instrument
How will you collect the information? (Check all that apply)
[ x ] Web-based or other forms of Social Media
[ x ] Telephone
[ ] In-person
[ ] Other, Explain
Will interviewers or facilitators be used? [ x ] Yes [ ] No
Attachments included below:
Attachment 2: Informed Consent
Attachment 3: Participant Communications (Preliminary follow-up email, scheduling request
email, and confirmation email)
Attachment 4: NIH Privacy Act Memo
Attachments in a separate file:
Attachment 1: Facilitator’s Guide
Attachment 5: System Usability Scale (SUS)
Attachment 2: Verbal Consent Form
DCEG Linkage Usability Test
As part of this research, I need to ask you to formally consent to participate in this usability test. As part of a research project for the National Cancer Institute, we are evaluating the usability of DCEG’s Linkage website, and we would like you to assist us by participating in a usability evaluation.
Your participation is voluntary, and if you choose not to participate it will not affect your relationship with the National Cancer Institute. You may ask questions at any time during the session. You are also free to stop the session at any time without penalty and without any questions being asked of you.
You will be asked to perform a series of information-seeking tasks and provide your opinion on the design and navigation of the website. The total time involved, including instructions, will be no more than 40 minutes.
All information collected in this study will be kept private under the Privacy Act. Any findings will be reported in aggregated form. We won’t be asking anything personal and no identifying information will be shared. There will be no recordings made of the audio or visuals from the usability test.
Do
you have any questions at this time?
If you agree to participate, you are saying that you understand what I’ve told you and that any questions you had were satisfactorily answered. You are also saying that you are at least 18 years old and that you voluntarily agree to participate.
Do you agree to participate in this study?
Participant’s name: _____________________________________
Date: ____________________________________
Researcher’s signature: _______________________________
Attachment 3: Initial follow-up email to potential recruits
Hi <name>,
Thank you for agreeing to participate in user testing of DCEG's online Linkage website! I received your name from <DCEG staff contact>.
We anticipate conducting the Linkage tests in January, and I will be back in touch with you to schedule a day and time closer to that point.
Thank you for your interest!
Regards,
Audrey
Audrey Lipps
Sr. Human Factors Engineer
User Centered Design, Inc.
~~~~~~~~~~~~~~~~~~~~~~
Office: 703-715-1062
Cell: 703-944-4263
2nd email to potential recruits to schedule testing
Hi <name>,
Thank you for agreeing to participate in user testing of DCEG's online Linkage website! We will be conducting testing on <dates>, and I would like to find a day and time that would be convenient for you to participate.
Testing will be conducted remotely, and I will send you a link to the online conference and the phone number for calling in once we have agreed upon a time. The session will last approximately 30 minutes.
Please tell me a couple of days and times on <dates> when you would be available.
Thank you,
Audrey
Audrey Lipps
Sr. Human Factors Engineer
User Centered Design, Inc.
~~~~~~~~~~~~~~~~~~~~~~
Office: 703-715-1062
Cell: 703-944-4263
Confirmation email to scheduled recruits
Hi <name>,
This is to confirm that you have been scheduled to participate in usability testing for DCEG’s Linkage website on <day> at <time>. The session will last approximately 30 minutes. Please confirm back to me that this day and time are still convenient for you.
Testing will be conducted remotely using GoToMeeting. Below you will find a link to the online conference and the phone number to call in.
<online conference information>
Thank you. I look forward to working with you.
Regards,
Audrey
Audrey Lipps
Sr. Human Factors Engineer
User Centered Design, Inc.
~~~~~~~~~~~~~~~~~~~~~~
Office: 703-715-1062
Cell: 703-944-4263
Attachment 4: NIH Privacy Act memo
1/6/2012 Page
File Type | application/msword |
File Title | DOCUMENTATION FOR THE GENERIC CLEARANCE |
Author | 558022 |
Last Modified By | Vivian Horovitch-Kelley |
File Modified | 2012-01-06 |
File Created | 2012-01-06 |