Form 1 #3 Attachments A1 and A4

Needs Assessment and Usability Testing of the

Science of Team Science Toolkit Website

OMB#: 0925-0589-03

Attachment A1: Participant Profile Questionnaire

Attachment A4: Interview Guides

Attachment A1: Participant Profile Questionnaire

The Science of Team Science Toolkit (TS Toolkit) web site serves several audience groups and it will be helpful to us to understand how you fit into those audience groups before participation in a usability test of the site. The following questions is intended to help us understand your job and your background.

Public reporting burden for this collection of information is estimated to average 5 minutes total, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: NIH, Project Clearance Branch, 6705 Rockledge Drive, MSC 7974, Bethesda, MD 20892-7974, ATTN; PRA (0925-0589-xx). Do not return the completed form to this address.

Use an X, bold, or the (Word) highlighter to mark your responses.

What is your background? [check all that apply] Communication Economics Education Epidemiology Evaluation Informatics/Library Science Psychology Public Health Social Sciences Statistics Other (please specify__________): Which positions describe you? [check all that apply] Program director at federal government Program director at non-profit organization Scientist Evaluator Academic researcher Student/ Trainee/ Fellow Administrative support staff Other (please specify):

Have you used the TS Toolkit Website before? Yes No If Yes to #3, what do you look for most often on the TS Toolkit web site? (a) (b) (c)

OMB# 0925-0589-03

Expiry Date: 5/31/2011

Attachment A4: Interview Guides

Needs Assessment and Usability Testing of the

Science of Team Science Toolkit Website

Public reporting burden for this collection of information is estimated to average 90 minutes total, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: NIH, Project Clearance Branch, 6705 Rockledge Drive, MSC 7974, Bethesda, MD 20892-7974, ATTN; PRA (0925-0589-xx). Do not return the completed form to this address.

Interview Guide, First and Second Rounds of Usability Testing

Intro: Thank you very much for taking part in usability testing for the Team Science Toolkit, being designed by the National Cancer Institute. Now that you’ve explored the Toolkit website, I’d like to ask you a few questions that will help us to identify how the website can be improved, both in terms of how it is designed, and the content of the website. The National Cancer Institute’s goal is to make this site better for you as a ________(Select one of the following, based on the role of the interviewee: scientist who has been engaged in team science/researcher who studies team science/individual who manages team science/individual interested in learning more about team science).

1. What did you anticipate you would find on the Toolkit website?

1. To what extent was the content of the website similar to or different from what you expectated to find?

2. Did you try to search for specific resources in the website? 

   1. Were you able to find them?

   2. How did you search fo the resources?

      1. Did you use the advanced search function?

   3. Were there any challenges in searching for resources?

3. Which specific resources did you find?

(FOR EACH RESOURCE, ASK QUESTION 4 AND ITS RELATED FOLLOW-UP QUESTIONS:)

4. What was your opinion of the resource?

   1. Do you think it would be helpful to you? And why or why not?

5. What did you think of the “attributes” page, where you can view the attributes of a resource, such as the author, year it was created, etcetera?

   1. Did you find that that was helpful?

   2. Was there any additional information you would have liked for it to include?

   3. Was there any information that wasn’t useful?

6. Were there any resources that you hoped to find, that were not present, or that you couldn’t locate? If so, what were they?

   1. What additional resources would you like to see included in the toolkit?

7. Did you read the blog?

   1. What was your opinion of the blog?

   2. Do you think it would be helpful to you? Why or why not?

   3. What kind of content would you like to see in future blog entries?

8. Did you read the “about TS” section?

   1. What was your opinion of the content of that section?

   2. Do you think it would be helpful to you? Why or why not?

   3. Is there any additional or different content you would like to see in that section of the Toolkit?

9. Before we wrap up:

   1. Do you have any additional feedback about the design and functionality of the website?

   2. Do you have any additional feedback about what you’d like to see in terms of additional or different content for the website?

   3. Is there any other feedback you want to give, about any of the topics we talked about today?

Thank you for sharing your feedback about the Team Science Toolkit. Your feedback will help us to enhance the design and content of the site. Do you have any questions for me about the Toolkit?

Interview Guide, Third Round of Usability Testing

Intro: Thank you very much for taking part in usability testing for the Team Science Toolkit, being designed by the National Cancer Institute. Now that you’ve explored the Toolkit website, I’d like to ask you a few questions that will help us to identify how the website can be improved, both in terms of how it is designed, and the content of the website. The National Cancer Institute’s goal is to make this site better for you as a ________(Select one of the following, based on the role of the interviewee: scientist who has been engaged in team science/researcher who studies team science/individual who manages team science/individual interested in learning more about team science).

1. Have you used the TS Toolkit Website before today?

If yes, how often do you use it, and what did you use it for?

If no, after the exposure to the website through usability testing today, do you think you would use it in the near future? What would you use it for?

2. How do you like the website so far? What components of the website do you consider to be most useful to your work? Please explain.

3. Have you downloaded or uploaded any tools, measures/instruments, and bibliographies to the website?

• If Yes, could you please tell us more about your experience with downloading or uploading the tools (or measures or instruments or bibliographies)? What are some aspects we can improve for you to download or upload the tools (or measures or instruments or bibliographies)?

• If No, how likely are you to download or upload a tool (or a measure or an instrument or bibliographies) to this site. Why or why not?

4. How do you feel about the expert blog, listserv, discussion boards, news section of the website? How frequently do you access or participate in these forms of social media? In what ways do you think these web features can be improved?

5. As a team scientist (or researcher/evaluator, program director, or any other role specification of the interviewee), are there any additional TS relevant topics you would like to see provided by this website that are not yet captured under the current version of the site? Please elaborate.

6. Do you have any additional comments about today's session or any additional advice to us as we move forward in the development of the next iteration of the TS Toolkit Website?

Thank you for sharing your feedback about the Team Science Toolkit. Your feedback will help us to enhance the design and content of the site. Do you have any questions for me about the Toolkit?

6

Science of Team Science #0925-0589-03