NIST, Information Technology Laboratory, MEMEX Data Collection

Search Task Participant Worksheet

Participant number: ________________ Date: ______________ Time: _____________

Question number: _______________

Question type: _________________

System: _______________________

Scenario:

(Here is a brief backgrounder on the question helping the participant know why s/he’s asking it.)

Question:

(question goes here)

Participant notes (or recorded online):

OMB Control #0693-0043

Expiration Date: 12/31/2018

Post-task questionnaire

1. Do you feel that this question was operationally relevant or useful in your investigative search process?

2. How easy or difficult did the UI make it to enter the parameters of the search?

__Very easy __Easy __Neutral __Difficult __Very difficult

Why did you select this rating?

3. The generated results were what I expected to display given my search query.

__Strongly agree __Agree __Neutral __Disagree __Strongly Disagree

Why did you select this rating?

4. This question would be difficult to search and get good results for no matter what system I used.

__Strongly agree __Agree __Neutral __Disagree __Strongly Disagree

What about the question did you find difficult?

5. The process took an acceptable amount of time to answer the question.

__Strongly agree __Agree __Neutral __Disagree __Strongly Disagree

6. I would have to use another tool to find answers to this question.

__Strongly agree __Agree __Neutral __Disagree __Strongly Disagree

If you agreed (strongly or agree) what tool or tools would you have used?

How would you have used that tool or tools?

This collection of information contains Paperwork Reduction Act (PRA) requirements approved by the Office of Management and Budget (OMB). Notwithstanding any other provisions of the law, no person is required to respond to, nor shall any person be subject to a penalty for failure to comply with, a collection of information subject to the requirements of the PRA unless that collection of information displays a currently valid OMB control number. Public reporting burden for this collection is estimated to be 10 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed and completing and reviewing the collection of information. Send comments regarding this burden estimate or any aspect of this collection of information, including suggestions for reducing this burden, to the National Institute of Standards and Technology, Attn: Ian Soboroff, [email protected], 301-975-3987.

Search Task Facilitator worksheet

Participant number: ________________ Date: ______________ Time: _____________

Question number: _______________

Question type: _________________

System: _______________________

Observations:

Review your workflow notes with the Participant, noting answers to the following questions:

1. Do any parts of this workflow stand out to you as places where the tool was particularly helpful? Why?
   
   
   
   
   
   

2. Do any parts of this workflow remind you of times when the tool was particularly difficult to use?
   
   
   
   
   
   
   

3. Do any parts of this workflow remind of times when the tool did not give you useful information?
   
   
   
   
   
   
   

4. How closely does this workflow mirror the way you typically like to run your investigations?
   
   
   
   
   
   
   

5. Does anything else stand out to you that you’d like to discuss about the process you went through in trying to answer this question?