Census of Aquaculture (COA)
Potential probe questions for cognitive interviews
For any/all sections:
How did you arrive at an answer for that question?
In your own words, what does this question/this term mean to you?
Were there any terms used in this section that you did not understand?
Would you need to use your records to answer this question?
Would you need to talk to someone else in your organization to answer this question/section?
Did the respondent leave any cells blank in this section?
Did the respondent read the instructions? If yes, were the instructions clear? If no, why not?
Section 1:
(For Q1) In your own words, what is this question asking you? What should you include? Exclude?
What does the term produce mean to you? Does this match your own definition for produce?
(For Q3) In your own words, what is this question asking you? What should you include? Exclude?
What does the term distribute mean to you? Does this match your own definition for distribute?
(For Q4) In your own words, what is this question asking you? What should you include? Exclude?
What does the term transfer mean to you? Does this definition match your own definition for transfer?
Did the respondent follow the correct skip pattern? If no, why not?
Section 2:
What does the term “sources” mean to you? Did the term stand out to you in the context of the question? Why or why not?
In your own words, what is this question is asking?
How confident are you in your answer? Would you need to consult someone to be sure? Or consult your records to be sure?
Section 3:
(For 1ai) In your own words, what is this question asking you?
(For 2ai) In your own words, what is this question asking you?
(For 1ai and 2ai) Did the respondent see the “or” statement?
Were there any questions in this section that you couldn’t answer? Why?
Were there any terms used in this section that you did not understand?
(For 3c(i) and (ii)) How did you arrive at an answer for these questions?
Would you need to use your records to answer any of these questions?
Section 4:
Tell me about this operation’s catfish production.
(For Q6) Did the respondent complete the table correctly? If no, what did they miss and why?
(For Q7) Did the respondent complete the table correctly? If no, what did they miss and why?
Was this section easy or difficult to complete? Why?
Section 5:
Tell me about this operation’s trout production.
Did you have distributed trout? If yes, where did you report that?
(For Q2) Did the respondent read the instructions?
(For Q3) Did the respondent complete the table correctly? If no, what did they miss and why?
(For Q4) Did the respondent complete the table correctly? If no, what did they miss and why?
Was this section easy or difficult to complete? Why?
Section 6:
Tell me about this operation’s food and sport fish production. What types of aquaculture did you include in your answer?
(For Q2) Did the respondent complete the table correctly? If no, what did they miss and why?
Were there any terms you didn’t understand?
Was this section easy or difficult to complete? Why?
Section 7:
Tell me about this operation’s baitfish production.
(For Q3) Did the respondent read the instructions?
(For Q3) Did the respondent complete the table correctly? If no, what did they miss and why?
Was this section easy or difficult to complete? Why?
Section 8:
Tell me about this operation’s crustacean and mollusk production. What did you include?
In your own words, what is this table asking you to do?
Did you notice the instructions with columns 6 and 7?
If yes, in your own words, what are they telling you to do?
Did you notice the instructions with column 8?
If yes, in your own words, what are they telling you to do?
Section 9:
Tell me about this operation’s ornamental fish production. What specific types of ornamental fish did you include?
(For Q2) Did the respondent complete the table correctly? If no, what did they miss and why?
Did you notice the instructions with column 4?
In your own words, what are they telling you to do?
Section 10:
Tell me about the aquaculture production you reported in this section.
Did the respondent complete this section correctly?
Did the respondent report any aquaculture as “other” aquaculture?
Are there any categories that you don’t understand?
Section 11:
Tell me about where you sell your aquaculture.
Does the respondent raise trout or catfish? If so, did they include them here?
Did the respondent complete this section correctly?
Did the respondent report any aquaculture as “other” aquaculture?
Did the respondent use percentages or numbers in the cells?
Section 12:
(For Q1) Did the respondent follow the skip instructions correctly? If no, why not?
(For Q2) Did the respondent complete the table correctly? If no, what did they miss and why?
Did the respondent report any aquaculture as “other” aquaculture?
Section 13:
Did the respondent have any issues with this section?
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Ott, Kathy - NASS |
| File Modified | 0000-00-00 |
| File Created | 2021-01-22 |