QID Supplemental Questions following CAWI

Follow-up Questions for the Census of Agriculture (COA) Content Test

OMB Number 0535-0243

Relating to the Computer Assisted Web Interview (CAWI) Instrument

And the Use of

Non-Edited Respondent Data (NERD)

Testing and Analysis Sub-team - Kathy Ott, Joe Rodhouse, Gavin Corral, Jared Pratt, Kenny Herrell, Zachary Terner

Updated August 25, 2020

In the Computer Assisted Web Interview (CAWI), following the opening introduction screen and OMB information will be the following text:

“You may notice that some questions in this survey may be pre-filled with information we have from previous surveys of this operation.  Please answer each question and change pre-filled answers if this operation’s current answers are different.  We hope this information helps you complete the survey.  Please click NEXT to continue.”

On top of the “Acreage” screen (which is the first possible NERD screen): 

“Some questions on this screen may be pre-filled with information we have from previous surveys of this operation.  Please answer each question and change pre-filled answers if this operation’s current answers are different.”

At the end of each Computer Assisted Web Interview (CAWI), NASS wants to obtain respondent feedback on the instrument, as well as the use of the Non-Edited Respondent Data (NERD). NASS would like to do this by adding the following questions at the very end of the CAWI instrument.

1. After the questionnaire is submitted, offer the System Usability Scale (SUS) to all respondents. The SUS questions should use the following answer response format:

The SUS questions are:

1. I think that I would like to use this web survey when completing the Census of Agriculture instead of a paper survey.

2. I found this web survey unnecessarily complex.

3. I thought the web survey was easy to use.

4. I think that I would need the support of a technical person to be able to use this web survey.

5. I found the various functions in this web survey were well integrated.

6. I thought there was too much inconsistency in this web survey.

7. I would imagine that most people would learn to use this web survey very quickly.

8. I found the web survey very cumbersome to use.

9. I felt very confident using the web survey.

10. I needed to learn a lot of things before I could get going with this web survey.

11. How many minutes did it take you to complete this web survey? _________minutes

2. After administering the SUS, for only those respondents who had NERD data in the instrument, administer these questions on the same scale, but add a “Not Applicable” (On a scale of 1 to 5, with 1 meaning strongly disagree and 5 meaning strongly agree, and include an option for “Not Applicable”):

Now, we would like to get your feedback about the pre-filled information used in this survey.

1. I understood what the pre-filled information were.

2. I recall providing the pre-filled information used in this survey on a previous NASS survey.

3. The pre-filled information was accurate.

4. The pre-filled information made it easier for me to complete the survey.

5. The pre-filled information helped me finish the survey faster.

6. I would have liked to see pre-filled information in more questions.

7. Overall, I have a positive reaction to pre-filled information being used in the survey.

8. Please provide any feedback about the pre-filled information. <open ended box with at least 300 (?) characters>

3