Various Governments Pretesting Activites

F-73 Cognitive Interview Protocol

Draft: June 7, 2012

(This protocol is a guide – the questions presented here will not necessarily be asked exactly as worded in the protocol or in this order. It is important to note that not all questions will be asked in every interview.)

Background Information

1. Respondent Background

• Tell me a little about this agency:

  • What sorts of activities is it involved in?

• What is your role in this agency?

• Have you filled out government forms in the past? If so, which ones?

• Generally speaking, how do government forms get completed at this agency?

  • Does more than one person fill out a form? If so, what is that process? Do you communicate with other people to complete the form?

• When does your fiscal year end? About how long does it take for quarterly figures to be ready?

Now I am going to hand you a copy of the questionnaire. We will go through it page by page. Please write on it, and complete it as if we were not here. I will ask you questions when you have finished the page.

Cognitive Interview

General Probes

• In your own words, what was that question asking?

• What are you thinking about?

• Can you tell me more about that?

• You answered, “…” because…?

• I want to make sure I understand, can you explain that again?

• Can you tell me how you arrived at that answer? What did you include? What did you exclude? What records did you use?

• Reflect back on R’s answer and ask R to correct (“I want to make sure I have it right. I think you said, “…?”)

1. Cover page

• What is your initial impression upon seeing the form?

• In your opinion, what is the most important information on this page?

• What is the least important?

• Is there any (other) information you would like to see here? What would that be?

• What information do you need prior to filling out the form?

2. Instructions

-Probe on descriptions offered of records, procedures, interpretations, etc.

-Observe whether R appears to read the question and instructions

• Did you read any of the information on this page?

  • (If yes) What did you read?

3. Item 2A (Property taxes)

• What does the word “imposed” mean to you?

• How would you go about answering this question? What records would you need to consult in order to answer this question?

• Is this information readily available?

• Is this information available here or would you need to go somewhere else to get this information? Where?

• What is your reaction to the Include and Exclude statements?

• How easy or difficult would you say this question is?

4. Item 2B (General sales and gross receipts taxes)

• How would you go about answering this question? What records would you need to consult in order to answer this question?

• Is this information readily available?

• Is this information available here or would you need to go somewhere else to get this information? Where?

• What is your reaction to the Include and Exclude statements?

• How easy or difficult would you say this question is?

5. Item 3C1 (Local individual income taxes)

• How would you go about answering this question? What records would you need to consult in order to answer this question?

• Is this information readily available?

• Is this information available here or would you need to go somewhere else to get this information? Where?

• What is your reaction to the Include and Exclude statements?

• How easy or difficult would you say this question is?

6. Item 3C2 (Local corporation net income tax)

• How would you go about answering this question? What records would you need to consult in order to answer this question?

• Is this information readily available?

• Is this information available here or would you need to go somewhere else to get this information? Where?

• What is your reaction to the Include statement?

• How easy or difficult would you say this question is?

Wrap-up

• Would the information requested on this form generally be available in this department, or would information have to come from some other department/staff member?

  • How would you go about getting that information?

  • Would you pass the form over to that department, or just get information from them over the phone/email/in-person?

• How much time would it take you to complete this report (actual time, not elapsed time)?

• Is collecting on a quarterly basis reasonable? If no, how often should this information be collected?

• Overall, how easy or difficult was it to complete this form? Which were the easiest questions to answer? Which were the hardest to answer?

• What are you thoughts on completing this form on the internet?

• Who would be the best person to address this form to? What other titles might be applicable at other comparable governments?

• (If respondent/government had not returned survey previously) Why have you not returned this survey in the past?

• What is your reaction to this shorter version of the form? (show them the previous version if necessary)

• How would you prefer to be reminded if this survey form was overdue? If we emailed you, would you find that acceptable?

• Is there anything else we might do to encourage response to this survey?

• Any other comments?

Thank you for your assistance today.

4