AIES Pilot Study
Respondent Debriefing Interview Protocol
Phase II
Winter/Spring 2023
This protocol is a guide – the questions here will not necessarily be asked exactly as worded in the protocol or in this order. Not all questions will be asked in every interview. As much information about interview participants and enterprises/establishments should be obtained prior to the interview as possible. In some cases, probing may need to be adjusted based on the background research that has been conducted and/or in response to participants’ insights.
These interviews will be guided by four research questions, each with sub-questions:
Research Question 1: Do respondents recall receiving the various communications?
Research Question 2: Did respondents comprehend the initial request?
Did respondents understand that the pilot was mandatory?
Did respondents understand that the pilot was replacing some annual surveys?
Were respondents able to access their surveys based on instructions embedded in the communications?
Research Question 3: What component of the messaging, if any, motivated respondents to start the survey?
Materials: Protocol, consent form, mailings/emails
Method: We will conduct the interviews by phone, Microsoft Teams, or we will conduct the interviews in person, depending on availability and federal employee travel restrictions.
Expected length of interview: 1 hour (60 minutes) maximum
General probes that may be used throughout the interview:
What else can you tell me about this?
Can you tell me more about that?
What looked unclear or is confusing here?
Introduction
If necessary: I sent you a consent form in an email today – did you get a chance to sign that? If not, please do so now, and then we’ll get started.
Thank you so much for agreeing to talk with me today!
As part of the pilot program for the new Annual Integrated Economic Survey, we are following up with some companies to learn more about you experience while participating.
I am part of a group within the Census Bureau that makes sure that our surveys are performing as expected and provides feedback to other parts of the Bureau about ways to improve the overall experience. I’m talking with you today because of your unique role in testing out the new AIES survey.
Remember, my job is to improve the survey experience. Please be candid and frank in your responses. Our interview is being conducted under the authority of Title 13, which means that your responses are confidential, and neither your name nor the name or identifying information about your company will be included in any of our findings.
Do you have any questions before we get started?
I’d like to record our session today so that when I go to analyze the results of these interviews, I can use the recording to pick up on anything I may have missed in my notes. Do I have your permission to record our session today?
<<Turn on recorder>>
Company Background
Tell me a little bit about your business. What types of goods or services does this business provide?
How many locations does your business currently operate? In how many states? In how many countries?
Is this a foreign or domestic company?
Are there related companies?
Did you have any confusion about which parts of the company to include when answering the survey?
What is your role in the company? How long have you been with the company?
What is your role in the process for responding to Census Bureau surveys?
Examples: gathering data, entering data, consulting with data providers, etc.
Are you typically the person within your company that receives survey requests?
Can you tell me about that process?
Do the Census Bureau letters typically go directly to you, or do they have to get routed to you by others? How long does that process generally take?
Do the Census Bureau emails typically go directly to you, or do they have to get routed to you by others? How long does that process generally take?
Communication Materials
(Each respondent will only have received and be asked about a subset of the following communications. Respondents will be provided with copies of each communication they are being asked about.)
Advanced Mailing
Do you recall receiving this letter? What were your first impressions?
Does anything about this letter stand out to you?
What do you think the purpose of this letter was?
Based on this letter, what do you think the Annual Integrated Economic Survey is?
Is there anything in this letter that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this letter? If so, why did you decide to do that?
Advanced Email
Do you recall receiving this email? What were your first impressions?
Does anything about this email stand out to you?
What do you think the purpose of this email was?
Based on this email, what do you think the Annual Integrated Economic Survey is?
Is there anything in this email that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this email? If so, why did you decide to do that?
Do you recall if the subject line grabbed your attention? Do you feel the subject line was appropriate?
Advanced Phone Call
Do you recall receiving a phone call in early February? What were your first impressions?
Did anything about that phone call stand out to you?
Do you recall the purpose of that phone call?
Do you recall taking any action after receiving that phone call? If so, why did you decide to do that?
Initial Request Mailing
Do you recall receiving this letter? What were your first impressions?
Does anything about this letter stand out to you?
What do you think the purpose of this letter was?
Is there anything in this letter that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this letter? If so, why did you decide to do that?
(If the respondent used their authentication code) Were you able to follow the instructions in the letter to access your survey?
Did you notice any reasons for doing the survey?
What were they?
What did you think about these reasons?
Did you think you had to do this survey?
Is there any information missing from this letter that you would have found helpful?
Initial Request Email
Do you recall receiving this email? What were your first impressions?
Does anything about this email stand out to you?
What do you think the purpose of this email was?
Is there anything in this email that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this email? If so, why did you decide to do that?
(If the respondent used their authentication code) Were you able to follow the instructions in the email to access your survey?
Did you notice any reasons for doing the survey?
What were they?
What did you think about these reasons?
Did you think you had to do this survey?
Is there any information missing from this email that you would have found helpful?
Reminder Phone Call (Live)
Do you recall receiving a phone call in early March? What were your first impressions?
Did anything about that phone call stand out to you?
Do you recall the purpose of that phone call?
Do you recall taking any action after receiving that phone call? If so, why did you decide to do that?
Due Date Reminder Email
Do you recall receiving this email? What were your first impressions?
Does anything about this email stand out to you?
What do you think the purpose of this email was?
Is there anything in this email that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this email? If so, why did you decide to do that?
Do you recall if the subject line grabbed your attention? Do you feel the subject line was appropriate?
Reminder Phone Call (Automated)
Do you recall receiving a phone call in early March? What were your first impressions?
Did anything about that phone call stand out to you?
Do you recall the purpose of that phone call?
Do you recall taking any action after receiving that phone call? If so, why did you decide to do that?
1st Past Due Follow-up Email
Do you recall receiving this email?
What do you think the purpose of this email was?
Is there anything in this email that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this email? If so, why did you decide to do that?
1st Past Due Follow-up Call
Do you recall receiving a phone call in early April?
Do you recall the purpose of that phone call?
Do you recall taking any action after receiving that phone call? If so, why did you decide to do that?
1st Past Due Follow-up Mailing
Do you recall receiving this letter? What were your first impressions?
Does anything about this letter stand out to you?
What do you think the purpose of this letter was?
Is there anything in this letter that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this letter? If so, why did you decide to do that?
2nd Past Due Follow-up Email
Do you recall receiving this email?
What do you think the purpose of this email was?
Is there anything in this email that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this email? If so, why did you decide to do that?
2nd Past Due Follow-up Call
Do you recall receiving a phone call in early April?
Do you recall the purpose of that phone call?
Do you recall taking any action after receiving that phone call? If so, why did you decide to do that?
2nd Past Due Follow-up Mailing
Do you recall receiving this letter? What were your first impressions?
Does anything about this letter stand out to you?
What do you think the purpose of this letter was?
Is there anything in this letter that was confusing to you, or might be confusing to others?
Do you recall taking any action after receiving this letter? If so, why did you decide to do that?
Overall Impressions
In general, how likely are you to read these letters and emails when/if you receive them?
How did you feel about the number of communications you received for this survey?
What types of communications do you generally prefer (i.e. letters, emails, phone calls)?
V. In-Person Possibility
In the past, we’ve found some types of interviews get results that are more true to how you might fill out a survey when we do those interviews in person. How would you feel about that?
Would there be certain requirements on our end that would make you more comfortable? Such as knowing the interviewer’s vaccination status? What about a recent negative test?
Would you have a preference between in-person or virtual interviews?
Does your company currently have a physical office?
How often are you in that office?
Is that somewhere we would hypothetically be able to conduct an interview?
Are there any protocols around visitors? Is your company meeting with visitors?
Is there anything else we should think about when considering in-person interviews as an option?
Wrap-up
That’s all the questions I have for you today! Do you have any other comments, questions, or suggestions for us?
Thank you so much for your time today.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Melissa A Cidade (CENSUS/ESMD FED) |
| File Modified | 0000-00-00 |
| File Created | 2023-12-22 |