Form 1 Protocol and Test Questions

Florida ABAWD Message Testing Protocol

Participant ID #: |___|___|___|___|___| ___|___|___|

Interview Date: |___|___| / |___|___| / |_2_|_0_|_1_|_9_| (mm/dd/yyyy)

Interviewer initials: |___|___|

Start Time: ____________ AM / PM End Time: ____________ AM / PM

Read or paraphrase the following intro text:

Greeting: Hello. My name is ________________, and I work for the Census Bureau. Thank you for agreeing to participate in our study.

What: Today we are talking to people about the information they receive from the Food Assistance (SNAP) program. The information should be clear and easy to understand, so people who are eligible receive their benefits and know about rules and requirements to continue participating in SNAP. We have found that the best way to test letters and messages is to meet with people in person and get their feedback as they read the materials. You will be helping us test messages and communications for SNAP recipients that are eligible for certain work requirements.

[HAND PARTICIPANT CONSENT FORM]

Confidentiality: This is a consent form. It tells you a little bit about the study and gives me permission to audio record this interview. Our session today is completely confidential. Your participation in this study is completely voluntary. You may decline to answer any particular question and you may stop the interview at any time. We do not share information with anyone. Only the people on the project have access to the recording and we do not use any names in our reports. Take a look and let me know if you have any questions. Please sign it when you are finished.

[SIGN CONSENT FORM AFTER PARTICIPANT SIGNS]

Think Aloud: As you read the materials today, I would like you to think aloud. I am interested in the thoughts and reactions that go through your mind as you process the messages. I would like you to tell me everything that you are thinking and feeling as we go through these materials.

Practice: Lets practice before we start. [SHOW PARTICIPANT PRACTICE PARAGRAPH]

Please think aloud as you read this short paragraph.

Practice probes: In your own words, can you tell me what this paragraph is saying?

Did you find any part of it difficult to understand?

Thank you. I am going to ask you these types of questions again. I will also ask you about your reactions to what you read. I really want to hear your opinions and reactions, so don’t hesitate to speak up whenever something is unclear, or not easy to understand. Do you have any questions before we begin? [TURN ON RECORDER. CHECK BATTERIES]

1. Information in application

[SHOW RESPONDENT APPLICATION]

This is a paper version of the application for SNAP benefits. You don’t have to fill this out. [POINT TO OR HIGHLIGHT THE ABAWD INSTRUCTIONS] Can you take a minute and read this paragraph aloud? Please remember to think aloud and tell me any immediate reactions you have to what it says.

In your own words, can you tell me what the paragraph is saying?

Have you read something like this before?

Based on your understanding, can you give me an example of a person who would be counted as an ABAWD?

Are there any parts of this that are confusing or unclear?

If yes: Which parts?

2. Approval Notice

Thank you for your responses so far. Here is a letter that you might receive after applying for benefits. Please take a few minutes to read the letter and then we will talk about it. If necessary: Please remember to think aloud as you read.

[SHOW RESPONDENT APPROVAL NOTICE]

In your own words, can you tell me what this letter is saying?

Did you find any part of it difficult to understand?

If yes: Which parts were difficult?

What would you expect to happen after receiving this letter?

Was there something you expected to see in this letter that was not here?

Let’s take a look at this paragraph. [POINT TO OR HIGHLIGHT ABAWD PARAGRAPH] We are particularly interested in making sure this part is clear and easy to understand. Do you think this section is clear?

If yes: Can you tell me in your own words what this section is saying?

If no: What about this section is unclear?

3. Notice of Mandatory Participation

Thank you. Here is a letter that you should receive if you were eligible for the ABAWD time limits. [GIVE PARTICIPANT NOMP LETTER] Take a look at the letter. Let me know when you are finished and we will talk about it. Please remember to think aloud as you are reading.

What, in your opinion, is the main point of this letter?

What is the letter asking you to do?

Are there any parts of the letter that are unclear or confusing? Which parts?

What does the term “obligations” mean to you in this section? [POINT TO OBLIGATIONS SECTION]

[POINT TO OR HIGHLIGHT THE FAILURE TO PARTICIPATE SECTION – AT THE BOTTOM OF PAGE 2 ]

In your own words, what is this section telling you?

[POINT TO OR HIGHLIGHT THE IMPORTANT NOTICE PAGE –PAGE 3 ]

Did you see this page when you looked at the letter earlier?

If no: Take a minute to look over this section and let me know when you are finished and I will ask you about it.

In your own words, can you tell me what this section is saying?

Thank you. The next letter is one that you might receive if the Food Assistance program thought that you or someone in your household did not meet the ABAWD work requirements. Please take a few minutes to read the letter and then we will talk about it. If necessary: Please remember to think aloud as you read.

[SHOW PARTICIPANT SANCTION LETTER A]

In your own words, can you tell me what this letter is saying?

Did you find any part of it difficult to understand?

If yes: Which parts were difficult?

What would you expect to happen after receiving this letter?

Was there something you expected to see in this letter that was not here?

If you could make any changes to this notice, what would you change?

[SHOW PARTICIPANT SANCTION B OR GOOD CAUSE NOTICE]

In your own words, can you tell me what this letter is saying?

Did you find any part of it difficult to understand?

If yes: Which parts were difficult?

What would you expect to happen after receiving this letter?

Was there something you expected to see in this letter that was not here?

Debriefing Questions:

Thank you. Just a few more questions before we are finished.

1. Is there any more information that you think would be helpful for people who are ABAWDs?

2. Have you ever been notified that you are required to comply with the ABAWD time limit?

   1. If yes: Was that notification clear and easy to understand? Tell me more about what the notices said. How were you notified?

3. In the past, have you had any issues receiving information from the Food Assistance program?

4. If you find yourself having trouble with a form or survey, what do you do at home?

   1. Do you call for help? Who tends to help you?

   2. Are there other things you do when you have trouble filling out forms?

5. Government agencies collect data when people fill out forms for programs. Just like applying for food assistance benefits. Do you think this data should be shared with other government agencies?

Is there anything else you would like to add that we didn’t get a chance to talk about today?

[ASK PARTICIPANT TO FILL OUT VOUCHER FORM. GIVE PARTICIPANT $40]

Practice Paragraph

Apple put their new device in the hands of different technology specialists to give them the chance to try it out. The overall impression was very positive, but there were also some complaints. The "infinite" screen is a lot larger than the earlier models, there is no start button (the biggest difference) or fingerprint reader, and it includes facial recognition and wireless charging.

Approval Notice

Sanction Letter A

Sanction Letter B

10