Attachment C Survey 2 Instrument

Attachment C

Survey 2

You are invited to participate in this survey because approximately one month ago you completed a survey for the Bureau of Labor Statistics (BLS).

This is a survey for the US Bureau of Labor Statistics. This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. This survey will take approximately 10 minutes to complete. Your participation is voluntary and you have the right to stop at any time.

We are looking for information about how respondents answer our surveys. Please take your time as you answer these questions. The information you provide will contribute to valuable research at the BLS, one of the leading Federal statistical agencies.

This survey is being administered by Qualtrics and resides on a server outside of the BLS Domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response. By proceeding with this study, you give your consent to participate in this study.

In order for us to match your previous responses to this survey, please provide your Mechanical Turk Worker ID.

What is your Mechanical Turk Worker ID?: ____

<page break>

About a month ago, you participated in an online survey for the Bureau of Labor Statistics that asked questions about yourself and up to 2 other members of your household. The survey asked demographic and work questions about you and members of your household. It also asked some questions about the place where you live.

Do you recall participating in that survey?

• Yes

• No

(If yes), Please summarize what you recall about your experience completing that survey. You can mention how you felt about the survey questions, what stood out to you most, or any specific questions that you recall: _______

(If no), Although it may be hard to remember, please think back to one month ago when you completed an online survey with demographic, work, and housing questions. Some of these questions asked about race, age, income, disability, heating fuel, and commuting.

Please summarize anything that you can recall about your experience completing that survey.: _______

<page break>

List up to 10 adjectives that describe your experience completing that survey one month ago:

1. ________

2. ________

3. ________

4. ________

5. ________

6. ________

7. ________

8. ________

9. ________

10. ________

<page break>

From the list below, please select all of the words you would use to describe your experience completing these survey questions. [order of words in each category randomized; 15 words will be selected from the Pre-testing phase to be displayed here; 5 per category]

Positive	Negative	Neutral
Interesting	Bothersome	Fine
Easy	Annoying	Standard
Important	Inconvenient	Typical
Useful	Time-consuming	Normal
Rewarding	Difficult	Reasonable
Motivating	Intrusive	Tolerable
Valuable	Disruptive	Necessary
Good	Stressful	Obligatory
Beneficial	Effortful	Civic Duty
Helpful	Boring	Expected
Relevant	Personal	Appropriate
	Hassle	Responsibility
	Draining
	Repetitive
	Sensitive

<page break>

Thinking back to when you completed the survey one month ago, please rate your experiences completing the survey questions about you and your household.

Questions with * denote that participants will be randomly assigned to receive scale labels with the qualifier ‘A lot’ vs. ‘Somewhat’

*How burdensome was it to complete the survey questions one month ago?

• Not at all burdensome

• [A little / Somewhat] burdensome

• Moderately burdensome

• Very burdensome

• Extremely burdensome

• N/A, I do not recall completing the survey

(If very/extremely): What made the survey burdensome?: _________

<page break>

Thinking back to the letter you imagined getting in the mail earlier, which of the following factors would contribute to finding this survey burdensome? (select all that apply) display only applicable items for burden condition:

• Time it takes to complete the survey

• Number of phone calls made to me

• Number of in person visits made to me [only for high burden condition]

• Number of pieces of mail sent to me

• Number of times I am asked to complete the survey

• The questions included on the survey

• None of these; I did not find the survey burdensome

• Other, specify: ___

*How burdensome would it be to complete this survey one more time?

• Not at all burdensome

• [A little / Somewhat] burdensome

• Moderately burdensome

• Very burdensome

• Extremely burdensome

• N/A, I do not recall completing the survey

*How burdensome would it be to complete this survey every month for eight months in a row?

• Not at all burdensome

• [A little / Somewhat] burdensome

• Moderately burdensome

• Very burdensome

• Extremely burdensome

• N/A, I do not recall completing the survey

*How much effort did you put into answering the survey questions one month ago?

• No effort

• [A little / Somewhat of an] effort

• Moderate effort

• A lot of effort

• Extreme effort

• N/A, I do not recall completing the survey

*How easy or difficult was it to answer the survey questions one month ago?

• Very easy

• [A little/Somewhat] easy

• Neither easy nor difficult

• [A little/Somewhat] difficult

• Very difficult

• N/A, I do not recall completing the survey

*How sensitive were the survey questions you answered one month ago?

• Not at all sensitive

• [A little / somewhat] sensitive

• Moderately sensitive

• Very sensitive

• Extremely sensitive

• N/A, I do not recall completing the survey

<page break>

Imagine you received the following envelope in your mailbox on <insert current date>. You open the envelope and find this letter. Please read the letter carefully, as you will answer some questions about it later.

<insert low / high burden letter, depending on which one they did not receive in Survey 1>

Now, imagine an interviewer from the federal government has some questions about you and your household. Please answer the following questions.

1. How many people, 15 years old or older, are living or staying with you, including yourself?

   • 1 (just yourself)

   • 2 people

   • 3 people

   • 4 people

   • 5 people

   • 6 or more people

2. <for 1-5 people> Please enter the initials (first, middle, and last) of each of the people who are living or staying with you (do not include yourself).

<for 6+ people>You indicated that more than one other person is living or staying with you. Please enter the initials (first, middle, and last) of each of the people who are living or staying with you (do not include yourself). In the spaces below, please indicate how you are related to each person.

If you have 6 more people living or staying with you, please select 5 of them.

<insert appropriate number of text boxes based on response to Q1>

<page break>

1. (skip if only 1 person living in the household) You indicated that [TEXT FILL] other [person/people] are living or staying with you. In the space(s) below, please indicate how you are related to [that/each] person. <instrument will randomly select 1 other HH member>

[TEXT FILL initials of Other HH member]

[TEXT FILL initials of Other HH member]

<Dropdown menu with the following selections for each person>

• Opposite sex husband/wife/spouse

• Opposite sex unmarried partner

• Same sex husband/wife/spouse

• Same sex unmarried partner

• Child

• Grandchild

• Brother or sister

• Parent

• Other relative (aunt, uncle, cousin, in law)

• Foster child

• Roommate or housemate

• Other nonrelative

<page break>

Next, we have some questions about you.

Insert demographic items (See Attachment G)

<page break>

You indicated that [TEXT FILL OTHER HH MEMBER INITIALS], is living or staying with you. Please answer the following questions about Person 2.

Insert demographic items (See Attachment G)

<page break>

Now we have a few questions about your household generally.

[insert questions about HH, (See Attachment G)]

<page break>

We would like to get feedback on your involvement in this survey as a whole, from the first survey you completed one month ago until now.

*How burdensome was it to complete this survey?

• Not at all burdensome

• [A little / Somewhat] burdensome

• Moderately burdensome

• Very burdensome

• Extremely burdensome

(If very/extremely): What made the survey burdensome?: _________

<page break>

Which of the following factors contribute to finding this survey burdensome? (select all that apply) display only applicable items for burden condition:

• The survey (is/is not) required by law

• Time it takes to complete the survey

• Number of phone calls made to me

• Number of in person visits made to me

• Number of pieces of mail sent to me

• Number of times I am asked to complete the survey

• The questions included on the survey

• Having to answer about other household members

• I did not find the survey burdensome

• Other, specify: ___

*How burdensome would it be to complete this survey one more time?

• Not at all burdensome

• [A little / Somewhat] burdensome

• Moderately burdensome

• Very burdensome

• Extremely burdensome

*How burdensome would it be to complete this survey every month for eight months in a row?

• Not at all burdensome

• [A little / Somewhat] burdensome

• Moderately burdensome

• Very burdensome

• Extremely burdensome

*How much effort did you put into answering these survey questions?

• No effort

• [A little / Somewhat of an] effort

• Moderate effort

• A lot of effort

• Extreme effort

*How easy or difficult was it to answer these survey questions?

• Very easy

• [A little/Somewhat] easy

• Neither easy nor difficult

• [A little/Somewhat] difficult

• Very difficult

*How sensitive were these survey questions?

• Not at all sensitive

• [A little / somewhat] sensitive

• Moderately sensitive

• Very sensitive

• Extremely sensitive

*How likely would you be to participate in this survey request one more time?

• Not at all likely

• [A little/somewhat] likely

• Moderately likely

• Very likely

• Extremely likely

*How likely would you be to participate in this survey every month for eight months in a row?

• Not at all likely

• [A little/somewhat] likely

• Moderately likely

• Very likely

• Extremely likely

*How beneficial would it be to society to complete this survey?

• Not at all beneficial

• [A little / Somewhat] beneficial

• Moderately beneficial

• Very beneficial

• Extremely beneficial

<page break>

Earlier, you answered questions about the following other member of your household,

<insert initials other HH member>

*How burdensome was it to complete the survey questions about <insert initials>?

• Not at all burdensome

• [A little / Somewhat] burdensome

• Moderately burdensome

• Very burdensome

• Extremely burdensome

*How sensitive was it to complete the survey questions about <insert initials>?

• Not at all sensitive

• [A little / somewhat] sensitive

• Moderately sensitive

• Very sensitive

• Extremely sensitive

*How easy or difficult was it to answer the survey questions about <insert initials>?

• Very easy

• [A little/Somewhat] easy

• Neither easy nor difficult

• [A little/Somewhat] difficult

• Very difficult

<repeat for up to one more HH member>

(If selected Very/Extremely Sensitive or Difficult) Please describe how your experience answering questions about other household members was sensitive/difficult: ___________________

<page break>

About how long did you spend answering these survey questions?

____ minutes

Do you feel that the time it took you to complete the survey was less than you expected, about what you expected, or more than you expected?

• Less than I expected

• About what I expected

• More than I expected

<page break>

What other comments or feedback do you have about your experience completing these survey questions and burden of the survey? ______

<page break>

Participant Debriefing:

Thank you for participating in this survey. We would like to tell you a bit more about this research. The survey letters presented in this research were entirely fictional. You have not been selected to participate in an official government survey. However, questions you answered are similar to existing surveys conducted by the Bureau of Labor Statistics and Census Bureau.

You will not be contacted again to participate in this research. Your responses will be used only to improve our existing surveys and to learn more about the burden of our surveys.

Thank you again for participating!

To receive payment for participating in this study, please copy the validation code shown below and paste it in the form on this page for this HIT and submit the task. We will check that code you paste in matches our own database and then approve your payment. 

Your code is: ____