Form Attachment 2 Attachment 2 Survey Protocol

Attachment 2: Survey instrument

Welcome! Thanks for your interest in this study.

This study is part of our research into how to improve surveys. Please do your best to respond to the questions accurately. We are not collecting any personally identifiable information in the survey questions.

 The study should take about 10 minutes. Please only start the study when you will be able to complete the whole study without interruption.

 Please do not use your browser's back button. 

This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141 (Expiration Date: March 31, 2021). Without this currently-approved number, we could not conduct this survey. We estimate that it will take on average 10 minutes to complete this survey. Your participation is voluntary, and you have the right to stop at any time. This survey is being administered by SurveyMonkey and resides on a server outside of the BLS Domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response. By proceeding with this study, you give your consent to participate in this study.

<page break>

We are interested in learning more about your experiences completing online surveys for pay or other compensation (for example, cash, gift cards, points, charitable donations, etc.)

This does not include classification, transcription, or other non-survey HITS on MTurk.

Aside from MTurk, please select all of the survey platforms that you have used to complete online surveys for pay or other compensation: [randomize order]

• SurveyMonkey

• Qualtrics

• Pinecone research

• Ipsos (Knowledge panel)

• YouGov

• Nielsen

• QuestionPro

• Swagbucks

• Opinion Outpost

• American Consumer Opinion

• Survey Junkie

• Toluna

• ClixSense

• GlobalTestMarket (Lightspeed)

• AmeriSpeak panel (NORC)

• Federal Government surveys or panels

• Gallup poll

• American Trends (Pew)

Please provide the names of any other survey platforms you have participated in:

__________

Approximately how many online surveys have you completed from the list above and MTurk? (Do not include classification, transcription, or other non-survey HITs from MTurk).

• 0-10

• 11-50

• 51-100

• 101-500

• 501-999

• 1000 or more

<page break>

Now we have some general questions about your experience completing online surveys for pay or other compensation.

1. How important is the compensation amount offered to you when selecting surveys to complete?

2. How important is the topic of the survey when selecting surveys to complete?

3. How important is the amount of time it will take to complete a survey when selecting surveys to complete?

4. How important is the type of compensation you will receive (for example, cash, gift card, charitable donations) when selecting which surveys to complete?

5. How important is it to receive fair pay for your completed surveys?

*Participants will answer these questions using the response scale they were randomly assigned to:

Condition 1	Condition 2	Condition 3	Condition 4
Not at all important	Not at all important	Not at all important	Not at all important
	Not too important
A little important			A little important
Somewhat important	Somewhat important	Somewhat important	Somewhat important
		Moderately important	Moderately important
Very important	Very important	Very important	Very important
Extremely important	Extremely important	Extremely important	Extremely important

<page break>

The following are some ways in which online survey platforms may use your data from the surveys you complete.

How important, if at all, is each of these uses to you personally? (EXCLUDING the survey you are currently completing).

• Public opinion on social issues

• Demographic changes

• Trends in the economy, such as employment, unemployment, and job growth

• How people spend their free time

• Health trends, such as disability, mental health issues, or physical exercise

• Consumer information, such as purchasing preferences or how people spend their money

• Market trends

• Transportation trends

• The link between education and income

*Participants will answer these questions using the response scale they were randomly assigned to:

Condition 1	Condition 2	Condition 3	Condition 4
Not at all important	Not at all important	Not at all important	Not at all important
	Not too important
A little important			A little important
Somewhat important	Somewhat important	Somewhat important	Somewhat important
		Moderately important	Moderately important
Very important	Very important	Very important	Very important
Extremely important	Extremely important	Extremely important	Extremely important

<page break>

Now we have some more general questions about your experiences completing online surveys for pay or other compensation (EXCLUDING the survey you currently completing).

1. How concerned are you, if at all, that online survey platforms will not keep your answers confidential?

2. How concerned are you, if at all, that online survey platforms will share your answers without your consent?

3. How concerned are you, if at all, that online survey platforms will use your answers against you?

4. How concerned are you, if at all, that online survey platforms will use your personal data in their research?

5. How concerned are you, if at all, with your privacy when completing online surveys?

6. How concerned are you, if at all, about being asked too much personal information when completing online surveys?

7. How concerned are you, if at all, about who might access your survey answers?

*Participants will answer these questions using the response scale they were randomly assigned to:

Condition 1	Condition 2	Condition 3	Condition 4
Not at all concerned	Not at all concerned	Not at all concerned	Not at all concerned
	Not too concerned
A little concerned			A little concerned
Somewhat concerned	Somewhat concerned	Somewhat concerned	Somewhat concerned
		Moderately concerned	Moderately concerned
Very concerned	Very concerned	Very concerned	Very concerned
Extremely concerned	Extremely concerned	Extremely concerned	Extremely concerned

<page break>

Now we have some questions about the most recent online survey you completed for compensation (for example, cash, gift cards, charitable donations, etc.)

1. Overall, how satisfied were you with the most recent online survey you completed?

2. How satisfied were you with the amount of compensation you received for the most recent online survey you completed?

3. How satisfied were you with the length of time it took to finish the most recent online survey you completed?

4. How satisfied were you with the topics you were asked about on the most recent online survey you completed?

5. How satisfied were you with the type of compensation you received for participating in the most recent online survey you completed? (for example, cash, gift cards, charitable donations, token of acknowledgement)?

6. How satisfied were you with the instructions provided on the most recent online survey you completed?

7. How satisfied were you with the amount of time it took to receive compensation for the most recent online survey you completed?

*Participants will answer these questions using the response scale they were randomly assigned to:

Condition 1	Condition 2	Condition 3	Condition 4
Not at all satisfied	Not at all satisfied	Not at all satisfied	Not at all satisfied
	Not too satisfied
A little satisfied			A little satisfied
Somewhat satisfied	Somewhat satisfied	Somewhat satisfied	Somewhat satisfied
		Moderately satisfied	Moderately satisfied
Very satisfied	Very satisfied	Very satisfied	Very satisfied
Extremely satisfied	Extremely satisfied	Extremely satisfied	Extremely satisfied

<page break>

Now we have some more questions about the most recent online survey you completed for pay or other compensation (EXCLUDING the survey you are currently completing).

1. How burdensome was the most recent online survey you completed?

2. How enjoyable was the most recent online survey you completed?

3. How effortful was the most recent online survey you completed?

4. How sensitive was the most recent online survey you completed?

5. How interesting was the most recent online survey you completed?

6. How difficult was the most recent online survey you completed?

*Participants will answer these questions using the response scale they were randomly assigned to across each burden item (i.e., burdensome, enjoyable, effortful, sensitive, interesting, and difficult):

Condition 1	Condition 2	Condition 3	Condition 4
Not at all	Not at all	Not at all	Not at all
	Not too
A little			A little
Somewhat	Somewhat	Somewhat	Somewhat
		Moderately	Moderately
Very	Very	Very	Very
Extremely	Extremely	Extremely	Extremely

<page break>

Now, we have some questions about your opinions on surveys in general. (These questions are taken from the Survey Pulse scale).

1. How enjoyable do you find responding to surveys through the mail or Internet?

2. How enjoyable do you find being interviewed for a survey?

3. How interesting are surveys in themselves?

4. How important are surveys for society?

5. How effective are surveys at collecting useful information?

6. To what extent is completing surveys a waste of time?

7. How excessive is the number of survey requests you receive?

8. How invasive do you believe opinion surveys are?

9. How exhausting is it to answer a survey with a lot of questions?

*Participants will answer these questions using the response scale they were randomly assigned to across each burden item (i.e., enjoyable, interesting, important, effective, wasteful, excessive, invasive, and exhausting):

Condition 1	Condition 2	Condition 3	Condition 4
Not at all	Not at all	Not at all	Not at all
	Not too
A little			A little
Somewhat	Somewhat	Somewhat	Somewhat
		Moderately	Moderately
Very	Very	Very	Very
Extremely	Extremely	Extremely	Extremely

<page break>

Next, you will look at pairs of words that represent different amounts:

• Your task is to select the word that you think suggests more, or a greater quantity.

• Some of the pairs of words may be very close in meaning.

• Please do your best to determine which of the words suggests more, or a greater quantity.

REMEMBER: go with your initial impression.

Which word or phrase suggests more, or a greater quantity? [each pair will be asked individually; each item within the pair will be displayed in a random order]

Not at all A little	A little Not too	A little Somewhat	Somewhat Moderately	Moderately Extremely
Not at all Not too	A little Slightly	Not too Somewhat	Somewhat Very	Very Extremely
Not at all Slightly	Not too Slightly	Slightly Somewhat	Moderately Very	Extremely Completely

<page break>

Now, we have some questions to complete about yourself.

Do you consider yourself to be straight (that is not gay, lesbian, or bisexual?)

o   Yes

o   No

(If no) Which of the following best represents how you think of yourself?

• Gay

• Lesbian

• Bisexual

• Something else

(If something else) Which of the following best represents how you think of yourself? (mark all that apply)

• Queer

• Pansexual

• Asexual

• Two-Spirit

• Demisexual

• Same-gender loving

• Fluid

• No label

• Questioning/uncertain

• None of these

(if none of these) How would you describe yourself? ______

<page break>

Was your sex recorded as male or female at birth?

• Male

• Female

Do you consider yourself as male, female, or transgender?

• Male

• Female

• Transgender

• None of these

(If None of these) Which of the following best represents how you think of yourself? (mark all that apply)

• Male

• Female

• Transgender

• Trans male

• Trans female

• Nonbinary

• Gender fluid

• Genderqueer

• Gender nonconforming

• None of these

(if none of these) How would you describe yourself? ______

<page break>

What is your age? ___

What is the highest level of education you’ve completed?

• Less than high school

• High school diploma or GED

• Some college

• Associate degree

• Bachelor's degree

• Graduate school degree

Are you of Hispanic, Latino, or Spanish origin?

• Yes

• No

Below is a list of five race categories. Please choose one or more races that you consider yourself to be.

• White

• Black or African American

• American Indian or Alaska Native

• Asian

• Native Hawaiian or Other Pacific Islander

<page break>

1. How burdensome was this survey to complete?

2. How enjoyable was this survey to complete?

3. How effortful was this survey to complete?

4. How sensitive was this survey to complete?

5. How interesting was this survey to complete?

6. How difficult was this survey to complete?

*Participants will answer these questions according to which of the four response scale conditions they were randomly assigned to, across the different burden items (i.e., burdensome, enjoyable, effortful, sensitive, interesting, and difficult):

Condition 1	Condition 2	Condition 3	Condition 4
Not at all	Not at all	Not at all	Not at all
	Not too
A little			A little
Somewhat	Somewhat	Somewhat	Somewhat
		Moderately	Moderately
Very	Very	Very	Very
Extremely	Extremely	Extremely	Extremely

<page break>

Thank you for completing this study!

To receive payment for participating in this study, please copy the validation code shown below and paste it in the form on this page for this HIT and submit the task.

We will check that code you paste in matches our own database and then approve your payment.

Your code is: _____.

13