Appendix B Framing Instructions Debriefing Questions

Appendix B: Respondent debriefing questions

The questions will be presented after the experimental protocol portion of the survey and a separation page explaining to the participant that they will now be asked questions about the experience of taking the survey that they just completed. These questions will appear in the same fixed order for all participants.

Thank you for participating in our survey. We’d like to ask you about what it was like to participate. These questions are important because they will help us to learn how to design better surveys in the future. Please answer honestly; your responses will not affect your earnings in any way.

1. Overall, how burdensome was participating in this survey?

Extremely burdensome

Very burdensome

Somewhat burdensome

Slightly burdensome

Not at all burdensome

---page break---

2. We would like to understand how your experience participating in this survey relates to other experiences in your life.

   1. What experience from real life would you give a rating of “Extremely burdensome”?

[open text entry]

2. What experience from real life would you give a rating of “Not at all burdensome”?

[open text entry]

3. What experience from real life would you give a middle rating of “Somewhat burdensome”?

[open text entry]

---page break---

3. As you completed the survey, how quickly or slowly did it feel time was passing?

Very slowly

Slowly

Somewhat slowly

Neither slowly nor quickly

Somewhat quickly

Quickly

Very quickly

4. How short or long did you feel the survey was?

Very short

Short

Somewhat short

Neither short nor long

Somewhat long

Long

Very long

5. How easy or difficult to complete did you feel the survey was?

Very easy

Easy

Somewhat easy

Neither easy nor difficult

Somewhat difficult

Difficult

Very difficult

6. How important did you feel this survey was?

Very important

Important

Somewhat important

Neither important nor unimportant

Somewhat unimportant

Unimportant

Very unimportant

7. How interesting did you feel the topic of the survey was?

Very interesting

Interesting

Somewhat interesting

Neither interesting nor uninteresting

Somewhat uninteresting

Uninteresting

Very uninteresting

8. How much effort did you put in to completing the survey?

Much more than was needed

More than was needed

Somewhat more than was needed

About the right amount

Somewhat less than was needed

Less than was needed

Much less than was needed

9. How trustworthy would you say the institution conducting this research is for safeguarding the information that you have provided?

Extremely trustworthy

Very trustworthy

Somewhat trustworthy

Slightly trustworthy

Not at all trustworthy

10. How willing would you be to participate in another survey like this one in the future?

Extremely trustworthy

Very trustworthy

Somewhat trustworthy

Slightly trustworthy

Not at all trustworthy

---page break---

1. What is your sex?

Male

Female

2. In what year were you born?

[open text box; numeric]

3. Are you Hispanic or Latino?
   Yes
   No

4. What is your race? (Please select one or more)

American Indian or Alaska native

Asian

Black or African American

Native Hawaiian or Pacific Islander

White

5. What is the highest degree you received?

No schooling completed

Elementary school diploma

High school diploma or the equivalent (GED)

Associate degree

Bachelor’s degree

Master’s degree

Professional or doctorate degree

---page break---

Thank you for participating in this research. The purpose of this study was to explore perceptions of burden of survey respondents, and how survey designers may be able to improve the survey experience. We apologize if participating in this survey caused you any confusion or frustration. It is our hope that this study will help to reduce the burden that surveys impose on respondents in the future by informing our understanding of how it feels to take burdensome surveys.

Please do not discuss the content or purpose of the study with anyone else for the next few days while we are still collecting data. Thanks for your help in keeping this study valid.

If you have any comments about your survey experience, please leave them in the box below. Please know that we appreciate your participation today.

Thank you!