Note to Reviewer - ATUS Sleep Study

Note to Reviewer - 1220-0141 ATUS Sleep Online Panel Study_OMB_Final.docx

Cognitive and Psychological Research

Note to Reviewer - ATUS Sleep Study

OMB: 1220-0141

Document [docx]
Download: docx | pdf

June 20, 2017


NOTE TO THE

REVIEWER OF:

OMB CLEARANCE 1220-0141

Cognitive and Psychological Research”


FROM:

Robin Kaplan

Research Statistician

Office of Survey Methods Research


SUBJECT:

Submission of Materials for the Online Panel Testing of American Time Use Survey Sleep Measures and Sleep Estimate Questions




Please accept the enclosed materials for approval under the OMB clearance package 1220-0141 “Cognitive and Psychological Research.” In accordance with our agreement with OMB, we are submitting a brief description of the study.


This is a revised submission of a previously approved package and reflects only the new sample and burden numbers. Please note that this is additional research related to the previously approved study.


The total estimated respondent burden hours for this study are 217.


If there are any questions regarding this project, please contact Robin Kaplan at

202-691-7378.


  1. Introduction and Purpose

The American Time Use Survey (ATUS) uses a time diary format to ask respondents about the activities they performed on the prior day. In 2014, the ATUS reported that members of the civilian, non-institutionalized population in the United States spend an average of 8.7 hours per day sleeping, and that number has remained similar over time. ATUS estimates of sleep are consistently higher than surveys that ask respondents directly about the amount of sleep they get (referred to in this protocol as stylized questions). The National Sleep Foundation (NSF), for example, asks respondents to estimate the amount of time they spend sleeping on an average weekday and weekend day. These numbers are then combined into an overall estimate. The NSF reported that American adults get an average of 7.1 hours of sleep per day in 2015. Other national surveys that use stylized questions about sleep, such as The National Health Interview Survey (NHIS), the Behavioral Risk Factor Surveillance System (BRFSS), and the National Health and Nutrition Examination Survey (NHANES) report sleep duration estimates ranging from 6.9 to 7.1 hours in 2014.

The ATUS differs from surveys that use stylized questions in methodology, sleep definition, and population. It is unclear how these differences influence the estimates. OSMR conducted a previous cognitive interview study to help understand the measurement properties of both the ATUS interview as it relates to sleep and of a sample of stylized questions about sleep. In that study, we found that diary and stylized measures of sleep duration differ from one another, with diary estimates exceeding stylized ones, consistent with prior research (e.g., Kan & Pudney, 2007).

The cognitive interview study results revealed a number of differences across participants in how they answered questions about sleep in general, and also across the diary versus stylized questions at each stage of the response process (Tourangeau, 1984). The main findings included differences in comprehension – participants with a broad definition of sleep (including activities such as lying in bed trying to fall asleep, resting, or dozing off) also reported getting more sleep than those with a narrower conception of sleep. Participants used a number of estimation strategies to answer the stylized questions about sleep versus the diary questions, where participants used memory retrieval strategies. We also found evidence that stylized questions may be more susceptible to social desirability concerns than the diary measure, that is, social desirability concerns about getting too much or too little sleep seemed to affect how participants answered the stylized questions about sleep, but this was not the case for the diary measure. Participants also indicated that if they thought the survey was about jobs and employment, it would more embarrassing to report oversleeping. In contrast, if a survey was about health, it would be more embarrassing to report undersleeping. These findings indicate that the context of the survey may also impact estimates of sleep duration. Since surveys across various agencies are framed differently, this may affect the sleep duration estimates obtained.

OSMR’s previous cognitive interview study had a very small sample, with only 29 participants who were all recruited from the Washington, DC metro area. Because of this, we conducted an online study to assess differences in sleep duration across diary and stylized estimates. We found that participants’ diary estimates exceeded their stylized sleep estimates, as expected. In addition, providing a definition of sleep seemed to bring participants’ diary and stylized sleep estimates slightly closer together, suggesting that including a precise definition of “sleep” might help reduce measurement error. We also found a large order effect where when stylized questions preceded diary questions, the diary sleep duration estimates were significantly lower, and the two measures matched more closely. We suspect that participants may have altered their response processes when the stylized sleep question came first, anchoring their diary answers to the stylized ones, consistent with other research (Schulz & Grunow, 2012; Schwarz et al., 1991). In addition, we found no effect of the survey context (telling participants the survey was about health, jobs, or general time use) on sleep duration estimates.


2. Research Design

All participants will be routed to an online survey, hosted on Qualtrics.com, where they will be asked to complete a modified version of the ATUS daily recall diary interview. They will enter each activity they did, along with their start and stop times, from 4am the prior day to 4am of the current day. Next, they will answer a set of stylized questions regarding how much they sleep on an average weekday and about other activities (e.g., time spent engaged in work-related activities, physical exercise, household chores, travel, and use of information-technology devices). These questions were adapted from other national surveys that ask for sleep estimates (e.g., the NHIS). Next, they will answer a set of stylized sleep questions aimed to assess the amount of time participants spend in bed versus actually sleeping. One source of measurement error in sleep duration might be because participants include the time they lie in bed awake or trying to fall asleep in their estimates, and this set of questions will tease that apart across weekdays and weekends. Finally, participants will answer a set of stylized questions adapted from other national surveys about the amount they typically sleep.

Participants will complete the surveys only on Tuesday – Friday so their ATUS recall of the prior day’s activities will always cover a weekday. Questions about where activities took place and who else was present (typical ATUS recall questions) will not be asked. After completing the diary and stylized time measures, participants will be asked questions aimed at understanding how they answered the questions, including questions about scheduling, social desirability, and demographics. See Appendix A for the full study protocol.

A number of stylized questions related to common activities in the ATUS will also be included to make the topic of sleep less salient and to fit with the framing of the survey. In addition to answering the diary and stylized time-use questions, we will also vary the framing of the study to be about sleep or general time use. This will allow us to determine whether the framing of the survey affects self-reports of sleep. This makes for a 2x2 study design with one between-subjects factor (Framing: sleep versus general time use) and two within-subjects factors (Diary vs. Stylized sleep questions).

The analyses will focus on possible reasons for a difference between the diary and stylized measures, if prior research showing a difference between these types of questions is replicated. We believe it is possible that framing the survey about sleep will cause people to report on their sleep in a manner consistent with their personal beliefs about whether it’s positive or negative to get a lot of sleep, or cause people to focus more on what is considered a “normative” amount of sleep (e.g., 8 hours) as they complete the survey. We will examine all main effects and interactions across the variables, along with participant demographics.

In addition, we will also include the following individual differences measures that might be related to how participants self-report about their sleep habits and their survey responses in general.

  1. Balanced Inventory of Socially Desirable Responding (BIDR; Paulhus, 1984). As evidenced from the cognitive interview results from previous studies, social desirability concerns may affect how respondents report on their sleep. Participants who exhibit high versus low levels of social desirability concerns may be differentially affected by the framing and context of the survey in which they report on sleep. Thus, a potential covariate for sleep duration in this study is participants’ own tendency to respond in socially desirable ways. Participants will complete a short version of Paulhus’s (1984) Balanced Inventory of Socially Desirable Responding (BIDR) impression management subscale, which assesses deliberate self-presentation to an audience. It contains 10 items (e.g., I sometimes tell lies if I have to.) See the full protocol in Appendix for the entire scale.

  2. Maximization Scale (Nenkov et al., 2008). This is a short scale used to determine whether people exhibit high versus low levels of a trait called maximization. Lower levels of maximization would tend to point to participants who satisfice. Satisficing is of great interest to survey researchers, as satisficers may tend to be less careful in completing surveys (e.g., straightline more on grids, speed through the survey instrument, or provide less thoughtful answers; Krosnick et al., 1996), which could lead to lower data quality. By taking a measure of participants’ tendency to maximize or satisfice, we can correlate this to other data quality indicators and paradata in the survey. See the full protocol in Appendix for the entire scale.

  3. Mindfulness Attention Awareness Scale (Brown, 2003). The state MAAS is a 5-item scale designed to assess the short-term or current expression of a core characteristic of mindfulness, namely, a receptive state of mind in which attention, informed by a sensitive awareness of what is occurring in the present, simply observes what is taking place. Mindfulness has been associated with differences in how participants complete surveys and data quality (e.g., McCalin et al., 2015). By measuring participants’ level of mindfulness while completing the survey, we can correlated this to other data quality indicators and paradata in the survey. See the full protocol in Appendix for the entire scale.

Near the end of the survey, we will ask participants to report how burdensome they found it was to complete the entire survey and time diary portion, as well as related measures such as how interesting, effortful, and how sensitive they found the survey. As previous research has shown (e.g., Fricker et al., 2012), these perceptions of burden may have an effect on data quality and important survey outcomes. Since in our previous work, the time diary took a substantial amount of time to complete (6 minutes), these measures will help us to better understand the impact that perceived burden may have had on this survey as well as implications for perceptions of burden in the ATUS.

3. Participants

Participants will be recruited using a Qualtrics panel (n = 650) consisting of adult, U.S. citizens (18 years and older, using a quota sample of age, education, and gender breakdowns designed to be representative of the U.S. population); however, the focus of this study is focused on internal validity rather than representativeness of any population. This research design requires this sample of participants in order to sufficiently explore the range of variables of interest and because we expect a very small effect size since, as the study manipulations are subtle for online surveys of this nature. This sample size also takes into account break-offs, incomplete data, and participants who do not follow the task instructions, similar to other samples used for studies of this nature.

4. Burden Hours

We will obtain responses from 650 participants recruited from Qualtrics. Each survey is expected to take no more than 20 minutes to complete, for a total of 217 burden hours. The survey will be administered completely online at the time and location of the participant’s choosing. There will be no recruitment burden associated with this research.

5. Payment to Respondents

Qualtrics will recruit 650 participants from their panel. Qualtrics requested $3,500 for 650 participants selected on 3 Census demographics (age, gender, education level). Per Qualtrics, the exact amount and form that each respondent receives can vary from respondent to respondent depending on their panelist profile, how they were recruited, and the form of incentives they have elected to receive (i.e. e-gift cards, points, cash, etc.). Generally speaking, though, respondents receive ~$1.00-$1.50 or a relative equivalent value for completing a 15 to 20 minute consumer survey. The remaining funds are paid to Qualtrics for licensing fees that are necessary for use of the panel.

6. Data Confidentiality

Recruiting of participants will be handled by Qualtrics. Participants will be informed that the study is about their perceptions of different types of questions. Once participants are recruited into the study, they will be sent a link to the survey, which is hosted by Qualtrics. The data collected as part of this study will be stored on Qualtrics servers. Participants in this study will not be asked to provide any personally identifiable information. Using the language shown below, participants will be informed of the voluntary nature of the study and they will not be given a pledge of confidentiality.


This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. You are not required to respond to this collection unless it displays a currently valid OMB control number. We will use the information you provide for statistical purposes only. Your participation is voluntary, and you have the right to stop at any time. This survey is being administered by Qualtrics and resides on a server outside of the BLS Domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response. By proceeding with this study, you give your consent to participate in this study.



















Appendix A – ATUS Sleep Measures Online Study Protocol

Welcome!

Thanks for your interest in our research. We’re conducting this study to better understand how people spend their time as it relates to…


<Sleep condition>

“…How much sleep people in America get. This survey includes questions about your sleep behavior, including times you typically go to bed and wake up and how much actual sleep you think you get.”


<ATUS condition >

“…How people in America spend their time. This survey includes questions about your time use, used to find out how people balance work, child care, leisure, and other activities in their lives.”


Unlike some surveys or online tasks, we ask that you complete this task all at one time. Please begin only when you are in a quiet place where you won't be disturbed for about 20 minutes.

Please do not use your browser's back button.


This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. You are not required to respond to this collection unless it displays a currently valid OMB control number. We will use the information you provide for statistical purposes only. Your participation is voluntary, and you have the right to stop at any time. This survey is being administered by Qualtrics and resides on a server outside of the BLS Domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response. By proceeding with this study, you give your consent to participate in this study.


Select ‘Next’ to continue

---page break---



Diary Introduction

On the next few pages, you will be prompted to think back to the last 24 hours, starting at 4 am yesterday morning and continuing through 4 am TODAY <INSERT DATE>. Please think back to each activity you did in as much detail as possible and what time you started and ended each activity. By activity, we mean anything you did during that time frame.


On the next screen, you will be asked to select the type of activity you did from a drop-down list and what time you started and stopped that activity. If you don’t see the activity you were doing, please select ‘Other Activity’.


Please be sure to account for your whole day, so the end time of one activity should be the start time of the next activity. There should not be any gaps.

Below is an example of a completed version of how the activity log should appear:


<Participants will be presented with a 20-row matrix of drop-down menus (as seen in the image of the Activity Log below) where they can enter each activity they did, including start and stop times, for the remainder of the 24-hour period>


Drop-down menu/randomize order of choices, except ‘Other’ is always last]:

  • Sleeping

  • Grooming

  • Watching TV

  • Working

  • Eating / Drinking

  • Household chores

  • Shopping

  • Traveling /commuting

  • Leisure activity

  • Sports / exercise / recreation

  • Studying / learning

  • Socializing

  • Other activity


---page break---


[question order on this page will be randomized]


Note: For this set of questions, participants will use a drop down menu. The ‘hours’ drop-down menu will have the numbers 0-24 and the minutes drop down will have the numbers 0-55 in increments of 5.



Thank you for completing the activity log. Next, we’d like to know more about how you spend your time in general. Please think of a typical day while answering these questions, not one where you traveled, vacationed, or had family crises.


On average, how many hours per day do you participate in the following activities…?


1.) Working at your main job? ____ hours ____minutes


2.) Exercising (for example, sports, or physical activities) in your free time? ____ hours ____minutes


3.) Household chores and other cleaning activities? ____ hours ____minutes


4.) Watching television? ____ hours ____minutes



5.) Using technological devices connected to the Internet (for example, a personal computer, cell phone, or tablet, excluding television), in your free time? ____ hours ____minutes


6.) Traveling from place to place, such as commuting to and from work? ____ hours ____minutes


7.) Leisure activities, such as reading or other hobbies? ____ hours ____minutes


---page break---



The following questions are about your typical sleep routine on a weekday or workday, in which you work the next day. Please think of a typical weekday while answering these questions, not one where you traveled, vacationed, or had family crises.


Note: For this set of questions, participants will use a drop down menu. The hours drop-down menu will have the numbers 1-12 and the minutes drop down will have the numbers 0-55 in increments of 5.


1.) On a typical weekday (or workday) at what time do you get into bed to fall asleep?

____ hour; ____ minute; ____AM/PM

2.) On a typical weekday (or workday) at what time do you actually fall asleep? ____ hour; ____ minute; ____AM/PM

3.) On a typical weekday (or workday) at what time do you wake up?

____ hour; ____ minute; ____AM/PM


4.) On a typical weekday (or workday) at what time do you get out of bed?

____ hour; ____ minute; ____AM/PM



---page break---


The following questions are about your typical sleep routine on a weekend or day off, in which you do NOT work the next day.


Please think of a typical weekend while answering these questions, not one where you traveled, vacationed, or had family crises.



1.) On a typical weekend (or day off) at what time do you get into bed to fall asleep?

____ hour; ____ minute; ____AM/PM

2.) On a typical weekend (or day off) at what time do you typically fall asleep? ____ hour; ____ minute; ____AM/PM

3.) On a typical weekend (or day off) at what time do you wake up?

____ hour; ____ minute; ____AM/PM

4.) On a typical weekend (or day off) at what time do you get out of bed?

____ hour; ____ minute; ____AM/PM

---page break---


The following questions are about how many hours you actually spend sleeping.



1.) On average, how many hours of sleep do you get in a 24-hour period? ____ hours

2.) On a typical weekday (or workday) how many hours of sleep do you get in a 24-hour period? ____ hours

3.) On a typical weekend (or day off), how many hours of sleep do you get in a 24-hour period? ____ hours

4.) On average, how long does it take you to fall asleep? ____ hours ____minutes

5.) Do you typically take naps?

  • Yes (go to 5)

  • No (go to 6)

6.) How long does your typical nap last? ____ hours ____minutes


7.) Do you typically wake up during the night for any reason?

  • Yes (go to 7)

  • No (skip to next page)


8.) When you wake up during the night, on average, how long are you awake for?

____ hours ____minutes


---page break---



Follow-up Questions

1.) Earlier you said that on average you sleep [TEXT FILL] number of hours in a 24-hour period. How confident are you about the accuracy of your answer?

  • Not at all confident

  • Slightly confident

  • Moderately confident

  • Very confident

  • Extremely confident

2.) How many hours do you think is appropriate for an average person to sleep in one night?

_____ hours


3.) How many hours do you think most people would have to sleep before feeling embarrassed for sleeping too MUCH in one night? ____ hours


4.) How embarrassing do you think it would be for most people to admit they slept more than <TEXT FILL from #3> hours in one night?

  • Not at all embarrassing

  • Slightly embarrassing

  • Moderately embarrassing

  • Very embarrassing

  • Extremely embarrassing

5.) How few hours do you think most people would have to sleep before feeling embarrassed for sleeping too LITTLE in one night? ____ hours


6.) How embarrassing do you think it would be for most people to admit they slept fewer than <TEXT FILL from #5> hours in one night?

  • Not at all embarrassing

  • Slightly embarrassing

  • Moderately embarrassing

  • Very embarrassing

  • Extremely embarrassing

7.) When you need more time, how often do you tend to cut back on your sleep?

  • Never (0 times per week)

  • Rarely (1-2 times per week)

  • Sometimes (3-4 times per week)

  • Frequently (5 or more times per week)

8.) How often do you have time on your hands that you don’t know what to do with?

  • Never (0 times per week)

  • Rarely (1-2 times per week)

  • Sometimes (3-4 times per week)

  • Frequently (5 or more times per week)

---page break---

Please answer the following questions about yourself.

Balanced Inventory of Socially Desirable Responding


1 2 3 4 5

(strongly disagree) (strongly agree)


  1. I sometimes tell lies if I have to.

  2. I never cover up my mistakes.

  3. I always obey laws, even if I am unlikely to get caught.

  4. I have said something bad about a friend behind his or her back.

  5. When I hear people talking privately, I avoid listening.

  6. I have received too much change from a salesperson without telling him or her.

  7. When I was young I sometimes stole things.

  8. I have done things that I don’t tell other people about.

  9. I never take things that don’t belong to me.

  10. I don’t gossip about other people’s business.


---page break---


Please answer the following questions about yourself.

Maximizer-Satisficer Scale


1 2 3 4 5

(strongly disagree) (strongly agree)


1. When I am in the car listening to the radio, I often check other stations to see if something better is playing, even if I am relatively satisfied with what I’m listening to.

2. No matter how satisfied I am with my job, it’s only right for me to be on the lookout for better opportunities.

3. I often find it difficult to shop for a gift for a friend.

4. Picking a movie to watch is really difficult. I’m always struggling to pick the best one.

5. No matter what I do, I have the highest standards for myself.

6. I never settle for second best.



---page break---

Mindfulness Attention Awareness Scale (MAAS)


1 2 3 4 5

(not at all) (a little) (moderately) (very much) (completely)


Please indicate to what degree you were having each experience described below while you completed the survey. Please answer according to what really reflected your experience rather than what you think your experience should have been.


1.) I was finding it difficult to stay focused on the survey.

2.) I was doing the survey without paying attention.

3.) I was preoccupied with the future or the past.

4.) I was doing the survey automatically, without being aware of what I was doing.

5.) I was rushing through the survey without really being attentive to it.



---page break---

[order of pages in this section will be randomized]


1.) How burdensome was it to complete this survey?

  • Not at all burdensome

  • A little burdensome

  • Moderately burdensome

  • Very burdensome

  • Extremely burdensome

(if answered Moderately, Very, or Extremely) Please explain: _______

2.) How burdensome was it to complete the activity log, where you entered each of your activities from the previous day?

  • Not at all burdensome

  • A little burdensome

  • Moderately burdensome

  • Very burdensome

  • Extremely burdensome

(if answered Moderately, Very, or Extremely) Please explain: _______



---page break---

1.) How effortful was it to complete this survey?

  • Not at all effortful

  • A little effortful

  • Moderately effortful

  • Very effortful

  • Extremely effortful

2.) How effortful was it to complete the activity log, where you entered each of your activities from the previous day?

  • Not at all effortful

  • A little effortful

  • Moderately effortful

  • Very effortful

  • Extremely effortful



---page break---

1.) How interesting did you find this survey?

  • Not at all interesting

  • A little interesting

  • Moderately interesting

  • Very interesting

  • Extremely interesting

2.) How interesting do you find the topic of how you spend your time?

  • Not at all interesting

  • A little interesting

  • Moderately interesting

  • Very interesting

  • Extremely interesting

3.) How interesting do you find the topic of sleep?

  • Not at all interesting

  • A little interesting

  • Moderately interesting

  • Very interesting

  • Extremely interesting



---page break---



1.) How sensitive were the questions in this survey?

  • Not at all sensitive

  • A little sensitive

  • Moderately sensitive

  • Very sensitive

  • Extremely sensitive

(if answered Moderately, Very, or Extremely) Please explain: _______



2.) How sensitive was it for you to answer questions about how much you sleep?

  • Not at all sensitive

  • A little sensitive

  • Moderately sensitive

  • Very sensitive

  • Extremely sensitive

(if answered Moderately, Very, or Extremely) Please explain: _______



---page break---

1.) How easy or difficult was it for you to answer the questions in this survey?

  • Very difficult

  • Difficult

  • Neither easy nor difficult

  • Easy

  • Very easy


2.) How easy or difficult was it to remember the activities you did yesterday?


  • Very difficult

  • Difficult

  • Neither easy nor difficult

  • Easy

  • Very easy


3.) How easy or difficult was it to answer the questions about how much sleep you get?

  • Very difficult

  • Difficult

  • Neither easy nor difficult

  • Easy

  • Very easy

(if answered Very difficult or Difficult) Please explain: _______

---page break---

1.) How well-rested do you feel right now?

  • Not at all rested

  • A little rested

  • Somewhat rested

  • Very rested

2.) Did you feel the length of this survey was too long, too short, or about right?

  • Too long

  • About right

  • Too short


---page break---



1.) Do you use a wearable device or Smartphone (for example, a Fitbit or Smartphone app) to track your sleep?

  • Yes (go to 2)

  • No (go to next page)

2.) Did you use the information from that device to answer any of the questions in this survey?

  • Yes

  • No

---page break---

Demographic information

1.) Which of the following best describes you?

  • Employed full time

  • Employed part time

  • Unemployed

  • Student

  • Retired

  • Other, specify: ______________


2.) How many days per week do you usually work?

  • [dropdown menu with 0-7]


3.) What is the highest level of education you’ve completed?

  • Less than high school

  • High school diploma or GED

  • Some college

  • Associate degree

  • Bachelor’s degree

  • Graduate school degree


4.) Are you of Hispanic, Latino or Spanish origin?

  • Yes

  • No


5.) What is your race? (One or more may be selected)

  • White

  • Black or African American

  • American Indian or Alaska Native

  • Asian

  • Native Hawaiian or Other Pacific Islander



6.) What is your gender?

  • Male

  • Female

  • Other


7.) What is your age?

____ years


8.) What is your household size? By household, we mean the number of people currently living in your residence, including yourself.

  • 1 person (including yourself)

  • 2 people

  • 3 people

  • 4 people

  • 5 or more people


9.) How many of the <TEXT FILL from #7> people in your household are under the age of 16?

10.) How many of the <TEXT FILL from #7> people in your household are under the age of 5?

---page break---


Thank you for your participation! If you have any additional thoughts on this survey, please provide them in the space below. _____________

















































References

Brown, K.W. & Ryan, R.M. (2003). The benefits of being present: Mindfulness and its

role in psychological well-being. Journal of Personality and Social Psychology, 84,

822-848.


Edgar, J., Murphy, J., & Keating, M. (2016). Comparing Traditional and Crowdsourcing Methods for Pretesting Survey Questions. SAGE Open6(4), 2158244016671770.


Fricker, S., Kreisler, C., & Tan, L. (2012). An exploration of the application of PLS path modeling approach to creating a summary index of respondent burden. In JSM Proceedings (pp. 4141-4155).


Kan & Pudney (2007). Measurement Error in Stylised and Diary Data on Time Use. Sociological Methodology 38, 101-132.


Krosnick, J. A., Narayan, S., & Smith, W. R. (1996). Satisficing in surveys: Initial evidence. New directions for evaluation1996(70), 29-44.


McClain et al. (2015) “Relationships between survey instructions, mindfulness, and data quality in a telephone survey. AAPOR 2015.


Michelson, W. (2014). Unraveling the mystery of sleep duration dynamics; Sleep in the objective and subjective lives of employed men and women. electronic International Journal of Time Use Research,, 57.


Mullinix, K.J., Leeper, T.J., Druckman, J.N. and Freese, J. (2015) ‘The Generalizability of Survey Experiments’, Journal of Experimental Political Science, 2(2), pp. 109–138. doi: 10.1017/XPS.2015.19.


Nenkov, G. Y., Morrin, M., Schwartz, B., Ward, A., & Hulland, J. (2008). A short form of the Maximization Scale: Factor structure, reliability and validity studies. Judgment and Decision Making3(5), 371-388.


Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of personality and social psychology, 46(3), 598.

Robinson, J. P., & Michelson, W. (2010). Sleep as a victim of the “time crunch”–A multinational

analysis. electronic International Journal of Time Use Research, 7(1), 61-72.


Schulz, F., & Grunow, D. (2012). Comparing diary and survey estimates on time use. European Sociological Review, 28(5), 622-632.


Schwarz, N., Strack, F., & Mai, H. P. (1991). Assimilation and contrast effects in part-whole question sequences: A conversational logic analysis. Public opinion quarterly, 55(1), 3-23.


Tourangeau, R. (1984). Cognitive science and survey methods. Cognitive aspects of survey methodology: Building a bridge between disciplines, 73-100.


Page 24 of 24


File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
Authorkopp_b
File Modified0000-00-00
File Created2021-01-22

© 2024 OMB.report | Privacy Policy