NOTE TO THE REVIEWER OF: |
OMB CLEARANCE 1220-0141 “Cognitive and Psychological Research”
|
FROM: |
Erica Yu Research Psychologist Office of Survey Methods Research
|
SUBJECT: |
Submission of Materials for the ‘Testing of Wording of Outlet Questions in CE’ Study |
Please accept the enclosed materials for approval under the OMB clearance package 1220-0141 “Cognitive and Psychological Research.” In accordance with our agreement with OMB, we are submitting a brief description of the study.
The total estimated respondent burden hours for this study are 100.
If there are any questions regarding this project, please contact Erica Yu at 202-691-7924.
Introduction and Purpose
The Consumer Expenditure Survey (CE) and Consumer Price Index (CPI) are integrating outlet questions into the CE quarterly interview for production cases in the third quarter of 2018. These outlet data are currently collected by the Telephone Point of Purchase Survey (TPOPS); however, integrating outlet collection into the CE requires writing new questions to collect the outlet information. The proposed new questions need to be tested for respondent comprehension.
Research Design
The purpose of this study is to ensure that the proposed questions are clear and understandable to respondents, and interpreted by respondents as intended. The questions being tested are based on current production questions used in production TPOPS (OMB information collection instrument information stored at https://www.reginfo.gov/public/do/PRAViewIC?ref_nbr=201409-1220-003&icID=14576, which ask about outlet name, purchase mode, and outlet city and state. In order to test these questions with participants with relevant outlets to report, the study will use an abridged form of the production CEQ (OMB information collection instrument information stored at https://www.reginfo.gov/public/do/PRAViewIC?ref_nbr=201607-1220-002&icID=46041 to provide content and provide the expenditure screening questions that feed into the targeted outlet questions being tested.
To most effectively use participant time, a mixture of in-lab cognitive interviewing and online testing will be used. Item categories with typically low rates of reporting in the CEQ will be concentrated in the online protocol, where the larger participant pool is more likely to include individuals with relevant expense histories. Because the number of proposed changes exceeds what can be tested in a single session, the full list of items is broken down into modules of related CEQ items and associated debriefing questions that will be administered together. Participants will be screened to be asked modules based on their self-reported expenses in the included item categories. The full protocol is shown in Appendix A.
Cognitive interviewing is one technique that will be used to evaluate the question wordings. Cognitive interviews provide an in-depth understanding of the respondent’s thought processes and reactions to the questions. The focus of this study is on the comprehension and validity of the outlet questions, rather than the CE expenditure questions; therefore, interviewing and probing will not focus on the expenditures themselves but rather on the outlets specifically. These interviews will be done one-on-one in the Office of Survey Methods Research (OSMR) laboratory, and will be audiotaped. Interviews will be conducted by staff from the OSMR who are experienced in conducting these types of interviews. The testing protocol is included in Appendix A, Part 1.
Online testing will also be used to conduct unmoderated cognitive interviews. These participants will complete an online form, which asks them the survey questions of interest, and then several debriefing questions, including questions to probe the accuracy of their response to the new questions and about the experience of answering those questions. The benefit of online testing is that feedback can be gained from a larger number of participants that are more diverse geographically and in terms of their expenditures than would be possible in the OSMR research lab in Washington, DC. This is especially helpful for testing changes to expenditure questions in which there is a low incidence rate (e.g., finding participants who recently went on a cruise). The testing protocol for online testing is included in Appendix A, Part 2.
The findings from both modes of testing will be evaluated qualitatively. For the online testing, quantitative analyses will be considered but statistical significance is not a goal. Rather, the debriefing feedback from both modes is the primary outcome to be used to revise question wordings.
As this is pretesting, we expect that modifications may be made during the course of the study based on initial results. Although the goals of the testing, and overall design, will remain the same, findings from preliminary results may be used to improve the interview questions. Modifications are likely to range from slight changes to question wording (e.g., naming examples) or additional instructions (e.g., inclusion or exclusion instructions).
3. Participants
For in-lab testing, 15 participants will be recruited from a participant database maintained by OSMR. Efforts will be made to select participants with varying levels of education, income, and occupation, and familiarity with the expenditures being tested based on self-reported information provided during the initial recruitment process
For online testing, 475 participants will be recruited using a convenience sample from Amazon Mechanical Turk1of adult U.S. citizens (18 years and older).
4. Burden Hours
For in-lab testing, our goal is to interview 15 participants. We anticipate that each session will average 45 minutes and last no longer than one hour. Participants will be asked several screening questions about their recent expenditures as part of recruitment (see Appendix B). Screening questions and scheduling an appointment is expected to take no longer than 10 minutes and participants will not be compensated for time spent on scheduling. We anticipate a low qualification rate for the screening questions (approximately 50%), so estimate we will need to contact approximately 30 people in order to get 15 interviews. This will add an additional 5 burden hours (30 participants x .1667 hours) to the study, for a total of 20 burden hours for cognitive interviews.
For online testing, each set of questions will be treated independently and individuals may participate in more than one of six modules. Our goal is to collect data from 75 participants for each module. An additional 25 participants will be recruited for piloting. We anticipate that each survey will average 10 minutes, including screening, demographics, target questions, and debriefing questions, for a total of 80 burden hours (475 participants x 0.1667 burden hours)
Combined, we anticipate that this study will result in no more than 100 burden hours.
6. Payment to participants
For in-lab testing, the 15 participants will each be paid $40 for their participation in testing, for a total of $600.
For online testing, each of the 475 participants will be paid $1.00 for participating in the study, a typical rate provided by Mechanical Turk for similar tasks; a total of $475 will be paid directly to Amazon Mechanical Turk for participant fees.
Combined, a total of $1,075 will be paid to participants.
7. Data confidentiality
For in-lab testing, participants will be informed as to the voluntary nature of the study. Participants will also be informed that the study will be used for internal purposes to improve the design of a national Consumer Expenditure interview survey. Participants will be given a consent form to read and sign (See Appendix C). Information related to this study will not be released to the public in any way that would allow identification of individuals except as prescribed under the conditions of the Privacy Act Notice.
For online testing, Recruiting of participants will be handled by Amazon Mechanical Turk. Once participants are recruited into the study, they will be provided a link to the survey, which is hosted by Qualtrics. The data collected as part of this study will be stored on Qualtrics servers. Using the language shown below, participants will be informed of the voluntary nature of the study and they will not be given a pledge of confidentiality.
This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. We will use the information you provide for statistical purposes only. Your participation is voluntary, and you have the right to stop at any time. This survey is being administered by Qualtrics and resides on a server outside of the BLS Domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response. By proceeding with this study, you give your consent to participate in this study.
Attachments
Appendix A – Protocol
Appendix B – Screening questions
Appendix C – Informed Consent form
Appendix A: Protocol
Part 1: In-Lab Testing
Hi! Thank you for coming in today.
I am …... [This is my colleague ( ) who will be taking notes for us today]
[Sign Consent Form/Permission to audiotape] (see Appendix C)
What we are going to do today is go through a few questions from the survey and get your reactions to them. The purpose of this session is to help us find out more about how people respond to these questions. Basically, we’re trying to find out what you think a question is asking and how hard it is to answer. We are not here to evaluate you, we are looking to improve the questions, so there are no wrong answers. All the information you give us will be kept completely confidential, and will be used to improve the survey questions.
Any questions before we begin?
The Consumer Expenditure Survey is a household survey so I am going to ask you to report expenses that you or anyone else in your household have made during the last three months. How many people are in your household, including yourself?
The bolded portions below are the new outlet questions being tested; the other portions of the CEQ are existing CEQ scripts or questions with some modifications given the abridgement of the protocol.
The Consumer Expenditure Survey collects information from the Nation's households and families on their buying habits (expenditures), income, and household characteristics. Knowing what goods and services consumers are buying and how much they are spending is critical information in determining the strength of our Nation’s economy and the direction in which it is moving. Knowing where consumers are buying these goods and services gives us a list of grocery stores, department stores, doctor’s offices, theaters, internet sites, and shopping malls where consumers spend money and enables us to track price changes in the economy.
First, let's talk about the construction or alteration of property [you own/you rent/you own or rent]. You should not include jobs that have been or will be totally reimbursed by someone outside your household, such as a landlord.
Since the first of the
reference month, have you or any members of your household had
expenses for-
Remodeling one or more rooms in the house?
If yes, go to follow-up questions; otherwise skip to next question
Now, let's talk about maintenance and repairs for property [you own/you rent/you own or rent]. Again, you should not include jobs that have been or will be totally reimbursed by someone outside your household, such as your landlord.
Since the first of the reference month, have you or any members of your household had expenses for-
Painting, either interior or exterior, or wallpapering?
Plumbing or water heating installations or repairs?
Heating or air conditioning jobs?
Flooring installation, repair, or replacement including carpeting, wood, vinyl, and tile?
Did you do this job yourself or did you pay someone else to do all or part of the work?
Self only
Paid or contracted with someone else
Both
What is the name of the business that provided the service contract, maintenance, or repair?
In what city and state is (business name) located?
Since the first of the reference month, excluding this month, have you or any member of your household purchased any materials or supplies that were FOR JOBS NOT YET STARTED?
Yes
No (skip to end of section)
What kind of job will the materials be used for? Select a job type below
Homes under construction including a vacation home or second home?
Building an addition to the house or a new structure, such as a porch, garage, or new rooms?
Finishing a basement or an attic or enclosing a porch?
Remodeling one or more rooms in the house?
Landscaping the ground or planting new shrubs or trees?
Building outdoor patios, walks, fences, or other enclosures, driveways, or permanent swimming pools or hot tubs?
Repairing outdoor patios, walks, fences, driveways, or permanent swimming pools?
Painting, either interior or exterior, or wallpapering
Plastering or paneling?
Plumbing or water heating installations or repairs?
Electrical work?
Heating or air conditioning jobs?
Flooring installation, repair, or replacement including carpeting, wood, vinyl, and tile?
Insulation?
Roofing, gutters or downspouts?
Siding?
Installation, repair, or replacement of window panes, screens, storm doors, awnings, and the like?
Masonry, brick or stucco work?
Other improvements or repairs?
Where were the materials purchased?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I am going to ask about the purchase or rental of major household
appliances.
Since the first of the reference month, have you or any members of your household purchased or rented any of the following items for your household or for someone outside of your household?
Cooking stove, range or oven
Clothes washer or dryer
Was this item -
Purchased for someone inside the household?
[Rented?/blank] (skip to next item)
Purchased for someone outside your household?
When did you purchase it?
What was the purchase price ?
Where was the (Description) purchased?
Was this item purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I am going to ask about the purchase or rental of household sports and exercise equipment.
Have you or any members of your household purchased or rented any –
General sports equipment (exclude athletic shoes for sports related use, such as football, baseball, soccer or bowling)
Bicycles or bicycle equipment
Was this item
Purchased for someone inside the household?
[Rented?]
Purchased for someone outside the household?
When did you purchase it?
What did it cost?
Where was the (item name) purchased?
Was this item purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I will ask about expenditures for household item maintenance or repairs and service contracts.
Since the first of the reference month, did you or any members of your household have any expenses for service contracts, maintenance, or repairs for any of the following items
Garbage disposal, range hood, or built-in dishwasher
Other household appliances, such as washer, refrigerator, or range/oven
Heating/air conditioning service contracts
What did the service contract or repair cover?
In what month was the expense?
What was the total cost?
What is the name of the business that provided the service contract, maintenance, or repair?
Was this paid for -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I am going to ask about expenses for home furnishings and related household items.
Since the first of the reference month, have you or any members of your household had any expenses for
Sofas?
Ping-pong, pool tables or other similar recreation room items?
Bedroom linens?
Bathroom linens?
Rugs or other non-permanent floor coverings, including carpet squares?
Blinds, shades, other window coverings?
In what month did you purchase it?
What was the purchase price?
Where was the (item name) purchased?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Since the first of the reference month, have you or has any member of your household had any expenses for repairing, refinishing or reupholstering furniture, including the cost for fabric?
What is the name of the business that repaired, refinished, or reupholstered the furniture?
Was this service paid for -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I am going to ask about clothing, footwear, and accessories, for infants, children, and adults.
Since the first of the reference month, have you or has any member of your household purchased any of the following items, either for members of your household or for someone outside your household?
Coats, jackets or furs
Shirts, sweaters, blouses, or tops
Dresses
Uniforms, for which the cost is not reimbursed
What did you buy?
For whom was it purchased?
Yourself
Someone else
Where was (DESCRIPTION) purchased?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If in person) In what city and state is (store name) located?
Now I am going to ask about expenses for vehicle rentals and leases.
Since the first of the reference month, have you or any members of your household rented any automobiles trucks, vans, minivans, or SUVs, which were not used entirely for business? Do not include leased vehicles.
Automobiles, trucks, vans, minivans, or SUVs
Since the first of the reference month, not including the current month, what has been your expense for renting this vehicle?
Were or will any of the rental expenses be deducted as business
expenses, reimbursed, or paid by someone outside of the
household?
Yes
No
What is the name of the rental car company used?
In what city and state was the vehicle picked up?
Was the reservation made directly with (outlet)?
Yes (skip to mode question)
No
What was the name of the company you used to make your reservation?
Was this reservation made -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I'm going to ask about trips and vacations.
Since the first of the reference month, have you or any members of your household taken any trips for reasons such as:
* Visiting relatives or friends?
* Business?
* Recreational
trips?
* Other trips overnight or longer?
* Day trips of at
least 75 miles away from home?
Yes
No
How many nights did you or any members of your household spend away from home on this trip/these trips?
Was all or part of this trip/these trips covered by a package deal?
Yes
No
Did you or any members of your household spend any money for ship fare, other than what a package deal covered, if applicable?
Yes
No (skip to next item category)
What is the name of the cruise line or ship travel company?
Was the reservation made directly with (outlet name)?
Yes (skip to mode question)
No
What was the name of the company you used to make the reservation?
Was this reservation made -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (outlet name) located?
Did you or any members of your household spend any money for rented automobiles, not including gas, other than what a package deal covered, if applicable?
What is the name of the rental car company used?
In what city and state was the vehicle picked up?
Was the reservation made directly with (outlet name)?
Yes (skip to mode question)
No
What was the name of the company you used to make your reservation?
Was this reservation made -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (outlet name) located?
Did you or any members of your household spend any money for tolls that won’t be reimbursed?
Yes
No (skip to next item category)
What is the last road, bridge, ferry or tunnel you paid a toll for?
And what is the city and state?
Did you or any members of your household spend any money for parking?
Yes
No (skip to next item category)
In what city and state was the vehicle parked?
What is the name of the place where you had an expense for parking?
Did you or any members of your household spend any money for lodging?
Yes
No (skip to next item category)
What is the name of the hotel or place that you stayed?
In what city and state is (outlet name) located?
Was the reservation made directly with (outlet name)?
Yes (skip to mode question)
No
What was the name of the company you used to make your reservation?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (outlet name) located?
The next section collects miscellaneous expenditures.
Since the first of the reference month, have you or any members of your household had expenses for any of the following, either for you or any members of your household or for someone outside your household?
Gardening or lawn care services
In what month did you have this expense?
What was the total amount of this expense or what was your monthly expense?
What is the name of the business that provided the service?
Was this paid for -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I am going to ask about expenses for food, beverages and other items you and/or your household have/has purchased since the first of the reference month.
What has been your or your household usual WEEKLY expense for grocery shopping?
About how much of this amount was for nonfood items, such as paper products, detergents, home cleaning supplies, pet foods, and alcoholic beverages?
Where did ^YOU_ANYMEM last purchase groceries?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Other than your regular grocery shopping already reported, have you or any members of your household purchased any food or nonalcoholic beverages from places such as grocery stores, convenience stores, specialty stores, home delivery, or farmer's markets?
Yes
No (skip to next item category)
What was your usual WEEKLY expense at these places?
Where were these last purchased?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Since the first of the reference month, have you or any members of your household purchased cigarettes?
Yes
No (skip to next item category)
Where were they purchased?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Have you or any members of your household purchased other tobacco products such as cigars, pipe tobacco, chewing tobacco, or vaping products?
Yes
No (skip to next item category)
Where were these purchased?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
What has been your usual monthly expense for alcohol, including beer and wine at restaurants, bars, and recreational events?
Where did you last purchase alcohol, including beer or wine?
In what city and state is (business name) located?
Since the first of the reference month, not including the current month, have you or any members of your household had expenses for taxis or limousine service? Do not include expenses entirely reimbursed for business purposes or expenses incurred on a trip.
What was the total expense?
Was the [TXLIMX] solely for limousine service?
Yes
No
(If NO then ask):
What is the name of the taxi company or ride service app that was used?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Debriefing questions
We have asked you here today to help us improve survey questions. The questions that I asked you about store name and location are new questions and we need to learn whether they make sense to respondents.
What did you think of the ‘store/business name’ question?
What did you think of the question asking online, in person, or by mail or telephone order?
What did you think of the question asking about the city and state location?
Were there any expenses for which the way I asked the question didn’t make sense or was confusing at all?
Why do you think we’re collecting this information about stores/businesses?
Let’s review the store/business information we collected earlier.
Probes for reporting accuracy will vary by participant but generally will follow these types:
You said that you purchased [item] from [store/business name]. How confident are you in that store/business name? location?
(not at all confident, somewhat confident, very confident)
Was it easy or difficult to recall that information?
(easy, neither easy nor difficult, difficult)
Tell me more about that [store/company/business].
For the question on groceries: Did your shopping include only food or non-food items?
For point-of-service questions (eg rental car, lodging): Is this company/business a third party or the actual company/business that provided the service or item?
For the rental car question: Did the questions about pick-up location and reservation location make sense?
Part 2: Online Testing
Each of these modules will be listed on mTurk as a separate study (module) with initial screening questions. The screening criteria for the study will be listed in the study invitation. Potential participants will see the following information on the mTurk site. If a potential participant clicks the link to the study, he or she will be asked the initial screening questions (see Appendix B). If the participant’s answer fits the screening criteria for that module, they will be forwarded to a screen with the introductory text on the next page. If they choose to proceed, they will be asked several demographic questions, the focal questions for that module, and then the debriefing questions. If the participant’s answer does not fit the screening criteria, they will see the following text: Thank you for your time, but you do not meet the qualifications for this study.
All modules:
Welcome! Thanks for your interest in our survey. You’re here because we have asked you to participate in our research to improve survey questions. We are asking you and hundreds of other people to tell us about what they think.
Unlike some surveys or online tasks you may be familiar with, we ask that you complete this survey all at one time and that you only start once you are in a quiet place where you won't be disturbed. The survey takes about 10 minutes, on average. Only share information you're comfortable with - nothing too personal - but please be honest and follow the instructions.
Please do not use your browser's back button.
This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. We will use the information you provide for statistical purposes only. Your participation is voluntary, and you have the right to stop at any time. This survey is being administered by Qualtrics and resides on a server outside of the BLS domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response. By proceeding, you give your consent to participate in this study.
---page break---
The
Consumer Expenditure Survey collects information from the Nation's
households and families on their buying habits (expenditures),
income, and household characteristics. Knowing what goods and
services consumers are buying and how much they are spending is
critical information in determining the strength of our Nation’s
economy and the direction in which it is moving. Knowing where
consumers are buying these goods and services gives us a list of
grocery stores, department stores, doctor’s offices, theaters,
internet sites, and shopping malls where consumers spend money and
enables us to track price changes in the economy.
We are asking for your help to improve our survey questions. We are adding new questions to our survey and we need to learn whether they make sense to respondents.
On the following pages, you’ll be asked to answer questions about expenditures you may or may not have made over the last three months. We will then ask you some additional questions to better understand your answers.
Let’s get started!
---page break---
We’ll start by asking a few questions about you and your household.
What is your age in years?
What is your gender?
Male
Female
What is the highest level of school you have completed or the highest degree you have received?
Grades 1-12/No Diploma
High School Diploma or Equivalent
Some College
Associate’s Degree
Bachelor’s Degree
Master’s Degree
Doctorate or Professional Degree
Are you Hispanic or Latino?
Yes
No
What is your race?
American Indian or Alaska Native
Asian
Black or African-American
Native Hawaiian or Other Pacific Islander
White
How many people live in your household, including yourself?
1
2
3
4
5 or more
[if HHSize > 1] How many of those people are under the age of 18?
1
2
3
4
5 or more
---page break---
Module A – car owner
Now we are going to ask about expenses for vehicle leases.
Since the first of the reference month, have you or any members of your household made any lease payments or begun leasing any automobile, truck, van, minivan, or SUV not used entirely for business?
Yes
No
What is the name of the business that provided this leased vehicle?
Was this leased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
---page break---
Now we are going to ask you about owned vehicles.
Do/Does you or your household own any automobiles, trucks, minivans, vans or SUV's which were not used entirely for business?
Yes
No
Do/Does you or your household own any other types of vehicles including boats and aircraft which are not used entirely for business?
IF YES - Do you own any -
1. Car, trucks, van
2. Motor home
3. Motorcycle, motor scooter, or moped (motorized bicycle)
Was it new or used when acquired?
New
Used
Was this vehicle purchased from a private individual?
Yes
No
In what year was it purchased?
Where was this vehicle purchased?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
---page break---
Now we will ask about expenses for vehicle services, parts, and equipment. Please do not include expenses for vehicles used entirely for business.
Since the first of the reference month, have you or any members of your household had expenses for any of the following?
1. Oil change, lubrication, or oil filter
2. Motor tune-up
3. Tire repair
What was the expense for?
Did this expense include labor?
Where was this purchased?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
---page break---
This section deals with other vehicle operating expenses.
Since the first of the reference month, not including this month – Have you or any members of your household had any expenses for parking, such as parking garages, parking lot fees, or parking meters?
Yes
No
In what city and state was the vehicle parked?
What is the name of the place where you had an expense for parking?
Since the first of the reference month, not including this month – Have you or any members of your household had expenses for local tolls or electronic toll passes?
Yes
No
What is the last road, bridge, ferry or tunnel you paid a toll for?
And what is the city and state?
---page break---
Now we’d like to ask you some follow-up questions about the expenses you reported, to make sure we understand what you’ve told us.
If leased a vehicle:
Was any element of the leasing process completed online?
Yes
No
(if yes) Please describe what part of the leasing process was done online.
For each question they reported an outlet for, show the original question and ask:
How confident are you in the store/business name that you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
How confident are you in the location you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
Was it easy or difficult to decide what store/business to report?
(easy, neither easy nor difficult, difficult)
If there were any questions for which you had more than one expense, how did you choose which store/business to report?
Module B – home owner, renovation work
First, let's talk about the construction or alteration of property [you own/you rent/you own or rent]. You should not include jobs that have been or will be totally reimbursed by someone outside your household, such as a landlord.
Since the first of the
reference month, have you or any members of your household had
expenses for-
Remodeling one or more rooms in the house?
If yes, go to follow-up questions; otherwise skip to next question
--- page break ---
Now, let's talk about maintenance and repairs for property [you own/you rent/you own or rent]. Again, you should not include jobs that have been or will be totally reimbursed by someone outside your household, such as your landlord.
Since the first of the reference month, have you or any members of your household had expenses for-
Painting, either interior or exterior, or wallpapering?
Plumbing or water heating installations or repairs?
Heating or air conditioning jobs?
Flooring installation, repair, or replacement including carpeting, wood, vinyl, and tile?
Did you do this job yourself or did you pay someone else to do all or part of the work?
Self only (skip to next item)
Paid or contracted with someone else
Both
What is the name of the business that provided the service contract, maintenance, or repair?
In what city and state is (business name) located?
Since the first of the reference month, excluding this month, have you or any member of you household purchased any materials or supplies that were FOR JOBS NOT YET STARTED?
Yes
No (skip to end of section)
What kind of job will the materials be used for? Select a job type below
Homes under construction including a vacation home or second home?
Building an addition to the house or a new structure, such as a porch, garage, or new rooms?
Finishing a basement or an attic or enclosing a porch?
Remodeling one or more rooms in the house?
Landscaping the ground or planting new shrubs or trees?
Building outdoor patios, walks, fences, or other enclosures, driveways, or permanent swimming pools or hot tubs?
Repairing outdoor patios, walks, fences, driveways, or permanent swimming poos?
Painting, either interior or exterior, or wallpapering
Plastering or paneling?
Plumbing or water heating installations or repairs?
Electrical work?
Heating or air conditioning jobs?
Flooring installation, repair, or replacement including carpeting, wood, vinyl, and tile?
Insulation?
Roofing, gutters or downspouts?
Siding?
Installation, repair, or replacement of window panes, screens, storm doors, awnings, and the like?
Masonry, brick or stucco work?
Other improvements or repairs?
Where were the materials purchased?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
Now I am going to ask about the purchase or rental of major household
appliances.
Since the first of the reference month, have you or any members of your household purchased or rented any of the following items for your household or for someone outside of your household?
Cooking stove, range or oven
Clothes washer or dryer
Was this item -
Purchased for someone inside the household?
[Rented?/blank]
Purchased for someone outside your household?
When did you purchase it?
What was the purchase price ?/ What was the total rental expense since the first of the reference month not including the current month?
Where was the (Description) purchased?
Was this item purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
Now I will ask about expenditures for household item maintenance or repairs and service contracts.
Since the first of the reference month, did you or any members of your household have any expenses for service contracts, maintenance, or repairs for any of the following items
Garbage disposal, range hood, or built-in dishwasher
Other household appliances, such as washer, refrigerator, or range/oven
Heating/air conditioning service contracts
What did the service contract or repair cover?
In what month was the expense?
What was the total cost?
What is the name of the business that provided the service contract, maintenance, or repair?
Was this paid for -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
The next section collects miscellaneous expenditures.
Since the first of the reference month, have you or any members of your household had expenses for any of the following, either for you or any members of your household or for someone outside your household?
Gardening or lawn care services
In what month did you have this expense?
What was the total amount of this expense or what was your monthly expense?
What is the name of the business that provided the service?
Was this paid for -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
Now we’d like to ask you some follow-up questions about the expenses you reported, to make sure we understand what you’ve told us.
For each question they reported an outlet for, show the original question and ask:
How confident are you in the store/business name that you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
How confident are you in the location you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
Was it easy or difficult to decide what store/business to report?
(easy, neither easy nor difficult, difficult)
If there were any questions for which you had more than one expense, how did you choose which store/business to report?
If there were any questions for which you had more than one expense, how did you choose which store/business name to report?
Module C – parent
Now I am going to ask about education expenses. Please include any direct payments made for any members of your household or for anyone outside your household and any payments you made online or had automatically deducted.
Since the first of the reference month, have you or any members of your household paid for –
1. Any recreational lessons or other instructions?
2. Preschool or child day care centers?
3. Food or board while attending school?
4. Purchase of any school books, supplies, or equipment which has not already been reported?
What was the expense for?
What kind of school or facility was it?
1. College or university
2. Elementary through high school
3. Child day care center
4. Nursery school or preschool
5. Vocational or Technical School
6. Other
Use above responses to filter follow-up questions
What is the name of the business that provides this lesson or instruction?
In what city and state is (business name) located?
What is the name of the preschool or child day care center?
What is the name of the school providing food or board?
Where was this item purchased?
Was this item purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
Now I am going to ask about miscellaneous expenses.
Since the first of the reference month, have you or any members of your household had expenses for any of the following, either for you or any members of your household or for someone outside your household?
Purchase of pets, pet supplies, or medicine for pets?
Pet services
Veterinarian expenses for pets
Where was this purchased?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
Now we’d like to ask you some follow-up questions about the expenses you reported, to make sure we understand what you’ve told us.
For each question they reported an outlet for, show the original question and ask:
How confident are you in the store/business name that you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
How confident are you in the location you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
Was it easy or difficult to decide what store/business to report?
(easy, neither easy nor difficult, difficult)
If there were any questions for which you had more than one expense, how did you choose which store/business to report?
If there were any questions for which you had more than one expense, how did you choose which store/business name to report?
Module D – technology/electronics expenses
Now I am going to ask about expenses for the purchase or rental of household appliances and other selected items.
Since the first of the reference month, have you or any members of your household purchased or rented any of the following items?
Computers, computer systems, or related hardware
Computer software including computer games
Portable memory, such as flash drives, memory cards, and recordable discs and tapes
Video game hardware or accessories
Telephones or accessories
Satellite dishes, receivers or accessories
What did you purchase or rent?
Was this item
Purchased for someone inside the household?
[Rented?/BLANK]
Purchased for someone outside the household?
Where was the (item name) purchased?
Was this item purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
Now I am going to ask about expenses for subscriptions, memberships, books, and entertainment. Please remember to include any payments you made online or had automatically deducted.
Since the first of reference month have you or any member of your household purchased any of the following items for your household or for someone outside your household?
Tickets to movies, parks, or museums
Rented video files or DVDs
Streaming video subscriptions
Applications, games, or ringtones for a cellphone or mobile device not already reported
Describe the item.
Where was this rented or purchased?
Was this rented or purchased-
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
--- page break ---
Now we’d like to ask you some follow-up questions about the expenses you reported, to make sure we understand what you’ve told us.
For each question they reported an outlet for, show the original question and ask:
How confident are you in the store/business name that you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
How confident are you in the location you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
Was it easy or difficult to decide what store/business to report?
(easy, neither easy nor difficult, difficult)
If there were any questions for which you had more than one expense, how did you choose which store/business to report?
If there were any questions for which you had more than one expense, how did you choose which store/business name to report?
Module E – trips
Now I'm going to ask about trips and vacations.
Since the first of the reference month, have you or any members of your household taken any trips for reasons such as:
* Visiting relatives or friends?
* Business?
* Recreational
trips?
* Other trips overnight or longer?
* Day trips of at
least 75 miles away from home?
Yes
No
How many nights did you or any members of your household spend away from home on this trip/these trips?
Was all or part of this trip/these trips covered by a package deal?
Yes
No
Did you or any members of your household spend any money for ship fare, other than what a package deal covered, if applicable?
Yes
No (skip to next item category)
What is the name of the cruise line or ship travel company?
Was the reservation made directly with (outlet name)?
Yes (skip to mode question)
No
What was the name of the company you used to make the reservation?
Was this reservation made -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (outlet name) located?
--- page break ---
Did you or any members of your household spend any money for rented automobiles, not including gas, other than what a package deal covered, if applicable?
What is the name of the rental car company used?
In what city and state was the vehicle picked up?
Was the reservation made directly with (outlet name)?
Yes (skip to mode question)
No
What was the name of the company you used to make your reservation?
Was this reservation made -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (outlet name) located?
Did you or any members of your household spend any money for tolls that won’t be reimbursed?
Yes
No (skip to next item category)
What is the last road, bridge, ferry or tunnel you paid a toll for?
And what is the city and state?
Did you or any members of your household spend any money for parking?
Yes
No (skip to next item category)
In what city and state was the vehicle parked?
What is the name of the place where you had an expense for parking?
Did you or any members of your household spend any money for lodging?
Yes
No (skip to next item category)
What is the name of the hotel or place that you stayed?
In what city and state is (outlet name) located?
Was the reservation made directly with (outlet name)?
Yes (skip to mode question)
No
What was the name of the company you used to make your reservation?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (outlet name) located?
--- page break ---
Now we’d like to ask you some follow-up questions about the expenses you reported, to make sure we understand what you’ve told us.
For each question they reported an outlet for, show the original question and ask:
How confident are you in the store/business name that you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
How confident are you in the location you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
Was it easy or difficult to decide what store/business to report?
(easy, neither easy nor difficult, difficult)
If there were any questions for which you had more than one expense, how did you choose which store/business to report?
If there were any questions for which you had more than one expense, how did you choose which store/business name to report?
If POS category
Please tell us more about your expense for [FILL]. Did you use a third party vendor to purchase the tickets or did you buy them directly from the company itself?
I used a third party vendor
I bought them directly from the company itself - in person or by mail or telephone
I bought them directly from the company itself – online
Module F – proxy reporting, multiple adults
Now I am going to ask about expenses for subscriptions, memberships, books, and entertainment. Please remember to include any payments you made online or had automatically deducted.
Since the first of reference month have you or any member of your household purchased any of the following items for your household or for someone outside your household?
1. Fees for participating in sports such as golf, bowling, biking, hockey, football, or swimming
2. Credit card membership fees
3. Single or season tickets to spectator sports events such as football, baseball, hockey, racing, or track events
4. Single or season tickets to plays, operas, or concerts
5. Tickets to movies, parks, or museums
6. Single copies of newspapers, magazines, or periodicals including digital
7. Subscriptions to newspapers, magazines, or periodicals, including digital
Fees for sports
What is the name of the organization or event?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Tickets
What is the name of the (sporting venue/ theater, opera house, or concert venue/ theater, park or museum)?
In what city and state is (outlet name) located?
Were the tickets purchased directly from (outlet name)?
Yes (skip to mode question)
No
What was the name of the company you used to purchase the tickets?
Were the tickets purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (outlet name) located?
Newspapers, etc
Where was this purchased?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Credit card
What is the name of the credit card company?
Now I am going to ask about miscellaneous expenses.
Since the first of the reference month, have you or any members of your household had expenses for any of the following, either for you or any members of your household or for someone outside your household?
Housekeeping services
Catering?
What was the expense for?
What is the name of the business that provided the service?
Was this paid for -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Now I am going to ask about expenses for food, beverages and other items you and/or your household have/has purchased since the first of the reference month.
What has been your or your household usual WEEKLY expense for grocery shopping?
* Include grocery home delivery service fees and drinking water delivery fees.
Where did ^YOU_ANYMEM last purchase groceries?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Other than your regular grocery shopping already reported, have you or any members of your household purchased any food or nonalcoholic beverages from places such as grocery stores, convenience stores, specialty stores, home delivery, or farmer's markets?
What was your usual WEEKLY expense at these places?
Where were these last purchased?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Since the first of the reference month, have you or any members of your household purchased cigarettes?
What is the usual WEEKLY expense?
Where were they purchased?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Have you or any members of your household purchased other tobacco products such as cigars, pipe tobacco, chewing tobacco, or vaping products?
What is the usual WEEKLY expense?
Where were they purchased?
Were they purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
What has been your usual monthly expense for alcohol, including beer and wine at restaurants, bars, and recreational events?
Where did you last purchase alcohol, including beer or wine?
In what city and state is (business name) located?
--- page break ---
This section deals with expenses for dry cleaning, laundry service, personal services, banking fees, taxis, limousines, and mass transportation.
Since the first of the reference month, not including the current month, have you or any members of your household had any expenses for self-service laundry machines?
Where did ^YOU_ANYMEM pay for self-service laundry machines?
In what city and state is (business name) located?
Have you or any members of your household paid any charges or fees for bank services such as ATM or overdraft fees or account service charges from a bank or similar financial institution?
What is the usual MONTHLY charge?
What was the name of the bank or institution?
Was this paid -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Since the first of the reference month, not including the current month, have you or any members of your household had expenses for taxis or limousine service? Do not include expenses entirely reimbursed for business purposes or expenses incurred on a trip.
What was the total expense?
Was the [TXLIMX] solely for limousine service?
Yes
No
(If NO then ask):
What is the name of the taxi company or ride service app that was used?
Was this purchased -
Online?
In person?
By mail or telephone order?
Other
(If answered in person): In what city and state is (business name) located?
Do you or any members of your household use mass transportation services such as a bus, subway, mini-bus or train?
Include all commuter services. Do not include expenses covered by employer-provided transit subsidies.
* Include commuter rail, light rail, and trolleys as mass transit
What is the name of the mass transportation service?
--- page break ---
Now we’d like to ask you some follow-up questions about the expenses you reported, to make sure we understand what you’ve told us.
For each question they reported an outlet for, show the original question and ask:
How confident are you in the store/business name that you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
How confident are you in the location you reported: [FILL]?
(not at all confident, somewhat confident, very confident)
Was it easy or difficult to decide what store/business to report?
(easy, neither easy nor difficult, difficult)
If there were any questions for which you had more than one expense, how did you choose which store/business to report?
For each question they did not report an outlet for, show the original question and ask:
Did anyone in your household have one of these expenses?
(Yes, No)
If POS category
Please tell us more about your expense for [FILL]. Did you use a third party vendor to purchase the tickets or did you buy them directly from the company itself?
I used a third party vendor
I bought them directly from the company itself - in person or by mail or telephone
I bought them directly from the company itself – online
Appendix B: Screening questions
OSMR staff will contact prospective participants by telephone or email to conduct an initial screening for eligibility to participate in the research. Eligibility requires positive answers to both 1 and 2 or to 3.
Do you own your home?
Yes**
No (skip to Q3)
In the past three months, have you had any major work or repairs done on your home?
Yes**
No
In the past three months, have you gone on any out-of-town trips?
Yes*
No
Individuals who are interested in participating in the online studies will be asked a set of screening questions tailored to each module. Asterisks mark responses that are required for eligibility.
Module A
In the past three months, have you purchased or begun a lease on a car, truck, or van?
Yes*
No
Module B
Do you own your home?
Yes*
No (skip to end; ineligible)
In the past three months, have you had any major work or repairs done on your home?
Yes*
No
Module C
Are you a parent?
Yes*
No
Module D
In the past three months, have you spent any money on computers or electronics?
Yes*
No
Module E
In the past three months, have you gone on any out-of-town trips?
Yes*
No
Module F
How many adults (age 18 or older) live in your household?
1 (yourself)
2
3 or more*
Appendix C: Informed Consent form
OMB Control Number: 1220-0141
Expiration Date: 04-30-2018
The Bureau of Labor Statistics (BLS) is conducting research to increase the quality of BLS surveys. This study is intended to suggest ways to improve the procedures the BLS uses to collect survey data.
The BLS, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act of 2002 (Title 5 of Public Law 107-347) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent. The Privacy Act notice on the back of this form describes the conditions under which information related to this study will be used by BLS employees and agents.
During this research you may be audio and/or videotaped, or you may be observed. If you do not wish to be taped, you still may participate in this research.
We estimate it will take you an average of 45 minutes to participate in this research (ranging from 40 minutes to 60 minutes).
Your participation in this research project is voluntary, and you have the right to stop at any time. If you agree to participate, please sign below.
Persons are not required to respond to the collection of information unless it displays a currently valid OMB control number. The OMB control number is 1220-0141 and expires 04-30-2018.
------------------------------------------------------------------------------------------------------------
I have read and understand the statements above. I consent to participate in this study.
___________________________________ ___________________________
Participant's signature Date
___________________________________
Participant's printed name
___________________________________
Researcher's signature
In accordance with the Privacy Act of 1974, as amended (5 U.S.C. 552a), you are hereby notified that this study is sponsored by the U.S. Department of Labor, Bureau of Labor Statistics (BLS), under authority of 29 U.S.C. 2. Your voluntary participation is important to the success of this study and will enable the BLS to better understand the behavioral and psychological processes of individuals, as they reflect on the accuracy of BLS information collections. The BLS, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act of 2002 (Title 5 of Public Law 107-347) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent.
1 Mechanical Turk is an online platform that offers a crowdsourcing “marketplace”. Individuals can volunteer to participate in short tasks and be paid small amounts of money ($4-6/hour pro-rated, on average). “Workers” may not be demographically representative of the United States but social science researchers are increasingly using Mechanical Turk for large-scale studies. Eligibility criteria can be set to restrict participation to only individuals over 18 years old and located in the United States.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Yu, Erica - BLS |
| File Modified | 0000-00-00 |
| File Created | 2021-01-22 |