Note to Reviewer - Testing of CIPSEA Pledge

Note to Reviewer - CIPSEA_Testing.docx

Cognitive and Psychological Research

Note to Reviewer - Testing of CIPSEA Pledge

OMB: 1220-0141

Document [docx]
Download: docx | pdf

OMB Control Number: 1220-0141

Expiration Date: April 30, 2018



June 21, 2016



NOTE TO THE REVIEWER OF:


OMB CLEARANCE 1220-0141

Cognitive and Psychological Research”

FROM:

Jennifer Edgar

Office of Survey Methods Research

SUBJECT:

Submission of Materials for Testing of Revised CIPSEA Pledge

Please accept the enclosed materials for approval under the OMB clearance package 1220-0141 “Cognitive and Psychological Research.” In accordance with our agreement with OMB, we are submitting a brief description of the study.

The total estimated respondent burden for this study is 122 hours.

If there are any questions regarding this project, please contact Jennifer Edgar at 202-691-7528.



  1. Introduction

The passage of the Cybersecurity Enhancement Act of 2015 requires the installation of the Department of Homeland Security’s Einstein cybersecurity protection system on all Federal civilian information technology systems by mid-December 2016.  Combined with DHS’ stated policies, it also potentially compromises the absolute nature of the Federal statistical system’s (FSS) confidentiality pledges by no longer enabling statistical agencies to pledge that respondents’ data will be seen only by a statistical agency’s employees or its sworn agents.  Consequently, the FSS needs to develop a revised confidentiality pledge(s) that informs respondents of this change in circumstances.


To optimize the effects of a revised confidentiality pledges, we need to conduct research to determine respondent’s comprehension of, and reaction to, the revised pledge language. We will also explore wording options, to determine which may minimize the negative impact. The BLS will focus on testing the revised CIPSEA pledge with establishment respondents, as they make up the overwhelming majority of the BLS respondent pool. BLS will be working with an interagency group, sharing research designs and findings to assist other statistical agencies in conducting similar testing for other respondent groups. It is possible that such a change may have differential effects on various classes of respondents such as households, small establishments, large establishments/enterprises, farmers and ranchers, educational or medical institutions, etc.  BLS currently has multiple versions of the revised language that we will test (Attachment A). As internal discussions are ongoing, the language may change slightly, but the intent will remain the same – to inform respondents of the cybersecurity legislation and implications for their data.

We will also be testing a new respondent flier which explains the BLS confidentiality assurances, including the new DHS provision. The current draft of the brochure is attached as Appendix B, as the brochure will be reviewed by BLS field staff while this OMB package is being reviewed, there may be minor changes in the third and fourth paragraph wording.



  1. Methodology

This study will use a multi-prong approach to collect the necessary information in the most time-efficient way possible.

  1. Primary purpose collection.

Participants will be recruited for the sole purpose of testing the CIPSEA language. We will recruit two types of participants: typical cognitive interview participants who can serve as proxies for household survey respondents, and participants who have a job or experience that would make them appropriate proxies for establishment survey respondents. For recruiting the latter group, we may contact respondents who have completed prior BLS surveys but are not active respondents. A standard cognitive interview approach will be used, either in-person or over the phone, depending on the participants location and ability to travel to the BLS cognitive laboratory. The interview is expected to take less than half an hour, and the protocol is included in Attachment C.

  1. Add-on to other studies.

Participants participating in other BLS cognitive research efforts will be given the CIPSEA protocol (Attachment C) at the end of the other study. For example, 9 establishment participants will be doing a test to evaluate an email designed to instruct SOII respondents on how to report electronically. After the SOII portion of the session has been concluded, the CIPSEA protocol (Attachment C) will be completed. These studies will either be conducted in the OSMR cognitive lab, or remotely (e.g. telephone or WebEx). The main studies, to be conducted independent of the CIPSEA research as needed, will either use 9 or fewer participants or have their own OMB clearance (e.g., CPS Contingent Worker Supplement testing).

  1. Online data collection: TryMyUI.

TryMyUI participants, screened to ensure they are a business owner or work in an office environment, will be shown versions CIPSEA pledges and asked a series of follow-up questions to determine their understanding of the assurances and gauge their reaction to the language. They will also be asked to provide feedback on the respondent confidentiality brochure. The TryMyUI protocol is included in Attachment D.

  1. Online data collection: MTurk.

Although MTurk is not expected to be an efficient way to recruit establishment respondents, its efficiency at collecting information from large numbers of participants warrants its inclusion in this study. For the MTurk portion of the study, we will conduct an experiment to test the impact of the CIPSEA pledge on reporting. In the online survey respondents do not receive an assurance of confidentiality as data is not secure, stored outside the BLS network. After answering a series of questions about their knowledge of the BLS and experience completing surveys, they will be shown one of the versions of the CIPSEA pledge and be asked to click a button saying they have read it.

Participants will then be asked a series of demographic and occupation questions. These questions will not only provide useful background on the participants to compare the composition of the pledge groups, they will also show if there is any differences in item reporting by the versions of the CIPSEA pledge. These questions will also serve as a filler, focusing the participant on another topic so we can evaluate how much of the CIPSEA pledge language and content they retained after completing another task.

Following the demographic questions, participants will be asked a series of questions to gauge their recall and comprehension of the CIPSEA pledge. They then will be shown the same version of the pledge and asked additional information about their comprehension of and reactions to the pledge. The survey is included in Attachment E.

  1. Data Collection Center (DCC) Staff

To gain insight into what respondent concerns are heard at the BLS Data Collection Centers, web surveys will be sent to contract staff who work at those telephone centers. The web survey (Attachment F) will ask about experience with respondents in terms of the CIPSEA pledge.



  1. Participants

  1. Primary purpose collection


Up to 30 participants will be recruited with the sole purpose of testing the CIPSEA language. For household participants, we will recruit from the existing OSMR participant database, as well as from online recruitment advertisements. For establishment participants, we will work with the BLS Office of Field Operations to recruit participants from prior production data collection.


  1. Add-on to other studies


Up to 20 participants will complete the CIPSEA testing as a part of other OSMR research. Only those who are reasonable proxies for BLS establishment respondents will be used, which will be known from the purpose of the primary research (e.g. SOII email testing).


  1. Online data collection: TryMyUI


Up to 20 TryMyUI participants will be recruited from their online panel. As part of the participant selection, we will require that the participants be 21 or older, living in the U.S., have at least a high school diploma, and work full-time in an office environment.


  1. Online data collection: MTurk


Up to 900 Amazon Mechanical Turk participants will be recruited. For participation, we will require that participants be 21 or older, living in the U.S., have at least a high school diploma, and work full-time in an office environment. Each participant will be randomly assigned to one of pledge versions.

  1. Data Collection Center (DCC) Staff

Up to 40 DCC staff, 20 from Dallas and 20 from Kansas City will be sent the web survey. They will be randomly selected by their supervisors at the request of BLS headquarters staff.

IV. Burden Hours

The burden hours for all prongs of this research are shown in Table 1.





Table 1. Estimated Burden Hours


# of Participants Screened

Minutes per participant for Screening

Total Screening Burden

Maximum number of Participants

Minutes per participant for data collection

Total Collection Burden

Total Burden (Screening + Collection)

  1. Primary purpose collection

60

5

300

30

30

900

1,200

  1. Add-on to other studies

20

0

0

20

30

600

600

  1. Online data collection: TryMyUI

20

0

0

20

20

400

400

  1. Online data collection: MTurk Survey

900

0

0

900

5

4,500

4,500

5. Data Collector Center Web Survey

40

0

0

40

15

600

600

Total Burden

7,300 minutes


122 hours





V. Payment to Participants

  1. Primary purpose collection


Participants who come to the OSMR cognitive lab will be paid $40. Participants who complete the study over the phone will receive no payment.


  1. Add-on to other studies


Participants who complete this research at the end of another study in the OSMR cognitive laboratory will receive $20 in addition to the incentive that they receive for the primary research. Participants who complete this research at the end of another remote (e.g. telephone, WebEx) study will not receive payment.


  1. Online data collection: TryMyUI


Participants who complete the study from the TryMyUI platform will receive $10 for participating in the study, a standard rate for TryMyUI studies. The estimated total for TryMyUI participant fees is $280, including a fee the company requires.



  1. Online data collection: MTurk


Participants who complete the study from the MTurk platform will receive $.75 for participating in each survey, a typical rate for similar tasks. The estimated total for MTurk participant fees is $930. This includes a fee the company requires.


  1. Data Collection Center (DCC) Staff

Staff will receive no compensation for their participation.

VI. Data Confidentiality

Since this study is testing the actual confidentiality pledge, we are requesting to use an atypical method of assuring confidentiality, varying by mode of collection.

    1. In person collection (Primary purpose collection, add-on to other study collection, and focus groups)

Participants will be given a consent form before the start of the study (Attachment G). The consent form will use the current CIPSEA wording, as prior research has shown that participants do not focus on the language on the form and we do not expect it to interact with the in-depth probing of the revised language.

    1. Telephone collection (Primary purpose collection, and add-on to other study collection)

Participants will be read the standard consent language (Attachment H) prior to beginning the study. They will be asked to give their verbal consent to participate in the research.

    1. Online collection (TryMyUI, MTurk)

Recruiting of participants will be handled by TryMyUI and Amazon Mechanical Turk. Once participants are recruited into the study, they will be given a link to the survey, which is hosted by Qualtrics. The data collected as part of this study will be stored on Qualtrics servers.

Participants will be informed of the OMB number and the voluntary nature of the study.

This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. This survey will take approximately 5 minutes to complete. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response This survey is being administered by Qualtrics and resides on a server outside of the BLS Domain. Your participation is voluntary, and you have the right to stop at any time.



  1. Attachments

Attachment A: Current Proposed CIPSEA revised language

Attachment B: Respondent Confidentiality Brochure

Attachment C: CIPSEA Cognitive Interviewing Protocol

Attachment D: TryMyUI Web Instrument

Attachment E: MTurk web survey

Attachment F: DCC Web Survey

Attachment G: Consent form for in-person testing



Attachment A: Proposed CIPSEA revised language



Note: BLS is still working on the exact final language of the revised pledges. These are the current options, which we expect to change slightly as internal discussions continue. The intent of all the versions will remain the same – to inform respondents of the cybersecurity legislation and potential impact on their data. All options are intended to go at the end of the current CIPSEA pledge.

Current CIPSEA Pledge

The Bureau of Labor Statistics, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act of 2002 (Title 5 of Public Law 107-347) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent.



Alternative Version – one for each combination of fills

To protect Federal information systems from cybersecurity risks [malicious activities], BLS information systems [your data] are protected [safeguarded] through cybersecurity monitoring [screening] of the systems that transmit your data.




Attachment B: Respondent Confidentiality Brochure

Shape1

Protecting Respondent Information

R esponding to the Bureau of Labor Statistics is important. Your answers ensure we produce data that accurately measure the nation’s economic health.

Responding to the Bureau of Labor Statistics is secure. Your answers are protected by law and are not shared with anyone.


The Bureau of Labor Statistics is bound by a strict criminal law and solemn commitment to protect the confidential information we collect. We have never had a breach of our data collection systems, and all transmitted data are protected by state-of-the-art encryption methods.

W e take the utmost measures to protect the identity of individuals and businesses, starting from the point at which the data are collected. All BLS data collection systems are 100 percent encrypted. Keeping your responses secure is our top priority. The safeguarding of your information continues long after the aggregate statistics are published.

The BLS information systems, along with systems throughout the federal government, themselves have recently begun an additional level of protection.  BLS has implemented a new monitoring system from the Department of Homeland Security (DHS). It is designed to protect government agency information systems. This system allows DHS to detect cyber-attacks targeting federal civilian government information systems and actively prevents potential compromises.

The intent of this DHS monitoring system is solely to detect and defend federal information systems against known cybersecurity threats. Information will be collected or retained by DHS only if they are associated with known or suspected cyber threats. DHS will use the information collected through Einstein to analyze the known or suspected cyber threat and help BLS and other agencies respond and better protect their computers and networks.

For additional information, please see the DHS cybersecurity privacy website: http://www.dhs.gov/files/publications/editorial_0514.shtm#4.



Attachment C: CIPSEA Cognitive Interviewing Protocol



  1. Introduction



  1. Hi! Thank you for coming in today. My name is ( ). I work for the Office of Survey Methods Research in the Bureau of Labor Statistics. I look forward to working with you today.

  2. With your permission, I will be taping this session. This allows me to ensure the accuracy of your answers, and also allows me to focus on you and your responses instead of taking notes. Do I have your permission to audiotape?

  3. Before we get started, please read over the consent form. If you agree to participate in the study, print and sign your name as indicated on the bottom of the form. If you do not agree, please let me know now.

  4. Let me explain a bit about what we’ll be doing today. The BLS collects a wide variety of data from companies and households to create important national statistics, such as the unemployment rate and the inflation rate. In order to earn, and keep, the trust of our respondents we work hard to keep all the information they give us safe and protected. We are actually required by law to protect the data.

  5. Recent changes to the laws require us to make some changes in the way we explain how we keep data protected to our respondents. To ensure that the changes we make are clear and easy to understand to respondents, we are talking to you and many others to get your feedback to the wording.

  6. We are looking for your honest feedback and reactions. There aren’t any right or wrong answers here, your opinions and thoughts are what matters today. We want to know what you would think if you heard the language before giving the BLS your personal information, so we will be asking you to pretend you’re a respondent who has been asked to participate in a BLS survey. With your ‘respondent hat’ on, I’ll be giving you the new language and then asking you a series of questions to get your feedback on it.

  7. Do you have any questions before we begin?

  1. Background

    1. Can you tell me a bit about what you do for a living?

    2. Have you answered government surveys before?

      1. For your company?

      2. For your household?

    3. If yes,

      1. Do you remember what surveys they were?

      2. What type of information did you provide?

      3. What do you remember about how the survey organization promised to keep your information secure?

    4. Did you have any concerns or hesitations about providing your information for the survey(s)?



  1. Current CIPSEA Language: Verbal

  1. Here is the way we currently explain how we protect data (read aloud)

The Bureau of Labor Statistics, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act of 2002 (Title 5 of Public Law 107-347) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent.

  1. I know that’s not the most straightforward thing you’ve heard, but can you tell me what it means in your own words?

  2. What is your general reaction to this language?

  3. If you heard this language before a survey, would it influence your decision to participate or not?

  4. Do you have any concerns with how your (company’s / personal) information would be treated after hearing this?



  1. Current CIPSEA Language: Visual

    1. Here is the pledge I just read, I’ll give you a minute to read through it (show card)

The Bureau of Labor Statistics, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act of 2002 (Title 5 of Public Law 107-347) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent.



    1. Now that you’ve read it, can you again tell me what it means?

    2. Is your reaction to it different now that you’ve seen it written down?

    3. (take back show card) I want to ask you some questions about what the language covers and doesn’t cover. Please make your best guess, even if you’re not sure of the answer. If you gave BLS data and were assured confidentiality using this language, who would be able to see your information?

    4. What would they be able to do with your information?

    5. I’m going to read a list of groups, tell me if they’d be able to see the information you provided

      1. Bureau of Labor Statistics (BLS)

      2. Department of Labor (DOL)

      3. Internal Review Service (IRS)

      4. Social Security Administration (SSA)

      5. Department of Homeland Security (DHS)

      6. The Census Bureau

      7. All federal government agencies

      8. Congress

      9. Other

      10. Anyone else who would be able to access your data under this language?

    6. Besides who can access your information, the language also talks about what can be done with it. Specifically it says it can only be used for “Statistical purposes.” What do you think that means?

    7. I’m going to read a list of activities, tell me if you think they’d be allowed under this language?

      1. It could be combined with other survey answers to create summary statistics

      2. It could be published exactly as you provided it

      3. It could be given to other statistical agencies

      4. It could be given to the IRS

      5. It could be given to other federal government agencies

      6. It could be given to private companies

      7. What else could be done under this language?



  1. Revised language {order will be randomly assigned across participants}

    1. As I mentioned, there have been changes to the laws related to the protection of BLS survey data. The main language that you just read will stay the same, but we’ll be adding the following to the end (show card)

To protect Federal information systems from cybersecurity risks, BLS information systems are protected through cybersecurity monitoring of the systems that transmit your data.

    1. What does that mean to you?

    2. What is your general reaction to it?

    3. If you heard this language before a survey, would it influence your decision to participate or not?

    4. Do you have any concerns with how your personal information would be treated after hearing this?

    5. What does “cybersecurity risks” mean to you?

    6. When it says that “BLS information systems” are protected, what does that mean?

      1. What would the monitoring be looking at?

      2. Would whoever is doing the monitoring be able to see the information you provided to the survey?

    7. What about “cybersecurity monitoring”?

    8. What do you think “the systems that transmit your data” are?

    9. How do you think your data would be protected?

    10. If you received this new language on a survey asking for information about your company would it impact your decision to respond?

      1. (Establishment version) What if the survey asked for

        1. Payroll information showing how much you pay your employees?

        2. Personal information about your employees?

        3. Proprietary information about your marketing plans?

        4. Is there any information you would be totally comfortable giving?

        5. Any information you’d be totally uncomfortable giving?

      2. (household version) What if the survey asked for

        1. Your name

        2. Your phone number

        3. Your income

        4. Your social security number

        5. Is there any information you would be totally comfortable giving?

        6. Any information you’d be totally uncomfortable giving?

    11. Does this language change who could see the information you provided?

    12. Any other comments?



  1. Cybersecurity Risks vs. Malicious Activities

    1. We have a few other wording options we are considering. Instead of cybersecurity risks, we could say malicious activities. What would that mean to you?

    2. Does it change your overall reaction to the pledge? How so?

    3. Which do you recommend we use – cybersecurity risks or malicious activities?

  2. BLS Information Systems vs. Your Data

    1. We also could say ‘your data’ instead of BLS information systems. {read language with your data} what do you think of that option?

    2. Does it change your overall reaction?

    3. Which one do you recommend we use?

  3. Protected vs. Safeguarded

    1. We also could say ‘safeguarded’ instead of ‘protected’. {read language with your data} what do you think of that option?

    2. Does it change your overall reaction?

    3. Which one do you recommend we use?

  4. Monitoring vs. Screening

    1. We also could say ‘screening’ instead of ‘monitoring’. {read language with your data} what do you think of that option?

    2. Does it change your overall reaction?

    3. Which one do you recommend we use?

  5. Suggestions

    1. Data security is a top priority for the BLS, but we also don’t want to unnecessarily scare people. Do you have any suggestions on language that could help us achieve that balance?

    2. With all of these options, which do you think we should move forward with {show card}

  6. Flier

    1. Finally, we have a flier that we’d give to respondents about this {hand flier}. What is your initial reaction?

    2. Does it clearly communicate the things we’ve talked about so far?

    3. Does anything stand out to you about the content?

    4. Do you think it would be useful?

    5. Is there anything we should add? Remove?

  7. Conclusions

    1. We’re almost done, thanks for your feedback so far. In general, do you have any concerns about how the government treats the data you provide for surveys?

    2. Do you have any suggestions or other feedback ?





Attachment D: TryMyUI Web Survey


Page 1


Introduction

Unlike some tasks you’ve completed on TryMyUI, we’re not looking for you to evaluate a website, rather we’re looking for you to answer a series of questions and give us your written and verbal feedback. Please talk aloud, giving your reactions and thoughts as you move through the pages.

This is a survey for the US Bureau of Labor Statistics. This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. This survey will take approximately 20 minutes to complete. Your participation is voluntary and you have the right to stop at any time.

We are looking for information about how respondents answer our surveys. Please take your time as you answer these questions. The information you provide will contribute to valuable research at the BLS, one of the leading federal statistical agencies.


{continue button}


This survey is being administered by Qualtrics and resides on a server outside of the BLS Domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response.




Page 2

The Bureau of Labor Statistics of the U.S. Department of Labor is the principal Federal agency responsible for measuring labor market activity, working conditions, and price changes in the economy.

Its mission is to collect, analyze, and disseminate essential economic information to support public and private decision-making.

As an independent statistical agency, BLS serves its diverse user communities by providing products and services that are objective, timely, accurate, and relevant.


  1. Prior to today, had you heard of the Bureau of Labor Statistics?

    1. Yes

    2. No

  2. Have you ever completed a survey for a market research firm, polling company or other private company?

    1. Yes

    2. No

  3. Have you ever completed a survey for the US Government?

    1. Yes (go to 4)

    2. No (go to 5)

  4. Did you complete the US Government survey online, in person or on the phone?

    1. Online

    2. In-person

    3. Over the phone

  5. In the last year, how many surveys have you completed?

    1. Fewer than 5

    2. 5 to 10

    3. 11 to 20

    4. More than 20

  6. Prior to today, how much have you thought about survey companies protect the information you provide?

    1. A lot of thought

    2. Some thought

    3. Never thought about it

  7. Please read the below information about confidentiality at the BLS:




Confidentiality at the BLS: {Insert one of pledge versions, randomly assigned}

Please click to indicate that you’ve read the above information about confidentiality at the BLS.


{I have read about confidentiality at the BLS}


  1. In your own words, please summarize the information about confidentiality at the BLS.

  2. What is your general reaction to this language?

  3. Would the information about confidentiality at the BLS play a role in your decision to participate in a BLS survey or not?

    1. Yes

    2. No

  4. Thinking only about confidentiality, how likely are you to participate in a BLS survey in the future now that you’ve read the information about confidentiality at the BLS?

    1. Very likely

    2. Somewhat likely

    3. Not at all likely

  5. Do you have any concerns about how BLS would keep your information confidential?

    1. Yes

    2. No

  6. Under this pledge, who would have access to the information you provided on a BLS survey? (mark all that apply)

    1. Bureau of Labor Statistics (BLS)

    2. Department of Labor (DOL)

    3. Internal Review Service (IRS)

    4. Social Security Administration (SSA)

    5. Department of Homeland Security (DHS)

    6. The Census Bureau

    7. All government agencies

    8. Congress

    9. Other

  7. Under this pledge, what could be done with the information you provided on a BLS survey? (mark all that apply)

    1. It could be combined with other survey answers to create summary statistics

    2. It could be published exactly as you provided it

    3. It could be given to other statistical agencies

    4. It could be given to the IRS

    5. It could be given to other federal agencies

    6. It could be given to private companies

Page 3

Next, we’d like to give you more background information for the following task.



The BLS collects a wide variety of data from companies and households to create important national statistics, such as the unemployment rate and the inflation rate. In order to earn, and keep, the trust of our respondents we work hard to keep all the information they give us safe and protected. We are actually required by law to protect the data.



Recent changes to the laws require us to make some changes in the way we explain how we keep data protected to our respondents. To ensure that the changes we make are clear and easy to understand to respondents, we’d like to get your feedback on wording options for our confidentiality statement.






We have a few wording options. You’ll see a pair of words, please discuss your thoughts about each and which one you’d recommend using and why.

To protect Federal information systems from cybersecurity risks [malicious activities], BLS information systems [your data] are protected [safeguarded] through cybersecurity monitoring [screening] of the systems that transmit your data.

  1. Cybersecurity risks vs. Malicious activities

  2. BLS information systems vs. Your data

  3. Protected vs. Safeguarded

  4. Monitoring vs. Screening



Page 4

  1. Any final comments or thoughts about confidentiality at the BLS?




Attachment E: MTurk Web Survey



MTurk CIPSEA Survey

5.27.16


Page 1


Introduction

This is a survey for the US Bureau of Labor Statistics. This voluntary study is being collected by the Bureau of Labor Statistics under OMB No. 1220-0141. This survey will take approximately 5 to 10 minutes to complete. Your participation is voluntary and you have the right to stop at any time.

We are looking for information about how respondents answer our surveys. Please take your time as you answer these questions. The information you provide will contribute to valuable research at the BLS, one of the leading Federal statistical agencies.


This survey is being administered by Qualtrics and resides on a server outside of the BLS Domain. The BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response. By proceeding with this study, you give your consent to participate in this study.


{continue button}


Page 2

The Bureau of Labor Statistics of the U.S. Department of Labor is the principal Federal agency responsible for measuring labor market activity, working conditions, and price changes in the economy.

Its mission is to collect, analyze, and distribute essential economic information to support public and private decision-making.

As an independent statistical agency, BLS serves its diverse user communities by providing products and services that are objective, timely, accurate, and relevant.

  1. Prior to today, had you heard of the Bureau of Labor Statistics?

    1. Yes

    2. No

  2. Have you ever completed a survey for a market research firm, polling company or other private company?

    1. Yes

    2. No

  3. Have you ever completed a survey for the US Government?

    1. Yes (go to 4)

    2. No (go to 5)

  4. Did you complete the US Government survey online, in person or on the phone?

    1. Online

    2. In-person

    3. Over the phone

  5. In the last year, outside of MTurk, how many surveys have you completed?

    1. Fewer than 5

    2. 5 to 10

    3. 11 to 20

    4. More than 20



  1. Prior to today, how much have you thought about how survey companies (the government or otherwise) protect the information you provide?

    1. A lot of thought

    2. Some thought

    3. Never thought about it

  2. Without looking for any information, please tell us how do you think the government keeps survey data confidential?{open ended}



Page 3

  1. Please read the below information about confidentiality at the BLS:


Confidentiality at the BLS: {Insert one of pledge versions, randomly assigned}

Please click to indicate that you’ve read the above information about confidentiality at the BLS.


{I have read about confidentiality at the BLS}

Page 4

Now, we’ll ask you a few questions about yourself.


  1. What is your age?

  2. What is the highest level of education you’ve completed?

    1. Less than high school

    2. High school diploma or GED

    3. Some college

    4. Associate degree

    5. Bachelor’s degree

    6. Graduate school degree

    7. Prefer not to say

  3. Are you currently employed:

    1. Full time (go to 4)

    2. Part time (go to 4)

    3. Unemployed (go to 6)

    4. Student (go to 6)

    5. Retired (go to 6)

    6. Other, specify (go to 4)

    7. Prefer not to say

  4. What is your occupation?

    1. Administrator, manager

    2. Teacher

    3. Professional

    4. Administrative support, including clerical

    5. Sales

    6. Technician

    7. Protective Services

    8. Other service

    9. Machine or transportation operator

    10. Construction worker, mechanic

    11. Farming

    12. Forestry, fishing or grounds keeping

    13. Armed Forces

    14. Other, specify:______

    15. Prefer not to say

  5. What is your job title?

    1. Prefer not to say

  6. What is your annual income?

  7. If 6 is blank, In which of these ranges does your annual income fall?

    1. Less than $25,000

    2. $25,000 - $50,000

    3. $50,001 – $75,000

    4. $75,001 - $100,000

    5. More than $100,000

    6. Prefer not to say

  8. What is your annual household income?

  9. If 6 is blank, In which of these ranges does your annual household income fall?

    1. Less than $25,000

    2. $25,000 - $50,000

    3. $50,001 – $75,000

    4. $75,001 - $100,000

    5. More than $100,000

    6. Prefer not to say

    7. Don’t know

  10. How many people currently live in your home?

    1. Prefer not to say

  11. Are you of Hispanic, Latino or Spanish origin?

    1. Yes

    2. No

    3. Prefer not to say

  12. What is your race?

    1. White

    2. Black or African American

    3. American Indian or Alaska Native

    4. Asian

    5. Other

    6. Prefer not to say

  13. What is your zip code?

    1. Prefer not to say



Page 5

  1. Earlier in this survey, you were shown information about confidentiality at the BLS. Do you remember seeing that?

    1. Yes

    2. No (skip to top of page 7)

  2. In your own words, please summarize the information about confidentiality at the BLS.

  3. Please list as many words or phrases as you can from that information:


Page 6

  1. Please check the words that were part of the information about confidentiality:

    1. Bureau of Labor Statistics (BLS)

    2. Department of Labor (DOL)

    3. Internal Revenue Service (IRS)

    4. Department of Homeland Security (DHS)

    5. Cybersecurity

    6. Threat

    7. Risk

    8. Terrorist

    9. Mandatory

    10. Voluntary

    11. Law

    12. Statistical

    13. Security

    14. Consent

    15. Confidential

Page 7

Here is the text about how your information is kept confidential at the BLS again {show one of the alternate versions}.


  1. Now that you see the text again, please rephrase it using your own words.

  2. Do you have any concerns about how BLS would keep your information confidential?

    1. Yes

    2. No

  3. Would how the BLS keeps your information confidential play a role in your decision to participate in a BLS survey or not?

    1. Yes

    2. No

  4. According to this pledge, who would have access to the information you provided on a BLS survey? (mark all that apply)

    1. Bureau of Labor Statistics (BLS)

    2. Department of Labor (DOL)

    3. Internal Revenue Service (IRS)

    4. Social Security Administration (SSA)

    5. Department of Homeland Security (DHS)

    6. The Census Bureau

    7. Congress

    8. The White House

    9. All government agencies

    10. Other, please specify:

  5. According to this pledge, what could be done with the information you provided on a BLS survey? (mark all that apply)

    1. It could be combined with other respondents’ survey answers to create statistics

    2. It could be given to other statistical agencies for policy making

    3. It could be given to other federal agencies for law enforcement

    4. It could be given to the IRS for tax enforcement

    5. It could be given to private companies for telemarketing

    6. Other






Page 8



Next, we’d like to give you more background information for the following task.



The BLS collects a wide variety of data from companies and households to create important national statistics, such as the unemployment rate and the inflation rate. In order to earn, and keep, the trust of our respondents we work hard to keep all the information they give us safe and protected. We are actually required by law to protect the data.



Recent changes to the laws require us to make some changes in the way we explain how we keep data protected to our respondents. To ensure that the changes we make are clear and easy to understand to respondents, we’d like to get your feedback

We have a few wording options. You’ll see a pair of words, mark which one you’d recommend using, and then answer a few questions about each.

To protect Federal information systems from cybersecurity risks [malicious activities], BLS information systems [your data] are protected [safeguarded] through cybersecurity monitoring [screening] of the systems that transmit your data.


  1. Cybersecurity risks vs. Malicious activities


Cybersecurity risks

Malicious activities

Which should we use?



Which is easier to understand?



Which is a more common problem for government information systems?



Which sounds least threatening?





35a. Comments

  1. BLS information systems vs. Your data


BLS information systems

Your Data

Which should we use?



Which is easier to understand?



Which sounds least threatening?





36a. Comments



  1. Protected vs. Safeguarded


Protected

Safeguarded

Which should we use?



Which is easier to understand?



Which sounds least threatening?





37a. Comments



  1. Monitoring vs. Screening


Monitoring

Screening

Which should we use?



Which is easier to understand?



Which sounds least threatening?






38a. Comments


Page 11


  1. Any final comments or thoughts about confidentiality at the BLS?





Attachment F: Data Collection Center Web Survey




CIPSEA Phase 1 Research Goals:

  • To understand how the CIPSEA pledge is currently administered

  • To understand how respondents currently react to the pledge as administered

  • To get feedback on the proposed alternative revisions from both FEs and proxy-respondents


Survey Goals

  • To determine what, if any, experience the DCC staff has with interacting with respondents about the CIPSEA pledge and confidentiality concerns


Sample

  • 20 full time DCC staff in Kansas City

  • 20 full time DCC staff in Dallas


Timeline

  • Distribute after OMB approval (likely early July)

  • Close out 1 week later



Introduction

As you probably know, the BLS collects its data under the Confidential Information Protection and Statistical Efficiency Act of 2002, or CIPSEA. To accommodate recent legislation, we are testing language that may be added to the CIPSEA pledge. Before any changes are made, it is important to understand how the pledge is currently administered and what reactions, if any, respondents have to it. To determine this, we are reaching out to a variety of BLS staff to identify who has direct experience with respondent reactions to the confidentiality pledge.

Do not include any personally identifiable information (PII). This survey is being administered by surveymonkey.com and resides on a server outside of the BLS domain. BLS cannot guarantee the protection of survey responses and advises against the inclusion of sensitive personal information in any response.

Please complete this survey by XXX.


Background

  1. What is your role at the Data Collection Center?

    1. Interviewer 1

    2. Interviewer 2

    3. Supervisor

    4. Task Manager

    5. Other, specify

  2. How often do you directly interact with respondents?

    1. Daily (Go to 3)

    2. Weekly (Go to 3)

    3. Monthly (Go to 3)

    4. Only a few times a year (Go to 7?)

  3. When you interact with respondents, what are you most often doing?

    1. Answering questions (Go to 4)

    2. Collecting data (Go to 5)

    3. Gaining cooperation (Go to 5)

    4. Other, specify (Go to 5)

  4. What are the topics of questions that respondents ask you? (open ended)


Confidentiality Concerns

  1. Have any respondents expressed concerns to you about how their data is protected?

    1. Yes (Go to 6)

    2. No (Go to 7)

  2. How do you usually respond? (open ended)


CIPSEA

  1. Are you familiar with the current CIPSEA pledge?

    1. Yes

    2. No (go to 10)

  2. Do you ever talk to respondents about the CIPSEA pledge?

    1. Yes

    2. No (go to 10)

  3. In what context do you talk about CIPSEA with respondents (open-ended)

  4. Do you have any comments or questions related to confidentiality and the CIPSEA pledge? (Open ended)









Attachment G: Consent form for in-person testing

CONSENT FORM


The Bureau of Labor Statistics (BLS) is conducting research to increase the quality of BLS surveys. This study is intended to suggest ways to improve the procedures the BLS uses to collect survey data.


The BLS, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act of 2002 (Title 5 of Public Law 107-347) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent. The Privacy Act notice on the back of this form describes the conditions under which information related to this study will be used by BLS employees and agents.


During this research you may be audio and/or videotaped, or you may be observed. If you do not wish to be taped, you still may participate in this research.


We estimate it will take you an average of 30 minutes to participate in this research.


Your participation in this research project is voluntary, and you have the right to stop at any time. If you agree to participate, please sign below.


Persons are not required to respond to the collection of information unless it displays a currently valid OMB control number. The OMB control number is 1220-0141 and expires April 30, 2018.


------------------------------------------------------------------------------------------------------------

I have read and understand the statements above. I consent to participate in this study.


___________________________________ ___________________________

Participant's signature Date



___________________________________

Participant's printed name



___________________________________

Researcher's signature





PRIVACY ACT STATEMENT

In accordance with the Privacy Act of 1974, as amended (5 U.S.C. 552a), you are hereby notified that this study is sponsored by the U.S. Department of Labor, Bureau of Labor Statistics (BLS), under authority of 29 U.S.C. 2. Your voluntary participation is important to the success of this study and will enable the BLS to better understand the behavioral and psychological processes of individuals, as they reflect on the accuracy of BLS information collections. The BLS, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act of 2002 (Title 5 of Public Law 107-347) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent.





8



File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
AuthorEdgar, Jennifer - BLS
File Modified0000-00-00
File Created2021-01-23

© 2024 OMB.report | Privacy Policy