Various Demographic Area Pretesting Activities

Generic Clearence for Questionnaire Pretesting Research

omb1209FSS POMSenc1

Various Demographic Area Pretesting Activities

OMB: 0607-0725

Document [docx]
Download: docx | pdf

FSS POMS Round 2 Cognitive Testing Questionnaire 2/21/2012


NOTE: Questions highlighted in yellow will be probed. All other questions will be presented in order to maintain the overall framing effects of the survey.


Introduction:

Hello, I’m ______________ and I work for _____________. Thanks for agreeing to help us today. Let me start by telling you a little about what we will be doing. Today we are working on some questions that will be asked of people in a telephone survey. We are very much interested in your own opinions and thoughts today. There aren’t any right or wrong answers, I just want to hear things from your perspective. After I ask you the survey questions, I’m really interested in what the questions meant to you, what you think they are getting at, so I’m going to ask you questions about the survey questions. There aren’t any right or wrong answers there either. I’m just really interested in your thoughts.


Permission to Tape-Record:

Because it would be hard to keep track of everything you say today, I’m going to tape-record this session. HAND RESPONDENT CONSENT FORM. Please read this over and sign it. I want you to know that your responses will not be associated with your name and will only be seen by people working on this project. The tapes will be destroyed after we conduct our analysis. Your participation in this study is completely voluntary and you can decline to answer any particular question.


Do you have any questions before we start?




First, I will ask you about four different numbers that you may have heard of or read about on the radio, TV, newspapers, the Internet, or somewhere else.



1. Do you happen to know who measures the total number of people in the U.S., or the population count?



2. Do you happen to know who measures the number of deaths in the U.S. caused by different diseases?

 



3. Do you happen to know who measures the crime rate in the U.S.?

 



4. Do you happen to know who measures the U.S. Consumer Price Index or CPI?



5. Numbers like the ones I just mentioned are federal statistics produced by federal statistical agencies that are part of the federal government. Have you ever used federal statistics for study or work?


1 Yes

2 No

3 (DK)

4 (Refused)



6. Personally, how much trust do you have in the federal statistics in the United States? Would you say that you tend to trust federal statistics or tend not to trust them?

    1. Tend to trust them

    2. Tend not to trust them



Please tell me, do you Strongly agree, Somewhat agree, Neither agree nor disagree, Somewhat disagree, or Strongly disagree with the following statements:



  1. Policy makers need federal statistics to make good decisions about things like federal funding.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree



  1. Statistics provided by federal agencies are generally accurate.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree


  1. Statistics provided by federal agencies are often biased.


5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree


  1. Elected officials interfere with the production of statistics by federal agencies.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree



  1. People can trust federal statistical agencies to keep information about them confidential.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree



  1. People can easily find out exactly how federal statistics are produced.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree



  1. Federal statistical agencies are honest.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree



  1. Federal statistical agencies are a reliable source for high quality statistics.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree





  1. If a mistake had been made when producing federal statistics, the public would not be told about it.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree


[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]




  1. Federal statistical agencies collect data to benefit the public.

5 Strongly agree

4 Somewhat agree

3 Neither agree nor disagree

2 Somewhat disagree

1 Strongly disagree


[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



Now I’m going to read you a list of organizations in American society. Please tell me how much confidence you, yourself, have in each one – a great deal, quite a lot, some or very little?

15. Newspapers

4 A great deal
3 Quite a lot
2 Some
1 Very little


16. The military

4 A great deal
3 Quite a lot
2 Some
1 Very little


17. Federal statistical agencies

4 A great deal
3 Quite a lot
2 Some
1 Very little


18. Congress

4 A great deal
3 Quite a lot
2 Some
1 Very little


  1. Universities

4 A great deal
3 Quite a lot
2 Some
1 Very little


25. Next, a question about the U.S. Government as a whole. Do you think federal government agencies share a single central database of the name, address and date of birth of U.S. residents?
Yes
No
DK


[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]


R1a. For the next census in 2020, if the Census Bureau could obtain your name and age from the Social Security Administration, instead of asking you for this information on a questionnaire, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R2a. If you knew that this information was only being obtained from the Social Security Administration to produce statistics, and that your personal information would remain unavailable to the public, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it??

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R3a. The 2010 Census cost over $10 billion dollars. To reduce this cost for the 2020 Census, the Census Bureau could get your name and age from the Social Security Administration. If this method could save government money, are you strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R4a. Various government agencies ask you to provide the same information on a number of forms. If the Census Bureau could save you the time and hassle by getting your name and age from the Social Security Administration, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R5a. Many Americans don’t return their census forms, and as a result the census numbers may be incomplete. If the Census Bureaus could improve the accuracy of their numbers by asking the Social Security Administration for the names and ages of the missing people, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R6a. Census numbers determine where local, state, and federal agencies build new schools, roads, and firehouses. If the Census Bureau could obtain names and ages from the Social Security Administration to get a better idea of where these types of services should be located, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



[If still responding in the negative after all rotating frames]



R7a. You seem to be uncomfortable with the Census Bureau asking the Social Security Administration for your name and age. Can you tell me why?

R1b. To produce the Consumer Price Index, the Bureau of Labor Statistics collects information on people’s living costs and spending habits through the Consumer Expenditure Survey. If the Bureau of Labor Statistics could obtain some of your spending habits from a credit card company instead of asking you on a questionnaire would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R2b. If you knew that this information was only being obtained from credit card companies to produce statistics, and that your personal information would remain unavailable to the public, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it??

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]


R3b. The Consumer Expenditure Survey costs over $40 million dollars. To reduce this cost, the Bureau of Labor Statistics could get some of your spending habits from a credit card company. If this method could save government money, are you strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]


R4b. Completing the Consumer Expenditure Survey takes a lot of time and effort. It requires you to keep a diary of your spending habits over a period of time. If the Bureau of Labor Statistics could save you the time and hassle by getting some of your spending habits from a credit card company, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]


R5b. Many of the costs asked on the Consumer Expenditure Survey may be difficult for a person to recall accurately, but a credit card company may already have this information. If the Bureau of Labor Statistics could improve the accuracy of the Consumer Price Index by asking a credit card company for some of your living costs or spending habits, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]


R6b. The Consumer Price Index is used to help calculate living costs, pensions, and wages across the country. If the Bureau of Labor Statistics could obtain some of your living costs and spending habits from a credit card company to get a better sense of how people really live, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



[If still responding in the negative after all rotating frames]



R7b. You seem to be uncomfortable with the Bureau of Labor Statistics obtaining some of your living costs and spending habits from a credit card company. Can you please tell me why?


R1c. The National Center for Health Statistics collects information on people’s health and medical care through a variety of surveys. If the National Center for Health Statistics could obtain some of your medical information from your health care provider instead of asking you on a questionnaire would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]


R2c. If you knew that this information was only being obtained from health care providers to produce statistics, and that your personal information would remain unavailable to the public, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it??

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]


R3c. The National Center for Health Statistics spends over $100 million on surveys every year. To reduce this cost, it could get some of your medical information from your health care provider. If this method could save government money, are you strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R4c. If you are selected for one of these health surveys, they can take a lot of time: they often ask people to recall detailed medical histories, doctors’ visits, and treatments. If the National Center for Health Statistics could save you the time and hassle by getting some of your medical information from your health care provider, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R5c. A lot of the information asked on these health surveys may be difficult for a person to recall accurately, but a health care provider may already have this information. If the National Center for Health Statistics could improve the accuracy of their numbers by asking your health care provider for some of your medical information, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



R6c. Information from these health surveys help make funding decisions for cancer research, elderly medical care, and hospitals. If the National Center for Health Statistics could obtain some of your medical information from health care provider to get a better idea of the health care needs of the nation, would you be strongly in favor of it, somewhat in favor of it, neither in favor nor against it, somewhat against it, or strongly against it?

[PROBE: why do you say {fill answer}? As needed: In your own words, what was that statement trying to say?]



[If still responding in the negative after all rotating frames]



R7c. You seem to be uncomfortable with the National Center for Health Statistics obtaining some of your medical information from your health care provider. Can you tell me why?


READ: I am now going to ask you to consider a few messages. I will read each statement and then ask you a few questions. If you need me to re-read the message at any time, I will.



R8. The United States Government will only ask you for a piece of information one time.

[PROBE:

  1. What do you think that statement would mean?

  2. How does it make you feel?

  3. Does it imply data sharing?

  4. Does it imply efficiency?

  5. How does all that make you feel?

  6. Do you support this statement?



R9. The U.S. Government will not release your personal information to non-Governmental entities.

[PROBE:

  1. What do you think that statement would mean?

  2. How does it make you feel?

  3. Does it imply data sharing?

  4. Does it imply efficiency?

  5. How does all that make you feel?

  6. Do you support this statement?



R10. Federal Statistical Agencies will not release your personal information to non-Statistical agencies.

[PROBE:

  1. What do you think that statement would mean?

  2. How does it make you feel?

  3. Does it imply data sharing?

  4. Does it imply efficiency?

  5. How does all that make you feel?

  6. Do you support this statement?



R11. The U.S. Government uses your information to evaluate programs and make them more efficient.

[PROBE:

  1. What do you think that statement would mean?

  2. How does it make you feel?

  3. Does it imply data sharing?

  4. Does it imply efficiency?

  5. How does all that make you feel?

  6. Do you support this statement?




The concept of federal statistics:


These questions have focused a lot on what we’re calling federal statistics. Does that term, federal statistic, have any meaning to you? Does it make sense or is something you’ve never thought about? What does ‘federal government’ mean to you? Does the fact that the federal government produces statistics on a variety of topics come as new information to you? Or was this something you already knew? Tell me what you’re thinking. Can you give me examples?


What about the term “government statistics”? Does it mean the same or different as “federal statistics”?


The concept of confidentiality:


When the questions asked about keeping information confidential, what do you think they were talking about? What does it mean to keep information confidential? How would confidentiality be broken?


The concept of trust:


Do you think most people trust numbers and statistics produced by the federal government? Why would or why wouldn’t they? What would make that information trustworthy or NOT trustworthy? Why would we have reason to trust it or not trust it?



For analysis purposes, we need to get a little more information from you:


  1. What is your age? ____


  1. Are you of Hispanic origin?

    1. Yes

    2. No


  1. What is your race? You may choose more than one. Are you:

    1. White?

    2. Black or African American?

    3. American Indian or Alaska Native?

    4. Asian?

    5. Native Hawaiian or Other Pacific Islander?


  1. What is the highest level of education you have completed?

    1. Less than high school?

    2. High school diploma or GED?

    3. Some college?

    4. Bachelors’ Degree?

    5. Graduate Degree?


  1. Is your household’s income:

    1. Less than $25,000 a year?

    2. Between $25,000 and $50,000?

    3. Between $50,000 and $100,000?

    4. Over $100,000?


  1. How many people, including yourself and any adults or children live with you? ______




18 | Page


File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
AuthorMiller Steiger, Darby
File Modified0000-00-00
File Created2021-02-02

© 2024 OMB.report | Privacy Policy