Various Demographic Area Pretesting Activities

Generic Clearence for Questionnaire Pretesting Research

omb1140coveragetestingenc9

Various Demographic Area Pretesting Activities

OMB: 0607-0725

Document [docx]
Download: docx | pdf

NRFU/Household Form– Version 2 Mobile Device Protocol


Yellow Highlight indicates differences from NRFU/Household V1 Protocol


Draft – 15 December 2011


APPROACH:

  • administer questions 1-10 to PARTICIPANT

  • record participant responses [NRFU: on DEVICE/HHD: on paper screenshots]

  • on separate protocol, NOTE ANY PROBLEMS OR CONFUSION participant has when ANSWERING THESE items, But do not ask any scripted probes until after q10

  • NOTE WHETHER PARTICIPANT LISTS THE SAME PERSON ON MULTIPLE QUESTIONS


Questions 1-10


Q1-Q10 DEBRIEFING:

  • I would like to stop here for a moment to ask you a few follow-up questions about the items you just answered. First, if they had any noticeable problems or confusion that they mentioned while answering these questions, go over these first. Then ask the following:

1. Can you tell me in your own words what that series of questions was asking about?

3. How easy or difficult was it for you to decide who to include and who not to include on each question? Why was it easy/difficult?

4. Is there anyone that I asked about that you don’t really think should be included as living or staying here? Why?

5. Is there anything else I should know about who was living or staying here that I didn’t ask about or that you did not have an opportunity to tell me about? IF YES, please explain.


  • pull out paper screenshots and turn to question 4. administer scripted probes for questions 4-10. allow respondent to see the question and their response.


  1. I’m here to complete a Census questionnaire for address. It should take about 10 minutes.


  1. Do you live or stay at Address now?

    1. Yes – What is your name? Go to 4.

    2. No


  1. Does anyone live or stay at Address now?


    1. Yes – Go to 4

    2. No – Go to 5


  1. Please list all the (other) people who live or stay at Address.

8. You listed [FILL NAMES]. How did you decide who to list in this question?


  1. Please look at this calendar – think back to who was living at ADDRESS on January 15, 2012. Where was each person living or staying on January 15, 2012?

List Roster Here Somewhere else

NAME [] []


9. In your own words, what is this question asking?

10. How easy or difficult was it to recall where each person was living on January 15? IF DIFFICULT: Why was it difficult?

11. IF BOTH HERE AND SOMEWHERE ELSE CHECKED: You checked both “here” and “somewhere” else for [NAME]. Can you tell me more about that?


  1. Were there any OTHER people NOT ALREADY LISTED who were living or staying at ADDRESS on January 15, 2012 who no longer live here?

12. In your own words, what is this question asking?


YesWhat is that person’s name? Anyone else?

13. How did you come up with your answer to this question? PROBE ON RELATIONSHIP TO PARTICIPANT.

14. When did [NAME] move somewhere else?

15. Do you think that [NAME] would fill out a census form for where he/she currently lives? Why/why not?

No

DK


  1. Were there any people NOT ALREADY LISTED who usually live or stay at ADDRESS but were temporarily away on January 15, 2012?


16. What does it mean to be “temporarily away” but “usually live or stay here” in this question? What type of situations did you think of?

Yes– What is that person’s name? Anyone else?

17. How did you come up with your answer to this question?

18. Can you tell me why you did not initially include [NAME] when you listed names?

19. IF NECESSARY: Where was [NAME] on January 15?

NoContinue


  1. There are certain types of people that are sometimes left off the census. Were there any additional people staying here on January 15th that you didn’t think of, for example:

    1. Babies? Y N

    2. Foster children? Y N

    3. Any other relatives? Y N

    4. Roommates or people not related to you? Y N

    5. How about anyone staying her who had no permanent place to live? Y N

20. In your own words, what is this question asking? IF NECESSARY: What does “There are certain types of people that are sometimes left off the census” mean to you?


Yes for any – What is that person’s name? Anyone else?

21. How did you come up with your answer to this question? Who were you thinking of? DETERMINE IF THESE ARE THE SAME PEOPLE THOUGHT OF IN ANSWERING Q2 OR ADDITIONAL PEOPLE.

22. IF ADDITIONAL: Initially you did not include [NAME]. Can you tell me more about that?

No for allContinue


23. How helpful or unhelpful was this list of individuals – babies, foster children, etc?

24. Can you think of any other types of people that someone might not think to list?


  1. Is there anyone who you thought of mentioning but decided not to?

25. In your own words, what is this question asking?


Yes– What is that person’s name? Anyone else?

26. How did you come up with your answer to this question?

27. Why were you unsure whether this person should be included/excluded? PROBE SUFFICIENTLY TO UNDERSTAND THIS PERSON’S SITUATION AND WHETHER THEY SHOULD BE COUNTED OR NOT.

28. Do you think that [NAME] would fill out a census form for where he/she currently lives? Why/why not?

NoContinue


  1. For people who were rostered at 9. When did [NAME] live or stay here?

    1. Lives /stays here now

    2. Lived/stayed here on January 15

    3. Neither

    4. Both

    5. Other



  • Those are all the follow-up questions I have for this part. Let’s continue with the rest of the interview.

  • administer questions 11-20 to respondent

  • record participant responses [NRFU: on DEVICE AND] on paper screenshots

  • on separate protocol, NOTE ANY PROBLEMS OR CONFUSION participant has when ANSWERING THESE items, But do not ask any scripted probes until after q19

  • hhD: note any usAbility issues and probe as necessary to understand

  • hhd: remind participant to read questions aloud

  • PAY PARTICULAR ATTENTION TO PEOPLE WHO WERE LISTED AS LIVING HERE AT QUESTION 9/10.


Questions 11-20.


Q11-Q20 DEBRIEFING:

  • I would like to stop here for a moment to ask you a few follow-up questions about the items you just answered.

  • Probe briefly about their problems with the demographic questions, but only if they have expressed concern or difficulty. This is only to note their concerns.

  • NEXT, if participant had any noticeable problems or confusion mentioned when answering these questions, go over these first. Then ask the following:

  • 33. In your own words, can you summarize what these questions were asking about? Do you remember the examples given?

  • 34. When answering these questions, who were you thinking about?

  • 35. What time period were you thinking about? (Examples – the past year, right now, the whole time you’ve lived at this place?)

36. Overall, how easy or difficult was it to answer these questions about whether someone in your household lives or stays in more than one place? Why was it easy/difficult?

37. Were there any places that you thought of, but were unsure whether you should mention or not? IF YES: Can you tell me more about that?

38. Is there anywhere else that someone in your household was living or staying that I did not ask about or you did not get a chance to tell me about? IF YES, explain.


  • pull out paper screenshots and turn to question 12. administer scripted probes for questions 12-20.


  1. Some people live or stay in more than one place and we would like to make sure everyone is only counted once.

39. In your own words, what is this introduction telling you?

40. IF NEEDED: What does “only counted once” mean to you in this sentence?


  1. People marked “Somewhere else” in 5 – What was [your/NAME’s] address(es) on January 15?

41. IF FOR SOMEONE ELSE: how sure or unsure are you of the address?

Address (Number and street name) ______________________________

City ______________________________

State ______________________________

Zip Code ______________________________


If there is no street address or if this is a facility, please type a description in the box below.


  1. If there are people 18 or under Do you/anyone sometimes live or stay somewhere else with a parent, grandparent or other person?

42. How did you come up with your answer to this question?

43. What does “with a parent, grandparent or other person” mean in this question? What kind of situations were you thinking of?

Yes – if more than one person in household – Who sometimes lives or stays somewhere else?

44. Can you tell me more about that? PROBE SUFFICIENTLY TO VERIFY IF THEY ANSWERED CORRECTLY

No -


  1. Do you/anyone sometimes live or stay at another home, like a seasonal or second residence?

45. What does “at another home, like a seasonal or second home” mean to you in this question? What were you thinking of?

Yes – if more than one person in household – Who sometimes lives or stays somewhere else?

46. Can you tell me more about that? PROBE SUFFICIENTLY TO VERIFY IF THEY ANSWERED CORRECTLY

No


  1. If there are people ages 18-25 In January, (Were you/ was anyone) living in college housing?

47. What does “college housing” mean to you? What were you thinking of?

48. IF NEEDED: Do you consider a dorm to be college housing? What about an apartment on campus? An apartment off campus?

Yes – if more than one person in household – Who was living in college housing?

49. Can you tell me more about that? PROBE SUFFICIENTLY TO VERIFY IF THEY ANSWERED CORRECTLY

No -


  1. If there are people ages 18-60 In January, (Were you/ Was anyone) living or staying away for the military or for a job?

Yes – if more than one person in household – Who was living or staying away?

50. Can you tell me more about that? PROBE SUFFICIENTLY TO VERIFY IF THEY ANSWERED CORRECTLY


No


  1. In January, (were you/was anyone) in a place like a nursing home or a group home?

51. This question says a place like a nursing home or group home. Can you think of any other examples of places like this?

Yes – Who was away?

52. Can you tell me more about that? PROBE SUFFICIENTLY TO VERIFY IF THEY ANSWERED CORRECTLY

No


  1. In January, was anyone in a jail or prison?

Yes – Who?


No


For those with another address:


  1. What was [your/NAME’s] other address(es)? Get as many addresses as they need to provide

53. IF FOR SOMEONE ELSE: how sure or unsure are you of the address?


  • Those are all the follow-up questions I have for this part.


  • FOR THOSE WITHOUT ANOTHER ADDRESS, GO TO FINAL DEBRIEFING


  • FOR THOSE WITH ANOTHER ADDRES, CONTINUE:

  • There are just a few more questions left. Let’s continue.

  • administer questions 21-23 to respondent

  • record participant responses [NRFU: on DEVICE AND] on paper screenshots

  • on separate protocol, NOTE ANY PROBLEMS OR CONFUSION participant has when ANSWERING THESE items, But do not ask any scripted probes until after q23

  • hhD: note any usability issues and probe as necessary to understand

  • hhd: remind participant to read questions aloud]


Q21-Q23 DEBRIEFING1:

  • Okay. I have a few follow-up questions about this last set of items you just answered.

  • NEXT, if participant had any noticeable problems or confusions mentioned when answering these questions, go over these first. Then ask the following:

54. What did you think about this last set of questions? Can you tell me in your own words what they were asking about?


55. Overall, how easy or difficult was it to answer these questions? Why was it easy/difficult?

  • pull out paper screenshots and turn to question 21. administer scripted probes for questions 21-23



  1. Where [do you/does NAME] live and sleep most of the time?

Fill all addresses as choices

Equal time at both/all places

Some other place – Go to 20

56. How did you determine where [do you/does NAME] live and sleep most of the time?

57. What time period were you thinking of when you answered this question?



  1. On January 15, 2012, where [were you/was NAME] staying?

Fill all addresses as choices

Equal time at both/all places

Some other place – Go to 20

58. How did you come up with your answer to this question?

59. Is this question the same as Q16 or is it different? IF DIFFERENT: How is it different?


  1. What address would [you/NAME] consider your/his/her permanent or official address?

Fill all addresses as choices

Equal time at both/all places

Some other place – Go to 20

60. How did you come up with your answer to this question?

61. What does “permanent or official address” mean to you?



FOR EACH ADDITIONAL ADDRESS:


62. You said that [you/Name] spend(s) some time at [ADDRESS]. How often does that occur?


63. How many times or stays do you think there were during the entire year, last year (2011)?

  • One stay How long did you stay there that time?

  • More than one stay How long did [you/he/she] usually stay there each time?


64. Did [you/NAME] go there regularly, that is, is there some fixed pattern or was it occasional?

  • Occasional Tell me about how often you stayed there.

  • Don't Know Tell me about how often you stayed there.

  • Patterned How would you describe your pattern?

65. Does the timing or number of stays sometimes change? IF YES, Please describe.


66. Was there another person in the household who went to the same place? [Note: Particularly important for custody and seasonal home cases]

  • Yes Who was that? Did [you/they] always go together, that is, at the same time? If not, how was the pattern different for [others mentioned]? Why?

  • No


67. For the past year, where did you/he/she live and sleep most of the time?


68. Around January 15, 2012, where were you/he/she living and sleeping most of the time? (Same place or different place?)


69. What address do you consider to be the place where you should be counted in the Census? Why?



FINAL DEBRIEFING:


Thanks, we’re almost finished. I have a few more questions for you.


70. This Census questionnaire was primarily focused on who was living or staying at this address. What does “living or staying” mean to you?


71. Does “staying here” mean the same thing to you as “living here” or does it mean something different? Explain.


72. What does “living and sleeping here” mean to you? Does it mean the same thing or something different?



73. Was there anything in these questions that you found sensitive or uncomfortable to answer?


74. Was there any information for yourself or others that you would be hesitant to provide on the census form?


75. Aside from the things we’ve talked about, were there any questions or instructions that you find confusing or difficult to answer?


76. Did you find parts of the interview repetitive? If so, what parts?


77. As I said at the beginning, this is the kind of interview that would be conducted with an interviewer coming to your home. How would you feel about the interviewer using a smartphone to do the interview? A Tablet, like an iPad? How about a laptop computer? How about a paper form? Which do you prefer and why?


78. If you were going to answer your census questionnaire on your own, without an interviewer, how would you prefer to do it:

On a smartphone?

On a tablet?

On a laptop or desktop?

On a paper form?


Why?

NRFU/Household, V2, Mobile Protocol 14


File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
Authornathanjurgenson
File Modified0000-00-00
File Created2021-02-02

© 2024 OMB.report | Privacy Policy