NCVS CS PILOT: 2C MAIL SCREENER
COGNITIVE INTERVIEW PROTOCOL
Date:_______________ Time_____ ID #:_____Interviewer Initials:_______________
Introduction
Thank you for taking the time to help us out today. The session will take approximately 1 to 1 ½ hours. I’ll give you a little background about what we’ll be doing today.
Westat is working on this project for the Bureau of Justice Statistics. We are testing a paper questionnaire that may be used for the National Crime Victimization Survey. The NCVS is administered every year nationwide and collects information on crime victimization. Westat is developing a paper questionnaire that will help the NCVS be administered in more efficient ways.
Today, I’ll ask you to first complete the questionnaire, working at your own pace as if you were doing this at home. I’ll watch what you are doing and we will talk about your answers and what they mean when you are finished. We would also like to read some of the survey letters that we will be sending out.
When you finish, we will go through the survey together and I’ll ask you some questions about your answers and how you arrived at your answers. We need to make sure that people understand the question and that these are questions that people are willing to answer. This will help us improve the questionnaire.
This is a research project and your participation is voluntary. You can skip any question and you can stop at any point. We would very much appreciate your permission to audio record this conversation. The recording will be used for note-taking purposes only and will be destroyed when the project is over. When we are finished, we have 40 dollars for you in gratitude for your assistance. There are no right or wrong answers – we are interested in everything you have to say and we encourage you to speak openly about the questions and your answers. Please sign the research consent form (that says everything I just said).
Consent Process
Hand the consent form to participant, answer any questions, and obtain consent before continuing.
Do you have any questions before we get started?
[Start recorder and get oral permission to record.] It is [DATE AND TIME], do I have your permission to audio record this conversation? ~~~~ Thank you.
ASK RESPONDENT TO START COMPLETING THE SCREENER.
Here is the questionnaire and a pen.
Please complete the questionnaire as if it had come in the mail and you were home alone filling it out.
The Debriefing
interviewer instructions
DURING THE DEBRIEFING – STATE THE QUESTION NUMBER SO ANY OBSERVERS AND THE RECORDING KNOW AT ALL TIMES WHICH QUESTION IS BEING DISCUSSED.
WRITE COMMENTS ON THE RESPONDENTS QUESTIONNAIRE. WRITING ON THE RESPONDENT’S QUESTIONNAIRE CREATES A COMPLETE DOCUMENT OF THE INTERVIEW.
IF RESPONDENT ASKS A QUESTION – STATE THE QUESTION NUMBER THAT THE RESPONDENT IS ASKING ABOUT AND SIMPLY SAY:
What makes you ask that?
Can you say more about that?
WHEN THE RESPONDENT HAS COMPLETED THE QUESTIONNAIRE, Review all answers. Point to the answer and say:
What does this answer means?
Can you say more about that?
IF THE RESPONDENT MAKES A MISTAKE (NAVIGATION, SKIP, CHANGED ANSWER, ETC): POINT TO THE MISTAKE AND ASK:
What happened here?
Can you say more about that?
FOR PLACES WHERE RESPONDENT DISPLAYED DIFFICULTY, CONFUSION, OR ANY “EXPRESSION”:
You seemed to hesitate here at Q___. What were you were thinking about?
You had a look on your face when you were reading this questions.
Can you tell me what you were thinking?
You just said that you ~~~. Can you say more about that?
You mentioned the ~~~~ ; how did that work for you?
3.1 Global Issues: Content, Response Propensity, and Sensitivity
Now that you have finished the questionnaire, but before we talk about your individual answers, let’s talk about some things in general.
Can you say in your own words what the questionnaire is about?
Was there anything that felt a little odd or not so good to answer?
Was there anything that you really didn’t want to answer or that felt a bit inappropriate or were all the questions completely fine?
Was there anything that would be a show stopper for you?
Who is this survey about?
Who do you think should respond to this survey?
Some questions ask about victimization – what comes to mind when you hear the word victimization?
Is victimization a word that you use or do you use some other word or way of talking about crimes that could happen to a person?
Can you answer these kinds of questions for yourself?
Can you answer these kinds of questions for others in your household?
3.2 Question-by-question Probes
The Introduction
POINT TO THE TEXT RIGHT BELOW AT THE TOP OF THE PAGE
Did you see this?
Did you read it?
Can you tell me in your own word what it said?
Can you tell me in your own words what you think “neighborhood” means?
[GET R’S DEFINITION OF “NEIGHBORHOOD”]
The way they describe neighborhood here, is this the way you think about neighborhood or do you think about neighborhood in some other way?
FOR QX 1-8, REVIEW EACH ANSWER AND ASK WHAT THE ANSWER MEANS.
Qx. 1 asks about “a good place to live.” What does that mean to you – “a good place to live?
You marked “~~~.” What does that mean?
Can you say more about ~~~~?
Qx. 2. Is “litter, broken glass or trash” something you would notice, or would you not notice those things?
You marked “~~~.” What does that mean?
Can you say more about ~~~~?
Qx. 3. When you saw “crime” what jumped into your head? Can you say more about that?
You marked “~~~.” What does that mean?
Can you say more about ~~~~?
The Instructions above Qx 4
POINT TO THE INSTRUCTION ABOVE QUESTION 4
Did you read this?
What is it asking you to do?
Qx. 4. What made you “~~~~~” that people around here are willing to help their neighbors?
Can you say more about that?
Qx 5. What made you “~~~~” that this is a close-knit neighborhood?
Can you say more about that?
Qx 6. Can you say in your own words what this question is asking?
The question asks about “people in the neighborhood.” Who do you think of when you see “people in the neighborhood”?
What does it mean to “trust” people in the neighborhood?
You answered that you “~~~~~.” Can you say what your answer means?
Qx 7. What made you “~~~~” that the people in this neighborhood generally get along?
What does it mean to “generally get along”?
Can you say more about that?
Qx 8. What made you “~~~~” that people in this neighborhood share the same values?
What does it mean to “share the same values”?
Can you say more about that?
Experiences of People in Your Household
The Instructions
POINT TO THE TEXT RIGHT BELOW “Experiences of People in Your Household”
Did you see this?
Did you read it?
Can you tell me in your own word what it said?
What came to your mind when you saw “neighborhood”?
[SEE WHETHER DEFINITION OF “NEIGHBORHOOD” HAS CHANGED FROM PREVIOUS SECTION]
The instructions ask that you “please include all experiences, even if not reported to the police.
What “experiences” are they referring to?
What does it mean “even if not reported to the police”?
The questions ask about “the last 12 months.”
How did you figure the last 12 months to answer these questions?
The questions also ask about “in this household.”
What do you think of when you see “in this household”?
Were you able to report for your household or were you able to report for yourself or yourself and someone else, but not really your entire “household”?
The questions asked in this section, do you know this for everyone in your household or do you know this only know for yourself and maybe some other person?
In other words, how many people in your household would you know these things for?
FOR QX 9-16, REVIEW EACH ANSWER AND ASK WHAT THE ANSWER MEANS.
Qx. 9. “has something belonging to anyone in this household been stolen, such as, ……” What do you think this question is asking about?
Can you give some examples?
What other things should be reported here – other than the ones already named?
You answered “~~~~~.”
Can you say what your answer means?
Qx. 10. Can you say what this question is asking in your own words?
What types of things would you report here?
You answered “~~~~~.”
Can you say what your answer means?
Qx. 11. “were any cars, vans, trucks or other motor vehicles owned by anyone in this household stolen or used without permission.”
What this question is asking?
What types of things would you report here?
Anything else?
You answered “~~~~~.”
Can you say what your answer means?
Qx. 12. “did anyone steal or attempt to steal any parts from a vehicle, like a tire, car stereo, hubcap or battery, or anything that was left in a vehicle.”
What this question is asking?
What types of things would you report here? Anything else?
You answered “~~~~~.”
Can you say what your answer means?
POINT TO THE INSTRUCTION ABOVE QUESTION 13
Did you read this?
What is it asking you to do?
What types of things is the instruction asking you to include?
Qx. 13. What does “by force or threat” mean?
Can you give some examples?
What does “between people that don’t know each other, but often involve people who know each other”?
You answered “~~~~”. Can you say what your answer means?
Qx. 14. What does “attached with some type of weapon” mean?
Can you give some examples?”
Can you think of other weapons than gun, knife, baseball bat or rock”?
You answered “~~~~”. Can you say what your answer means?
Qx. 15. What does “attached in another way” mean?
Can you give some examples?”
Can you think of other ways of being attacked than grabbing, forcing unwanted sexual activity, punching, or choking”?
You answered “~~~~”. Can you say what your answer means?
Qx. 16. What does “threatened with any kind of attack” mean?
Can you give some examples?”
Can you think of other ways of being threatened with any kind of attack”?
You answered “~~~~”.
Can you say what your answer means?
Police and 911 Services
The Instructions
POINT TO THE TEXT RIGHT BELOW “Police and 911 Services”
Did you see this?
Did you read it?
Can you tell me in your own word what it said?
What came to your mind when you saw “Police”?
What came to your mind when you saw “911”?
FOR QX 17-19, REVIEW EACH ANSWER AND ASK WHAT THE ANSWER MEANS.
Qx. 17. Can you say in your own words what this question is asking?
What would be some of the concerns of the people in your neighborhood?
You answered that you “~~~~~.”
Can you say what your answer means?
Qx. 18. Can you say in your own words what this question is asking?
The question asks about “people in the neighborhood.”
Who do you think of when you see “people in the neighborhood”?
What do you think of when you see “responding to people in the neighborhood after they have been victims of crime” mean?
You answered that you “~~~~~.”
Can you say what your answer means?
Qx. 19. Can you say in your own words what this question is asking?
The question asks about “when people in your neighborhood call 911, does help arrive quickly?”
Is this information that you or other people in your neighborhood would know?
You answered that you “~~~~~.”
Can you say what your answer means?
Your Household
Qx. 20. The Matrix
Before we look at what you filled in for Qx. 20, can you just run through everyone who is a part of your household?
Anyone else?
So do you have anyone who lives in your household just part time?
College students away at school most of the year?
Could you say in your own words what the instruction [POINT TO QX. 20] asks you to do?
Anything else?
Let’s look at how you filled this in. [COMPARE ANSWERS IN MATRIX TO WHAT THEY JUST TOLD YOU.]
Was this easy or difficult to do?
Qx. 21. Can you say in your own words what this question is asking?
What does “not working who wants to find a job” mean?
You answered that you “~~~~~.”
Can you say what your answer means?
Qx. 22. Before we look at your answer, could you tell me all the jobs of the members of your household?
Any other jobs?
[COMPARE ANSWERS TO WHAT THEY JUST TOLD YOU.]
Let’s look at your answers.
You marked “~~~~” and that would be for “~~~~~” and then you marked “~~~~~~~” and that would be for “~~~~~”.
Qx. 23. You answered that you “~~~~~.”
Can you say what your answer means?
Is this an easy or a difficult question to answer?
Qx. 24. You answered that you “~~~~~.”
Can you say more about that?
How did you figure that you have live “~~~~” years at this address?
Qx. 25. You answered that you “~~~~~.”
Can you say more about that?
How did you figure that you have move “~~~~~” times in the past 5 years?
Qx. 26. You wrote/did not write in your phone number. What made you write in/not write in your phone number?
Is this information that you usually give out?
Do you feel comfortable or not comfortable giving out your phone number
Do you expect to get a phone call or do you expect not to be called?
For what reasons do you think you would be called?
Can you say more about that?
IF THE RESPONDENT WAS NOT A CRIME VICTIM, PROVIDE ONE OF THE CRIME SCENARIOS AND GO BACK TO EXPLORE THE SECTION ON CRIMES
IF THERE IS ENOUGH TIME REMAINING IN THE SESSION, ASK SECTION 4; ELSE SKIP TO SECTION 5/CLOSING
Envelope, Survey Cover and Letters
Can you say something about the envelope that the survey was enclosed in? Is there anything about the envelope that you particularly like or dislike? Anything that would encourage you (or discourage you) from opening the envelope?
What about the cover letter that accompanied the survey? (Is there anything in the letter that you particularly like or dislike?)
The logo on the envelope and the letter is for the Bureau of Justice Statistics. I would like to show you some other logos that could be used on the survey materials. Please let me know What you think of these. [SHARE THE JUSTICE PROGRAM LOGO AND THE DOJ LOGO] What about the logos? Can you say more about that? is there one you prefer to the others? If yes, can you tell me why?
What do you think about the front cover of the questionnaire? Is there anything that jumps out at you?
Closing
Is there anything else you noticed about the survey that we have not discussed?
Was there anything that you particularly liked or disliked about the survey?
Do you have any other thoughts or comments about the survey?
Thank you for your time.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | pricel |
| File Modified | 0000-00-00 |
| File Created | 2021-02-03 |