Attachment J
SURVEY REVISION CROSSWALK
Below are the revisions made in response to feedback during cognitive testing and for use in feasibility testing. The left-most columns show the survey question number to which the revision applies. Revisions are shown in red font.
x = Not Applicable
CATI Survey # |
Web Survey # |
Paper Survey # |
Type of Revision |
Description of Revision |
x |
x |
14 |
ADD INSTRUCTION |
Added instruction to improve response to items: "Please answer yes or no to the following questions about health conditions that you may have." |
HC06 |
HC06 |
16 |
ADD EMPHASIS |
Emphasize "any prescription" to improve understanding of the types of medication being asked about: "Have you ever, even once, taken any prescription pain medicine without a prescription or differently than how a doctor told you to use it (like OxyContin, Vicodin, Lortab, or Percocet)?" |
HC06 |
HC06 |
16 |
EDIT LANGUAGE |
Moved medication examples to the end of the question to improve understanding of the question. Have you ever, even once, taken any prescription pain medicine without a prescription or differently than how a doctor told you to use it (like OxyContin, Vicodin, Lortab, or Percocet)? |
HC07 |
HC07 |
17 |
ADD EMPHASIS |
Emphasize "any" to prompt respondents to include all forms of depression: Have you ever been told by a doctor, nurse, or other health professional that you had any type of depression? |
HC08_01 |
HC08a |
18a |
ADD INTRO |
Added introduction to suicide question to ease transition: “The next questions are about thoughts of suicide. Please remember that your answers are confidential.” |
HC08_01 |
HC08a |
18a |
ADD QUESTION |
Added suicidal thoughts question to ease transition to suicide attempts question. Used question language used by NSDUH: "Have you ever seriously thought about trying to kill yourself?" |
HC08_01 |
HC08a |
18a |
ADD SKIP PATTERN |
Added skip pattern (i.e., if suicidal thoughts question is 'no' then skip suicide attempt question). |
HC08 |
HC08 |
18b |
EDIT LANGUAGE |
Revised language to more closely match language used by NSDUH. Change to: “Have you ever tried to kill yourself?” |
ST05 |
ST05 |
19e |
ADD INSTRUCTION |
Added instruction as a reminder in case the introductory instruction was missed: "Has anyone ever made unwanted phone calls to you, sent you emails, voice, or text messages? Please do not include bill collectors or telephone solicitors." |
ST05 |
ST05 |
19e |
EDIT LANGUAGE |
To improve clarity, we changed the question to say: “made unwanted phone calls to you, sent you emails, voice, or text messages.” |
x |
x |
20 |
EDIT INSTRUCTIONS |
Changed instruction to a question to better guide respondents in whether they should answer subsequent questions: "Did you mark 'yes' to any of these questions (19a through 19g)? Yes No → GO TO SECTION D, NEXT PAGE" |
ST08_01 |
ST08_01 |
21 |
EDIT LANGUAGE |
To improve understanding, we revised the question to say (replaced "anyone" with "the same person"): Has the same person done any of these things to you on more than one occasion? |
SC01 |
SC01 |
29 |
EDIT LANGUAGE |
To improve understanding about the circumstances, we changed the question to say: “In your lifetime, how many people from your WORKPLACE made unwanted sexual remarks, sexual jokes in your presence or sexually offensive comments about your body or appearance? This may have happened at work, or elsewhere with people connected to your workplace.” |
AD_INTRO1 |
AD01 |
48, 69 |
EDIT INTRO LANGUAGE |
To address respondents who have not drank or used drugs, added sentence in red: “Sometimes unwanted sex or sexual contact happens when a person is unable to consent to it or stop it from happening because they are too drunk, high, drugged, or passed out from alcohol, drugs, or medications. This can include times when they voluntarily consumed alcohol or drugs or times when they were given alcohol or drugs without their knowledge or consent. You might or might not have ever been in this type of situation. Please remember that even if someone uses alcohol or drugs, what happens to them is not their fault. These questions use detailed and explicit language so that everyone is clear about what the questions are asking.” |
AD_INTRO1 |
AD01 |
48, 69 |
EDIT INTRO LANGUAGE |
To address respondents who felt the rape and made to penetrate questions were too explicit, we repeated the sentence in red (intro to questions): “Sometimes unwanted sex or sexual contact happens when a person is unable to consent to it or stop it from happening because they are too drunk, high, drugged, or passed out from alcohol, drugs, or medications. This can include times when they voluntarily consumed alcohol or drugs or times when they were given alcohol or drugs without their knowledge or consent. You might or might not have ever been in this type of situation. Please remember that even if someone uses alcohol or drugs, what happens to them is not their fault. These questions use detailed and explicit language so that everyone is clear about what the questions are asking.” |
x |
AD01 |
Checkbox after 48a |
DROP |
To reduce confusion among respondents, we removed the opt-out checkbox ("Click here if you have never been drunk, high, drugged, impaired, or passed out from alcohol, drugs or medications”). The checkbox was supposed to address respondents who have never drank alcohol or used drugs, but the opt-out checkbox was still confusing, and CDC staff were concerned that it would be used incorrectly and lead to skipped questions. |
x |
AD05 |
69a |
EDIT RESPONSE OPTION |
To address respondents who have never drank or used drugs, we revised the "none" response to say "None/Not Applicable" with an instruction at the beginning of the series that “If this has never happened or you have never been drunk or drugged, choose None/Not Applicable.” |
FC06 |
FC06 |
91 |
EDIT LANGUAGE |
Added additional language to improve understanding: "… put their mouth on your penis, or make you put your penis in their mouth?” |
FA02 |
FA02 |
105 |
EDIT LANGUAGE |
Added additional language to improve understanding: “How many PEOPLE have ever used physical force or threats of physical harm to TRY to put their mouth on your penis, or TRY to make you put your penis in their mouth, but it DID NOT happen?” |
PA_INTRO1 |
PA_INTRO1 |
Section J Intro (before 113) |
EDIT LANGUAGE |
To improve understanding and to transition to the IPV section, we revised the intro sentence to say: "The next questions ask more generally about any experiences you may have had in your life with your romantic or sexual partners." |
PA01-PA08 |
PA01-PA08 |
113a-g |
MOVED ITEM |
To remove potential context effects, we moved an item to the end of the question set: "Insulted or humiliated you in front of others." Renumbered the full set. |
PA07 |
PA07 |
113f |
EDIT LANGUAGE |
Edited question to emphasize deliberate behavior: "Destroyed something on purpose that was important to you?" |
PA11 & PV15 |
x |
x |
SHORTEN FILL |
To reduce length and repetitiveness, For CATI: Use short fills (i.e., descriptors) only if R reports 3 or fewer behaviors. If they report 4 or more behaviors in PA01-PA08, then continue to use the more concise version: “How often did a current or ex-partner do any of these things to you? |
x |
x |
123a |
EDIT INSTRUCTIONS |
Instruction for IPV impact
section was converted into a question to better guide respondents
about whether they are supposed to answer this set of questions:
"In
the previous sections of this survey, did you answer “yes,”
that any of the situations described below ever happened to you by
a current or ex-romantic or sexual partner? Question numbers are
provided for your reference. |
x |
Age at 1st |
x |
EDIT LANGUAGE |
To improve understanding of which perpetrator we're asking about, we changed the question (replaced “this person” with Person #): "How old were you the first time Person [#] did any of these things to you?” |
x |
Perpetrator Relationship Items (throughout) |
x |
EDIT LANGUAGE |
To increase clarity about the perpetrator we are asking about: In the intro to the perpetrator relationship questions, for respondents with more than 1 perpetrator: Removed the phrase “The first time this happened.” Changed question to: "How did you know Person [#]?" |
x |
Perpetrator Relationship Items (throughout) |
x |
SHORTEN |
To increase clarity about the perpetrator we are asking about: For the subcategory of the perpetrator relationship, revised question from, "Specifically, was that person…" to : "Specifically, was Person [#]…?" |
Perpetrator Relationship Items (throughout) |
x |
x |
NOTE TO INTERVIEWER |
Added a note for CATI interviewers when asking questions about the relationship between the respondent and the perpetrator: [IF NEEDED: What was your connection, if any, to this person?]" |
x |
Perpetrator Relationship Items |
x |
RESPONSE OPTIONS |
Corrected typo in web perpetrator categories.. Added the word “with” to response options 1 and 2 (intimate partners): "Someone I was involved with romantically or sexually at the time"; "Someone I previously had been involved with romantically or sexually." |
Perpetrator Relationship Items (throughout) |
Perpetrator Relationship Items |
x |
RESPONSE OPTIONS |
To help respondents and interviewers locate the subcategory of perpetrator relationships, we changed response option 4 to “A friend or acquaintance (e.g., neighbor, roommate, classmate, etc.)”. And we added new response option 5: “Someone I knew through work (e.g., co-worker, boss/supervisor, client/customer/patient, etc.)” |
Perpetrator Relationship Items (throughout) |
Perpetrator Relationship Items (throughout) |
x |
RESPONSE OPTIONS |
To help respondents and interviewers locate the subcategory of perpetrator relationships, we changed the following response options: Removed category 304 (Client/customer/co-worker/Employee/Patient) from the relationship list. Removed category 401 (Boss/Supervisor/Supervisor In Command) from the list that displays for ST11_B=6 (Person of authority). Added/modified categories: Client/Customer/Patient (304), Co-worker (815), Executive/Manager (815), Boss/Supervisor/Supervisor In Command (401), Someone who was working for you (816), and Other (817). |
x |
x |
29, 31, 33a, 33b |
RESPONSE OPTIONS (paper) |
Added instruction: “If more than 10, write in 10”. Rather than adding this for ALL questions with numerical write-ins, contractor recommended only adding it for those questions/experiences that have a higher likelihood of having more than 10 perpetrators. |
x |
x |
Number of perpetrators response items (stalking and SV sections) |
RESPONSE OPTIONS (paper) |
To improve understanding, for all questions that ask the respondent to write in the number of people (i.e., perpetrators), we revised the label next to the response box to say “number of people” rather than “number in lifetime” |
x |
x |
Number of perpetrators response items (IPV sections) |
RESPONSE OPTIONS (paper) |
For IPV sections only: To improve understanding, for all questions that ask the respondent to write in the number of people (i.e., perpetrators), we revised the label next to the response box to say “number of current/ex-partners” rather than “number in lifetime”. |
x |
x |
All places where intimate partner examples are given (IPV section) |
ADD INSTRUCTION |
To match the CDC definition of intimate partner, we added a clarifying instruction after the examples of an intimate partner: "Do NOT include 1st dates or one-time hook-up situations." |
x |
x |
Section G.1 Intro |
SHORTEN |
Removed language “By this I mean” since the paper survey is self-administered. |
IC1 or IC2 |
IC1 or IC2 |
x |
ADD QUESTIONS (see below) |
The questions will be used to derive an alternative estimate of unwanted sexual contact using the item-count method. Half will get the question IC1 and half will get question IC2. We can estimate the prevalence of unwanted contact by comparing the number endorsed between the two lists (i.e., item counts). IC1 and IC2 vary slightly depending on the mode. See survey for response options. |
x |
IC1 |
x |
ADD QUESTION |
"Next is a list of three things that may happen to some people. How many of them happened to you in the past 12 months? (1) Had something stolen or taken away from your porch, lawn, or other parts of your property (2) Had something you carry (such as cell phone, money, wallet etc.) stolen or taken away from you (3) Had a traffic ticket" |
IC1 |
x |
x |
ADD QUESTION |
“Next is a list of three things that may happen to some people. In the past 12 months, how many of these things happened to you? (1) In the past 12 months, have you had something stolen or taken away from your porch, lawn, or other parts of your property? (2) In the past 12 months, have you had something you carry; such as cell phone, money, wallet etc., stolen or taken away from you? (3) Have you received a traffic ticket?” |
x |
IC2 |
x |
ADD QUESTION |
"Next is a list of four things that may happen to some people. How many of them happened to you in the past 12 months? (1) Had something stolen or taken away from your porch, lawn, or other parts of your property (2) Had something you carry (such as cell phone, money, wallet, etc.) stolen or taken away from you (3) Had been kissed, fondled, groped, grabbed or touched in a sexual way when you didn’t want it to happen (4) Had a traffic ticket" |
IC2 |
x |
x |
ADD QUESTION |
“Next is a list of four things that may happen to some people. In the past 12 months, how many of these things happened to you? (1) In the past 12 months, have you had something stolen or taken away from your porch, lawn, or other parts of your property? (2) In the past 12 months, have you had something you carry; such as cell phone, money, wallet etc., stolen or taken away from you? (3) Have you been kissed, fondled, groped, grabbed or touched in a sexual way when you didn’t want it to happen? (4) Have you received a traffic ticket?” |
x |
NARRATIVE |
x |
ADD QUESTION |
This is a quality check
item. We will compare the details provided in the narrative to the
incidents reported on the questionnaire. The question will read:
"Thanks
for sharing your experience. To make sure that the survey captures
everything needed, would you describe, in your own words, an
incident of someone doing any of these to you…? - (IF
ST11_REVIEW>0: Following you) |
DQ_INTRO - D15, 14 questions (see below) |
DQ_INTRO - D15, 14 questions (see below) |
Section M (133a - 140), 11 questions (see below) |
ADD QUESTIONS (see below) |
Added questions that will be used to evaluate the procedures and compare across the modes: (1) The emotional reaction to the survey – did respondents get emotionally upset. If so, what is their view of taking the survey again. (2) The privacy when taking the survey – did they take it in a private setting, were they able to keep the survey topic confidential (3) The perceived burden of the survey – what is the perceived burden of the survey. These questions won't appear in the real survey when we gather national prevalence (in the future). Questions are below. See survey for response options and skip patterns. |
DQ_INTRO |
DQ_INTRO |
DQ_INTRO |
ADD INTRO |
“Thank you for answering these questions. We appreciate that you were willing to share your personal experiences and answer questions about some very private and sensitive issues in this survey. The following questions are about your reactions to this survey. Please indicate how strongly you agree or disagree with each statement.” |
D1 |
D1 |
133a |
ADD QUESTION |
“You experienced intense emotions while completing the survey.” |
D2 |
D2 |
133b |
ADD QUESTION |
“The survey made you think about things you didn’t want to think about. |
D3 |
D3 |
133c |
ADD QUESTION |
You believe you have been able to help others by participating in this study.” |
D5 |
D5 |
133d |
ADD QUESTION |
“Now that you know what the survey is about, you would have made the same choice to participate.” |
D6 |
D6 |
x |
ADD QUESTION |
“Where were you when completing the survey?” |
D7 |
D7 |
134 |
ADD QUESTION |
“Was anyone else in the room while you were completing the survey?” |
D8 |
D8 |
x |
ADD QUESTION |
“When someone was in the room, was this because…?” |
D9 |
D9 |
x |
ADD QUESTION |
“Who else was in the room while you were completing the survey?” |
x |
x |
135 |
ADD QUESTION |
“Did anyone who lives here see your responses to any of these questions?” |
D10 |
D10 |
136 |
ADD QUESTION |
“Do you think anyone in your household knows what this survey is about?” |
D11 |
D11 |
137 |
ADD QUESTION |
“Overall, how burdensome was this survey to you?” |
D12 |
D12 |
x |
ADD QUESTION |
“How sensitive did you feel the questions asked in this survey were?” |
D13 |
D13 |
138 |
ADD QUESTION |
“Do you feel that the length of this interview was too long, too short, or about right?” |
D14 |
D14 |
139 |
ADD QUESTION |
“How would you rate your understanding of the questions asked in this survey?” |
D15 |
D15 |
140 |
ADD QUESTION |
“How sure are you that you’ve reported all of the things that happened to you?” |
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | Smith, Sharon G. (CDC/DDNID/NCIPC/DVP) |
File Modified | 0000-00-00 |
File Created | 2021-01-14 |