COGNITIVE PRETESTING OF THE CIVIC ENGAGEMENT AND VOLUNTEER SUPPLEMENT TO THE CURRENT POPULATION SURVEY
Jenna Fulton
Jasmine Luck
Jonathan Katz
Mary C. Davis
Final Report
Center for Survey Measurement
U.S. Census Bureau
Washington, D.C. 20233
Disclaimer: This report is released to inform interested parties of research and to encourage discussion. The views expressed are those of the authors and not necessarily those of the U.S. Census Bureau.
4.1. National Academy of Sciences Report 4
4.2. Quantitative Analysis of the Volunteer and Civic Engagement Supplement Redesign 5
5.2.1. Recruitment Criteria and Strategy 6
5.2.1.2. Unrelated Households 7
5.2.2. Respondent Characteristics 8
5.2.3. Interviewer Staffing and Training 10
5.2.4. The Cognitive Interview Protocol 10
6. COGNITIVE INTERVIEW FINDINGS 11
6.1. Talking to and Spending Time with Family and Friends 13
6.2. Discussing Various Issues with Family and Friends 15
6.3. Providing Help to Friends or Extended Family 17
6.4. Talking to and Spending Time with Neighbors 21
6.5. Discussing Various Issues with Neighbors 23
6.6. Doing Favors for Neighbors 24
6.7. Doing Something Positive for the Neighborhood 26
6.8. Talking to and Spending Time with People of Different Backgrounds 28
6.9. Posting About Various Issues on Social Media 30
6.10. Reading, Watching, or Listening to News 32
6.11. Voting in Last Local Elections 33
6.12. Attending Public Meetings 33
6.13. Contacting a Public Official 34
6.14. Choosing Services Based on Social or Political Values of Companies 36
6.17. Group You are Most Active With 41
6.20. Volunteering Hours in a Year 46
6.21. Donating Money to Political Organizations 47
6.22. Donating Money to Charitable or Religious Organizations 48
12. APPENDIX A: SURVEY QUESTIONNAIRES 117
12.1. Round 1 Questionnaire 117
213.1. Round 2 Questionnaire 123
213.2. Final Questionnaire 129
214. APPENDIX B: COGNITIVE TESTING PROTOCOLS 136
This report presents findings from the cognitive testing of the 2017 Civic Engagement and Volunteerism Supplement to the Current Population Survey (CPS). An expert review team was assembled by National Academy of Sciences (NAS) in 2010 and tasked with the design and development of a civic health assessment. In 2014, the team released a report titled Civic Engagement and Social Cohesion: Measuring Dimensions of Social Capital to Inform Policy that recommended merging two existing CPS supplements, the Civic Engagement Supplement and the Volunteer Supplement, into one combined Civic Engagement and Volunteerism Supplement in order to reduce costs and better assess factors related to civic health. The newly-combined Civic Engagement and Volunteerism Supplement will be conducted in November 2017. This report documents cognitive testing of the newly-combined supplement, which includes some items that existed in the two separate modules, along with some new and revised items.
The purpose of cognitive testing was to examine new and revised questions included in the combined Civic Engagement and Volunteerism Supplement, and assess the feasibility of conducting a survey interview with a single household member who could accurately provide proxy reports for all other household members. Previously, when the supplements were conducted separately, the Civic Engagement Supplement permitted self and proxy responses while the Volunteer Supplement permitted proxy responses only after two unsuccessful attempts for self-response. One objective of the research was to examine the utility of proxy response in the combined supplement, because that would offer cost savings compared to attempting a self-response from all household members. Researchers conducted 48 cognitive interviews over two iterative rounds of testing. In 21 households, a pair of respondents was interviewed, and in six households a single respondent was interviewed.
Overall, the findings from this research indicate that the majority of questions tested in the combined Civic Engagement and Volunteerism Supplement were clear and comprehensible to the respondents who participated in cognitive testing. Most of the tested questions required only minor revisions, such as abbreviating the reference period, removing redundant phrases, and adding or removing terms or examples from the questions.
Only one question required substantial revision (Question 14), which included restructuring the question to ask whether the social or political values of a company influenced the respondent, rather than if a respondent decided to buy products or services based on a company’s values, as the question was originally worded. At the conclusion of both rounds of testing, we recommended dropping this question from the final questionnaire. CNCS opted to include this question as it permits measurement of a key concept in the supplement, and provided final, revised wording. (See Section 6.14 for more details.)
The design of this study, in which primarily pairs of respondents were interviewed, permitted measurement of the ability of one respondent to accurately provide a proxy response for other members of their household for questions relating to both civic engagement and volunteerism. (Historically, proxy and self-responses were permitted in the Civic Engagement Supplement, and only after two unsuccessful attempts for self-response in the Volunteer Supplement.) Although respondents expressed confidence in their ability to respond for other household members, overall match rates were slightly above 50% for all questions in the survey in both rounds of testing. Given that collecting self-response from all household members can be costly, the decision to accept proxy responses should be weighed against potential cost tradeoffs. (For more details, refer to Sections 7 and 9.)
At the request of the Corporation for National and Community Service (CNCS), the Center for Survey Measurement (CSM) conducted cognitive interviews for the Civic Engagement and Volunteerism Supplement of the CPS. The Civic Engagement and Volunteerism Supplement was newly designed prior to testing, in that it combines two existing CPS supplements, Civic Engagement and Volunteer, which were previously conducted separately each year. The newly-combined Civic Engagement and Volunteerism Supplement will be conducted in November 2017.
The core CPS survey is administered on a monthly basis and primarily asks questions relating to labor force, employment, and unemployment. In addition, CPS administers several supplement questionnaires, such as those on Displaced Workers, Fertility, and Computer and Internet Use, in order to evaluate current trends in social and economic well-being. Supplement questionnaires are administered on an annual, bi-annual, or a one-time basis. As with the main CPS questionnaire, these supplement questionnaires are conducted via Computer Assisted Personal Interviewing or Computer Assisted Telephone Interviewing (U.S. Bureau of Labor Statistics & U.S. Census Bureau, 2006).
The revised Civic Engagement and Volunteerism Supplement explores individuals’ interactions with their friends, family, community, and neighborhood; political involvement in their community; group membership and activities; volunteering experience and frequency; and donations to political or charitable organizations.
Two rounds of cognitive testing were conducted to examine new and revised questions of the combined Civic Engagement and Volunteerism Supplement, and assess the feasibility of conducting a survey interview with a single household member who could accurately provide proxy reports for all other household members. Previously, when CPS administered the Civic Engagement supplement and Volunteering supplement separately, self and proxy responses were permitted in the Civic Engagement Supplement, though they were only permitted in the Volunteer Supplement after two unsuccessful attempts for self-response. This research helped to provide guidance regarding the utility of proxy response in the combined supplement, which includes questions relating to both civic engagement and volunteerism, and which may offer cost savings compared to attempting a response from all household members.
In total, 48 interviews were conducted with 21 pairs of respondents (each pair being from the same household) and six single respondents, representing 27 households. This report documents the results of these 48 interviews, which were conducted from August 2016 to December 2016. Results of these interviews are used to inform recommendations for the proposed final version of the Civic Engagement and Volunteerism Supplement.
The Civic Engagement Supplement was first administered as part of the CPS in November 2008. Since its inception, the Civic Engagement Supplement was administered each November annually from 2008-2014, with the exception of 2012 because of funding issues. This supplement focused on individuals’ civic involvement in their communities, including interactions with friends, family, and neighbors; group activity participation; political participation; and political discussion.
The Volunteer Supplement was first administered as part of the CPS in September 2005, and was administered annually each September through 2014. Among respondents who had volunteered in the past 12 months, questions in this supplement assessed frequency of volunteering, the type of organizations they volunteered with, and their volunteer activities within these organizations. Respondents who had not volunteered were asked about any obstacles to volunteering and how individuals could be motivated to start volunteering (United States Census Bureau, 2016).
As an outcome of the Serve America Act of 2009, The National Academy of Science (NAS) was asked by CNCS to assemble an expert review team to assist with designing a civic health assessment in 2010. According to CNCS (2016), this review team was formed to explore and develop constructs that measure civic health, examine previous methodologies and data sources that assessed factors of civic health, and implement final recommendations on how to create this assessment. In 2014, the team released a report titled Civic Engagement and Social Cohesion: Measuring Dimensions of Social Capital to Inform Policy that recommended merging the two CPS supplements into one Civic Engagement and Volunteerism Supplement to reduce costs and to better assess the indicators of civic health.
The combined Civic Engagement and Volunteerism Supplement includes 22 questions (18 main questions and four follow-up questions) encompassing a variety of topics that assess civic health. This includes interactions with family, friends, neighbors, and people from other backgrounds; political engagement; group membership and participation; frequency of volunteering activity; and donations to political or charitable organizations.
Eight questions in the combined supplement are focused on interactions with family, friends, neighbors, and people from other racial, ethnic or cultural backgrounds. Four of the eight questions were new to the supplement. This includes questions focused on frequency of talking or spending time with friends and family in the past 12 months; providing help or assistance to friends or extended family; the frequency of discussing political, societal, or local issues with neighbors; and the frequency of talking or spending time with a person from a different racial, ethnic, or cultural background.
Six questions in the combined supplement relate to political engagement, including one new question that asks about the frequency of reading, watching, or listening to news about political, societal, or local issues. Three questions focused on group membership and participation, including one new question that assesses how much group membership time is spent in person and online.
Three questions assessed volunteering activity, including two new questions which evaluate volunteer frequency and the number of hours spent volunteering in the past 12 months. Two questions assess donations, including one new question that asks about donations to a political organization, party, or campaign.
Items that were included in the original Civic Engagement and Volunteer Supplements but not included in the combined, redesigned supplement include the type of volunteering activity one engaged in (for example, coaching, tutoring, etc.), involvement in the organization as a committee member or officer, how an individual initially became involved in an organization, volunteer involvement outside the individual’s living area, and trust in other people living in the neighborhood (CNCS, 2016).
Under the Serve America Act of 2009, CNCS was asked to develop a measure of civic health, and questions from the CPS Volunteer Supplement and Civic Engagement Supplement were recommended to be considered for this assessment. In 2010, CNCS asked NAS to initiate an expert panel to aid in the development of the Civic Health Assessment. This panel was asked to evaluate important constructs related to measuring civic health, review current methodologies and data files that examined indicators of civic health, and ultimately recommend how to design the Civic Health Assessment.
The NAS panel developed a report that examined the concepts of civic engagement, social cohesion, and social capital, and how these three factors affect the functioning of society (National Research Council, 2014). Social cohesion is defined in this report as the behaviors and attitudes that can promote belonging or isolation (Jenson, 1998). Social capital focuses on the connection between individuals in terms of similar norms or values, and how they can promote cooperation (Fukuyama, 2002). The report defines civic engagement as the activities, knowledge, and values that influence the civic life of a community (Ehrlich, 2000).
Berger (2009) defined civic engagement as a construct of three factors: political engagement, social engagement, and moral engagement. Traditionally, political engagement has been thought of as any type of activity that influences government decision. In their 2007 paper, Teorell et al. expanded upon political engagement to include a number of behaviors and activities. This includes electoral participation and voting behavior; consumer participation, which includes donating to a political party or organization, boycotting or buying products based on political values, and signing a petition; party activity, organizational membership, or any volunteer work associated with the party or organization; protest activity; and contacting a political or public official or engaging in political discourse online.
According to Berger (2009), the social engagement component of civic engagement is defined as any type of social involvement, including social interactions with others that do not express any political stance. CNCS (2016) explains that this type of engagement centers on the development of trust within groups such as friends, family, and neighbors, and across groups such as those of different races or cultures. Trust behaviors can also be demonstrated through activities such as volunteering, offering donations, and group involvement.
The final component of civic engagement as described by Berger (2009), moral engagement, is the recognition and backing of any moral attitudes and beliefs. This type of engagement focuses on democratic societal ideals to help promote moral codes or principles.
As described by CNCS (2016), the ideas of social engagement and political engagement that help foster civic engagement form the basis of this newly redesigned Civic Engagement and Volunteerism Supplement. Although moral engagement is an integral measure of civic engagement, CNCS decided to remove items related to this construct because of difficulties measuring this component independently of social and political engagement.
In order to combine the Volunteer Supplement and Civic Engagement Supplement, a two-part analysis was conducted by the NAS panel to help identify which items would be retained from each original supplement and which items would be deleted. The first part of the analysis included reviewing the existing items in each supplement and evaluating them based on the social engagement and political engagement measures derived from the literature.
The second part of the analysis was to examine previous data collected for the original Civic Engagement and Volunteer Supplements. Data was analyzed for respondents who had completed both supplements in 2011 and 2013. Inter-item correlations, exploratory factor analysis, and item frequencies were conducted to help further determine which of the items from the original two supplements would be retained or deleted for the redesigned supplement. Following this data analysis and the evaluation of the items on the supplement aligning to the political and social engagement measures, CNCS developed a list of questions from the two original supplements to be pretested through cognitive interviewing. These items related to the following constructs: interactions with friends and family, interactions with neighbors, civic activity, and group and organization membership.
Prior to cognitive testing, an expert review of the new and revised questions in the Civic Engagement and Volunteerism Supplement was conducted by CSM in the spring of 2016 (see Section 9 for expert review findings). CSM evaluated the questionnaire wording for the supplement provided by CNCS for clarity, flow, and comprehension. The changes suggested by CSM were incorporated into the questionnaire for cognitive testing.
Two iterative rounds of cognitive testing were conducted between August 2016 and December 2016, resulting in 48 completed face-to-face cognitive interviews. This included 21 pairs of respondents for which two respondents were interviewed from the same household, and six single interviews in which only one respondent from the household participated, resulting in 48 interviews across both rounds of testing. Interviews were conducted with respondents from the following states: Maryland, Michigan, Pennsylvania, Virginia, and Washington, D.C. The interviews were conducted by five members of CSM staff in Round 1 of testing, and four members of CSM staff in Round 2 of testing. Results from Round 1 were used to modify the questionnaire wording and protocol for Round 2 of testing, and the results from Rounds 1 and 2 were used to inform the final recommended questionnaire wording.
In both rounds of cognitive testing, pairs of respondents and single respondents from related and unrelated households were recruited to participate. All respondents were required to meet the following criteria:
Age 18 or older
Live in a household with at least one other person age 18 or older
Volunteered in the past 12 months
Participated in a group, organization, or association in the past 12 months including religious, recreational, school, professional, and not-for profit groups
Pairs of respondents from related and unrelated households were recruited and interviewed in order to evaluate the feasibility of conducting a survey interview with a single household member who could accurately provide proxy reports for all other household members, using an approach described by Blair, Menon, and Bickart (1991). Each respondent who completed an interview received $40.
In Round 1 of cognitive testing, both members of the pair were required to complete their interviews on the same day and at the same location. This criteria was relaxed in Round 2 in order to boost recruitment efforts. In Round 2, both members of the pair were required to complete their interviews within the same workweek and the interviews did not have to be conducted at the same location. A small number of interviews were conducted with single (non-paired) respondents (four in Round 1 and two in Round 2), in which only one respondent participated from a household containing two or more related or unrelated adults.
In addition, we aimed to recruit respondents who represented a broad range of demographic characteristics including age, gender, race, ethnicity, and education level.
Respondents were recruited through the following methods: (1) a Broadcast message distributed through email to all Census Bureau employees who work at headquarters in Suitland, MD and may have friends or family interested in participating, and (2) Craigslist advertisements displayed in both the Washington, D.C. and Philadelphia areas. The Broadcast and Craigslist messages were posted at the beginning of each round.1 The advertisements listed the eligibility criteria as well as the dedicated recruitment phone number and email address and instructed interested participants to call or email.
Potential respondents who contacted CSM were administered a screening interview by telephone.2 (Those who initially contacted CSM via email were asked for a contact phone number.) During screening, respondents were asked a series of questions including their marital status, urbanicity, employment, donation frequency, and volunteering and group membership activities. Respondents were also asked how they heard about the study and for their contact information.
As part of the screening interview, potential respondents were also asked to provide the name of another person in their household who would be interested in participating in the study, as well as their contact information including an email address or phone number, which was used to contact the second member of the pair, and schedule the pair if both members qualified. Potential respondents were also asked to describe the nature of their relationship to the other household member, such as spouse, parent, child, or roommate. This information was used to categorize the pair as related or unrelated.
For Rounds 1 and 2, the recruitment goals were to recruit at least five pairs of each related and unrelated respondents, and allow for up to four single interviews. Pairs were more desirable as they provide question feedback and permit the assessment of proxy reporting, while single interviews provide question feedback only. Five pairs of each type and four single interviews were completed in Round 1; and six pairs of related respondents, five pairs of unrelated respondents, and two single interviews were completed in Round 2.
In this research, CSM considered a “related household” to be one in which the members of the pair described their relationship as spouses, unmarried partners, or boyfriend and girlfriend; or if a respondent lived with their child, parent, sibling, grandparent, grandchild, cousin, or aunt or uncle. Out of the 11 related pairs included in this research, five pairs were parent and child, five pairs were spouses, and one other pair was grandparent and grandchild.
CSM considered an “unrelated household” to be one in which the members of the pair were not spouses, unmarried partners, boyfriend and girlfriend, or related in any other way. Of the ten unrelated pairs of respondents, eight pairs were roommates, one pair was friends, and one pair described themselves as godsisters.
For this study, the goal was to balance respondents based on a variety of demographic characteristics that included sex, race, ethnicity, education, and age, though a perfect balance was not achieved. Overall, roughly two-thirds of respondents were female, and the majority of respondents identified as either Black or African American or White
Respondents represented a broad range of education levels, however the majority of respondents in both rounds had achieved a Bachelor’s degree or greater. This was due to having a small pool of interested respondents in both rounds of testing, so qualifying and scheduling criteria took precedence over other demographic characteristics. In both rounds of interviewing, recruiting Hispanic respondents proved to be difficult for similar reasons, and only one Hispanic respondent completed an interview in each round.
Only one respondent from each pair was fully screened in Round 1 (all single respondents were screened). All Round 2 respondents were fully screened in Round 2. Table 1 presents the characteristics of all respondents.
Table 1. Respondent Characteristics
|
Round 1 |
Round 2 |
Total
(n=48) |
||
|
Live with Relatives (n=13) |
Live with Nonrelatives (n=11) |
Live with Relatives (n=12) |
Live with Nonrelatives (n=12) |
|
Age (mean) |
43 |
28 |
35.5 |
33.9 |
35.4 |
Sex |
|
|
|
|
|
Male |
4 |
3 |
4 |
4 |
15 |
Female |
9 |
8 |
8 |
8 |
33 |
Race* |
|
|
|
|
|
White |
5 |
7 |
4 |
5 |
21 |
Black or African American |
8 |
4 |
6 |
5 |
23 |
American Indian or Alaska Native |
0 |
0 |
0 |
0 |
0 |
Asian |
1 |
1 |
2 |
1 |
5 |
Native Hawaiian or other Pacific Islander |
1 |
0 |
0 |
0 |
1 |
Missing** |
0 |
0 |
0 |
1 |
1 |
Ethnicity |
|
|
|
|
|
Hispanic |
0 |
1 |
0 |
1 |
2 |
Non-Hispanic |
13 |
10 |
12 |
11 |
46 |
Education † |
|
|
|
|
|
Less than high school |
0 |
0 |
0 |
0 |
0 |
Completed high school |
2 |
0 |
2 |
0 |
4 |
Some college, no degree |
1 |
1 |
2 |
0 |
4 |
Associate's degree (AA/AS) |
1 |
0 |
1 |
1 |
3 |
Bachelor's degree (BA/BS) |
3 |
4 |
7 |
7 |
21 |
Post Bachelor's degree (MA, MS, Ph. D, JD, etc.) |
1 |
1 |
2 |
4 |
8 |
Urbanicity † |
|
|
|
|
|
Urban |
5 |
3 |
5 |
10 |
23 |
Suburban |
2 |
3 |
1 |
2 |
8 |
Rural |
1 |
0 |
3 |
0 |
4 |
# of Other Adults in Household † |
|
|
|
|
|
1 |
3 |
0 |
5 |
5 |
13 |
2 |
3 |
2 |
1 |
5 |
11 |
3 |
2 |
3 |
12 |
2 |
19 |
4+ |
0 |
1 |
2 |
0 |
3 |
Volunteer in Past Year †, †† |
|
|
|
|
|
Yes |
7 |
5 |
1 |
11 |
24 |
No |
1 |
1 |
4 |
1 |
7 |
Donate † |
|
|
|
|
|
Once a week or more frequently |
1 |
0 |
1 |
0 |
2 |
A few times a month |
0 |
1 |
4 |
0 |
5 |
Once a month |
2 |
2 |
5 |
1 |
10 |
Once or a few times a year |
5 |
3 |
2 |
11 |
21 |
Did not donate in the past year |
0 |
0 |
0 |
0 |
0 |
*The race total exceeds the sample size because respondents were allowed to report multiple races.
** Race is missing for one Round 2 respondent because he felt that none of the race categories accurately represented him.
† Round 1 data for this question is reported for only respondent from each pair who was fully screened, as well as all single respondents who were fully screened.
†† Some respondents who did not report any volunteer activity were recruited to participate because they reported group membership and donating to charity in the past year.
All interviews were conducted by CSM interviewers who were trained in cognitive interviewing methods and had experience conducting cognitive interviews. Prior to Round 1 of testing, all interviewers received training on administering the roster and CEV questionnaires and protocol. Interviewers were also trained on procedures for summarizing interviews. Prior to Round 2 of testing, interviewers were trained on revisions to the questionnaire and protocol. All interviewers completed mock interviews with other interviewers acting as respondents prior to each round of testing. After conducting their first interview in each round, interviewers provided a brief summary of their interviews to the project lead to confirm that there were no issues with the questionnaires or protocol. During each round, approximately two meetings each week were held to discuss interview findings, recruitment updates, and next steps in the project.
The focus of the protocol was to evaluate new and revised questions in the Civic Engagement and Volunteerism Supplement in the CPS. The revised questions were modified following an expert review conducted by CSM in the spring of 2016. Respondents were informed that the purpose of the interview was to collect their thoughts and opinions on how these questions worked.
At the beginning of the interview, respondents were administered the roster portion of the questionnaire, which was an abbreviated version of the roster included in the CPS. Respondents were first asked to list all household members, and then asked the demographic characteristics of each person in the household, including sex, relationship to other household members, date of birth, education, ethnicity, and race. Also as part of the roster interview, respondents were asked a series of items regarding whether anyone in the household had a disability.
Following the roster questionnaire, the respondent was administered the CEV supplement questionnaire and asked to respond for themselves. Respondents were then administered the same CEV supplement questionnaire for up to two additional household members age 18 and older and asked to provide proxy responses for them.3 During questionnaire administration, interviewers wrote down any issues respondents experienced while answering items, which included question misunderstanding, recall, and response mapping.
Following the administration of all questions for all eligible household members, respondents were asked a series of retrospective probes to assess respondent comprehension of the survey questions. Retrospective probing in cognitive interviewing refers to the process in which a respondent completes some or all of the questionnaire before being asked to respond to a series of probes pertaining to the survey questions. Although retrospective probing allows respondents to complete the survey free of any interruption, respondents may have a more difficult time retrieving their thoughts on how they answered because some time will have elapsed since they answered the survey questions (Willis, 2005). Retrospective probing was chosen over concurrent probing, or when follow-up questions are asked directly after a test question, in order to avoid influencing respondents’ answers for other household members.
Many probes focused on how respondents defined words and phrases mentioned in the survey questions and the type of activities they were thinking of when answering. Respondents were probed on each survey question sequentially (note, Questions 6, 10, 11, and 15a did not have written probes), however questions were divided into groups primarily for the purposes of evaluating proxy responses. For each set of questions, respondents were first probed on their self-reported answers, and then were probed on the responses they provided for other household members for the same set of questions
For each group of items, after respondents answered probes for their own answers, they were probed on the responses they provided for other members of their household, including being asked to describe how they came up with their answers for other members of their household. Respondents were also asked how easy or difficult it was to answer these questions for other household members, their confidence level in responding for them, and if any of the questions were particularly difficult compared to the other questions.
Following retrospective probing, respondents were asked a series of debriefing questions, including which questions, if any, other people might find sensitive. Respondents were also asked if they wanted to share any other information relating to the interview that they hadn’t mentioned yet.
At the beginning of each interview, the respondent was asked to sign a consent form. The form explained how the respondent’s answers and feedback would be used to improve the questionnaire. In addition, it also highlighted the respondent’s confidentiality and rights as a participant including their freedom to decline answering any question or stopping the interview at any point. The respondent’s signature on the consent form granted the interviewer authorization to audiotape the interview. The interviewer also signed this consent form to demonstrate that they agreed to the terms listed. All forty-eight respondents consented to being audio-recorded. At the conclusion of the study, the interviewer signed a second copy of the consent form for the respondent to take home and keep for their records.
In this section, we present the question-by-question findings from the cognitive interviews. Each question is presented with findings from each round, highlighting any changes that occurred from one round to the next. A brief discussion of each question’s performance during testing is included.
Some global changes were made to the questionnaire prior to Round 2 of testing. These changes are described in more detail in the question-by-question findings, and include the following:
Reference Period: Beginning in Round 2 of testing, the full reference period (“In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today) was mentioned only in conjunction with Question 1. For other questions, the reference period was mentioned as “In the past 12 months,” only as needed. This change eliminated wordiness from the questions, and respondents understood the abbreviated reference period correctly.
Communication Options: For Round 2 of testing, the sentence “This may have been in person, over the phone, or through the internet or social media”, which followed the question text for Questions 1, 2, 4, 5, and 8 in Round 1 of testing, was moved to the introduction prior to Question 1, and prior to Question 4 when there was a transition in survey topic. (This change was not compatible with Question 8, and so this sentence remains in the same placement as in Round 1 for Question 8). This change helped to successfully prevent respondents from interrupting the interviewers while reading the survey questions, which was a problem in Round 1.
In the following sections, when direct respondent quotes are used to illustrate findings, respondents are referred to using a respondent identifier that indicates whether the interview was paired or single (P or S), whether they were from a related or unrelated household (R or U), and which round they were interviewed in (R1 or R2). The ID structure also contains a unique respondent numeric identifier. Finally, the IDs of paired respondents contain
For example, the ID of the fourth paired respondent in Round 2, who lives in a related household, and was part of the second paired household interviewed is PR104R2P02. The ID of the fifth single related respondent in Round 1 is SR105R1.
The length of each questionnaire was also recorded in order to calculate an average time across interviews. Across all Round 1 and Round 2 interviews, the average length of administering a single questionnaire was 5:26. More detail regarding interview length is provided in Table 2, below.
Table 2. Interview Length
|
Round 1 Average Length (n) |
Round 2 Average Length (n) |
Overall Average Length (n) |
Questionnaire 1 |
6:35 (24) |
5:56 (24) |
6:15 (48) |
Questionnaire 1 + 2 (sum) |
12:06 (23) |
10:50 (24) |
11:27 (47) |
Questionnaire 1 + 2 +3 (sum) |
16:00 (16) |
15:11 (10) |
15:41 (26) |
Questionnaire 1 + 2 + 3 + 4 (sum) |
19:10 (2) |
19:48 (2) |
19:29 (4) |
Total Length Across All Questionnaires |
15:37 (24) |
13:17 (24) |
14:27 (48) |
Single Questionnaire |
5:38 (65) |
5:12 (60) |
5:26 (125) |
Question 1
Round 1 Wording These next questions will help us understand how people in America interact with and relate to each other, as well as how we work together to make changes in our communities and country.
1. The first few questions focus on how [you/[NAME]] interact[s] with family and friends.
In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, how often did [you/[NAME]] talk to or spend time with friends and family? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Wording and Final Recommendation These next questions will help us understand how people in America interact with and relate to each other, as well as how we work together to make changes in our communities and country.
1. The first few questions focus on how [you/[NAME]] interact[s] with family and friends in person, over the phone, or through the internet or social media.
In
the past 12 months, that is from [FILL CURRENT MONTH] of 2015
until today, how often did [you/[NAME]] talk to or spend time
with friends and family?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents in Rounds 1 and 2 of cognitive testing responded to Question 1 for themselves and other household members. To understand who, and what forms of communication respondents were considering in their response, respondents in both rounds of testing were asked to respond to a series of probes about Question 1. Respondents were asked who they considered in their response, and if they consider interacting with friends and family through the internet or social media to be talking or spending time with them. Respondents were also asked if they communicate through any other methods not addressed in the question (“in person, over the phone, or through the internet or social media”). Also, in order to determine if respondents clearly understood the reference period, they were asked if their answer to Question 1 would have changed if the question asked about the past year instead of the past 12 months.
Round 1 Findings
Respondents were asked to indicate who they considered in their answer to Question 1. Fifteen respondents mentioned family members or roommates with whom they live. The responses of the remaining nine respondents did not explicitly mention that they shared a household with the people mentioned in their response. Respondents also varied in terms of whether they included friends from work in their responses. Ten respondents said they considered friends from work in their response, while eight respondents said that they did not.
Round 1 respondents also varied in whether they considered interacting with friends and family through the internet and social media to equate to talking or spending time with them, even though the question specifies “This may have been … through the internet or social media.” In particular, respondents may be more likely to consider internet and social media interactions as talking to others, but not spending time with them.
"Usually online, it's just something quick and short... Social media, if you're just liking something or commenting on something or looking at a picture, it's not really an interaction." (PU107R1P04)
"I would consider it talking, I wouldn't consider it spending time with them." (PU102R1P01)
Two respondents mentioned that text messaging was missing from the list of communication options, and one respondent also mentioned Skype and FaceTime. These respondents appeared to consider text messaging or Skype / FaceTime to be distinct from “over the phone”, however it isn’t known whether including these other communication options would have lead any respondents to change their answer.
All respondents in Round 1 of testing understood the reference period cited “In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today” to be synonymous with the past year. However, interviewers found it awkward to repeat the reference period, as well as the phrase “This may have been in person, over the phone, or through the internet or social media” for this question and others (Questions 1, 2, 4, 5, and 8) in the questionnaire.
As a result of Round 1 testing, the change was made to state the reference period prior to Question 1, and then only as needed throughout the rest of the questionnaire, for example, if respondents had a question about it. For the remainder of the questions in the survey, interviewers were instructed to mention “In the past 12 months” as needed. The sentence, “This may have been in person, over the phone, or through the internet or social media” was moved to the question’s introduction following Round 1 of testing.
Round 2 Findings
Responses to probes and findings for Round 2 of testing were very similar to those from Round 1. Sixteen of the 24 respondents from Round 2 considered their friends in their answer for Question 1, and all but one respondent considered one or more family members, including parents, siblings, grandparents, and children. When probed, four respondents said that they considered work colleagues in their response, and nine respondents said that they had not (three additional respondents in this round of testing noted that they are not employed).
"Every day I work with associates that I know and have made friends with. I call my mom and grandma on a daily basis." (PU103R2P02)
"I’m always on the internet, on Facebook, I talk to people I haven’t seen in a while. On the phone I call my mother, my sisters. And my family at home." (PR101R2P01)
When asked, 11 respondents said that they consider interacting with friends and family through the internet to equate to talking to or spending time with them, four respondents said they did not, and eight respondents said that while this would equate to talking to them, it is not the same as spending time with them.
Respondents were also probed on whether they communicate in any ways other than the modes referenced in the question. Six respondents said that they send letters or cards through the mail, and one respondent said that they use FaceTime. Only one of these respondents said that their answer to Question 1 would change if the additional communication method was added. (However, this respondent had reported “Basically Every Day” for their original response, and so their response could not have changed, regardless.)
Respondents were also probed on their understanding of the reference period again in Round 2, in particular whether their answer would change if the question referenced “the past year” instead of “the past 12 months.” None of the 24 respondents in Round 2 said that their answer would change if the reference period asked about the past year instead.
“I feel like people know that 12 months is a year.” (SU112R2)
Final Recommendations
Respondents across both rounds of testing appeared to understand the item as intended, and the change made as a result of Round 1 testing, which included moving the sentence, “This may have been in person, over the phone, or through the internet or social media” to the question’s introduction following Round 1 of testing, was effective. A final change was suggested following Round 2 of testing: to require interviewers to read the response options for this question for all respondents, as it would be the first time respondents would be exposed to them.
Question 2
Round 1 Wording 2. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
How often did [you/[NAME]] discuss political, societal, or local issues with friends or family? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Wording and Final Recommendation 2. [In
the past 12 months,
How
often did [you/[NAME]] discuss political, societal, or local
issues with friends or family?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents in Rounds 1 and 2 of cognitive testing responded to Question 2 for themselves and other household members. To determine their comprehension of the question, respondents were probed on their understanding of several terms in this question, including “discuss” and “societal issues” (in Round 1 only), and were asked provide examples of “political issues”.
Round 1 Findings
Responses to probes for Question 2 indicate variability in how respondents interpreted the phrase “societal issues” in this question. Eleven respondents understood this to mean current events, 7 respondents understood this to mean problems in society, and 2 respondents did not understand the meaning of this term.
The majority of respondents interpreted the term “discuss” in Question 2 to imply a two-way conversation. However, when probed, 15 respondents said they consider posting comments online as discussing something, which contrasts with the notion of “discuss” as a two-way conversation. (Three respondents did not agree that posting comments online is equivalent to discussing something).
"To have a conversation about. It's not just to state your opinion." (PU107R1P04)
Respondents were also asked to provide examples of political issues, and the examples mentioned suggest that most clearly understood the term. Examples mentioned include elections (3 respondents), foreign affairs, and policies (one respondent each). Two respondents did understand what was meant by a political issue and could not provide an example.
As a result of Round 1 testing, a probe was added to ask Round 2 respondents what it means to discuss something through the internet or social media.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. Nearly all Round 2 respondents (22) said the word “discuss” in Question 2 implied a two-way conversation. Respondents used phrases such as “sharing views,” “speaking together,” or a “dialogue” to convey the meaning of this word. (The remaining two respondents appeared to misunderstand this probe.)
“To share your opinions and viewpoints on different things, and then hear back from the other person their views, opinions, whatever.” (PR109R2P05)
“My friend says something, someone else responds, someone else responds, someone else responds.” (PU102R2P01)
“He gives his opinion and I give mine.” (SU111R2)
Respondents were near evenly split on whether or not they considered posting comments online to be akin to discussing something. Eleven respondents said that posting comments is the same as discussing something, and eight respondents said these were not the same. Four respondents said that posting comments online can only be considered discussing something if there is a dialogue, reply, or comments from other parties.
Question 2 contains the phrase “political issue” and respondents were also asked to provide an example of what they consider a political issue. Over half of respondents (13) mentioned the recent presidential race; other issues mentioned included government-related issues (four respondents), racial issues (four respondents), immigration (two respondents), and homelessness, the economy, healthcare, income inequality, climate change, education, and the North Dakota pipeline protest (all mentioned by one respondent each).
Final Recommendations
Respondents across both rounds of testing appeared to understand the item as intended, although with this question and others (Questions 4 and 15) there appears to be some variability in how respondents think about and categorize their behavior online. The changes made as a result of Round 1 testing, which included removing the sentence, “This may have been in person, over the phone, or through the internet or social media”, permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed were effective and respondents appear to understand Question 2 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 3
Round 1 Wording 3. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
How often did [you/[NAME]] provide food, housing, money or help for friends or extended family other than [your/his/her] children, parents, and spouses, partners or significant others?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Version 1 Wording 3. [In
the past 12 months,
How
often did [you/[NAME]] provide food, housing, money or help for
friends or extended family
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Version 2 Wording and Final Recommendation 3. [In
the past 12 months,
How often did [you/[NAME]] provide food, housing, money or help for friends or extended family? Do not include anything you do for [your/his/her] children, parents, and spouses, partners or significant others even if they do not live with [you/him/her].
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 24 respondents in Round 1 of cognitive testing responded to Question 3 for themselves and other household members. In Round 2, all 24 respondents answered Version 1 of Question 3 for themselves and other household members during the survey interview. All 24 respondents then answered Version 2 of Question 3 for themselves only during the probing portion of the interview. To determine respondents’ comprehension of the question, respondents were probed on who they were thinking of when they answered this question and what they understood the terms “extended family” and “help” to mean. As two versions of this question were tested in Round 2, respondents in this round were also asked to comment on which version, if either, was easier to answer, and on their understanding of the difference between the question versions.
Round 1 Findings
Seven Round 1 respondents demonstrated comprehension issues with this question, which appeared to stem primarily from the final portion of the question, “other than your children, parents, and spouses, partners or significant others?” This includes 3 respondents who asked to have the question re-read before they were able to provide a response.
"I'm going to be honest. The first time you read it I didn’t really get this. I think what tripped me up was the ‘other than’.” (PR105R1P03)
Given their difficulty with the exclusionary portion of the question, five respondents were unclear who the question was asking about, and who they should consider in their response.
"So you said other than for them? So you’re talking about doing it for myself then?" (PU105R1P03)
"Is this including family?" (PU106R1P03)
"I was confused by this question. Because you said people other than children … I was thinking about cousins or people around the corner." (PR107R1P04)
When asked, respondents generally said they considered friends or family with whom they do not live as “extended family”, though five respondents cited examples that fall outside of the definition of “extended family” as provided in the question, including spouses, parents, and step children, which are included in the exclusionary clause. The exclusions in Question 3 fall after the question stem, and respondents may have already began to formulate their response before the question had been read fully, and then were confused by, misinterpreted, or didn’t clearly hear the final sentence.
To respondents, the term “help” encompassed a broad range of tasks, including financial help, cleaning, babysitting, or providing food, time, transportation, yardwork, or emotional support.
"Aiding for work issues, mental issues, emotional issues." (SU104R1)
“Any type of help whether it's just talking to someone or physical and non-physical help.” (PR108R1P05)
"You can just help them out, in the house or something, doing a favor or something, it don't have to be money." (SR101R1)
Because of the comprehension difficulties presented by the exclusionary clause, for Round 2 of testing, respondents were randomized to one of two versions of Question 3. Version 1 of Question 3 tested in Round 2 completely removed the exclusionary clause. Version 2 moved the exclusionary clause to a second sentence in the question, preceded by “Do not include anything you do for” and with the phrase “even if they do not live with [you/him/her]” added at the end. The goal of testing alternative versions of this question in Round 2 was primarily to determine if the exclusionary clause was helpful, or if respondents understood this concept clearly without the definition.
Round 2 Findings
In order to test two versions of Question 3 in Round 2, all respondents were administered Version 1 of Question 3 as part of the survey interview in order to provide a baseline measure of whether respondents are able to answer the question without a definition of “extended family.” After discussing Version 1 of Question 3, all respondents were presented with Version 2 of Question 3 and asked to answer it for themselves during the probing section of the interview. Respondents were asked to comment on which version was easier to answer, and on their understanding of the difference between the question versions.
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. During probing, respondents were then asked who they were thinking of when responding to Version 1 of Question 3. Fourteen respondents mentioned friends, five respondents mentioned family generally (though it was unclear if they were referring to immediate family), two respondents mentioned neighbors, and one respondent mentioned their roommate. Some respondents mentioned people who would not be considered extended family, including three respondents who mentioned their parents, one respondent who mentioned their wife, and one respondent who mentioned their son.
Respondents were also asked what “extended family” meant to them in Version 1 of Question 3. Nine respondents said that this meant people who are not in your immediate family and do not live with you. Other respondents provided examples of who they consider to be their extended family, including cousins (mentioned by 10 respondents), friends (seven respondents), aunts or uncles (six respondents), grandparents (one respondent), in-laws (one respondent), and nieces and nephews (one respondent).
“People close to us that we care about like our family.” (PR101R2P01)
“More than your immediate family – your mom, dad, and sister.” (PR102R2P01)
“Any of my relatives that are not in my immediate household.” (PR109R2P05)
Additionally, three respondents mentioned parents, which would not be considered their extended family, according to the definition provided as part of Question 3 Version 2.
Respondents were also probed on the meaning of the word “help” in Version 1 of Question 3. Respondents provided varying examples of what they considered help to mean including advice or someone to talk to (six respondents), rides or transportation (six respondents), money (six respondents), food (four respondents), clothes (three respondents), housing (two respondents), babysitting (one respondent), housework (one respondent), and help with moving (one respondent). Three respondents said help could mean “anything” that the other party needed.
Respondents were then presented with Version 2 of Question 3 and asked to comment on which version, if either, was easier to answer, and on their understanding of the difference between the question versions. Overall, 12 respondents said that Version 2 was easier, nine respondents said Version 1 was easier, and three respondents said the questions were similar in terms of ease of answering. Nine respondents said that they liked that Version 2 was more detailed than Version 1, and specified who respondents should include in their answer. Three respondents who preferred Version 1 said that it was clearer to understand. Two respondents noted that when responding to Version 1 they were thinking of immediate family members. Two respondents said that Version 1 had fewer exclusions than Version 2 (these respondents did not realize that the exclusions in both question versions were equivalent), and one respondent thought that she was to limit her response to “children, parents, and spouses, partners or significant others.”
Final Recommendations
The change made to Question 3 as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed was effective. In addition, a final change was suggested following Round 2 of testing. The definition of extended family in Question 3 contributed to some comprehension issues in Round 1 of testing when it was positioned as the final clause of the sentence. Round 2 of testing sought to determine if incorporating this definition was needed or helpful to respondents. Given the feedback on both question versions, it appears that without a definition, “extended family” may not be a clear enough phrase for some respondents that they are able to limit their response to only this group of people. Although adding a definition to clarify this phrase seems logical, it appears that including one may complicate the concept of the question for some respondents. Even so, the final suggestion for Question 3 is that it should include a definition. In particular, Version 2 of Question 3 is recommended as the final version of this question, as it provides clarification as to who should be considered as extended family which should lead to fewer reporting errors, and lead to fewer comprehension issues than the version of Question 3 tested in Round 1.
Question 4
Round 1 Wording This next set of questions focuses on how [you/[NAME]] interact[s] with neighbors.
4. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, how often did [you/[NAME]] talk to or spend time with neighbors? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Wording and Final Recommendation This next set of questions focuses on how [you/[NAME]] interact[s] with [your/his/her] neighbors in person, over the phone, or through the internet or social media.
4. In
the past 12 months,
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents in Rounds 1 and 2 of testing responded to Question 4 for themselves and other household members. To assess their comprehension of this question, respondents were probed on who they consider their neighbors to be, and if they would consider in their response neighbors who they did not talk to in person, but with whom they were Facebook friends. Round 1 respondents were also probed on the meaning of the phrase “talk to,” and Round 2 respondents were probed on what it means to “have a conversation” with someone.
Round 1 Findings
Regardless of their stated urbanicity (collected in the screener), most Round 1 respondents said they considered their neighbors to be those who live on their block or street, or within a few blocks from them; only 2 respondents considered their neighbors to include everyone living within a larger radius, such as their community at large.
Respondents were also asked if they would also consider in their response neighbors who they did not talk to in person, but with whom they were Facebook friends. Five respondents said that they would, though 15 respondents said that they would not consider this in their response.
"I’m torn about that one, I don’t know how to answer it. I guess so … but I consider neighborly more personal or in-person relationships." (PR107R1P04)
Respondents were probed on the meaning of the phrase “talk to” in this question, and whether this implied a conversation, or simply saying hello. Fifteen respondents said that “talk to” implied a conversation, whereas six respondents said that just saying hello was sufficient. Given this feedback, the decision was made to change “talk to” to “have a conversation with” for Round 2 of testing, as the intent of the question was to assess exchanges that extended beyond saying hello.
Further, while respondents did not struggle to understand the phrase “with neighbors”, for Round 2 of testing, this was reworded as “with [your/his/her] neighbors” for greater clarity. This change was made to both Questions 4 and 5.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. When asked who they consider their neighbors, most respondents say they consider neighbors to be those who are geographically nearby, including on their street or block (seven respondents), within their apartment complex (five respondents); those living next door (four respondents), within a few blocks (three respondents), or within a mile (one respondent).
Respondents were also asked what the phrase “have a conversation” meant to them in Question 4, which was a revision made for Round 2 of testing. The majority of respondents (15) said that this phrase means to talk about something or exchange thoughts, and two respondents said this means to discuss something. Two other respondents incorrectly understood this to mean simply saying “hello” or “hi”. This reflects an improvement over the original wording of this question, which read “talk to.”
Finally, respondents were asked to imagine that they were Facebook friends with a neighbor, but never spoke to them in person, and asked to comment on whether or not they would consider this to be having a conversation or spending time with them. Eleven respondents said that they would not consider this as having a conversation or spending time with them; seven respondents said that they would. (An additional three respondents noted that they did not use Facebook.)
Final Recommendations
As with Questions 2 and 15, there appears to be some variability in how respondents think about and categorize their behavior online. The changes made as a result of Round 1 testing, which included changing the phrase “talk to” to “have a conversation”, removing the sentence, “This may have been in person, over the phone, or through the internet or social media”, and permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed, were effective and respondents appear to understand Question 2 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 5
Round 1 Wording 5. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
How often did [you/[NAME]] discuss political, societal, or local issues with neighbors? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Wording and Final Recommendation 5. [In
the past 12 months,
How
often did [you/[NAME]] discuss political, societal, or local
issues with [your/his/her]
neighbors?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents answered Question 5 for themselves and other household members. No probes were included for Question 5 in either round of testing because of its parallels to Question 2. Respondents did not demonstrate any comprehension issues for this question in either round of testing. The changes made as a result of Round 1 testing, which included removing the sentence, “This may have been in person, over the phone, or through the internet or social media”, rewording the phrase “with neighbors”, as “with [your/his/her] neighbors” for greater clarity, and permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed, were effective and respondents appeared to understand Question 2 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 6
Round 1 Wording 6. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
How often did [you/[NAME]] and [your/his/her] neighbors do favors for each other? By favors, we mean such things as house sitting, watching each other’s children, lending tools, and other things to help each other.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Version 1 Wording 6. [In
the past 12 months,
How
often did [you/[NAME]] and [your/his/her] neighbors do favors for
each other?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Version 2 Wording and Final Recommendation 6. [In
the past 12 months,
How
often did [you/[NAME]] and [your/his/her] neighbors do favors for
each other
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents answered Question 6 for themselves and other household members. To evaluate comprehension of this question, respondents were asked a series of probes after the questionnaire was administered. Respondents were asked to provide examples of favors that they were thinking of when answering, and if they understood the question to ask only about times that they did favors for their neighbors, or also times that their neighbors did favors for them. As two versions of this question were tested in Round 2, respondents in this round were also asked to comment on which version, if either, was easier to answer, and on their understanding of the difference between the question versions.
Round 1 Findings
When asked, Round 1 respondents mentioned a broad range of examples of favors, including cooking, grass cutting, and picking up packages. Not all respondents understood this question to imply reciprocity. Eleven respondents said that they were thinking both of favors they did for their neighbors and their neighbors did for them, although seven respondents said that they were thinking only of favors that they did for their neighbor.
"She'll give me something that she cooked and I'll give her something that I cooked." (PR108R1P04)
It is possible that the phrase “do favors for each other” may have been blended in with the list of examples read to respondents in Round 1.
Also during this round of testing, three respondents interrupted the interviewer while reading this question, in particular, during the sentence, “By favors, we mean such things as house sitting, watching each other’s children, lending tools, and other things to help each other.” Given that respondents were easily able to provide examples of favors in this question when asked, we believed it was possible that they would understand the intended meaning of “favors” without the examples. To test this, respondents were randomized to one of two versions of Question 6 in Round 2, including one version without the definition of favors, to determine if this text was critical to comprehension, or if it overly complicated the question. .
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. In order to test two versions of Question 6 in Round 2, all respondents were administered Version 1 of Question 6 as part of the survey interview in order to provide a baseline measure of whether respondents are able to answer the question without examples of favors. After discussing Version 1 of Question 6, all respondents were presented with Version 2 of Question 6 and asked to answer it for themselves during the probing section of the interview. Respondents were asked to comment on which version was easier to answer, and on their understanding of the difference between the question versions.
For Version 1 of Question 6, respondents were asked to provide examples of favors they did for their neighbors. Five respondents mentioned offering food; four respondents each mentioned babysitting and picking up mail; three respondents each mentioned offering transportation, watching pets, and helping with gardening; two respondents each mentioned helping a neighbor who was locked out, taking out trash, household maintenance, and lending things; and one respondent mentioned providing help cleaning.
Sixteen respondents said that when responding to Version 1 of Question 6 they were thinking about both favors they had done for their neighbors and favors their neighbors had done for them. Three respondents said that they were thinking only about favors their neighbors had done for them; one respondent said that their neighbors had not done any favors for them, and another respondent said that they had not done any favors for their neighbors.
During probing and after Version 1 of Question 6 had been discussed, respondents were asked to respond to Version 2 of Question 6 only for themselves. Respondents were asked to state which version of Question 6 they felt was easier to answer, and reasons for saying so. Thirteen respondents felt that Version 2 was easier, seven respondents felt that Version 1 was easier, and three respondents found them to be about the same. Nine respondents felt that Version 2 was easier because it was more specific, and the examples provided were helpful. However, four respondents who preferred Version 1 said that they did so because Version 2 limited their response to the examples mentioned, and led them to focus exclusively on the examples. Three respondents who preferred Version 1 said that it was less limiting, and one respondent who preferred Version 1 said it was more direct.
Final Recommendations
The change made to Question 6 as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed was effective. In addition, a final change was suggested following Round 2 of testing. It was possible that the examples of favors included in Round 1 in Question 3 contributed to some respondent interruption of the question reading, complicated the question text, and may have been unnecessary. Round 2 of testing sought to determine if incorporating the examples of favors were needed or helpful to respondents. Given the feedback on both question versions, it appears that although a portion of respondents favored each version of Question 6 tested in Round 2, we recommend incorporating Version 2, as many respondents found the examples to be helpful in identifying the kinds of favors respondents should consider in their response. Further, as compared to the version of Question 6 tested in Round 1, Version 2 is slightly less wordy, and as such, no respondents interrupted the reading of this question.
Question 7
Round 1 Wording 7. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did [you/[NAME]] get together with other people from [your/his/her] neighborhood to fix a problem or do something positive for [your/his/her] neighborhood or the community?
(1) Yes (2) No
Round 2 Wording and Final Recommendation 7. [In
the past 12 months,
Did
[you/[NAME]] get together with other people from [your/his/her]
neighborhood to
(1) Yes (2) No |
All 48 respondents answered Question 7 for themselves and other household members. Respondents’ understanding of this question was then assessed through a series of probes. Respondents were asked to describe the meanings of several terms in the question including “fix a problem”, “do something positive” (in Round 1 only), and “community” (in Round 1 only). Respondents were also asked if they were thinking about favors done by the whole neighborhood or by individuals specifically, and what, if anything, they saw as the difference between Questions 6 and 7.
Round 1 Findings
Respondents largely understood the phrases “fix a problem” and “do something positive” to be synonymous, with both meaning addressing or attending to an issue in their community.
"Have an impact, to change something so it's better." (PU107R1P04)
Because of this, the phrase “fix a problem” was eliminated from the question for Round 2 of testing.
Respondents varied on their understanding of “community” in this question, with 10 respondents saying that it implied their neighborhood, 6 respondents saying it implied an area extending beyond their neighborhood, and another 4 respondents interpreting this to mean a group of people united by a common purpose or interest, and not necessarily bound by geography. Given respondents’ variability in how they interpreted “community” in this question, this word was removed from the question for Round 2 of testing.
Respondents also varied on whether they considered Question 7 to ask about favors done by the neighborhood in general or by individuals, with 10 respondents saying they considered only favors done by individuals, six respondents saying they considered favors done by their neighborhood, and two respondents saying they considered both. However, when probed on the difference between Question 6 and Question 7, respondents’ comments suggested that they understood that Question 7 related to the neighborhood at large. When asked, 16 respondents said that Question 6 was asking about smaller favors done by individuals, and Question 7 related to the whole neighborhood helping together. Five respondents did not see any difference between Question 6 and Question 7.
"House sitting and pet sitting, that's something nice you can do, but you're not fixing a problem... Fixing a problem or doing something positive is like a bigger, larger scale." (PU107R1P04)
"The favors with my neighbor is not the same as fixing the problems in my community. It could be the same people, but it would be two different things." (PR108R1P04)
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. Round 2 respondents were asked what the phrase “do something positive” meant to them in Question 7. Nine respondents mentioned improving or bettering something, such as their neighborhood; and an additional three respondents said it meant to do something good.
“Something that will help or enhance the neighborhood.” (PR101R2P01)
“Make something easier, more fun, happier.” (PR105R2P03)
“Do something to uplift the neighborhood.” (PU105R2P03)
“Do something good that will benefit someone else.” (PR102R2P01)
Other respondents instead gave examples of what “do something positive” meant to them in this question, including neighborhood cleanup (six respondents), community outreach (four respondents), shoveling snow (one respondent), and participating in a book bag drive (one respondent).
When asked, 14 respondents in Round 2 said that they were thinking about favors done by the whole neighborhood when answering this question. Five respondents said that they were thinking about favors done by individuals specifically, and three respondents said that they were thinking about favors done both by individuals and the whole neighborhood.
However, when probing on the difference between Question 6 and Question 7 in the survey, most respondents (18) said that Question 7 is broader and relates to the whole neighborhood, and Question 6 relates more to individuals or specific neighbors. Three respondents could not detect a difference between the two questions, and two respondents could not articulate the difference between the two questions although they acknowledged that one existed.
Final Recommendations
Respondents across both rounds of testing appeared to understand the item as intended, and the change made as a result of Round 1 testing, which included eliminating the phrase “do something positive” and the word “community”, and permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed were effective and respondents appear to understand Question 2 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 8
Round 1 Wording 8. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, how often did [you/[NAME]] talk to or spend time with people from a racial, ethnic or cultural background that is different than [yours/his/hers]? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Wording and Final Recommendation 8. In
the past 12 months,
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents answered Question 8 for themselves and other household members. Respondents were then asked a series of probes to assess their comprehension of this question. Respondents were asked who they considered in their response, to explain their understanding of the phrase “racial, ethnic, and cultural background that is different from yours”, and to provide an example of a cultural background.
Round 1 Findings
When asked who they considered in their response, Round 1 respondents mentioned coworkers (11 respondents), neighbors (six respondents), friends (three respondents), and people at church (two respondents).
Respondents most commonly understood the phrase “racial, ethnic, and cultural background that is different from yours” to mean people who were born in a different country, raised differently, or have values different from theirs.
"People who were born in a different country and emigrated here.” (PU102R1P01)
“People who grew up here and were raised in a family with a different ethnicity or heritage." (PU102R1P01)
Examples of a cultural background as mentioned by Round 1 respondents include being of different nationalities (eight respondents), religions (four respondents), and regions of the country (three respondents), or differing in terms of socioeconomic status or education (three respondents).
"Rural Alabama as opposed to New York City." (PU101R1P01)
"Hood vs. preppy, but it could also mean real culture like Asian Indian vs Native American Indian." (PR107R1P04)
Two Round 1 respondents did not understand what was meant by “cultural background”.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. When asked who they considered in their response, Round 2 respondents mentioned coworkers (13 respondents), neighbors (five respondents), friends (14 respondents), family (one respondent), other members of online groups (one respondent) and people at church (three respondents). Twelve respondents understood the phrase “racial, ethnic, or cultural background” as meaning someone with different origins, from a different background, or from a different area; 11 respondents described this as having a different race or skin color; four respondents described this as having different traditions; and one respondent described this as believing in a different religion.
When asked to provide an example of a cultural background, respondents mentioned a variety of examples, including Hispanics or Latinos (six respondents), African Americans (four respondents), Asians (three respondents), Africans (two respondents), Filipinos (one respondent), and Indians (one respondent). Three respondents mentioned someone of a different religious background, and one respondent mentioned someone with a sexual orientation different from theirs.
Final Recommendations
Respondents across both rounds of testing appeared to understand the item as intended. The change made as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed was effective, and respondents appear to understand Question 8 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 9
Round 1 Wording 9. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
How often did [you/[NAME]] post [your/his/her] views about political, societal, or local issues on the internet or social media?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Wording and Final Recommendation 9. [In
the past 12 months,
How often did [you/[NAME]] post [your/his/her] views about political, societal, or local issues on the internet or social media?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents answered Question 9 for themselves and other household members. After the survey was administered, respondents were asked a series of probes to demonstrate comprehension. This included asking respondents what they were thinking about when answering this question, how easy or difficult it was to answer the question, and in Round 2, if they consider commenting on or otherwise reacting to others’ social media posts to be the same as posting their own.
Round 1 Findings
When respondents were asked what they were thinking about when answering this question, 7 respondents mentioned posting their views on Facebook, and 2 mentioned posting their views on Twitter. Respondents were also asked how easy or difficult it was to answer Question 9. The majority of respondents (20) said that this question was easy to answer; one respondent said it was difficult.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. When asked what they were thinking about when they answered this question, seven respondents mentioned posting their views on social media. In Round 2, respondents were asked if they consider commenting on or otherwise reacting to someone’s social media posts to be the same as posting their own views. Thirteen respondents said that they considered this to be the same, while three respondents did not.
“It may not be much depth, but I’m making a statement that should express the way I feel.” (PR110R2P05)
“Reacting to someone else’s view is still sharing your own view.” (PU101R2P01)
Respondents were also asked how easy or difficult it was to answer Question 9. The majority of respondents (17) said that this question was easy to answer. Two respondents said that this question was more difficult, with one of these two respondents saying that this was because they felt this question could be interpreted multiple ways.
Final Recommendations
Respondents across both rounds of testing appeared to understand the item as intended. The change made as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed was effective and respondents appear to understand Question 9 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 10
Round 1 Wording 10. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
How often did [you/[NAME]] read, watch or listen to news or information about political, societal, or local issues?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Round 2 Wording and Final Recommendation 10. [In
the past 12 months,
How often did [you/[NAME]] read, watch or listen to news or information about political, societal, or local issues?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
All 48 respondents answered Question 10 for themselves and other household members. No probes were included for Question 10 in either round of testing. Respondents did not demonstrate any comprehension issues for this question in either round of testing. The change made as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed was effective and respondents appear to understand Question 10 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 11
Round 1 Wording 11. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
Did [you/[NAME]] vote in the last local elections, such as for mayor or school board?
(1) Yes (2) No
Round 2 Wording and Final Recommendation 11. [In
the past 12 months,
Did [you/[NAME]] vote in the last local elections, such as for mayor or school board?
(1) Yes (2) No |
All 48 respondents answered Question 11 for themselves and other household members. No probes were included for Question 11 in either round of testing. Two Round 2 respondents (members of the same pair) had recently moved and weren’t sure if they should consider their current or previous location in their response. No respondents understood this question to ask about the recent presidential election or demonstrated any other difficulty with this question, and respondents did not demonstrate any comprehension issues for this question in either round of testing. The change made as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed was effective and respondents appear to understand Question 11 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 12
Round 1 Wording 12. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
Did [you/[NAME]] attend a public meeting to discuss a local issue?
(1) Yes (2) No
Round 2 Wording and Final Recommendation 12. [In
the past 12 months,
Did [you/[NAME]] attend a public meeting, such as a zoning or school board meeting, to discuss a local issue?
(1) Yes (2) No |
All 48 respondents answered Question 12 for themselves and other household members. Respondents were also asked a series of probes to demonstrate comprehension. This included providing examples of local issues, and describing the type of meeting they attended (in Round 2 only).
Round 1 Findings
When asked about local issues that came to mind for this question, Round 1 respondents mentioned education (six respondents), local elections (two respondents), crime (one respondent), construction (one respondent), and transportation (one respondent). Two respondents did not understand what was meant by “a public meeting to discuss a local issue.” In response to this, some examples were added to this question for Round 2 of testing.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. All respondents were asked to provide examples of local issues that came to mind when answering this question. Eight respondents each mentioned zoning and education, three respondents mentioned traffic and potholes, two respondents each mentioned crime and housing, and one respondent mentioned parking.
Respondents who said that they had attended a meeting were asked to elaborate on the meeting they attended. Three respondents mentioned a school board meeting, and one respondent mentioned a zoning meeting.
Final Recommendations
Respondents across both rounds of testing appeared to understand the item as intended. The change made as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed, and adding examples of a public meeting, were effective and respondents appear to understand Question 12 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 13
Round 1 Wording 13. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
Did [you/[NAME]] contact or visit a public official – at any level of government – to express [your/his/her] opinion?
(1) Yes (2) No
Round 2 Wording and Final Recommendation 13. [In
the past 12 months,
Did [you/[NAME]] contact or visit a public official – at any level of government – to express [your/his/her] opinion?
(1) Yes (2) No |
All 48 respondents answered Question 13 for themselves and other household members. After questionnaire administration, respondents’ understanding was evaluated through a series of probes. Respondents were asked what the term “contact” meant in this question, and Round 2 respondents who had contacted a public official were asked to elaborate on their experience.
Round 1 Findings
Round 1 respondents understood the term “contact” to mean writing a letter or email (17 respondents), contacting them by phone (13 respondents), or seeing them in person (12 respondents). However, five respondents understood “contact” to include posting something on social media addressed for the public official, and four respondents understood this to mean signing a petition.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. Round 2 respondents were also asked to explain what the word “contact” meant to them in this question. Two respondents said that this means to get in touch with someone, one respondent said that this means to reach out to someone, and another respondent said that contact was synonymous with communicate. Other respondents answered this probe by providing examples of the word contact: 12 respondents mentioned email, nine respondents mentioned calling someone over the phone, seven respondents mentioned in-person communication, five respondents mentioned writing someone a letter, and one respondent mentioned text messaging.
Respondents who said that they had contacted or visited a public official were asked to elaborate on their experience. One respondent each said that they had contacted a senator in person, emailed a senator, written a letter to a local official, and signed a petition.
Although fewer respondents in Round 2 mentioned signing a petition as a form of contact (four respondents in Round 1 compared to one respondent in Round 2), responses to other probes across the two rounds of testing were similar, where applicable.
Final Recommendations
Respondents across both rounds of testing appeared to understand the item as intended. The change made as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed was effective and respondents appear to understand Question 13 as intended. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 14
Round 1 Wording 14. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
Did [you/[NAME]] decide whether or not to buy products or services based on the social or political values of the company that provides them?
(1) Yes (2) No
Round 2 Wording 14. [In
the past 12 months,
Did the social or political values of a company influence [your/[NAME]’s] decision of whether or not to buy products or services provided by that company?
(1) Yes (2) No
Final Recommendation Drop this question.
CNCS Decision: Final Recommendation [In the past 12 months,]
Did you buy or boycott a product based on a company's political values or business practices?
(1) Yes (2) No |
All 48 respondents answered Question 14 for themselves and other household members. After responding to the questionnaire, respondents were probed on the meaning of “social or political values”, and asked to describe the meaning of this question in their own words.
Round 1 Findings
Respondents were asked to explain Question 14 in their own words; the responses of seven respondents indicated that they did not understand this question. Two of these respondents understood this to ask if they considered whether other people liked the product or service (such as by reading customer reviews) before purchasing or using it, and three of these respondents understood this to refer to the product’s or service’s advertising or celebrity endorsements.
"I'm trying to figure it out … if something came out in the supermarket and everyone was buying it, and I got everyone's opinion and some people were saying I wouldn’t buy that if I was you, but other people said they liked it." (PR108R1P04)
"Chipotle had the lettuce scare with some bacteria or something so we all stopped [eating there].” (PR107R1P04)
"Was I influenced by anything, any company and then bought the product because of my feelings about the company or advertisement." (SR102R1)
Six respondents did not understand the meaning of the phrase “social or political values” in Question 14. Other respondents said that this referred to things that are important to a company, including their political involvement and position on religious issues. Some respondents provided examples including buying “green” products, and not eating at Chick-Fil-A or shopping at Target because of their stances on LGBTQ issues.
“What a company stands for, their beliefs or mission.” (PU107R1P04)
Given respondents’ difficulty with both the intent of the question and the phrase “social or political values”, a revised and potentially clearer version of Question 14 was tested in Round 2. The revised version of the question was restructured to ask whether the social or political values of a company influenced the respondent, rather than if a respondent decided to buy products or services based on a company’s values.
Round 2 Findings
Responses to probes and findings for Round 2 of testing were very similar to those from Round 1. With the revised version of this question tested in Round 2, we continued to find that the concept addressed in this question was not familiar to all respondents, and that several respondents failed to understand the intended meaning of the question. As with Round 1, respondents were asked to describe the meaning of this question, in their own words. Responses to this probe suggest that 13 respondents understood the question’s intent, while another eight misunderstood the question. Among those who understood the intent of the question, common themes that emerged in their description of the question included avoiding or pursuing a company because of certain values they hold, policies, or political stances; a company’s treatment of their own employees; and a company’s support of certain political candidates. One of these respondents was confused by the question during the interview, but was able to answer and correctly paraphrase the question when presented with it on a show card during probing.
“Supporting someone who has negative opinions of minorities … or helping someone get rich off of me being a minority.” (PU103R2P02)
“Does a company’s views, like with a politician, influence whether or not I buy things from them.” (PU104R2P02)
“If a company that I use, if it’s attached to a certain belief or political view, do I choose not to buy their products because I don’t agree with their stances on certain things.” (PR109R2P05)
Descriptions of the meaning of this question from the eight respondents who appeared to misunderstand the question included whether advertisements (two respondents), telemarketers (one respondent), or product reviews (one respondent) influenced their purchasing decisions; being pressured to buy things from a company (one respondent); brand loyalty (one respondent); and whether a store’s change in management could influence their purchasing decisions (one respondent).
“I thought you were talking about buying something. Like did I see an advertisement or something … like makeup or electronics stuff.” (PR102R2P01)
Respondents were also asked to elaborate on what the phrase “social and political values” meant to them in this question. Fourteen respondents appeared to understand this phrase correctly as the values and policies by which companies operate.
“How people really express themselves when they think that someone isn’t watching.” (PU103R2P02)
“Basically if they side with a particular political campaign, like Koch Industries.” (PU104R2P02)
Responses from six respondents suggest that they did not understand this phrase as intended. Three of these respondents understood this to mean other people’s opinions of the brand or product reviews, one respondent understood it to mean whether they were familiar with the brand, and one respondent understood it to mean how a store treats its customers.
Final Recommendations
Overall, even though the question was reworded prior to Round 2 of testing, responses to probes for Round 2 were largely consistent with those from Round 1. The other change made to this question as a result of Round 1 testing, permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed, was effective. We suggested dropping this question from the survey, as many respondents in both rounds of testing failed to comprehend the intended meaning of the question, and failed to understand the meaning of the phrase “social or political values.” CNCS provided final wording for this question, and opted to keep Question 14 in the final survey, as measurement of this concept was important to capture in the supplement. This change was incorporated into the final version of the questionnaire.
Question 15
Round 1 Wording This last set of questions focuses on local and national groups, organizations and associations that [you/[NAME]] may belong to. Examples include community groups, like a neighborhood watch or parent-teacher association; civic or service organizations; religious or spiritual communities; recreational groups, like a book club or sports league; professional associations or unions; and political or advocacy groups. Participation in these groups could be in-person, online, or both.
15. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did [you/[NAME]] belong to any groups, organizations, or associations?
(1) Yes (2) No
Round 2 Wording This
last set of questions focuses on local and national groups,
organizations and associations that [you/[NAME]] may belong to.
Examples include community groups Participation in these groups could be in-person, online, or both.
15. In
the past 12 months,
(1) Yes (2) No
Final Recommendation This next set of questions focuses on local and national groups, organizations and associations that [you/[NAME]] may belong to. Examples include community groups; civic or service organizations; religious or spiritual communities; recreational groups; and political or advocacy groups. Participation in these groups could be in-person, online, or both.
15. In the past 12 months, did [you/[NAME]] belong to any groups, organizations, or associations?
(1) Yes (2) No |
All 48 respondents answered Question 15 for themselves and other household members. Respondents’ comprehension of this question was assessed through a series of probes including the meaning of the phrase “belong to”, and if formal registration (in Round 1 only) or paying dues were required to belong to a group, organization, or association. Respondents were also asked to describe the groups, organizations, and associations that they were thinking of when they answered this question.
Round 1 Findings
Interviewers reported that because the introduction to the set of questions on group membership is lengthy, several respondents interrupted the interviewer while they were reading it during Round 1 of testing. Given this feedback, the examples included in the introduction were removed prior to Round 2 of testing in order to reduce the length of this text.
Nearly all respondents understood “belong to” in the context of Question 15 to mean “be a member of” or “participate in.” The majority of respondents said that paying dues is not required to belong to a group, organization, or association, but were split on whether they believed formal registration would be required (9 respondents said members would need to be formally registered, and 6 respondents said they would not).
Respondents were also asked to elaborate on the groups, organizations, and associations they were thinking of when answered this question, and all but one respondent provided a logical response (one respondent mentioned being a member of a gym). Only one respondent mentioned an internet group, however findings for Question 15a1 suggest that most respondents were thinking of groups that had an internet component.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. The reduced-length introductory text that eliminated examples appeared to be effective, and no interviewers reported any respondent interruptions while reading this text.
Round 2 respondents were also asked to clarify what the phrase “belong to” meant. Eight respondents said this means to participate, six respondents said this means being a member, four respondents said this means to be a part of something, two respondents said that this means being involved, and one said this means being committed to something. One respondent said that they didn’t know what the phrase meant. When asked if “belong to” meant you have to pay dues, 19 respondents said that it didn’t; no respondents said that it did.
Respondents were also asked to elaborate on the groups, organizations, and associations that they were thinking of in their response. Twelve respondents said religious groups, five respondents said nonprofit groups (such as Girl Scouts, the Salvation Army, AARP, and NAACP), five respondents said recreational sports, four respondents said professional associations, two respondents said political advocacy groups, and one respondent mentioned community groups.
Final Recommendations
The changes made to Question 15 as a result of Round 1 testing, which included permitting interviewers to mention an abbreviated reference period (“In the past 12 months,”) only as needed, and reducing the length of the introductory text were effective. In addition, a final change was suggested following Round 2 of testing. Because Question 15 is an introduction only to the questions on group membership, and is followed by questions on volunteering and charitable donations, we recommend replacing the word “last” in the phrase “This last set of questions” with the word “next.”
Question 15a
Rounds 1 and 2 Wording and Final Recommendation 15a. How many groups, organizations, or associations would you say [you/[NAME]] have belonged to over the past 12 months?
_________________ Number of groups / organizations / associations |
41 respondents answered Question 15a for themselves and/or other household members; the 7 respondents who skipped this question did so because they did not report belonging to any groups, organizations, or associations in Question 15. No probes were included for Question 15 in either round of testing. No changes were suggested to this item as a result of either round of testing. The wording tested in Rounds 1 and 2 is considered final.
Question 15a1
Round 1 Wording 15a1. Thinking about the group, organization, or association with which [you/[NAME]] are most active, which best describes the proportion of [your/his/her] in-person activity to online activity?
READ ALL RESPONSE OPTIONS (1) All activity is in person (2) Activity is more in-person than online (3) Activity is evenly split between in-person and online (4) Activity is more online than in-person (5) All activity is online (6) I am a member but not active with any groups, organizations or associations.
Round 2 Wording and Final Recommendation 15a1. Thinking about the group, organization, or association with which [you/[NAME]] are most active, which best describes the proportion of [your/his/her] in-person activity to online activity?
READ ALL RESPONSE OPTIONS (1) All activity is in person (2) Activity is more in-person than online (3) Activity is evenly split between in-person and online (4) Activity is more online than in-person (5) All activity is online (6) [I am / he is / she is] a member but not active with any groups, organizations or associations.
CNCS Decision: Final Recommendation 15a1. Thinking about the group, organization, or association with which [you/[NAME]] are most active, would you say -
READ ALL RESPONSE OPTIONS (1) All activity is in person (2) Activity is more in-person than online (3) Activity is evenly split between in-person and online (4) Activity is more online than in-person (5) All activity is online, or (6) [You are / he is / she is] a member but not active with any groups, organizations or associations.
|
41 respondents answered Question 15a1 for themselves and other household members; the 7 respondents who skipped this question did so because they did not report belonging to any groups, organizations, or associations in Question 15. To assess comprehension, respondents were probed on the meanings of the phrases “most active” and “proportion of your in-person activity to online activity”, and asked to describe their role in the group, and how they meet with other members.
Round 1 Findings
Most respondents (18) said that they met with their group in person, with one respondent saying that they met with other members of their group online, and one respondent saying that they met with other members online and in person. Five respondents said that they were members of the group, and two said that they were leaders or organizers. Sixteen Round 1 respondents understood the phrase “most active” in Question 15a1 to mean the group with which they were most involved or spend the most time. One respondent did not understand the meaning of this phrase.
"The one I devote the most of my time to ... relative to the others." (PU101R1P01)
"Most active means the organization I feel like I dedicate the most time or energy to supporting, participating." (PU102R1P01)
Respondents were also probed on the phrase “proportion of your in-person activity to online activity”. Fifteen respondents said that this referred to the percentage or ratio of time spent in person versus online. Two respondents did not understand this phrase.
"Percentage, how much time you spend, like the ratio." (PR107R1P04)
"Basically, ratio of time that I spend participating actively versus participating online." (PU101R1P01)
"Based on the amount of time that you're spending, whether it's split between being online or at the location or place." (PU103R1P02)
"I guess it would mean … Would it mean voicing my opinion or using my physical body?" (PR108R1P04)
Following Round 1 of testing, the final response option was reworded to accommodate proxy responses.
Round 2 Findings
Responses to probes and findings for Round 2 of testing were very similar to those from Round 1. Respondents were probed on the meaning of the phrase “most active”, which all asked respondents correctly defined. Nine respondents said this referred to the group one participated in more, five respondents said that this referred to the group to which they dedicated the most time, three respondents said that it implied the group they were most involved with, and two respondents said that it referred to the group that they did the most for.
Respondents were also asked how they meet with other members of their group, and to describe their role in the group. Most respondents (17) said that they met with their group in person, with four respondents saying that they met with other members of their group online, and one respondent saying that they video chatted with their group. Five respondents said that they were members of the group, and four said that they were leaders or organizers.
As in Round 1 of testing, some respondents did not clearly understand or were unable to restate the phrase “proportion of your in-person activity to online activity” in Question 15a1 in their own words.
Final Recommendations
The change made to Question 15 as a result of Round 1 testing, which included rewording the final response option to accommodate proxy responses, was effective. In addition, a change was suggested by the sponsors following Round 2 of testing. As in Round 1 of testing, some respondents did not clearly understand or were unable to restate the phrase “proportion of your in-person activity to online activity” in Question 15a1 in their own words. The suggested change was to eliminate this phrase from the question, and require interviewers to read all response options as part of the question. This change was incorporated into the final version of the questionnaire.
Question 16
Round 1 Wording 16. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did [you/[NAME]] volunteer for a group, organization, or association?
(1) Yes (2) No
Round 2 Wording 16. In
the past 12 months,
(1) Yes (2) No
Final Recommendation 16. In the past 12 months, did [you/[NAME]] spend any time volunteering for any organization or association?
(1) Yes (2) No |
All 48 respondents answered Question 16 for themselves and other household members. To assess comprehension, respondents were then asked to describe which groups, organizations, or associations they considered in their response. In Round 2 of testing only, respondents were also asked whether the groups that came to mind while answering Question 16 were the same or different groups as those mentioned in Question 15 (in Round 1, this probe was only asked of those who reported the same number in their response to Question 15).
Round 1 Findings
Respondents were asked to specify which groups, organizations, or associations that they were considering in their response, and the most commonly mentioned examples included those relating to education such as a PTA (10 respondents), church (nine respondents) and non-profit or charitable organizations (seven respondents). Respondents who said that they volunteer were also asked for the number of groups, organizations, or associations they volunteer with, and, if they reported the same number as their response to Question 15, they were also asked if they were considering the same groups in their responses to both questions. All seven respondents who were asked this probe said that they were considering the same groups in their responses to both questions. However, responses of those who were not asked this probe suggest that several other respondents were considering the same opportunities in their responses to Question 15 and Question 16. Because of this, all respondents were asked this probe in Round 2.
Round 2 Findings
Where applicable, responses to probes and findings for Round 2 of testing were very similar to those from Round 1. Respondents provided a broad range of examples of groups they were thinking of when answering Question 16, including religious groups (seven respondents), educational or PTA groups (six respondents), civic or community organizations (five respondents), homeless shelters or soup kitchens (three respondents), political campaign volunteering (three respondents), and recreational sports teams (one respondent), among others.
Respondents were also asked whether the groups that came to mind while answering Question 16 were the same or different groups as those mentioned in Question 15. Nine respondents said that they mentioned the same groups for both questions or that there was some degree of overlap with the groups mentioned; only two respondents said that the groups they mentioned were completely different. This may be due to the phrase “group, organization, or association” which is repeated in both questions. Particularly in Question 16, respondents may have heard the phrase “group, organization, or association” for the fourth time in the survey, and assumed they were still being asked about group membership.
Final Recommendations
The change made to Question 15 as a result of Round 1 testing, which included removing the text "that is from [FILL CURRENT MONTH] of 2015 until today” was effective. In addition, a final change was suggested following Round 2 of testing. Because the phrase “group, organization, or association” was mentioned in both Questions 15 and 16, respondents may have assumed Question 16 was asking about group membership. In order to differentiate the intent of this question from that of the Question 15 series on group membership, the final wording was changed to read “spend any time volunteering for any organization or association.” This change removes the word “group” which may have contributed to respondents’ difficulty distinguishing from the questions on group membership.
Question 16a
Rounds 1 and 2 Wording 16a. How often did [you/[NAME]] volunteer?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all
Final Recommendation 16a. How often did [you/[NAME]] volunteer?
[READ ALL RESPONSE OPTIONS] (1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
41 respondents answered Question 16b for themselves and other household members; the 7 respondents who skipped this question did so because they did not report volunteering in Question 16. All respondents who answered this question were asked how they came up with their response.
Round 1 Findings
When asked how they came up with their answer, nine respondents said that they estimated how frequently they volunteer, while two said that they counted their volunteer opportunities over the past year. Respondents with multiple volunteer opportunities did not demonstrate any difficulty in reporting the frequency of volunteering across all opportunities.
Round 2 Findings
Round 2 respondents were also asked how they came up with their answer for Question 16a. In general, all respondents who answered this question said that they recalled the volunteer opportunities they participate in, and then either counted the number of hours they volunteered or calculated them across the year, depending on the frequency for which they volunteer, and how many hours they volunteer. Overall, responses to probes for Round 2 of testing were largely consistent with those from Round 1.
Further, five respondents weren’t sure what the response options were for this question, and needed them reread.
Final Recommendations
No changes were made to Question 16a as a result of Round 1 testing, however, one final change was suggested following Round 2 of testing. Because some Round 2 respondents were unsure what the response options were for this question without them being read aloud, we suggested requiring interviewers to read the response options for Question 16a.
Question 16b
Rounds 1 and 2 Wording 16b. Approximately how many hours did [you/[NAME]] volunteer?
_____________ Hours
Final Recommendation 16b. In the past 12 months, approximately how many hours did [you/[NAME]] volunteer?
_____________ Hours |
41 respondents answered Question 16b for themselves and other household members; the 7 respondents who skipped this question did so because they did not report volunteering in Question 16. All respondents who answered Question 16b were asked to describe how they came up with their answer to this question, and how easy or difficult it was to respond to this question.
Round 1 Findings
Respondents were asked how they came up with their answer to Question 16b, and 14 respondents reported that they estimated the number of hours based on their approximate frequency of volunteering. However, five of these respondents calculated incorrectly or mentioned that they were not confident in the accuracy of their calculation. Respondents were also asked how easy or difficult this question was, and five respondents said it was easy, while one respondent said it was more difficult, as they couldn’t recall the exact number from memory, and had to average the amount of hours they volunteered for a single month, and then multiply that number across 12 months.
Round 2 Findings
Round 2 respondents were also asked to explain how they arrived at their answer for Question 16b, and all respondents mentioned that they recalled their volunteer activities, and then either tallied the hours and reported them for a day, month, week, or year; or multiplied the hours across 12 months to report an annual number. Respondents were also asked how easy or difficult this question was, and while nine respondents said it was easy, eight said it was more difficult, as some had to recall hours across multiple volunteer positions and opportunities, and others said it was difficult to remember the number of hours accurately. Regardless, all but one respondent was able to provide an answer. Overall, responses to probes for Round 2 of testing were similar with those from Round 1, though more respondents in Round 1 specifically stated that they estimated their response.
Nine respondents in Round 2 asked the interviewer to clarify the reference period for this question.
Final Recommendations
No changes were made as a result of Round 1 testing, however, a final change was suggested following Round 2 of testing. Several Round 2 respondents were unsure of the reference period for this question, and so a reference period of the past 12 months was added to this question.
Question 17
Round 1 Wording 17. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did [you/[NAME]] give money, assets, or property with a combined value of more than $25 to a political party, campaign, or organization?
(1) Yes (2) No
Round 2 Wording and Final Recommendation 17. [In
the past 12 months,
Did
[you/[NAME]] give money
or possessions
with a combined
value of more than $25 to a political organization,
party, or
campaign
(1) Yes (2) No |
All 48 respondents answered Questions 17 and 18 for themselves and other household members. Respondents were then asked a series of probes in order to demonstrate their comprehension with these questions. In Round 1 of testing, Questions 17 and 18 were probed on simultaneously. During Round 1, respondents were probed on the meaning of “assets” and “property”. The Round 1 findings for Questions 17 and 18 are below.
In Round 2, Questions 17 and 18 were probed on separately. For Question 17, respondents were probed on the meaning of “possessions” and those who said that they had given money or possessions with a combined value of more than $25 to a political organization, party, or campaign were asked to provide an example of an organization, party, or campaign to whom they had given money or possessions.
Round 1 Findings
Respondents were probed on the meaning of “assets” and “property” in Questions 17 and 18. Four respondents pointed out that these terms were synonymous with each other, and while they did not state it explicitly, several other respondents provided very similar definitions for “assets” and “property”, suggesting that other respondents understand them to mean the same thing as well. According to respondents, “assets” implies possessions or household goods (13 respondents), money (eight respondents), houses (six respondents), time and talents (five respondents) and cars (three respondents). “Property” implies houses or land (11 respondents), possessions or household goods (seven respondents). Given this, the terms “assets” and “property” was deleted from Question 17 following Round 1 of testing, and replaced with “possessions”.
Further, three respondents included their answer to Question 18 in their response to Question 17. Given this, the phrase “political party, campaign or organization” was re-ordered following Round 1 of testing to prevent respondents from thinking that this question is asking about non-political organizations.
Round 2 Findings
This section details the Round 2 findings for Question 17. Respondents who said that they had given money or possessions with a combined value of more than $25 to a political organization, party, or campaign were asked to provide an example of an organization, party, or campaign to whom they had given money or possessions. Three respondents mentioned a political campaign, and one respondent mentioned the Republican party.
All respondents were asked to clarify what “possessions” meant to them in this question. Twelve respondents mentioned belongings or property, five respondents mentioned money, three respondents mentioned clothes, two respondents mentioned something of monetary value, two mentioned food, two mentioned time, and one respondent mentioned furniture. One respondent was not able to define “possessions”.
Final Recommendations
The changes made to Question 17 for Round 2 of testing, which include replacing the words “assets” and “property” with “possessions”, re-ordering the phrase “political party, campaign, or organization” to clarify that respondents should only include political organizations in their response, and only restating the full reference period if needed, appear to have been effective. No changes were suggested as a result of Round 2 testing. The wording tested in Round 2 is considered final.
Question 18
Round 1 Wording 18. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,]
Did [you/[NAME]] give money, assets, or property with a combined value of more than $25 to a charitable or religious organization or group?
(1) Yes (2) No
Round 2 Version 1 Wording and Final Recommendation 18. [In
the past 12 months,
Did
[you/[NAME]] give money or
possessions
with a combined
value of more than $25 to a non-political
group or organization, such as a charity, school, or
religious organization
(1) Yes (2) No
Round 2 Version 2 Wording 18. [In
the past 12 months,
Did [you/[NAME]] give money or possessions with a combined value of more than $25 to any other group or organization?
(1) Yes (2) No |
All 48 respondents answered Questions 17 and 18 for themselves and other household members. Respondents were then asked a series of probes in order to demonstrate their comprehension with these questions. In Round 1 of testing, Questions 17 and 18 were probed on simultaneously. Please see Question 17 (above) for findings for both questions from Round 1 .
Two versions of Question 18 were tested in Round 2. Respondents who saw Version 1 first were asked to define the phrase “non-political”. All respondents were asked to name the groups or organizations that came to mind when responding to the version they saw first, and to comment on which version of Question 18, if either, was easier to understand.
Round 1 Findings
Please see Question 17 (above) for details from Round 1.
Round 2 Findings
Two versions of Question 18 were tested in Round 2. The purpose of testing two versions of this question was to determine which was more effective in facilitating a comprehensive response from respondents that included all donations to non-political organizations. Half of respondents were presented with Version 1 of Question 18 as part of the survey interview, and the other half of respondents were presented with Version 2 as part of the survey interview. Respondents were then asked to respond to the alternate version of the question for themselves only during probing, and asked to state which version they found easier to answer.
Respondents who saw Version 1 first were asked to define the phrase “non-political” in Version 1 in their own words. Eight respondents said that this meant unrelated to politics, and one respondent said this meant non-profit. All respondents were asked to name the groups or organizations that came to mind when responding to the version they saw first, and responses were similar regardless of version presented first. Eleven respondents said they were thinking of religious organizations, eight respondents said charities (such as Red Cross and United Way), and one respondent each said food banks and community organizations. All respondents were asked if there were any groups or organizations that they donated to that were not asked about in Questions 17 or 18, and no respondents said that there were. (For reference, six respondents said “Yes” to Question 17 for themselves or another household member, and 22 respondents said “Yes” for themselves or another household member to the first version of Question 18 that they were asked.)
Eleven respondents said that Version 1 of Question 18 was easier to answer, and eight respondents said that Version 2 was easier to answer. Five respondents said that the two versions were similar. Nine respondents who preferred Version 1 said that it was more specific and the examples helped, while three respondents said that they preferred Version 2 because it was less specific.
Final Recommendations
No changes were made to Question 6 as a result of Round 1 testing. A change to Question 18 was suggested following Round 2 of testing. Round 2 of testing sought to determine which question version more successfully facilitated a response from respondents that included all donations to non-political organizations. Given the feedback on both question versions, both versions of Question 18 tested in Round 2 appear work as intended. However, we recommend incorporating Version 1 into the final version of the questionnaire, as the examples provided appear to help several respondents while the additional wording does not negatively affect question comprehension.
The design of this research facilitated examining the ability of a paired respondent to accurately provide a proxy response for other members of their household. Respondents answered the same set of questions for other members in their household after responding for themselves, which permitted calculation of a match rate, or rate for which respondents’ answers for another household member matched the response given by the other household member (match rates were not calculated for single respondents). In addition, for questions excluding those with “Yes / No” response options, the number of mismatched responses that were off by one response category was also calculated. This information is shown for each question by round in Section 9.
After responding to the questionnaires for themselves and other household members, respondent were asked a series of probes to demonstrate their comprehension of the questionnaire. After each question or block of questions on a similar topic, respondents were asked to describe how they came up with their answer for the other members of their household, and their level of confidence in the response they provided for them.
When asked how they came up with their answer for other household members, respondents commonly answered that they had observed the other household member engage in this behavior or engaged in this behavior together, had spoken to the other household member about it or overheard them speaking about it with someone else, or were estimating or assuming this response based on known personality traits of the other household member. Respondents generally reported high or very high levels of confidence for the proxy responses they reported, and there were no trends among questions for which the small number of respondents reported lower levels of confidence.
While most respondents reported high levels of confidence for all questions in the survey, respondents provided accurate proxy responses for their household members slightly more than half of the time. (The average match rate among all respondents across all questions was 50.2% (R1) and 54.5% (R2); for Yes / No questions it was 65.9% (R1) and 68.0% (R2), and for questions with another type of response option it was 39.3% (R1) and 44.4% (R2).) Neither related nor unrelated respondents appeared to be able to more accurately respond for other household members. (The average match rate among all questions for related households was 48.6% (R1) and 54.7% (R2); for unrelated households this number was 51.8% (R1) and 54.3% (R2). Further, question topic appeared to be unrelated to match rates.
Overall, the findings from this research indicate that the majority of questions tested in the combined Civic Engagement and Volunteerism Supplement were clear and comprehensible to the respondents who participated in cognitive testing. Many of the tested questions required only minor revisions, such as abbreviating the reference period (in questions other than Question 1), to read “In the past 12 months,” only as needed, and moving the sentence “This may have been in person, over the phone, or through the internet or social media” to the introduction prior to Question 1, and prior to Question 4 when there was a transition in survey topic (this change was not compatible with Question 8, and so this sentence remains in the same placement as in Round 1 for Question 8). Other minor revisions include adding or removing terms or examples from the questions.
Question 14 required more substantial revisions, including restructuring the question to ask whether the social or political values of a company influenced the respondent, rather than if a respondent decided to buy products or services based on a company’s values, as the question was originally worded. At the conclusion of both rounds of testing, we recommended dropping this question from the final questionnaire. CNCS opted to include this question as it permits measurement of a key concept in the supplement, and provided final, revised wording.
Two versions of Questions 3, 6, and 18 were tested during Round 2 of interviews in order to determine if including a definition or examples was helpful to respondents and improved their comprehension of the question. Although most respondents understood both versions of these questions, the more detailed version tested (with a definition or examples) for each of these questions was ultimately selected as many respondents benefitted from the additional clarification.
The design of this study, in which primarily pairs of respondents were interviewed, permitted measurement of the ability of one respondent to accurately provide a proxy response for other members of their household. Although respondents expressed confidence in their ability to respond for other household members, overall match rates were slightly above 50% for all questions in the survey in both rounds of testing.
COMBINED SUPPLEMENT FOR CIVIC ENGAGEMENT AND VOLUNTEERISM
Summary of Expert Review
Original Item Number |
Source |
Construct (based on factor analyses) |
Original Question Text and Response Options |
Recommended Item Number, Question Text and Response Options |
Comments |
Recommended Probes during Cognitive Interviewing |
|
|
|
This survey is intended to help us better understand civic engagement in America. This includes understanding how we interact and relate to each other, as well as how we work together to make changes in our communities and country.
|
These next questions will help us understand how we, in America, interact and relate to each other, as well as how we work together to make changes in our communities and country.
|
The word “survey” was removed since these questions will be administered as part of the larger CPS.
The phrase “civic engagement” was removed due to concerns that it would not be commonly understood. The 2015 wording is an alternative option (“The next set of questions are about people’s involvement and communication within their communities.”) |
How do Rs define “community?” Geographic? Cultural? Language? Lifestyle? Something else?
Ask Rs to define “civic engagement.”
|
1. |
2015 CPS- Civic Engagement- modified |
|
The first set of questions focuses on interacting with family and friends.
In the past 12 months, how often (did you/did NAME)…
Speak to or spend time with friends and family, including spouses, partners and significant others? This might be in person, over the phone, or using the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
Thinking about the people (you/NAME) interact(s) with in person, over the phone or using the internet or social media, in the past 12 months, how often (did you/did NAME)…
Talk to or spend time with friends and family?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
The initial sentence that describes the forthcoming questions was removed, as there are so few questions in this section. This change allows for the types of communication to be stated upfront.
Modified question from “speak” to “talk” to simplify the language.
Recommend not including the phrase, “including spouses, partners and significant others?” Current wording will likely no produce much variation in response. It may also lead respondents to focus on those relationships more than others.
The 2015 wording is an alternative option (“This next question is about friends and family (you do/NAME does) not live with.”) |
Are there other ways of communicating that we missed? Text messaging?
Whom did R include in their response? Did everyone live with them, close by or did distance not matter? Were friends from work settings included?
|
2. |
2015 CPS- Civic Engagement-modified |
Political Engagement |
[In the past 12 months, how often (did you/did NAME)…]
Discuss political, societal, or local issues with friends or family? This might be in person, over the phone, or using the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
[In the past 12 months, how often (did you/did NAME)…]
Discuss political, societal, or local issues with friends or family?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
Reference period does not need to be stated again as this is only the second question. Same logic for removing methods of communication. |
What constitutes a discussion? Does it need to be bi-directional or does posting ones thoughts online count as a discussion?
|
3. |
|
|
[In the past 12 months, how often (did you/did NAME)…]
Provide food, housing, money or help for friends or extended family beyond (your/his/her) children, parents, and partners?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
During the past 12 months, how often (did you/did NAME) provide food, housing, money or help for friends or extended family beyond (your/his/her) children, parents, and spouses, partners or significant others?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
This question was unique enough from the last two that we felt it needed its own introductory clause.
Added “spouses” and “significant others” since “partner” may not be understood by all respondents.
|
Ask Rs to define “help.” |
|
|
|
This next set of questions focuses on interacting with neighbors. |
Still thinking about people you interact with in person, over the phone, or using the internet or social media, in the past 12 months, how often did (you/NAME)…. |
Since neighbors could fall into the responses for #s 1-2, modified question intro to remind respondent of reference period and communication modes. |
|
4. |
2015 CPS- Civic Engagement-modified |
Social Engagement |
In the past 12 months, how often (did you/did NAME)…
Speak to or spend time with neighbors? This might be in person, over the phone, or using the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
4. Talk with or spend time with neighbors?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
Modified question changing “speak” to “talk” to simplify language. |
Ask whom R considers “neighbors.” Is the “neighborhood” different from the “community?” Is it solely geographic proximity? What radius?
What constitutes “talking” with? Can a simple “hello” when passing by count? Or does it need to be more substantial? |
5. |
|
|
[In the past 12 months, how often (did you/did NAME)…]
Discuss political, societal, or local issues with neighbors? This might be in person, over the phone, or using the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
5. Discuss political, societal, or local issues with neighbors? This might be in person, over the phone, or using the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
|
How does R define societal? |
6. |
2015 CPS- Civic Engagement |
Social Engagement |
[In the past 12 months, how often (did you/did NAME)…]
Do (your/his/her) neighbors do favors for each other? By favors we mean such things as watching each other’s children, helping with shopping, house sitting, lending garden or house tools and other things to help each other.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
6. In the past 12 months, how often did (your/his/her) neighbors do favors for each other? By favors, we mean such things as watching each other’s children, house sitting, lending tools, and other things to help each other.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
There was a wording error in the original.
Shortened question by removing some examples. |
Ask Rs to provide other examples that came to mind.
Ask R if they interpreted question to mean that they were involved in doing or receiving a favor, or if it was more general for the neighborhood. Ask about reciprocity and whether they felt this question implied that favors needed to be returned. |
7. |
2015 CPS Volunteer - modified |
Civic Engagement |
In the past 12 months, (did you/did NAME) get together with other people from (your/his/her) neighborhood to fix a problem or do something positive for (your/his/her) neighborhood or the community?
(1) Yes (2) No |
7. In the past 12 months (did you/did NAME) get together with other people from (your/his/her) neighborhood to fix a problem or do something positive for (your/his/her) neighborhood or the community?
(1) Yes (2) No |
|
Ask R to provide examples of “fixing a problem” or “doing something positive.”
Did R think of the same responses as in #6? Is this duplicative? What does R think is the difference between the two questions?
Does the word “community” change the meaning of this question versus including “neighborhood” alone? |
|
|
|
This next set of questions focuses on interactions and civic activity in general. |
This next set of questions focuses on interactions and activities in general, that take place in person, over the phone or using the internet or social media. |
Modified to eliminate term “civic” as it might not be understood. |
|
8. |
|
|
In the past 12 months, how often (did you/did NAME)…
Speak to or spend time with people from a racial, ethnic or cultural background that is different than (yours/his/hers)? This might be in person, over the phone, or using the internet or social media.
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
8. In the past 12 months, how often (did you/did NAME) talk to or spend time with people from a racial, ethnic or cultural background that is different than (yours/his/hers)?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
Modified question from “speak” to “talk” to simplify the language.
We may be introducing error with the term “cultural” as it might have meaning beyond ethnicity or nativity. Specifically, respondents may include those from different socioeconomic backgrounds, religious backgrounds, LGBTQ, etc. |
Ask R for examples of cultural backgrounds. |
9. |
2015 CPS- Civic Engagement- modified |
Political Engagement |
[In the past 12 months, how often (did you/did NAME)…]
Post your views about or otherwise discuss political, societal, or local issues on the internet or social media?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
9. [In the past 12 months, how often (did you/did NAME)…]
Post your views about or otherwise discuss political, societal, or local issues on the internet or social media?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
This question may be redundant to #5 |
Ask R if they had difficulties answering this question. Did they think about whether their postings were restricted to friends/family or open to all? Did that not matter? |
10. |
|
|
[In the past 12 months, how often (did you/did NAME)…]
Consume news or information about political, societal, or local issues?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
10. [In the past 12 months, how often (did you/did NAME)…]
Read, watch or listen to news or information about political, societal, or local issues?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
Modified question to remove term “consume” |
|
11. |
|
|
In the past 12 months, (did you/did NAME)…
Provide food, money or help to an individual you did not necessarily know but believed to be in need?
(1) Yes (2) No |
11. In the past 12 months, (did you/did NAME)…
Provide food, money or help to an individual you did not necessarily know but believed to be in need?
(1) Yes (2) No |
This question creates several problems. The first is the very high social desirability factor. Most people would feel compelled to say yes, and this is further amplified by an interviewer-administered mode, and the lengthy reference period of 12 months.
There is also likely to be confusion with charitable donations and whether those should be included here. |
Ask how R defines “help.” Does it mean finding someone a job? Or holding open a door for them?
How does R interpret a relationship with the person? They may know that but don’t have to?
Is help required to be done “in person?” How should someone who “adopts” a child in another country by sending money respond? |
12. |
|
Political Engagement |
[In the past 12 months, (did you/did NAME)…]
Vote in local elections, such as for mayor or school board?
(1) Yes (2) No |
12. [In the past 12 months, (did you/did NAME)…]
Vote in local elections, such as for mayor or school board?
(1) Yes (2) No |
Depending on the schedule of local elections the R may not have had the opportunity to do this. Consider revising this to ask if R voted in the “last” local election. |
|
13. |
2015 CPS Volunteer - modified |
Civic Engagement |
[In the past 12 months, (did you/did NAME)…]
Attend a public meeting, such as to address a local issue?
(1) Yes (2) No |
13. [In the past 12 months, (did you/did NAME)…]
Attend a public meeting to discuss a local issue?
(1) Yes (2) No |
Revised question for clarity. |
|
14. |
|
|
[In the past 12 months, (did you/did NAME)…]
Attend a cultural event?
(1) Yes (2) No |
14. [In the past 12 months, (did you/did NAME)…]
Attend a cultural event?
(1) Yes (2) No |
This question may produce some confusion. It may be useful to provide some examples for respondents. |
Ask R to provide examples of cultural events. |
15. |
2015 CPS- Civic Engagement |
Political Engagement |
[In the past 12 months, (did you/did NAME)…]
Contact or visit a public official – at any level of government – to express (your/his/her) opinion?
(1) Yes (2) No |
15. [In the past 12 months, (did you/did NAME)…]
Contact or visit a public official – at any level of government – to express (your/his/her) opinion?
(1) Yes (2) No |
|
|
16. |
2015 CPS- Civic Engagement |
Political Engagement |
[In the past 12 months, (did you/did NAME)…]
Buy or boycott a certain product or service because of the social or political values of the company that provides it?
(1) Yes (2) No |
[In the past 12 months, (did you/did NAME)…]
Decide whether to buy products or services based on the social or political values of the company that provides it?
(1) Yes (2) No |
Revised question for clarity. |
|
|
|
|
This last set of questions focuses on membership in and activity with groups, organizations and associations. This could include but is not limited to community groups and organizations like a neighborhood watch or parent-teacher association, civic or service organizations, religious or spiritual communities, recreational groups like a book club or sports league, professional associations or unions, or political or advocacy groups. Additionally, participation in these groups could be in-person, online, or a mixture of the two. |
This last set of questions focuses on activity with groups, organizations and associations. Examples include community groups, like a neighborhood watch or parent-teacher association, civic or service organizations, religious or spiritual communities; recreational groups, like a book club or sports league; professional associations or unions; and political or advocacy groups. Participation in these groups could be in-person, online, or both. |
This introduction is very lengthy to be read as part of a telephone survey. Tried to shorten a bit. The term “membership” may also be problematic and was removed.
Some additional clarification is needed for this item. Is the intent to capture online engagement? The current list of examples omits any interest/support groups as well as internet-only recreational groups, such as gaming. |
As R to list specific groups that would fit into these categories. Probe on whether online participation is applicable.
|
17. |
2015 CPS Volunteer |
|
In the past 12 months, (did you/did NAME)…
Volunteer through or for a group, organization, or association?
(1) Yes (2) No |
18. In the past 12 months, (did you/did NAME)…
Volunteer for a group, organization, or association?
(1) Yes (2) No |
** Note re-ordering of questions. This was done because organizations where one volunteers are likely a subset of a larger group of organizations referenced in the original questions on group membership.
Revised to simplify language. |
|
17a |
2015 CPS Volunteer |
|
If Yes, approximately how many hours per week would you say you spent volunteering?
[Open numerical response]
|
18a. If Yes, how often did you volunteer?
(1) Basically every day (2) A few times a week (3) A few times a month (4) Once a month (5) Less than once a month (6) Not at all |
Asking Rs to report the number of hours per week over a 12 month time frame is difficult. Consider using the recommended response categories. Consider adding a time element to the actual question. For example, “If yes, how often did you volunteer for a least one hour at a time?” |
As Rs to estimate their time spent volunteering by day, hour, week, etc. |
18. |
2015 CPS Volunteer |
Civic Engagement |
[In the past 12 months, (did you/did NAME)…]
Give money, assets, or property with a combined value of more than $25.00 to a charitable or religious organization or group?
(1) Yes (2) No |
19. [In the past 12 months, (did you/did NAME)…]
Give money, assets, or property with a combined value of more than $25 to a political party, campaign, or organization?
(1) Yes (2) No |
** Note re-ordering of questions. Some respondents may include political donations to be charitable and might misreport on that category. Asking this question first eliminates that risk. |
|
19. |
|
|
[In the past 12 months, (did you/did NAME)…]
Give money, assets, or property with a combined value of more than $25.00 to a political party, campaign, or organization?
(1) Yes (2) No |
20. [In the past 12 months, (did you/did NAME)…]
Give money, assets, or property with a combined value of more than $25 to a charitable or religious organization or group?
(1) Yes (2) No |
|
|
20. |
|
|
In the past 12 months, were (you/NAME) a member of any groups, organizations, or associations?
(1) Yes (2) No |
17. In the past 12 months, did (you/NAME) belong to any groups, organizations, or associations?
(1) Yes (2) No |
* Note re-ordering of questions.
Revised question to remove “membership.” |
Ask R to define what “membership” in a group entails. Does it require dues? Formal registration? |
20a |
|
|
If Yes, how many groups, organizations, or associations would (you/he/she) say (you/he/she) are a member of?
[Open numerical response] |
17a. If Yes, how many groups, organizations, or associations would (you/he/she) say (you/he/she) belong(s) to?
[Open numerical response] |
Is the survey trying to measure formal membership? If so, consider an additional question in this section. |
|
20a1 |
|
|
Thinking about the group, organization, or association with which (you/he/she) are most active, which best describes the proportion of in-person activity to online activity?
(1) All activity is in person (2) Activity is more in-person than online (3) Activity is evenly split between in-person and online (4) Activity is more online than in-person (5) All activity is online (6) I am a member but not active with any groups, organizations or associations. |
17a1. Thinking about the group, organization, or association with which (you/he/she) are most active, which best describes the proportion of (your/his/her) in-person activity to online activity?
(1) All activity is in person (2) Activity is more in-person than online (3) Activity is evenly split between in-person and online (4) Activity is more online than in-person (5) All activity is online (6) I am a member but not active with any groups, organizations or associations. |
Revised question to clarify that we are interested in the proportion of activity of the respondent, not the group as a whole. |
|
|
|
|
That brings us to the end of the survey. Thank you very much for your time and contribution to this important research. |
That brings us to the end of the survey. Thank you very much for your time and contribution to this important research. |
This statement may not be appropriate depending on where within CPS it is administered. |
|
This section presents match rate tables for the questions tested in Rounds 1 and 2. The question wording tested is presented followed by two tables of data for each question by round. The tables in this document summarize the quantitative responses from the cognitive interviews, as well as the proportion of respondents who were able to correctly report a proxy response. The interpretation for the tables in the document is as follows.
Table a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2: A frequency distribution for question responses collected through the cognitive interviews is presented first for each survey question. The first column of each frequency table provides the distribution of responses from all interviews for all household members age 18 and older. For the second and third columns, paired respondents were divided into two groups. The intent of these final two columns is to show how the distribution of responses would differ depending on which household member reported for the adults in their household. Single respondents (those not part of a pair) were excluded from the second and third columns of these tables so comparisons to the first column distributions are not recommended.
Table b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members: Row 1 of this table presents the number of matching responses for each question among related and unrelated respondent pairs (columns 1 and 2), and among other household members who did not provide a self-response, but for whom a proxy response was provided (columns 3 and 4). Please note that respondents from single (non-paired) interviews are excluded from this table. Row 2 of this table presents the number of mismatched responses that were off by one response category (this data is not presented for questions with Yes / No response options). Row 3 of this table presents the number of mismatched responses that were two or more response categories off.
Question 1
Round 1
These next questions will help us understand how people in America, interact with and relate to each other, as well as how we work together to make changes in our communities and country.
1. The first few questions focus on how [you/[NAME]] interact with family and friends.
In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
How often did [you/[NAME]] talk to or spend time with friends and family? This may have been in person, over the phone, or through the internet or social media.
Table 1R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
69.2% |
71.4% |
60.7% |
A few times a week |
16.9% |
17.9% |
17.9% |
A few times a month |
9.2% |
10.7% |
10.7% |
Once a month |
3.1% |
0.0% |
7.1% |
Less than once a month |
1.5% |
0.0% |
3.6% |
Not at all |
0.0% |
0.0% |
0.0% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 1R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
5 |
5 |
2 |
2 |
One Category Difference |
5 |
2 |
0 |
1 |
Two or More Categories Difference |
0 |
3 |
1 |
2 |
Question 1
Round 2
These next questions will help us understand how people in America interact with and relate to each other, as well as how we work together to make changes in our communities and country.
1. The first few questions focus on how [you/[NAME]] interact with family and friends in person, over the phone, or through the internet or social media.
In the past 12
months, that is from [FILL CURRENT MONTH] of 2015 until today, how
often did [you/[NAME]] talk to or spend time with
friends and family?
Table 1R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
71.7% |
75.0% |
71.4% |
A few times a week |
21.7% |
21.4% |
21.4% |
A few times a month |
5.0% |
3.6% |
7.1% |
Once a month |
0.0% |
0.0% |
0.0% |
Less than once a month |
1.7% |
0.0% |
0.0% |
Not at all |
0.0% |
0.0% |
0.0% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 1R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
6 |
6 |
2 |
3 |
One Category Difference |
6 |
3 |
1 |
0 |
Two or More Categories Difference |
0 |
1 |
0 |
0 |
Question 2
Round 1
2. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did [you/[NAME]] discuss political, societal, or local issues with friends or family? This may have been in person, over the phone, or through the internet or social media.
Table 2R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
29.2% |
42.9% |
17.9% |
A few times a week |
23.1% |
28.6% |
21.4% |
A few times a month |
27.7% |
17.9% |
39.3% |
Once a month |
6.2% |
7.1% |
3.6% |
Less than once a month |
4.6% |
3.6% |
3.6% |
Not at all |
9.2% |
0.0% |
14.3% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 2R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
2 |
5 |
0 |
1 |
One Category Difference |
4 |
2 |
1 |
2 |
Two or More Categories Difference |
4 |
3 |
2 |
2 |
Question 2
Round 2
2. [In the past 12 months,]
How often did
[you/[NAME]] discuss political, societal, or local issues with
friends or family?
Table 2R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
26.7% |
35.7% |
21.4% |
A few times a week |
33.3% |
17.9% |
39.3% |
A few times a month |
13.3% |
10.7% |
17.9% |
Once a month |
15.0% |
17.9% |
14.3% |
Less than once a month |
5.0% |
10.7% |
0.0% |
Not at all |
6.7% |
7.1% |
7.1% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 2R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
4 |
4 |
2 |
0 |
One Category Difference |
4 |
3 |
0 |
0 |
Two or More Categories Difference |
4 |
3 |
1 |
3 |
Question 3
Round 1
3. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did [you/[NAME]] provide food, housing, money or help for friends or extended family other than [your/his/her] children, parents, and spouses, partners or significant others?
Table 3R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
6.2% |
7.1% |
7.1% |
A few times a week |
9.2% |
10.7% |
10.7% |
A few times a month |
15.4% |
28.6% |
7.1% |
Once a month |
21.5% |
21.4% |
25.0% |
Less than once a month |
16.9% |
10.7% |
14.3% |
Not at all |
29.2% |
17.9% |
35.7% |
Skipped / DK / REF |
1.5% |
3.6% |
0.0% |
Table 3R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
3 |
1 |
0 |
1 |
One Category Difference |
1 |
3 |
0 |
2 |
Two or More Categories Difference |
6 |
6 |
3 |
2 |
Question 3
Round 2
3. (VERSION 1)
[In the past 12 months,]
How often did [you/[NAME]] provide food, housing, money or help for friends or extended family?
Table 3V1R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
16.7% |
14.3% |
17.9% |
A few times a week |
10.0% |
10.7% |
10.7% |
A few times a month |
11.7% |
3.6% |
17.9% |
Once a month |
21.7% |
28.6% |
17.9% |
Less than once a month |
23.3% |
25.0% |
21.4% |
Not at all |
15.0% |
17.9% |
10.7% |
Skipped / DK / REF* |
1.7% |
0.0% |
3.6% |
*One respondent reported DK for another household member.
Table 3V1R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
2 |
3 |
2 |
1 |
One Category Difference |
5 |
5 |
0 |
2 |
Two or More Categories Difference |
5 |
2 |
1 |
0 |
Question 3
Round 2, Continued
3. (VERSION 2)
In the past 12 months, how often did [you/[NAME]] provide food, housing, money or help for friends or extended family? Do not include anything [you do/[NAME does]] for your children, parents, and spouses, partners or significant others even if they do not live with you.
Table 3V2R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=24)* |
Pair Member #1 (n=11) |
Pair Member #2 (n=11) |
Basically every day |
4.2% |
9.1% |
0.0% |
A few times a week |
8.3% |
0.0% |
18.2% |
A few times a month |
29.2% |
18.2% |
36.4% |
Once a month |
12.5% |
18.2% |
9.1% |
Less than once a month |
37.5% |
45.5% |
27.3% |
Not at all |
8.3% |
9.1% |
9.1% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
*The sample size is smaller for this question because respondents only answered this question for themselves, and not for any other household members.
Question 4
Round 1
This next set of questions focuses on how [you/[NAME]] interact with neighbors.
4. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
How often did [you/[NAME]] talk to or spend time with neighbors? This may have been in person, over the phone, or through the internet or social media.
Table 4R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
7.7% |
10.7% |
7.1% |
A few times a week |
24.6% |
28.6% |
28.6% |
A few times a month |
12.3% |
7.1% |
17.9% |
Once a month |
9.2% |
7.1% |
7.1% |
Less than once a month |
26.2% |
32.1% |
17.9% |
Not at all |
20.0% |
14.3% |
21.4% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 4R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
5 |
5 |
1 |
2 |
One Category Difference |
4 |
2 |
1 |
0 |
Two or More Categories Difference |
1 |
3 |
1 |
3 |
Question 4
Round 2
This next set of questions focuses on how [you/[NAME]] interact with your neighbors in person, over the phone, or through the internet or social media.
4. In the past 12
months, how often did [you/[NAME]] have a
conversation or spend time with [you/his/her] neighbors?
Table 4R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
8.3% |
10.7% |
7.1% |
A few times a week |
21.7% |
21.4% |
21.4% |
A few times a month |
18.3% |
17.9% |
17.9% |
Once a month |
18.3% |
21.4% |
14.3% |
Less than once a month |
23.3% |
17.9% |
32.1% |
Not at all |
10.0% |
10.7% |
7.1% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 4R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
3 |
3 |
1 |
2 |
One Category Difference |
6 |
4 |
2 |
1 |
Two or More Categories Difference |
1 |
3 |
0 |
0 |
Question 5
Round 1
5. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did [you/[NAME]] discuss political, societal, or local issues with neighbors? This may have been in person, over the phone, or through the internet or social media.
Table 5R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
1.5% |
3.6% |
0.0% |
A few times a week |
3.1% |
0.0% |
7.1% |
A few times a month |
12.3% |
21.4% |
7.1% |
Once a month |
6.2% |
3.6% |
10.7% |
Less than once a month |
21.5% |
21.4% |
21.4% |
Not at all |
52.3% |
50.0% |
46.4% |
Skipped / DK / REF |
3.1% |
0.0% |
7.1% |
Table 5R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
3 |
4 |
0 |
3 |
One Category Difference |
3 |
4 |
2 |
1 |
Two or More Categories Difference |
4 |
2 |
1 |
1 |
Question 5
Round 2
5. [In the past 12 months,]
How often did
[you/[NAME]] discuss political, societal, or local issues with
[your/his/her] neighbors?
Table 5R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
0.0% |
0.0% |
0.0% |
A few times a week |
8.3% |
14.3% |
3.6% |
A few times a month |
11.7% |
7.1% |
14.3% |
Once a month |
8.3% |
10.7% |
7.1% |
Less than once a month |
21.7% |
25.0% |
21.4% |
Not at all |
50.0% |
42.9% |
53.6% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 5R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
5 |
7 |
1 |
2 |
One Category Difference |
4 |
2 |
2 |
1 |
Two or More Categories Difference |
3 |
1 |
0 |
0 |
Question 6
Round 1
6. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did [you/[NAME]] and [your/his/her] neighbors do favors for each other? By favors, we mean such things as house sitting, watching each other’s children, lending tools, and other things to help each other.
Table 6R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
4.6% |
3.6% |
7.1% |
A few times a week |
1.5% |
3.6% |
0.0% |
A few times a month |
10.8% |
10.7% |
14.3% |
Once a month |
13.8% |
7.1% |
25.0% |
Less than once a month |
24.6% |
25.0% |
17.9% |
Not at all |
44.6% |
50.0% |
35.7% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 6R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
3 |
6 |
1 |
3 |
One Category Difference |
3 |
2 |
2 |
1 |
Two or More Categories Difference |
4 |
2 |
0 |
1 |
Question 6
Round 2
6. (VERSION 1)
[In the past 12 months,]
How often did [you/[NAME]] and [your/his/her] neighbors do favors for each other?
Table 6V1R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
3.3% |
0.0% |
7.1% |
A few times a week |
13.3% |
17.9% |
10.7% |
A few times a month |
15.0% |
10.7% |
17.9% |
Once a month |
26.7% |
32.1% |
21.4% |
Less than once a month |
21.7% |
32.1% |
10.7% |
Not at all |
20.0% |
7.1% |
32.1% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 6V1R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
5 |
4 |
1 |
1 |
One Category Difference |
4 |
4 |
1 |
1 |
Two or More Categories Difference |
3 |
2 |
1 |
1 |
Question 6
Round 2, Continued
6. (VERSION 2)
In the past 12 months, how often did [you/[NAME]] and [your/his/her] neighbors do favors for each other such as house sitting, watching each other’s children, lending tools, and other things to help each other?
Table 6V2R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=24)** |
Pair Member #1 (n=11) |
Pair Member #2 (n=11) |
Basically every day |
0.0% |
0.0% |
0.0% |
A few times a week |
12.5% |
9.1% |
18.2% |
A few times a month |
16.7% |
9.1% |
18.2% |
Once a month |
20.8% |
27.3% |
18.2% |
Less than once a month |
29.2% |
45.5% |
18.2% |
Not at all |
16.7% |
9.1% |
18.2% |
Skipped / DK / REF* |
4.2% |
0.0% |
9.1% |
*One respondent reported DK for themselves.
**The sample size is smaller for this question because respondents only answered this question for themselves, and not for any other household members.
Question 7
Round 1
7. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did [you/[NAME]] get together with other people from [your/his/her] neighborhood to fix a problem or do something positive for [your/his/her] neighborhood or the community?
Table 7R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
40.0% |
32.1% |
46.4% |
No |
58.5% |
64.3% |
53.6% |
Skipped / DK / REF |
1.5% |
3.6% |
0.0% |
Table 7R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
4 |
8 |
0 |
3 |
No Match |
6 |
2 |
3 |
2 |
Question 7
Round 2
7. [In the past 12 months,]
Did [you/[NAME]] get together with [your/his/her] neighbors to do something positive for [your/his/her] neighborhood?
Table 7R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
31.7% |
28.6% |
35.7% |
No |
68.3% |
71.4% |
64.3% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 7R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
10 |
9 |
2 |
3 |
No Match |
2 |
1 |
1 |
0 |
Question 8
Round 1
8. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, how often did [you/[NAME]] talk to or spend time with people from a racial, ethnic or cultural background that is different than [yours/his/hers]? This may have been in person, over the phone, or through the internet or social media.
Table 8R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
43.1% |
53.6% |
39.3% |
A few times a week |
21.5% |
14.3% |
28.6% |
A few times a month |
15.4% |
21.4% |
7.1% |
Once a month |
7.7% |
7.1% |
10.7% |
Less than once a month |
3.1% |
0.0% |
3.6% |
Not at all |
7.7% |
0.0% |
10.7% |
Skipped / DK / REF |
1.5% |
3.6% |
0.0% |
Table 8R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
3 |
3 |
1 |
1 |
One Category Difference |
2 |
3 |
1 |
1 |
Two or More Categories Difference |
5 |
4 |
1 |
3 |
Question 8
Round 2
8. In the past 12 months, how often did [you/[NAME]] talk to or spend time with people from a racial, ethnic or cultural background that is different than [yours/his/hers]? This may have been in person, over the phone, or through the internet or social media.
Table 8R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
53.3% |
53.6% |
60.7% |
A few times a week |
23.3% |
32.1% |
17.9% |
A few times a month |
8.3% |
3.6% |
7.1% |
Once a month |
8.3% |
7.1% |
7.1% |
Less than once a month |
1.7% |
0.0% |
3.6% |
Not at all |
3.3% |
3.6% |
3.6% |
Skipped / DK / REF* |
1.7% |
0.0% |
0.0% |
*One respondent said DK.
Table 8R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
1 |
8 |
3 |
3 |
One Category Difference |
6 |
1 |
0 |
0 |
Two or More Categories Difference |
5 |
1 |
0 |
0 |
Question 9
Round 1
9. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did [you/[NAME]] post [your/his/her] views about political, societal, or local issues on the internet or social media?
Table 9R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
4.6% |
0.0% |
10.7% |
A few times a week |
10.8% |
17.9% |
7.1% |
A few times a month |
18.5% |
14.3% |
17.9% |
Once a month |
4.6% |
7.1% |
3.6% |
Less than once a month |
6.2% |
10.7% |
3.6% |
Not at all |
53.8% |
46.4% |
57.1% |
Skipped / DK / REF |
1.5% |
3.6% |
0.0% |
Table 9R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
3 |
4 |
1 |
4 |
One Category Difference |
1 |
4 |
2 |
1 |
Two or More Categories Difference |
6 |
2 |
0 |
0 |
Question 9
Round 2
9. [In the past 12 months,]
How often did [you/[NAME]] post [your/his/her] views about political, societal, or local issues on the internet or social media?
Table 9R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
1.7% |
0.0% |
3.6% |
A few times a week |
5.0% |
10.7% |
0.0% |
A few times a month |
16.7% |
10.7% |
17.9% |
Once a month |
8.3% |
3.6% |
14.3% |
Less than once a month |
11.7% |
14.3% |
10.7% |
Not at all |
55.0% |
60.7% |
50.0% |
Skipped / DK / REF* |
1.7% |
0.0% |
3.6% |
*One respondent said DK.
Table 9R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
5 |
5 |
3 |
0 |
One Category Difference |
2 |
3 |
0 |
2 |
Two or More Categories Difference |
5 |
2 |
0 |
1 |
Question 10
Round 1
10.[In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did [you/[NAME]] read, watch or listen to news or information about political, societal, or local issues?
Table 10R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
47.7% |
53.6% |
39.3% |
A few times a week |
35.4% |
28.6% |
46.4% |
A few times a month |
6.2% |
10.7% |
0.0% |
Once a month |
1.5% |
3.6% |
0.0% |
Less than once a month |
3.1% |
3.6% |
0.0% |
Not at all |
6.2% |
0.0% |
14.3% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 10R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
7 |
5 |
1 |
2 |
One Category Difference |
1 |
2 |
2 |
2 |
Two or More Categories Difference |
2 |
3 |
0 |
1 |
Question 10
Round 2
10. [In the past 12 months,]
How often did [you/[NAME]] read, watch or listen to news or information about political, societal, or local issues?
Table 10R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
58.3% |
75.0% |
46.4% |
A few times a week |
26.7% |
10.7% |
42.9% |
A few times a month |
6.7% |
3.6% |
7.1% |
Once a month |
3.3% |
7.1% |
0.0% |
Less than once a month |
0.0% |
0.0% |
0.0% |
Not at all |
5.0% |
3.6% |
3.6% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 10R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
6 |
3 |
1 |
2 |
One Category Difference |
3 |
7 |
0 |
1 |
Two or More Categories Difference |
3 |
0 |
2 |
0 |
Question 11
Round 1
11. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did [you/[NAME]] vote in the last local elections, such as for mayor or school board?
Table 11R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
50.8% |
57.1% |
53.6% |
No |
47.7% |
39.3% |
46.4% |
Skipped / DK / REF |
1.5% |
3.6% |
0.0% |
Table 11R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
9 |
6 |
2 |
3 |
No Match |
1 |
4 |
1 |
2 |
Question 11
Round 2
11. [In the past 12 months,]
Did [you/[NAME]] vote in the last local elections, such as for mayor or school board?
Table 11R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
71.7% |
78.6% |
67.9% |
No |
28.3% |
21.4% |
32.1% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 11R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
11 |
8 |
3 |
1 |
No Match |
1 |
2 |
0 |
2 |
Question 12
Round 1
12. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did [you/[NAME]] attend a public meeting to discuss a local issue?
Table 12R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
23.1% |
28.6% |
21.4% |
No |
72.3% |
60.7% |
78.6% |
Skipped / DK / REF |
4.6% |
10.7% |
0.0% |
Table 12R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
4 |
6 |
3 |
4 |
No Match |
6 |
4 |
0 |
1 |
Question 12
Round 2
12. [In the past 12 months,]
Did [you/[NAME]] attend a public meeting, such as a zoning or school board meeting, to discuss a local issue?
Table 12R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
18.3% |
17.9% |
21.4% |
No |
81.7% |
82.1% |
78.6% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 12R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
10 |
5 |
3 |
3 |
No Match |
2 |
5 |
0 |
0 |
Question 13
Round 1
13. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did [you/[NAME]] contact or visit a public official – at any level of government – to express [your/his/her] opinion?
Table 13R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
13.8% |
21.4% |
7.1% |
No |
84.6% |
75.0% |
92.9% |
Skipped / DK / REF |
1.5% |
3.6% |
0.0% |
Table 13R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
6 |
10 |
3 |
4 |
No Match |
4 |
0 |
0 |
1 |
Question 13
Round 2
13. [In the past 12 months,]
Did [you/[NAME]] contact or visit a public official – at any level of government – to express [your/his/her] opinion?
Table 13R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
23.3% |
28.6% |
21.4% |
No |
76.7% |
71.4% |
78.6% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 13R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
11 |
6 |
1 |
2 |
No Match |
1 |
4 |
2 |
1 |
Question 14
Round 1
14. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did [you/[NAME]] decide whether or not to buy products or services based on the social or political values of the company that provides them?
Table 14R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
43.1% |
53.6% |
39.3% |
No |
53.8% |
42.9% |
60.7% |
Skipped / DK / REF |
3.1% |
3.6% |
0.0% |
Table 14R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
4 |
8 |
2 |
4 |
No Match |
6 |
2 |
1 |
1 |
Question 14
Round 2
14. [In the past 12 months,]
Did the social or political values of a company influence [your/NAME’S] decision of whether or not to buy products or services provided by that company?
Table 14R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
58.3% |
53.6% |
60.7% |
No |
40.0% |
46.4% |
39.3% |
Skipped / DK / REF* |
1.7% |
0.0% |
0.0% |
*One respondent reported DK for another household member.
Table 14R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
10 |
5 |
2 |
1 |
No Match |
2 |
5 |
1 |
2 |
Question 15
Round 1
This last set of questions focuses on local and national groups, organizations and associations that [you/[NAME]] may belong to. Examples include community groups, like a neighborhood watch or parent-teacher association; civic or service organizations; religious or spiritual communities; recreational groups, like a book club or sports league; professional associations or unions; and political or advocacy groups.
Participation in these groups could be in-person, online, or both.
15. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did [you/[NAME]] belong to any groups, organizations, or associations?
Table 15R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
67.7% |
75.0% |
64.3% |
No |
32.3% |
25.0% |
35.7% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 15R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
8 |
5 |
3 |
2 |
No Match |
2 |
5 |
0 |
3 |
Question 15
Round 2
This last set of questions focuses on local and national groups, organizations and associations that [you/NAME] may belong to. Examples include community groups; civic or service organizations; religious or spiritual communities; recreational groups; and political or advocacy groups.
Participation in these groups could be in-person, online, or both.
In the past 12 months, did [you/[NAME]] belong to any groups, organizations, or associations?
Table 15R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
75.0% |
78.6% |
71.4% |
No |
25.0% |
21.4% |
28.6% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 15R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
7 |
6 |
2 |
3 |
No Match |
5 |
4 |
1 |
0 |
Question 15a
Round 1
15a. How many groups, organizations, or associations would you say [you/[NAME]] have belonged to over the past 12 months?
Table 15aR1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
1 group |
16.9% |
7.1% |
25.0% |
2 groups |
26.2% |
25.0% |
28.6% |
3 groups |
7.7% |
10.7% |
7.1% |
4 groups |
3.1% |
7.1% |
0.0% |
5 groups |
6.2% |
7.1% |
3.6% |
6 groups |
1.5% |
3.6% |
0.0% |
Other responses* |
4.6% |
10.7% |
0.0% |
Skipped / DK / REF |
33.8% |
28.6% |
35.7% |
*Other responses include: 8-9, “At least 1”, and “A few”
Table 15aR1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
4 |
1 |
1 |
3 |
One Category Difference |
2 |
3 |
2 |
0 |
Two or More Categories Difference |
4 |
6 |
0 |
2 |
Question 15a
Round 2
15a. How many groups, organizations, or associations would you say [you/[NAME]] have belonged to over the past 12 months?
Table 15aR2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
1 group |
20.0% |
25.0% |
10.7% |
2 groups |
26.7% |
17.9% |
35.7% |
3 groups |
11.7% |
10.7% |
14.3% |
4 groups |
5.0% |
7.1% |
3.6% |
5 groups |
6.7% |
14.3% |
0.0% |
6 groups |
1.7% |
3.6% |
0.0% |
Other responses* |
1.7% |
0.0% |
3.6% |
Skipped / DK / REF** |
26.7% |
21.4% |
32.1% |
*Other responses include: “at least 2”
**One respondent reported DK for another household member, and 15 respondents skipped this question.
Table 15aR2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members*
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
3 |
1 |
1 |
2 |
One Category Difference |
1 |
3 |
0 |
0 |
Two or More Categories Difference |
7 |
6 |
2 |
1 |
*One related pair of respondents was excluded from this table. One member of the pair reported “4” for their number of groups, and the other member of the pair reported “at least 2” by proxy for the first person.
Question 15a1
Round 1
15a1. Thinking about the group, organization, or association with which [you/[NAME]] are most active, which best describes the proportion of [your/his/her] in-person activity to online activity?
Table 15a1R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
All activity is in person |
29.2% |
32.1% |
25.0% |
Activity is more in-person than online |
26.2% |
21.4% |
32.1% |
Activity is evenly split between in-person and online |
4.6% |
7.1% |
3.6% |
Activity is more online than in-person |
4.6% |
10.7% |
0.0% |
All activity is online |
0.0% |
0.0% |
0.0% |
I am a member but not active with any groups, organizations or associations |
1.5% |
0.0% |
3.6% |
Skipped / DK / REF |
33.8% |
28.6% |
35.7% |
Table 15a1R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
2 |
2 |
2 |
3 |
One Category Difference |
5 |
3 |
1 |
0 |
Two or More Categories Difference |
3 |
5 |
0 |
2 |
Question 15a1
Round 2
15a1. Thinking about the group, organization, or association with which [you/[NAME]] are most active, which best describes the proportion of [your/his/her] in-person activity to online activity?
Table 15a1R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
All activity is in person |
33.3% |
35.7% |
32.1% |
Activity is more in-person than online |
25.0% |
21.4% |
25.0% |
Activity is evenly split between in-person and online |
11.7% |
17.9% |
7.1% |
Activity is more online than in-person |
5.0% |
7.1% |
3.6% |
All activity is online |
0.0% |
0.0% |
0.0% |
I am a member but not active with any groups, organizations or associations |
1.7% |
0.0% |
3.6% |
Skipped / DK / REF* |
23.3% |
17.9% |
28.6% |
*Fourteen respondents skipped this question.
Table 15a1R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
1 |
5 |
2 |
2 |
One Category Difference |
3 |
2 |
0 |
1 |
Two or More Categories Difference* |
8 |
3 |
1 |
0 |
*One related pair counted as ‘two or more categories of difference’ had similar answers. One person reported that they were ‘a member but not active with any groups.’ The other person reported by proxy that this person was not involved with any groups, therefore skipping this question.
Question 16
Round 1
16. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
Did [you/[NAME]] volunteer for a group, organization, or association?
Table 16R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
53.8% |
71.4% |
46.4% |
No |
44.6% |
25.0% |
53.6% |
Skipped / DK / REF |
1.5% |
3.6% |
0.0% |
Table 16R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
8 |
4 |
2 |
4 |
No Match |
2 |
6 |
1 |
1 |
Question 16
Round 2
16. In the past 12 months, did [you/[NAME]] volunteer for a group, organization, or association?
Table 16R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
78.3% |
89.3% |
71.4% |
No |
21.7% |
10.7% |
28.6% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 16R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
10 |
6 |
2 |
3 |
No Match |
2 |
4 |
1 |
0 |
Question 16a
Round 1
16a. How often did [you/[NAME]] volunteer?
Table 16aR1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
1.5% |
3.6% |
0.0% |
A few times a week |
9.2% |
10.7% |
10.7% |
A few times a month |
12.3% |
14.3% |
7.1% |
Once a month |
10.8% |
17.9% |
7.1% |
Less than once a month |
18.5% |
21.4% |
21.4% |
Not at all |
0.0% |
0.0% |
0.0% |
Skipped / DK / REF |
47.7% |
32.1% |
53.6% |
Table 16aR1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
5 |
4 |
2 |
4 |
One Category Difference |
1 |
0 |
1 |
0 |
Two or More Categories Difference |
4 |
6 |
0 |
1 |
Question 16a
Round 2
16a. How often did [you/[NAME]] volunteer?
Table 16aR2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Basically every day |
1.7% |
3.6% |
0.0% |
A few times a week |
16.7% |
10.7% |
21.4% |
A few times a month |
23.3% |
25.0% |
25.0% |
Once a month |
23.3% |
28.6% |
21.4% |
Less than once a month |
15.0% |
21.4% |
7.1% |
Not at all |
0.0% |
0.0% |
0.0% |
Skipped / DK / REF* |
20.0% |
10.7% |
25.0% |
*Twelve respondents skipped this question.
Table 16aR2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
3 |
5 |
1 |
2 |
One Category Difference |
6 |
0 |
2 |
1 |
Two or More Categories Difference |
3 |
5 |
0 |
0 |
Question 16b
Round 1
16b. Approximately how many hours did [you/[NAME]] volunteer?
Table 16bR1-a1: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2 – Annual Responses Only*
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Not reporting annual hours |
3.1% |
7.1% |
0.0% |
1 to 14 hours |
9.2% |
10.7% |
10.7% |
15 to 49 hours |
21.5% |
25.0% |
17.9% |
50 to 99 hours |
6.2% |
7.1% |
7.1% |
100 to 499 hours |
10.8% |
17.9% |
7.1% |
500 or more hours |
0.0% |
0.0% |
0.0% |
Skipped / DK / REF** |
49.2% |
32.1% |
57.1% |
*For this table, any responses not reported in an annual format (e.g., “two hours each month” rather than “24 hours a year”) were included as ‘not reporting annual hours’.
**One respondent reported DK for another household member.
Table 16bR1-a2: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2 - All Codeable Responses*
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Not reporting annual hours |
0.0% |
0.0% |
0.0% |
1 to 14 hours |
9.2% |
10.7% |
10.7% |
15 to 49 hours |
23.1% |
28.6% |
17.9% |
50 to 99 hours |
7.7% |
10.7% |
7.1% |
100 to 499 hours |
10.8% |
17.9% |
7.1% |
500 or more hours |
0.0% |
0.0% |
0.0% |
Skipped / DK / REF |
49.2% |
32.1% |
57.1% |
*For this table, only responses not reported in an annual format (e.g., “two hours each month” rather than “24 hours a year”) that could not be coded into an annual format were included as ‘not reporting annual hours’ (e.g. using 16a or probe responses).
Table 16bR1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members – All Codeable Responses
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
3 |
2 |
1 |
4 |
Within the same range |
2 |
0 |
1 |
0 |
Not within the same range |
5 |
8 |
1 |
1 |
*For this table, the results were based off of table 16bR1-a2.
Question 16b
Round 2
16b. Approximately how many hours did [you/[NAME]] volunteer?
Table 16bR2-a1: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2 – Annual Responses Only*
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Not reporting annual hours |
31.7% |
39.3% |
25.0% |
1 to 14 hours |
5.0% |
10.7% |
0.0% |
15 to 49 hours |
11.7% |
17.9% |
3.6% |
50 to 99 hours |
8.8% |
3.6% |
14.3% |
100 to 499 hours |
15.8% |
10.7% |
21.4% |
500 or more hours |
5.0% |
7.1% |
3.6% |
Skipped / DK / REF** |
23.3% |
10.7% |
32.1% |
*For this table, any responses not reported in an annual format (e.g., “two hours each month” rather than “24 hours a year”) were included as ‘not reporting annual hours’.
**One respondent reported DK for another household member.
Table 16bR2-a2: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2 - All Codeable Responses*
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Not reporting annual hours |
15.0% |
10.7% |
21.4% |
1 to 14 hours |
5.0% |
10.7% |
0.0% |
15 to 49 hours |
18.3% |
28.6% |
7.1% |
50 to 99 hours |
17.5% |
21.4% |
14.3% |
100 to 499 hours |
17.5% |
10.7% |
21.4% |
500 or more hours |
5.0% |
7.1% |
3.6% |
Skipped / DK / REF |
23.3% |
10.7% |
32.1% |
*For this table, only responses not reported in an annual format (e.g., “two hours each month” rather than “24 hours a year”) that could not be coded into an annual format were included as ‘not reporting annual hours’ (e.g. using 16a or probe responses).
Question 16b
Round 2
Table 16bR2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members – All Codeable Responses
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
0 |
0 |
1 |
1 |
Within the same range |
3 |
3 |
0 |
1 |
Not within the same range |
9 |
7 |
2 |
1 |
*For this table, the results were based off of table 16bR2-a2.
Question 17
Round 1
17. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
Did [you/[NAME]] give money, assets, or property with a combined value of more than $25 to a political party, campaign, or organization?
Table 17R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
20.0% |
32.1% |
14.3% |
No |
75.4% |
57.1% |
85.7% |
Skipped / DK / REF |
4.6% |
10.7% |
0.0% |
Table 17R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
8 |
7 |
2 |
4 |
No Match |
2 |
3 |
1 |
1 |
Question 17
Round 2
17. [In the past 12 months,]
Did [you/[NAME]] give money or possessions with a combined value of more than $25 to a political organization, party, or campaign?
Table 17R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=60) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
18.3% |
21.4% |
17.9% |
No |
81.7% |
78.6% |
82.1% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
Table 17R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=12) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=3) |
Perfect Match |
9 |
6 |
2 |
2 |
No Match |
3 |
4 |
1 |
1 |
Question 18
Round 1
18. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did [you/[NAME]] give money, assets, or property with a combined value of more than $25 to a charitable or religious organization or group?
Table 18R1-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=65) |
Pair Member #1 (n=28) |
Pair Member #2 (n=28) |
Yes |
52.3% |
64.3% |
50.0% |
No |
43.1% |
25.0% |
50.0% |
Skipped / DK / REF |
4.6% |
10.7% |
0.0% |
Table 18R1-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=10) |
Unrelated Household Respondents (n=10) |
Other Related Household Members (n=3) |
Other Unrelated Household Members (n=5) |
Perfect Match |
8 |
3 |
2 |
1 |
No Match |
2 |
7 |
1 |
4 |
Question 18
Round 2
18. (VERSION 1)
[In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did [you/[NAME]] give money or possessions with a combined value of more than $25 to a non-political group or organization, such as a charity, school, or religious organization?
Table 18V1R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=26)* |
Pair Member #1 (n=12) |
Pair Member #2 (n=12) |
Yes |
80.8% |
75.0% |
91.7% |
No |
19.2% |
25.0% |
8.3% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
*This table includes respondents who heard Version 1 first, both their self-responses and their responses for other household members.
Table 18V1R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=6)* |
Unrelated Household Respondents (n=4) |
Other Related Household Members (n=2) |
Other Unrelated Household Members (n=0) |
Perfect Match |
6 |
1 |
1 |
0 |
No Match |
0 |
3 |
1 |
0 |
*This table includes respondents who heard Version 1 first, both their self-responses and their responses for other household members.
Question 18
Round 2, Continued
18. (VERSION 2)
[In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did [you/[NAME]] give money or possessions with a combined value of more than $25 to any other group or organization?
Table 18V2R2-a: Frequency Distribution for All Respondents, and Members of Respondent Pairs #1 and #2
|
All Respondents (n=34)* |
Pair Member #1 (n=16) |
Pair Member #2 (n=16) |
Yes |
61.8% |
75.0% |
50.0% |
No |
38.2% |
25.0% |
50.0% |
Skipped / DK / REF |
0.0% |
0.0% |
0.0% |
*This table includes respondents who heard Version 2 first, both their self-responses and their responses for other household members.
Table 18V2R2-b: Difference in Reporting Among Related and Unrelated Household Respondents and Other Related and Unrelated Household Members
|
Related Household Respondents (n=6) |
Unrelated Household Respondents (n=6) |
Other Related Household Members (n=1) |
Other Unrelated Household Members (n=3) |
Perfect Match |
5 |
2 |
0 |
1 |
No Match |
1 |
4 |
1 |
2 |
*This table includes respondents who heard Version 2 first, both their self-responses and their responses for other household members.
Table 18V1-V2: Frequency Distribution for All Respondents Who Saw Each Version First
|
Version 1 Responses (Respondents who Saw Version 1 First) (n=11)* |
Version 2 Responses (Respondents who Saw Version 2 First) (n=13) |
Yes |
90.9% |
92.3% |
No |
9.1% |
7.7% |
Skipped / DK / REF |
0.0% |
0.0% |
*This table includes the self-responses of respondents who heard Version 1 first (first column) and Version 2 first (second column). Note that when only self-responses are included in the distribution, the distributions for Version 1 and Version 2 are very similar. This suggests that the discrepancy in the distribution in Table 18V1-a compared to Table 18V2-a is caused by the responses for other household members. Given that Table 18V2-a includes the responses for a greater number of other household members than Table 18V1-a (21 vs. 15 other household members), the distribution in Table 18V2-a is more skewed than the distribution in Table 18V1-a.
Berger, B. (2009). Political theory, political science, and the end of civic engagement. Perspective on Politics, 7(2), 335-350.
Blair, J., Menon, G., & Bickart, B. (1991). Measurement effects in self vs. proxy responses to survey questions: An information-processing perspective. In P.P. Biemer, R.M. Groves, L.E. Lyberg, N.A. Mathiowetz, & S. Sudman (Eds.), Measurement Errors in Surveys (145-166). Hoboken, NJ: John Wiley & Sons, Inc.
Corporation for National and Community Service. (2016). Redesign of CNCS-funded supplements-concept paper. Unpublished manuscript.
Ehrlich, T. (2000). Preface. In T. Ehrlich (Eds.), Civic Responsibility and Higher Education (VI-X). Westport, CT: The American Council on Education and The Orynx Press.
Fukuyama, F. (2002). Social capital and development: The coming agenda. SAIS Review, 22(1), 23-37.
Jenson, J. (1998). Mapping Social Cohesion: The State of Canadian Research. Montreal, Canada: Canadian Policy Research Networks Inc.
National Research Council (2014). Civic engagement and social cohesion: Measuring dimensions of social capital to inform policy. Washington, DC: The National Academies Press.
Teorell, J., Torcal, M., & Montero, J. Political participation: Mapping the terrain. In J.W. Van Deth, J.R. Montero, & A. Westholm (Eds.), Citizen and involvement in European democracies: A comparative analysis (335-357). New York: Routledge.
United States Bureau of Labor Statistics & United States Census Bureau. (2006). Design and Methodology: Current Population Survey. Retrieved from http://www.census.gov/prod/2006pubs/tp-66.pdf
United States Census Bureau. (2016). Supplemental Surveys. Retrieved from http://www.census.gov/programs-surveys/cps/about/supplemental-surveys.html
Willis, G.B. (2005). Cognitive interviewing: A tools improving questionnaire design. Thousand Oaks, CA: Sage.
* Please note that only the self-response versions of the questionnaires are included in this section. The proxy response versions are reworded slightly (i.e., pronouns are changed).
These next questions will help us understand how people in America, interact with and relate to each other, as well as how we work together to make changes in our communities and country.
1. The first few questions focus on how you interact with family and friends.
In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
How often did you talk to or spend time with friends and family? This may have been in person, over the phone, or through the internet or social media.
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
2. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did you discuss political, societal, or local issues with friends or family? This may have been in person, over the phone, or through the internet or social media.
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
3. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did you provide food, housing, money or help for friends or extended family other than your children, parents, and spouses, partners or significant others?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
This next set of questions focuses on how you interact with neighbors.
4. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
How often did you talk to or spend time with neighbors? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
5. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did you discuss political, societal, or local issues with neighbors? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
6. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did you and your neighbors do favors for each other? By favors, we mean such things as house sitting, watching each other’s children, lending tools, and other things to help each other.
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
7. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did you get together with other people from your neighborhood to fix a problem or do something positive for your neighborhood or the community?
(1) Yes
(2) No
8. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, how often did you talk to or spend time with people from a racial, ethnic or cultural background that is different than yours? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
9. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did you post your views about political, societal, or local issues on the internet or social media?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
10.[In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
How often did you read, watch or listen to news or information about political, societal, or local issues?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
11. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did you vote in the last local elections, such as for mayor or school board?
(1) Yes
(2) No
12. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did you attend a public meeting to discuss a local issue?
(1) Yes
(2) No
13. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did you contact or visit a public official – at any level of government – to express your opinion?
(1) Yes
(2) No
14. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did you decide whether or not to buy products or services based on the social or political values of the company that provides them?
(1) Yes
(2) No
This last set of questions focuses on local and national groups, organizations and associations that you may belong to. Examples include community groups, like a neighborhood watch or parent-teacher association; civic or service organizations; religious or spiritual communities; recreational groups, like a book club or sports league; professional associations or unions; and political or advocacy groups.
Participation in these groups could be in-person, online, or both.
15. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did you belong to any groups, organizations, or associations?
(1) Yes
(2) No --- SKIP to Q16
15a. How many groups, organizations, or associations would you say you have belonged to over the past 12 months?
_________________ Number of groups / organizations / associations
[IF Q15a=0 SKIP TO Q16]
15a1. Thinking about the group, organization, or association with which you are most active, which best describes the proportion of your in-person activity to online activity?
READ ALL RESPONSE OPTIONS
(1) All activity is in person
(2) Activity is more in-person than online
(3) Activity is evenly split between in-person and online
(4) Activity is more online than in-person
(5) All activity is online
(6) I am a member but not active with any groups, organizations or associations.
16. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
Did you volunteer for a group, organization, or association?
(1) Yes
(2) No --- SKIP TO Q17
16a. How often did you volunteer?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all --- SKIP TO Q17
16b. Approximately how many hours did you volunteer?
_____________ Hours
17. In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today,
Did you give money, assets, or property with a combined value of more than $25 to a political party, campaign, or organization?
(1) Yes
(2) No
18. [In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today]
Did you give money, assets, or property with a combined value of more than $25 to a charitable or religious organization or group?
(1) Yes
(2) No
[IF THERE ARE ADDITIONAL RESPONDENTS IN THE HOUSEHOLD GO TO THE NEXT PAGE]
[IF THERE ARE NO ADDITIONAL RESPONDENTS IN THE HOUSEHOLD] That brings us to the end of the survey. Thank you for participating in this survey.
These next questions will help us understand how people in America interact with and relate to each other, as well as how we work together to make changes in our communities and country.
1. The first few questions focus on how you interact with family and friends in person, over the phone, or through the internet or social media.
In the past 12
months, that is from [FILL CURRENT MONTH] of 2015 until today, how
often did you talk to or spend time with friends and family?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
2. [In the past 12 months,]
How often did you
discuss political, societal, or local issues with friends or family?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
3. [In the past 12 months,]
How often did you provide food, housing, money or help for friends or extended family?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
This next set of questions focuses on how you interact with your neighbors in person, over the phone, or through the internet or social media.
4. In the past 12
months, how often did you have a conversation or spend time
with your neighbors?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
5. [In the past 12 months,]
How often did you
discuss political, societal, or local issues with your neighbors?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
6. [In the past 12 months,]
How often did you and your neighbors do favors for each other?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
7. [In the past 12 months,]
Did you get together with your neighbors to do something positive for your neighborhood?
(1) Yes
(2) No
8. In the past 12 months, how often did you talk to or spend time with people from a racial, ethnic or cultural background that is different than yours? This may have been in person, over the phone, or through the internet or social media.
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
9. [In the past 12 months,]
How often did you post your views about political, societal, or local issues on the internet or social media?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
10. [In the past 12 months,]
How often did you read, watch or listen to news or information about political, societal, or local issues?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
11. [In the past 12 months,]
Did you vote in the last local elections, such as for mayor or school board?
(1) Yes
(2) No
12. [In the past 12 months,]
Did you attend a public meeting, such as a zoning or school board meeting, to discuss a local issue?
(1) Yes
(2) No
13. [In the past 12 months,]
Did you contact or visit a public official – at any level of government – to express your opinion?
(1) Yes
(2) No
14. [In the past 12 months,]
Did the social or political values of a company influence your decision of whether or not to buy products or services provided by that company?
(1) Yes
(2) No
This last set of questions focuses on local and national groups, organizations and associations that you may belong to. Examples include community groups; civic or service organizations; religious or spiritual communities; recreational groups; and political or advocacy groups.
Participation in these groups could be in-person, online, or both.
15. In the past 12 months, did you belong to any groups, organizations, or associations?
(1) Yes
(2) No --- SKIP to Q16
15a. How many groups, organizations, or associations would you say you have belonged to over the past 12 months?
_________________ Number of groups / organizations / associations
[IF Q15a=0 SKIP TO Q16]
15a1. Thinking about the group, organization, or association with which you are most active, which best describes the proportion of your in-person activity to online activity?
READ ALL RESPONSE OPTIONS
(1) All activity is in person
(2) Activity is more in-person than online
(3) Activity is evenly split between in-person and online
(4) Activity is more online than in-person
(5) All activity is online
(6) I am a member but not active with any groups, organizations or associations.
16. In the past 12 months, did you volunteer for a group, organization, or association?
(1) Yes
(2) No --- SKIP TO Q17
16a. How often did you volunteer?
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all --- SKIP TO Q17
16b. Approximately how many hours did you volunteer?
_____________ Hours
17. [In the past 12 months,]
Did you give money or possessions with a combined value of more than $25 to a political organization, party, or campaign?
(1) Yes
(2) No
18. [CHOOSE EITHER VERSION 1 OR VERSION 2 FOR THE WHOLE QUESTIONNAIRE BEFORE READING.]
[In the past 12 months,]
[V1:] Did you give money or possessions with a combined value of more than $25 to a non-political group or organization, such as a charity, school, or religious organization?
[V2:] Did you give money or possessions with a combined value of more than $25 to any other group or organization?
(1) Yes
(2) No
[IF THERE ARE ADDITIONAL RESPONDENTS IN THE HOUSEHOLD GO TO THE NEXT PAGE]
[IF THERE ARE NO ADDITIONAL RESPONDENTS IN THE HOUSEHOLD] That brings us to the end of the survey. Thank you for participating in this survey.
These next questions will help us understand how people in America interact with and relate to each other, as well as how we work together to make changes in our communities and country.
1. The first few questions focus on how you interact with family and friends in person, over the phone, or through the internet or social media.
In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, how often did you talk to or spend time with friends and family?
[READ ALL RESPONSE OPTIONS]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
2. [In the past 12 months,] how often did you discuss political, societal, or local issues with friends or family?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
3. [In the past 12 months,] how often did you provide food, housing, money or help for friends or extended family? Do not include anything you do for your children, parents, and spouses, partners or significant others even if they do not live with you.
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
This next set of questions focuses on how you interact with your neighbors in person, over the phone, or through the internet or social media.
4. In the past 12 months, how often did you have a conversation or spend time with your neighbors?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
5. [In the past 12 months,] how often did you discuss political, societal, or local issues with your neighbors?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
6. [In the past 12 months,] how often did you and your neighbors do favors for each other such as house sitting, watching each other’s children, lending tools, and other things to help each other.
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
7. [In the past 12 months,] did you get together with other people from your neighborhood to do something positive for your neighborhood or the community?
(1) Yes
(2) No
8. In the past 12 months, how often did you talk to or spend time with people from a racial, ethnic or cultural background that is different than yours? This may have been in person, over the phone, or through the internet or social media.
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
9. [In the past 12 months,] how often did you post your views about political, societal, or local issues on the internet or social media?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
10. [In the past 12 months,] how often did you read, watch or listen to news or information about political, societal, or local issues?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
11. [In the past 12 months,] did you vote in the last local elections, such as for mayor or school board?
(1) Yes
(2) No
12. [In the past 12 months,] did you attend a public meeting, such as a zoning or school board meeting, to discuss a local issue?
(1) Yes
(2) No
13. [In the past 12 months,] did you contact or visit a public official – at any level of government – to express your opinion?
(1) Yes
(2) No
14. [In the past 12 months,] did you buy or boycott a product based on a company's political values or business practices?
(1) Yes
(2) No
This next set of questions focuses on local and national groups, organizations and associations that you may belong to. Examples include community groups; civic or service organizations; religious or spiritual communities; recreational groups; and political or advocacy groups.
Participation in these groups could be in-person, online, or both.
15. In the past 12 months, did you belong to any groups, organizations, or associations?
(1) Yes
(2) No --- SKIP to Q15
15a. How many groups, organizations, or associations would you say you have belonged to over the past 12 months?
_________________ Number of groups / organizations / associations
[IF Q14a=0 SKIP TO Q15]
15a1. Thinking about the group, organization, or association with which you are most active, would you say –
[READ ALL RESPONSE OPTIONS]
(1) All activity is in person
(2) Activity is more in-person than online
(3) Activity is evenly split between in-person and online
(4) Activity is more online than in-person
(5) All activity is online, or
(6) You are a member but not active with any groups, organizations or associations.
16. In the past 12 months, did you spend any time volunteering for any organization or association?
(1) Yes
(2) No --- SKIP TO Q16
16a. How often did you volunteer?
[READ ALL RESPONSE OPTIONS]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all --- SKIP TO Q16
16b. In the past 12 months, approximately how many hours did you volunteer?
_____________ Hours
17. [In the past 12 months,] did you give money or possessions with a combined value of more than $25 to a political organization, party, or campaign?
(1) Yes
(2) No
18. [In the past 12 months,] did you give money or possessions with a combined value of more than $25 to a non-political group or organization, such as a charity, school, or religious organization?
(1) Yes
(2) No
[IF THERE ARE ADDITIONAL RESPONDENTS IN THE HOUSEHOLD GO TO THE NEXT PAGE]
[IF THERE ARE NO ADDITIONAL RESPONDENTS IN THE HOUSEHOLD] That brings us to the end of the survey. Thank you for participating in this survey.
Civic Engagement and Volunteerism Instrument Testing
Cognitive Interview Protocol
Participant ID #: ________________________
Interview Date: |__|__| / |__|__| / |__|__|__|__| (mm/dd/yyyy)
Interviewer initials: _____
Start Time: ____________ AM / PM End Time: ____________ AM / PM
Introduction
Hello, my name is ________________, and I work for the Census Bureau. Thank you for agreeing to participate in our study.
The Census Bureau is working with the Corporation for National and Community Service to develop new questions for a supplemental survey to the Current Population Survey. Before surveys are conducted, it’s important to try out questions with the help of people such as yourself. The survey asks questions about your household, yourself, and other people who live with you.
It is important that the questions make sense, are easy to answer, and that everyone understands the questions the same way. If you agree to take part in this study, I will read you the questions as if I were an interviewer contacting you at your home. After I ask you the survey questions, I will ask some follow-up questions about your answers and what you understood the questions to mean. There are no right or wrong answers. Our purpose is not to compile information about you. Instead, your interview, along with those of others, will show us how to improve these questions for the survey.
Informed Consent
HAND RESPONDENT 1 COPY OF THE CONSENT FORM.
Before we start, I would like you to read over the document in front of you. This document explains a little bit about this interview and provides information about your rights as a participant, such as that all information you provide is confidential and we won’t use your name or specific circumstances in any report. It also asks for your permission to have this session audio recorded so that I can concentrate on you what are saying rather than having to take extensive notes. Please ask me any questions you have about this document. Once you have finished reading the document, please sign and date it.
PARTICIPANT READS FORM THEN SIGNS AND DATES FORM.
INTERVIEWER SIGNS AND DATES FORM.
Thank you for signing the consent form. I will also sign this form to show that I agree to everything in the form. At the end of the interview, I’ll be sure to give you a copy for you to take with you.
IF PARTICIPANT PROVIDES CONSENT TO HAVE THE SESSION AUDIO-TAPED: I will now turn on the audio recorder.
Your participation in this interview is very important because it will help the Census Bureau with improving these questions. Your participation in this interview is voluntary, and you may decline to answer any question, or stop the interview at any time. We are scheduled to be here for about 60 minutes, and I won’t keep you any longer. As a thank you for your help, we will give you $40 after the interview is completed.
Before we begin, do you have any questions about the process?
Questionnaire
ADMINISTER ROSTER QUESTIONNAIRE AND CEV SURVEY TO RESPONDENT / RESPONDENTS.
Retrospective Probing
Now I’d like to ask you a few questions about some of the questions you just answered.
Q1, PAGE 1: TALK / SPEND TIME WITH FAMILY / FRIENDS
Research Questions:
Who is respondent including in their response?
What methods of communication are relevant?
Person 1 Probes [ASK ALL RESPONDENTS]
The first question I asked was, “In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, how often did you … Talk to or spend time with friends and family? This may have been in person, over the phone, or through the internet or social media,” and you answered [REPEAT PERSON 1’S ANSWER].
How did you come up with your answer for this question?
Who did you consider in your answer?
[IF NEEDED] Do these people live nearby, or further away? Does distance matter?
[IF NEEDED] Did you include any friends from your work?
Do you consider interacting with friends and family through the internet or social media to be talking or spending time with them?
Are there any other ways that you communicate with friends and family that we didn’t ask about?
This question asks about whether you talk or spend time with friends and family during the past 12 months. Would your answer have changed if we asked about the past year instead?
Q2, PAGE 1: POLITICAL, SOCIETAL, LOCAL ISSUES WITH FAMILY / FRIENDS
Research Questions:
What is respondent’s understanding of societal, political, and local issues?
Does the word “discuss” suggest a one- or two-sided conversation?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was “… How often did you … Discuss political, societal, or local issues with friends or family?” And you answered [REPEAT PERSON 1’S ANSWER].
[IF “BASICALLY EVERY DAY” OR “A FEW TIMES A WEEK”] How did you come up with your answer?
What does the word “discuss” mean to you in this question?
[IF NEEDED] Does posting comments online count as discussing something?
What does the phrase “societal issues” mean to you in this question?
What is an example of a societal issue?
What would you say is the difference between “societal issues” and “social issues”?
This question also asked about “political issues” and “local issues.” Can you give me an example of what you would consider a political issue? What about a local issue?
Q3, PAGE 1: PROVIDE FOR / HELP FRIENDS / EXTENDED FAMILY
Research Questions:
Who are respondents including in their response?
What does “help” mean?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was “How often did you … Provide food, housing, money or help for friends or extended family other than your children, parents, and spouses, partners or significant others?” And you answered [REPEAT PERSON 1’S ANSWER].
[IF NOT “NOT AT ALL”] Who were you thinking of when you answered this question?
What does the phrase “extended family” mean to you in this question?
What does the word “help” mean to you in the phrase “provide food, housing, money, or help”?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTIONS 1, 2, 3.
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q1 RESPONSE] for the first question, [Q2 RESPONSE] for the second question, and [Q3 RESPONSE] for the third question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT]: Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME 2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q4, PAGE 2: TALK / SPEND TIME WITH NEIGHBORS
Research Questions:
Who does respondent consider to be his/her neighbors?
What does “talk to” mean in this question?
Person 1 Probes [ASK ALL RESPONDENTS]
Now thinking back to questions I asked about you, the next question I asked was “How often did you … Talk to or spend time with neighbors? This may have been in person, over the phone, or through the internet or social media,” and you answered [REPEAT PERSON 1’S ANSWER].
Who did you consider your neighbors to be?
[IF NEEDED] Is this determined by how close they live to you?
[IF NEEDED] How close to you would someone need to live for you to consider them your neighbor
If you were Facebook friends with a neighbor but never talked to them in person, would you answer “Yes” to this question?
What does the phrase “talk to” mean to you in this question?
[IF NEEDED] Does just saying “hello” count, or would you need to have a conversation?
NO PROBES FOR Q5. NOTE ANY PROBLEMS WITH ADMINISTRATION.
Q6, PAGE 2: DO FAVORS FOR NEIGHBORS
Research Questions:
What type of favors come to mind?
Does respondent think the question implies reciprocity?
Person 1 Probes [ASK ALL RESPONDENTS]
I also asked you “How often did you … and your neighbors do favors for each other? By favors we mean such things as house sitting, watching each other’s children, lending tools, and other things to help each other,” and you answered [REPEAT PERSON 1’S ANSWER].
[IF “NOT AT ALL”] What types of favors were you thinking of when I asked you this question?
[IF NEEDED] What about pet sitting?
[IF NOT “NOT AT ALL”] Can you tell me more about what you did?
[IF NEEDED] Can you give me an example of a favor that you did?
[IF NEEDED] What about a favor your neighbor did for you?
When you answered this question, were you thinking only about times that you did favors for your neighbors, or were you also thinking about times that your neighbors did favors for you?
Q7, PAGE 2: FIX PROBLEM / DO SOMETHING FOR COMMUNITY
Research Questions:
What, if anything, do respondents see as the difference between Questions 6 and 7?
Does the word “community” influence the context of the question?
Person 1 Probes [ASK ALL RESPONDENTS]
Next I asked “Did you … get together with other people from your neighborhood to fix a problem or do something positive for your neighborhood or community?” And you answered [REPEAT PERSON 1’S ANSWER].
What does the phrase “fix a problem” mean to you in this question? What about “do something positive”?
What does “community” mean to you in this question?
Were you thinking about favors that were done by the whole neighborhood generally or by individuals specifically?
The last question I asked you about was whether you and your neighbors do favors for each other. Do you see any difference between that question and this one? [IF NEEDED: SHOW RESPONDENT Q4,5,6 HANDOUT AND POINT TO Q6]
[IF YES] Tell me more about that.
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTIONS 4, 6, 7.
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q4 RESPONSE] for the first question, [Q6 RESPONSE] for the second question, and [Q7 RESPONSE] for the third question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT]: Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q8, PAGE 3: TALK TO / SPEND TIME WITH DIFFERENT CULTURAL BACKGROUND
Research Questions:
How do respondents interpret “cultural background”
Is this question redundant with Q4?
Person 1 Probes [ASK ALL RESPONDENTS]
Now thinking back to questions I asked about you, the next question I asked was “How often did you … Talk to or spend time with people from a racial, ethnic, or cultural background that is different from yours? This may have been in person, over the phone, or through the internet or social media,” and you answered [REPEAT PERSON 1’S ANSWER].
[IF NOT “NOT AT ALL”] Who were you thinking of when you answered this question?
[IF NEEDED] Were you thinking about any family, friends, or neighbors?
What does “racial, ethnic, or cultural background” mean to you in this question?
[IF NEEDED] What is an example of a cultural background?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTION 8
I also asked you this question on this handout about [NAME]. When I asked you this question about [NAME], you answered [Q8 RESPONSE].
Tell me more about your answer for [NAME].
[IF NEEDED] How did you come up with your response for [NAME] for this question?
How confident are you in your response for [NAME]?
[IF NEEDED] How easy or difficult was it to choose an answer for this question for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for this question? [IF YES] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q9, PAGE 3: POST VIEWS ON SOCIAL MEDIA
Research Questions:
What do respondents think about when answering this question?
Person 1 Probes [ASK ALL RESPONDENTS] Next I asked “How often did you … Post your views about political, societal, or local issues on the internet or social media?” And you answered [REPEAT PERSON 1’S ANSWER].
[ASK IF NOT “NOT AT ALL”] What were you thinking about when you answered this question?
How easy or how difficult was it to answer this question?
NO PROBES FOR Q10, Q11. NOTE ANY PROBLEMS WITH ADMINISTRATION.
Q12, PAGE 4: ATTEND PUBLIC MEETING
Research Questions:
What do respondents consider to be local issues?
Next I asked “In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did you … Attend a public meeting to discuss a local issue?” And you answered [REPEAT PERSON 1’S ANSWER].
[IF YES] Tell me more about the meeting you attended.
What are some examples of local issues that came to mind when you were answering this question?
Q13, PAGE 4: CONTACT / VISIT PUBLIC OFFICIAL
Research Questions:
What is meant by “contact” in this question?
Person 1 Probes [ASK ALL RESPONDENTS]
Next I asked “ … Did you … Contact or visit a public official – at any level of government – to express your opinion?” And you answered [REPEAT PERSON 1’S ANSWER].
[IF YES] Tell me more about that.
[IF NEEDED] What does “contact” mean to you in this question?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTIONS 9, 12, 13.
I also asked you these questions on this next handout about [NAME]. When I asked you these questions about [NAME], you answered [Q9 RESPONSE] for the first question, [Q12 RESPONSE] for the second question, and [Q13 RESPONSE] for the third question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q14, PAGE 4: BUY BASED ON SOCIAL / POLITICAL VALUES OF COMPANY
Research Questions:
Do respondents understand what is meant by “social or political values”?
Person 1 Probes [ASK ALL RESPONDENTS]
Now thinking back to questions I asked about you, the next question I asked was “Did you … Decide whether or not to buy products or services based on the social or political values of the company that provides them?” And you answered [REPEAT PERSON 1’S ANSWER].
[IF YES] Can you tell me more about that?
[IF NO] In your own words, what is this question asking?
What does “social or political values” mean to you in this question?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTION 14
I also asked you this question on this handout about [NAME]. When I asked you this question about [NAME], you answered [Q14 RESPONSE].
Tell me more about your answer for [NAME].
[IF NEEDED] How did you come up with your response for [NAME] for this question?
How confident are you in your response for [NAME]?
[IF NEEDED] How easy or difficult was it to choose an answer for this question for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for this question? [IF YES] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q15, PAGE 4: BELONG TO GROUPS, ORGANIZATIONS, ASSOCIATIONS
Research Questions:
What do respondents understand group “membership” to mean in this question?
Person 1 Probes [ASK ALL RESPONDENTS]
Now thinking back to questions I asked about you, the next question I asked was “Did you … Belong to any groups, organizations, or associations?” And you answered [REPEAT PERSON 1’S ANSWER].
What does “belong to” mean to you in this question?
[IF NEEDED] Does it mean that you have to pay dues?
[IF NEEDED] Does it mean that you have to be formally registered?
[IF YES] What groups, organizations, or associations were you thinking of when you answered this question?
NO PROBES FOR Q15a. NOTE ANY PROBLEMS WITH ADMINISTRATION.
Q15A1, PAGE 5: PROPORTION OF ONLINE TO IN-PERSON GROUP ACTIVITY
Research Questions:
What is respondent’s role in the groups, organizations, or associations they are active with, and how do they meet with members?
Person 1 Probes [ASK ALL RESPONDENTS IF Q15=YES]
Next I asked “Thinking about the group, organization, or association with which you are most active, which best describes the proportion of your in-person activity to online activity?” And you answered [REPEAT PERSON 1’S ANSWER].
How easy or difficult was this question to answer?
What does “most active” mean to you in this question?
How do you meet with the other members of this group?
[IF NEEDED] What is your role in this group?
What does the phrase “proportion of your in-person activity to online activity” mean to you?
Additional Household Member Probes [ASK IF Q15=YES]
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTIONS 15, 15A1
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q15 RESPONSE] for the first question, and [Q15A1 RESPONSE] for the second question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF NEEDED] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
[IF NEEDED] Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q16, PAGE 5: VOLUNTEER FOR GROUP, ORGANIZATION, ASSOCIATION
Research Questions:
What volunteer organizations and volunteer roles are respondents thinking of?
Person 1 Probes [ASK ALL RESPONDENTS]
Now thinking back to questions I asked about you, the next question I asked was “In the past 12 months, that is from [FILL CURRENT MONTH] of 2015 until today, did you … Volunteer for a group, organization, or association?” And you answered [REPEAT PERSON 1’S ANSWER].
What kinds of groups, organizations, or associations were you thinking about when you answered this question?
[IF YES] How many groups, organizations, and associations do you volunteer with?
[IF SAME NUMBER REPORTED FOR Q15a AND Q16] Are the groups that came to mind for this question different from those that you mentioned belonging to in the previous question?
[IF YES] What is your role in this group / these groups?
Q16A, PAGE 5: HOW OFTEN VOLUNTEER
Research Questions:
How easy or difficult is it for respondents to report the frequency of volunteering?
Person 1 Probes [ASK ALL RESPONDENTS]
Next I asked “How often did you volunteer?”
How did you come up with your answer?
[IF NEEDED] How easy or difficult was this question for you?
Q16B, PAGE 5: HOW MANY HOURS VOLUNTEER
Research Questions:
How easy or difficult is it for respondents to report the number of hours spent volunteering?
[ASK IF Q16A IS NOT “NOT AT ALL”] Next I asked “Approximately how many hours did you volunteer?”
How did you come up with your answer?
How easy or difficult was this question for you?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTIONS 16, 16A, 16B.
[IF Q16=NO]
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered that [NAME] did not volunteer for a group or organization.
[IF Q16=YES]
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered that [NAME] volunteered for a group or organization [Q16A RESPONSE] for [Q16B RESPONSE] hours.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q17/Q18, PAGE 5: GIVE $25 OR MORE
Research Questions:
What do respondents understand “assets” and “property” to mean?
Person 1 Probes [ASK ALL RESPONDENTS]
Now thinking back to questions I asked about you, the next question I asked was “In the past 12 months, did you … Give money, assets, or property with a combined value of more than $25.00 to a political party, campaign, or organization?” And you answered [REPEAT PERSON 1’S ANSWER].
And I also asked you, “In the past 12 months, did you … Give money, assets, or property with a combined value of more than $25.00 to a charitable or religious organization or group?” And you answered [REPEAT PERSON 1’S ANSWER].
[IF YES] Tell me more about your answers to each question.
[IF NEEDED] Have you given assets or property to any of the types of organizations listed in either question?
What does “assets” mean to you in these questions? What about “property”?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
SHOW RESPONDENT HANDOUT WITH QUESTIONS 17, 18.
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q17 RESPONSE] for the first question, and [Q18 RESPONSE] for the second question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were either of these questions about [NAME] more difficult than the other or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer either of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer either of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Debriefing Questions
Do you think other people might find any of these questions to be sensitive?
[IF YES] Which ones?
[IF NEEDED] What about the question do you think people would find sensitive?
Closing and Incentive
Those are all the questions I have for you.
Is there anything else you would like to tell us that you haven’t had a chance to mention yet?
Thank you for participating in this study. Your feedback has been very helpful.
TURN OFF TAPE RECORDER AND GIVE INCENTIVE. HAVE R SIGN THE PAYMENT VOUCHER.
Here is your money for helping me today. I need you to sign this payment voucher so the government knows that I gave you the money
MAKE SURE TO GIVE A COPY OF THE CONSENT FORM (NOT THE ONE SIGNED BY THE RESPONDENT) TO THE RESPONDENT AT THE END OF THE INTERVIEW.
Civic Engagement and Volunteerism Instrument Testing
Cognitive Interview Protocol
Participant ID #: ________________________
Interview Date: |__|__| / |__|__| / |__|__|__|__| (mm/dd/yyyy)
Interviewer initials: _____
Start Time: ____________ AM / PM End Time: ____________ AM / PM
Introduction
Hello, my name is ________________, and I work for the Census Bureau. Thank you for agreeing to participate in our study.
The Census Bureau is working with the Corporation for National and Community Service to develop new questions for a supplemental survey to the Current Population Survey. Before surveys are conducted, it’s important to try out questions with the help of people such as yourself. The survey asks questions about your household, yourself, and other people who live with you.
It is important that the questions make sense, are easy to answer, and that everyone understands the questions the same way. If you agree to take part in this study, I will read you the questions as if I were an interviewer contacting you at your home. After I ask you the survey questions, I will ask some follow-up questions about your answers and what you understood the questions to mean. There are no right or wrong answers. Our purpose is not to compile information about you. Instead, your interview, along with those of others, will show us how to improve these questions for the survey.
Informed Consent
HAND RESPONDENT 1 COPY OF THE CONSENT FORM.
Before we start, I would like you to read over the document in front of you. This document explains a little bit about this interview and provides information about your rights as a participant, such as that all information you provide is confidential and we won’t use your name or specific circumstances in any report. It also asks for your permission to have this session audio recorded so that I can concentrate on you what are saying rather than having to take extensive notes. Please ask me any questions you have about this document. Once you have finished reading the document, please sign and date it.
PARTICIPANT READS FORM THEN SIGNS AND DATES FORM.
INTERVIEWER SIGNS AND DATES FORM.
Thank you for signing the consent form. I will also sign this form to show that I agree to everything in the form. At the end of the interview, I’ll be sure to give you a copy for you to take with you.
IF PARTICIPANT PROVIDES CONSENT TO HAVE THE SESSION AUDIO-TAPED: I will now turn on the audio recorder.
Your participation in this interview is very important because it will help the Census Bureau with improving these questions. Your participation in this interview is voluntary, and you may decline to answer any question, or stop the interview at any time. We are scheduled to be here for about 60 minutes, and I won’t keep you any longer.
IF RESPONDENT IS NOT A FEDERAL EMPLOYEE: As a thank you for your help, we will give you $40 after the interview is completed.
Before we begin, do you have any questions about the process?
Questionnaire
ADMINISTER ROSTER QUESTIONNAIRE AND CEV SURVEY TO RESPONDENT / RESPONDENTS.
Retrospective Probing
Now I’d like to ask you a few questions about some of the questions you just answered.
Q1, PAGE 1: TALK / SPEND TIME WITH FAMILY / FRIENDS
Research Questions:
Who is respondent including in their response?
What methods of communication are relevant?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTIONS 1, 2, 3.
Now I am going to show you some of the questions I asked about you. The first question I asked was Question 1 and you answered [REPEAT PERSON 1’S ANSWER]. [PAUSE TO ALLOW THEM R TO READ THE QUESTION. IF THEY DON’T, ASK THEM TO READ IT.]
How did you come up with your answer for this question?
Who did you consider in your answer?
[IF NEEDED] Do these people live nearby, or further away? Does distance matter?
[IF NEEDED] Did you include any friends from your work?
Do you consider interacting with friends and family through the internet or social media to be talking or spending time with them?
Are there any other ways that you communicate with friends and family that we didn’t ask about?
[IF YES] If these other communication options were included in the question, would your answer change?
This question asks about whether you talk or spend time with friends and family during the past 12 months. Would your answer have changed if we asked about the past year instead?
Q2, PAGE 1: POLITICAL, SOCIETAL, LOCAL ISSUES WITH FAMILY / FRIENDS
Research Questions:
What is respondent’s understanding of societal, political, and local issues?
Does the word “discuss” suggest a one- or two-sided conversation?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 2 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION.]
[IF “BASICALLY EVERY DAY” OR “A FEW TIMES A WEEK”] How did you come up with your answer?
What does the word “discuss” mean to you in this question?
[IF NEEDED] Does posting comments online count as discussing something?
This question also asked about “political issues”. Can you give me an example of what you would consider a political issue?
Q3, PAGE 1: PROVIDE FOR / HELP FRIENDS / EXTENDED FAMILY
Research Questions:
Who are respondents including in their response?
What does “help” mean?
What, if anything, caused the respondent to change their answer to the two question versions?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 3 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION.]
[IF NOT “NOT AT ALL”] Who were you thinking of when you answered this question?
What does the phrase “extended family” mean to you in this question?
What does the word “help” mean to you in the phrase “provide food, housing, money, or help”?
Now I am going to read another question that I would like for you to answer.
3. In the past 12 months, how often did you provide food, housing, money or help for friends or extended family? Do not include anything you do for your children, parents, and spouses, partners or significant others even if they do not live with you.
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
Now I have some questions about this last question you just answered.
Can you tell me how you came up with your answer for this question?
[IF ANSWERS DON’T MATCH] Who were you considering when you were answering this question?
[IF NEEDED] Can you tell me more about the difference between these two answers? [POINT TO QUESTION 3]
Considering the question I just asked you and Question 3 on your sheet, which was easier to answer, if either? Can you tell me more about that?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
I also asked you all these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q1 RESPONSE] for the first question, [Q2 RESPONSE] for the second question, and [Q3 RESPONSE] for the third question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT]: Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME 2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q4, PAGE 2: TALK / SPEND TIME WITH NEIGHBORS
Research Questions:
Who does respondent consider to be his/her neighbors?
What does “have a conversation” mean in this question?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTIONS 4, 6, 7.
Now I am going to show you some of the questions I asked about you. The next question I asked you was Question 4 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION.]
Who did you consider your neighbors to be?
[IF NEEDED] Is this determined by how close they live to you?
[IF NEEDED] How close to you would someone need to live for you to consider them your neighbor
If you were Facebook friends with a neighbor but never talked to them in person, would you answer “Yes” to this question?
What does the phrase “have a conversation” mean to you in this question?
NO PROBES FOR Q5. NOTE ANY PROBLEMS WITH ADMINISTRATION.
Q6, PAGE 2: DO FAVORS FOR NEIGHBORS
Research Questions:
What type of favors come to mind?
Does respondent think the question implies reciprocity?
What, if anything, caused the respondent to change their answer to the two question versions?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 6 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
[IF “NOT AT ALL”] What types of favors were you thinking of when I asked you this question?
[IF NEEDED] What about pet sitting?
[IF NOT “NOT AT ALL”] Can you tell me more about what you did?
[IF NEEDED] Can you give me an example of a favor that you did?
[IF NEEDED] What about a favor your neighbor did for you?
When you answered this question, were you thinking only about times that you did favors for your neighbors, or were you also thinking about times that your neighbors did favors for you?
Now I am going to read another question that I would like for you to answer.
6. In the past 12 months, how often did you and your neighbors do favors for each other such as house sitting, watching each other’s children, lending tools, and other things to help each other?
[READ RESPONSE OPTIONS AS NEEDED]
(1) Basically every day
(2) A few times a week
(3) A few times a month
(4) Once a month
(5) Less than once a month
(6) Not at all
Now I have some questions about this last question you just answered.
Can you tell me how you came up with you answer for this question?
[IF ANSWERS DON’T MATCH] Who were you considering when you were answering this question?
[IF NEEDED] Can you tell me more about the difference between these two answers? [POINT TO QUESTION 6]
Considering the question I just asked you and Question 6 on your sheet, which was easier to answer, if either? Can you tell me more about that?
Q7, PAGE 2: FIX PROBLEM / DO SOMETHING FOR COMMUNITY
Research Questions:
What, if anything, do respondents see as the difference between Questions 6 and 7?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 7 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
What does the phrase “do something positive” mean to you in this question?
Were you thinking about favors that were done by the whole neighborhood generally or by individuals specifically?
The last question I asked you about was whether you and your neighbors do favors for each other. Do you see any difference between that question and this one? [IF NEEDED: SHOW RESPONDENT Q4,5,6 HANDOUT AND POINT TO Q6]
[IF YES] Tell me more about that.
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q4 RESPONSE] for the first question, [Q6 RESPONSE] for the second question, and [Q7 RESPONSE] for the third question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT]: Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q8, PAGE 3: TALK TO / SPEND TIME WITH DIFFERENT CULTURAL BACKGROUND
Research Questions:
How do respondents interpret “cultural background”
Is this question redundant with Q4?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTION 8
Now I am going to show you another question I asked about you. The next question I asked you was Question 8 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
[IF NOT “NOT AT ALL”] Who were you thinking of when you answered this question?
[IF NEEDED] Were you thinking about any family, friends, or neighbors?
What does “racial, ethnic, or cultural background” mean to you in this question?
[IF NEEDED] What is an example of a cultural background?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
I also asked you this question on this handout about [NAME]. When I asked you this question about [NAME], you answered [Q8 RESPONSE].
Tell me more about your answer for [NAME].
[IF NEEDED] How did you come up with your response for [NAME] for this question?
How confident are you in your response for [NAME]?
[IF NEEDED] How easy or difficult was it to choose an answer for this question for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for this question? [IF YES] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q9, PAGE 3: POST VIEWS ON SOCIAL MEDIA
Research Questions:
What do respondents think about when answering this question?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTIONS 9, 12, 13.
Now I am going to show you some other questions I asked about you. The next question I asked you was question 9 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
[ASK IF NOT “NOT AT ALL”] What were you thinking about when you answered this question?
Do you consider commenting on or otherwise reacting to someone’s social media post to be the same as posting your views?
How easy or how difficult was it to answer this question?
NO PROBES FOR Q10, Q11. NOTE ANY PROBLEMS WITH ADMINISTRATION.
Q12, PAGE 4: ATTEND PUBLIC MEETING
Research Questions:
What do respondents consider to be local issues?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 12 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
[IF YES] Tell me more about the meeting you attended.
What are some examples of local issues that came to mind when you were answering this question?
Q13, PAGE 4: CONTACT / VISIT PUBLIC OFFICIAL
Research Questions:
What is meant by “contact” in this question?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 13 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
[IF YES] Tell me more about that.
[IF NEEDED] What does “contact” mean to you in this question?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
I also asked you these questions on this next handout about [NAME]. When I asked you these questions about [NAME], you answered [Q9 RESPONSE] for the first question, [Q12 RESPONSE] for the second question, and [Q13 RESPONSE] for the third question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q14, PAGE 4: BUY BASED ON SOCIAL / POLITICAL VALUES OF COMPANY
Research Questions:
Do respondents understand what is meant by “social or political values”?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTION 14
Now I am going to show you another question I asked about you. The next question I asked you was Question 14 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
[IF YES] Can you tell me more about that?
[IF NO] In your own words, what is this question asking?
What does “social or political values” mean to you in this question?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
I also asked you this question on this handout about [NAME]. When I asked you this question about [NAME], you answered [Q14 RESPONSE].
Tell me more about your answer for [NAME].
[IF NEEDED] How did you come up with your response for [NAME] for this question?
How confident are you in your response for [NAME]?
[IF NEEDED] How easy or difficult was it to choose an answer for this question for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for this question? [IF YES] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer this question for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q15, PAGE 4: BELONG TO GROUPS, ORGANIZATIONS, ASSOCIATIONS
Research Questions:
What do respondents understand “belong to any groups” to mean in this question?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTIONS 15, 15A1
Now I am going to show you some other questions I asked about you. The next question I asked you was question 15 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
What does “belong to” mean to you in this question?
[IF NEEDED] Does it mean that you have to pay dues?
[IF YES] What groups, organizations, or associations were you thinking of when you answered this question?
NO PROBES FOR Q15a. NOTE ANY PROBLEMS WITH ADMINISTRATION.
Q15A1, PAGE 5: PROPORTION OF ONLINE TO IN-PERSON GROUP ACTIVITY
Research Questions:
What is respondent’s role in the groups, organizations, or associations they are active with, and how do they meet with members?
Person 1 Probes [ASK ALL RESPONDENTS IF Q15=YES]
The next question I asked you was Question 15a1 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
How easy or difficult was this question to answer?
What does “most active” mean to you in this question?
How do you meet with the other members of this group?
[IF NEEDED] What is your role in this group?
What does the phrase “proportion of your in-person activity to online activity” mean to you?
Additional Household Member Probes [ASK IF Q15=YES]
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q15 RESPONSE] for the first question, and [Q15A1 RESPONSE] for the second question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF NEEDED] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
[IF NEEDED] Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q16, PAGE 5: VOLUNTEER FOR GROUP, ORGANIZATION, ASSOCIATION
Research Questions:
What volunteer organizations and volunteer roles are respondents thinking of?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTIONS 16, 16A, 16B.
Now I am going to show you some other questions I asked about you. The next question I asked you was Question 16 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
What kinds of groups, organizations, or associations were you thinking about when you answered this question?
[IF YES] How many groups, organizations, and associations do you volunteer with?
Are the groups that came to mind for this question different from those that you mentioned belonging to in the previous question?
[IF YES] What is your role in this group / these groups?
Q16A, PAGE 5: HOW OFTEN VOLUNTEER
Research Questions:
How easy or difficult is it for respondents to report the frequency of volunteering?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 16a and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION]
How did you come up with your answer?
[IF NEEDED] How easy or difficult was this question for you?
Q16B, PAGE 5: HOW MANY HOURS VOLUNTEER
Research Questions:
How easy or difficult is it for respondents to report the number of hours spent volunteering?
[ASK IF Q16A IS NOT “NOT AT ALL”] The next question I asked you was Question 16b and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION.]
How did you come up with your answer?
How easy or difficult was this question for you?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
[IF Q16=NO]
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered that [NAME] did not volunteer for a group or organization.
[IF Q16=YES]
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered that [NAME] volunteered for a group or organization [Q16A RESPONSE] for [Q16B RESPONSE] hours.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were any of these questions about [NAME] more difficult than the others or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer any of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Q17 PAGE 6: GIVE $25 OR MORE - POLITICAL
Research Questions:
What do respondents understand “possessions”” to mean?
Are respondents including only political groups in their response?
Person 1 Probes [ASK ALL RESPONDENTS]
SHOW RESPONDENT HANDOUT WITH QUESTIONS 17, 18.
Now I am going to show you some other questions I asked about you. The next question I asked you was Question 17 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION.]
[IF YES] Tell me more about your answer to this question.
[IF NEEDED] Can you give an example of an organization, party, or campaign you gave money or possessions to?
What does “possessions” mean to you in this question?
Q18 PAGE 6: GIVE $25 OR MORE - OTHER
Research Questions:
What groups are respondents considering in their response?
What, if anything, caused the respondent to change their answer to the two question versions?
Person 1 Probes [ASK ALL RESPONDENTS]
The next question I asked you was Question 18 and you answered [REPEAT PERSON 1’S ANSWER]. [MAKE SURE R READS OVER THE QUESTION.]
VERSION 1 RESPONDENTS:
What does “non-political” mean to you in this question?
[IF YES] What groups or organizations were you thinking of in your response?
Are there any other groups or organizations that you donated to that we didn’t ask about in Question 17 or Question 18?
Now I am going to read another question that I would like for you to answer.
18. Did you give money or possessions with a combined value of more than $25 to any other group or organization?
(1) Yes
(2) No
Now I have some questions about this last question you just answered.
Can you tell me how you came up with you answer for this question?
[IF ANSWERS DON’T MATCH] Who were you considering when you were answering this question?
[IF NEEDED] Can you tell me more about the difference between these two answers? [POINT TO QUESTION 18]
Considering the question I just asked you and Question 18 on your sheet, which was easier to answer, if either? Can you tell me more about that?
VERSION 2 RESPONDENTS:
[IF YES] What groups or organizations were you thinking of in your response?
Now I am going to read another question that I would like for you to answer.
18. Did you give money or possessions with a combined value of more than $25 to a non-political group or organization, such as a charity, school, or religious organization?
(1) Yes
(2) No
Now I have some questions about this last question you just answered.
Can you tell me how you came up with you answer for this question?
[IF ANSWERS DON’T MATCH] Who were you considering when you were answering this question?
[IF NEEDED] Can you tell me more about the difference between these two answers?
Considering the question I just asked you and Question 18 on your sheet [POINT TO QUESTION 18], which was easier to answer, if either? Can you tell me more about that?
Additional Household Member Probes
NOTE: ASK THESE PROBES OF EACH ADDITIONAL ADULT IN THE HOUSEHOLD.
I also asked you these questions on this handout about [NAME]. When I asked you these questions about [NAME], you answered [Q17 RESPONSE] for the first question, and [Q18 RESPONSE] for the second question.
Tell me more about your answers for [NAME].
[IF NEEDED] How did you come up with your responses for [NAME] for these questions?
How confident are you in your responses for [NAME]?
[IF NEEDED] How easy or difficult was it to choose answers for these questions for [NAME]? [IF DIFFICULT] Did you think about answering in another way than what you finally settled on for any of these questions? [IF YES] Tell me more about that.
Were either of these questions about [NAME] more difficult than the other or were they about the same? [IF NEEDED] Tell me more about that.
ASK IF 2 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer either of these questions for [NAME 1] as compared to [NAME 2] or was it about the same? [IF NEEDED] Tell me more about that.
ASK IF 3 ADDITIONAL ADULTS IN HOUSEHOLD:
Was it more difficult to answer either of these questions for [NAME 1], [NAME2] or [NAME 3] or was it about the same? [IF NEEDED] Tell me more about that.
Debriefing Questions
Do you think other people might find any of these questions to be sensitive?
[IF YES] Which ones?
[IF NEEDED] What about the question do you think people would find sensitive?
Closing and Incentive
Those are all the questions I have for you.
Is there anything else you would like to tell us that you haven’t had a chance to mention yet?
Thank you for participating in this study. Your feedback has been very helpful.
TURN OFF TAPE RECORDER AND GIVE INCENTIVE. HAVE R SIGN THE PAYMENT VOUCHER.
Here is your money for helping me today. I need you to sign this payment voucher so the government knows that I gave you the money
MAKE SURE TO GIVE A COPY OF THE CONSENT FORM (NOT THE ONE SIGNED BY THE RESPONDENT) TO THE RESPONDENT AT THE END OF THE INTERVIEW.
1 As recruiting unrelated households proved especially difficult, advertisements specifically targeting unrelated households were posted to Craigslist in the middle of Round 1 and at the beginning of Round 2.
2 In Rounds 1 and 2, the respondent who initially contacted CSM to express interest in participating was administered the full screener; this respondent was also asked to report on the other household member’s volunteering and group activities. In Round 2, the second member of the pair was administered a shortened version of the screener that included demographic, group membership, and volunteering items.
3 In Round 1 of testing, respondents were administered a questionnaire for all other adults in their household. However, this proved to be time prohibitive, and in Round 2 of testing the decision was made to administer the supplement for only two additional adult household members.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Jasmine Luck (CENSUS/CSM FED) |
| File Modified | 0000-00-00 |
| File Created | 2021-01-22 |