Matrix of Survey Changes Proposed

Changes to Survey for Grantees and Other Museums and Libraries (changed content highlighted in yellow)

[GENERAL CHANGE] Outcome Type: Outcome (Indicator)	Old Item	New item	Ratiionale
[SIMPLIFY LANGUAGE] Survey Intro, part of first paragraph	You received this survey because you were identified by members of the CCI project team for [project name] as a person in your organization who knows the project well.	You received this survey because you know the [project name] well.	Wanted to simplify. Also some people who get this survey are members of the project team so it was awkward to tell them that members of the project team selected them.
[REMOVED] Individual Capacity: Increased flexibility/ agility/ adaptability to respond to changing nature/ contexts of grantee projects (Openness to altering course in response to changing community priorities and context)	C1Q3: Staff in our organization who are involved in the project (5-pt agreement scale): A. are able to change project strategies or tactics in response to new community member priorities or changes in the community.	None	Decided better to measure as practice change (demonstrated flexibility) than capacity change
[SHIFTED] Individual Capacity: Increased valuing of catalyzing community transformation efforts grounded in asset-based, community-driven collaboration (Sense of accountability to community members versus institutional partners)	C1Q3: Staff in our organization who are involved in the project (5-pt agreement scale): B. believe community impact of this project is more important than benefit to organizational partners. C. feel more accountable to community members than to organizational partners, in the context of this project	C1Q3: Staff in our organization who are involved in the project (5-pt agreement scale): B. believe that—in community change efforts—community impact is more important than benefit to organizational partners. C. feel more accountable to community members than to organizational partners.	To ask about a belief about community change projects more generally (versus the CCI-funded project specifically) so that more consistent with other indicators of this outcome, that was adapted based on input from IMLS and stakeholders
[NEW EXPLANATORY INFO]	None	[before C1Q5] Please note: The next several questions ask about various ways that organizations can support and do asset-focused community-driven collaboration. It is understood that no single organization or project will incorporate all—or even most—of these ways. Your candid responses will best support everyone’s learning.	We wanted to guard against people being overwhelmed by the number of things they are NOT doing, which could bias responses.
[REFINED INDICATOR] Organizational Capacity: Increased alignment of organizational priorities and expertise with co-designed, jointly implemented, asset-focused, community-driven collaboration (Resources dedicated to asset-focused, community-driven collaboration)	C1Q5: Select the response that applies to your organization (before project, since project, before and since, no but has plans, no and no current plans): B. Our organization devoted a percent of staff member time to doing asset-focused, community-driven collaboration (apart from this project). C. Doing asset-focused, community-driven collaboration was made an expectation of one or more staff member's job (apart from this project). D. Our organization tried to get grant funding for doing asset-focused, community-driven collaboration (apart from this project).	C1Q5: Select the response that applies to your organization (before project, since project, before and since, no but has plans, no and no current plans): ADD1: Our organization hired a community member that did asset-focused, community-driven collaboration within the CCI-funded project. ADD2: Our organization hired a community member that did/is doing/will do asset-focused, community-driven collaboration beyond the CCI-funded project. B. Our organization devoted existing staff member time to doing asset-focused, community-driven collaboration beyond the CCI-funded project. C. Doing asset-focused, community-driven collaboration was made an expectation of one or more existing staff member's job beyond the CCI-funded project. D. Our organization tried to get grant funding for doing asset-focused, community-driven collaboration beyond the CCI-funded project.	Added/changed to capture increases in organizational capacity for doing asset-focused, community-driven collaboration through hiring of community members and differentiate this from changing job expectations of existing staff
[REMOVED] Organizational Capacity: Increased structures and processes supporting authentic engagement of community members (Internal communication structures/ processes to support effective, bi-directional, and culturally responsive information flow and engagement with the community)	C1Q12: Does this project have ways of getting input from community members (other than at regular meetings and events)? (yes; no but plans; no and no plans) [If yes to Q12] C1Q13: These ways of getting input from community members between project meetings and events... (yes; no; DK) A. were in place prior to this project B. were put in place as part of this project C. will continue after this project	None	Removed because evolution of “continuous communication” with collective impact model is authentic community engagement and capacity for this is captured in org capacity indicator “Resources dedicated to asset-focused-community driven collaboration” (related to staffing for this type of activity)
[REMOVED] Practice: Increased co-creation and joint implementation of a shared aspiration with community members and cross-sector partners, within CCI-funded project (Community partners use communication processes and structures to provide input and support collaboration/ engagement)	C1Q14: Do community members use these ways to provide input to the project? (no; yes rarely; yes sometimes; yes regularly) C1Q15: What kids of input do community members provide (both descriptions and examples are welcome)?	None	Removed because evolution of “continuous communication” with collective impact model is authentic community engagement, which is captured in practice indicator “Regular interactions with community associations, leaders, and individuals”
[REFINED INDICATOR] Practice: Increased co-creation and joint implementation of a shared aspiration with community members and cross-sector partners, within CCI-funded project (Community members have led/impacted decision-making in implementation of CCI-funded projects)	C1Q26: Within this project, community members... (yes; no; DK) A. led decision-making in the planning and doing of the project. B. influenced decision-making in the planning and doing of the project.	C1Q26: Within this project, community members... (yes, most of the time; yes, once or twice; no; DK/NA) A. made project-related decisions B. had as much say as institutional partners in project-related decision-making C. made decisions related to a new change effort that emerged from this project’s community engagement activities D. had as much say as institutional partners in decision-making related to a new change effort that emerged from this project’s community engagement activities	Amended to capture the right threshold for community member decision-making and account for efforts that spawned from community engagement activities that allowed projects more freedom to respond to community voice
[LANGUAGE CHANGE] Practice: Increased co-creation and joint implementation of a shared aspiration with community members and cross-sector partners, within CCI-funded project (There is a common agenda that was co-created by diverse community partners around community driven priorities)	C1Q27: Does this project have a "common agenda"* that was co-created by community partners? (*common agenda = common vision/community impact goal) (yes; no) C1Q28: Regarding the "common agenda" for this project... (yes; no; DK) B. Does it include priorities of community members?	C1Q27: Does this project focus on a “shared aspiration”* that was co-established with community partners? (*common community impact goal) (yes; no) C1Q28: Regarding the "shared aspiration" for this project... (yes; no; DK) B. Does it include community members’ aspirations for changes they want to see in their community?	To better align with updated conceptualization of “common agenda” to “shared aspiration”
[LANGUAGE CHANGE] Practice: Increased co-creation and joint implementation of a shared aspiration with community members and cross-sector partners, within CCI-funded project (Community partners implement and support strategies and solutions aligned with shared aspiration)	C1Q30: Who helps implement strategies or activities aligned with the project's common agenda or work plan (yes; no; DK) A. Our organization? B. Other community organizations? C. Community members?	C1Q30: Who helps directly implement the project strategies or activities, e.g., plan a summit, act as peer mentors (versus participating in or benefiting from a project activity) (yes; no; DK) A. Our organization? B. Other community organizations? C. Community members?	Reworded to more clearly describe what we mean by helping implement a project
[REMOVE] Practice: Increased co-creation and joint implementation of a shared aspiration with community members and cross-sector partners, within CCI-funded project (Community partners use common indicators to track progress)	QC1Q31: Does this project have indicators of measures of success for helping track progress toward project goals (sometimes called “common indicators”)? (yes; no but plans; no and no plans; DK) C1Q32: Regarding the “common indicators” for this project... (yes; no; DK) A. Were they agreed upon by community partners? Were they agreed upon by a set of community partners that included community members? B. Does your organization collect data on any of the common indicators? C. Do other organizations collect data on any of the common indicators?	None	Removed to better align with updated conceptualization of “shared measurement” now “strategy learning,” which is covered in indicator “Community partners collectively engage in ongoing evaluation, data use, and learning to assess progress and impact (strategic learning)”
[LANGUAGE REMOVAL] Practice: Increased co-creation and joint implementation of a shared aspiration with community members and cross-sector partners, within CCI-funded project (Community partners collectively engage in ongoing evaluation, data use, and learning to assess progress and impact (strategic learning)	C1Q33: Does the project use data for learning and decision-making (including data related and not related to common indicators)? (yes; no; DK)	C1Q33: Does the project use data for learning and decision-making? (yes; no; DK)	See above
[MINOR WORDING CHANGE: Implementation	C1Q36. Please rate the overall satisfaction of your organization’s experience of being coached by the ABCD site consultant. (5-point scale from ‘not’ to ‘very high’)	C1Q36. Please rate your organization’s overall satisfaction with its experience of being coached by the ABCD site consultant. (5-point scale from ‘not’ to ‘very high’)	To make sure asking about organization-level satisfaction with consultation experience

Changes to Survey for Local Partners

[GENERAL CHANGE] Outcome Type: Outcome (Indicator)	Old Item	New item	Notes
[SIMPLIFY LANGUAGE] Survey Intro, part of first paragraph	You received this survey because you were identified by members of the CCI project team for [project name] as a person in your organization who knows the project well.	You received this survey because you know the [project name] well.	Wanted to simplify.
[ADD] Practice: Increased network-building with community members and non-traditional partners (Engagement of additional relevant cross-sector institutional partners in dialogue with community members)	Q12. Has your organization made asset-focused, community-driven collaboration a part of other community change efforts? (Yes; No, but it is planning on doing this is the future; No, and there are no plans to do this is the future, Don’t know)	Q12. Did your organization…? (Yes; No, but it is planning on doing this is the future; No, and there are no plans to do this is the future; Don’t know) A. Interact directly with community members, as part of this project? B. Make asset-focused, community-driven collaboration a part of other community change efforts?	Added so can triangulate with project team reports of connecting partners with community members in the context of the project