NSF INCLUDES Network Member Survey - Parts A and B for funded projects

***

NSF INCLUDES Network Member Survey

PART A: All Respondents Complete this Section

The NSF INCLUDES National Network (the Network) aims to create systems change to broaden participation in STEM career pathways and opportunities through a collaborative approach that brings together member resources, expertise, and connections.

This survey is an opportunity for you to provide feedback on your experiences with the Network. This includes your perspectives on desired outcomes and ways in which the Network is informing and supporting your efforts to broaden participation in STEM.

Your feedback will improve network functioning, advance collaboration and shape Network and Coordination Hub activities in the future.

If you are a member of an active or recently concluded NSF INCLUDES project, the survey will take approximately 25 minutes to complete. If you are not part of an NSF INCLUDES project, you will complete only Part A which will take approximately 10 minutes. The survey consists of primarily multiple-choice questions.

Your participation in this survey is voluntary, and you may can opt out at any time. We will not report individual responses—all findings will be reported in aggregate without personally identifiable information (PII). We will not report any statistics for disaggregated groups with less than 10 responses. We will destroy all personally identifiable information at the end of the Hub’s funding period.

1. Network Activity

There are many ways to engage with members of the NSF INCLUDES National Network including participating in the online community at INCLUDESNetwork.org, interacting directly with other Network members outside the online community, and attending convenings and conferences.

1. Do you consider yourself to be part of the NSF INCLUDES National Network?

   1. No

   2. No, but interested in learning more

   3. Yes, but not very involved

   4. Yes, involved quite a bit

How have you interacted with the Network to date?	Never	Sometimes	Often
Participated in the online community (INCLUDESNetwork.org)			
If answer to a is “sometimes or often” answer i-vii; if never skip to b
Participated in one or more Affinity Groups			
Led an Affinity Group			
Read posts or announcements from INCLUDESNetwork.org			
Engaged in online discussions on INCLUDESNetwork.org			
Accessed materials on the INCLUDESNetwork.org			
Participated in one or more INCLUDESNetwork.org webinars or virtual events about NSF funding opportunities or programs			
Participated in one or more Hub or Network member capacity building webinars or virtual events on INCLUDESNetwork.org			
Interacted with Network members outside the online community			
If answer to b is “sometimes or often”, answer i-vi; if “never” skip to c
Contacted Network members outside my own project via telephone or email			
Contacted Network members outside my own project via the NSF INCLUDES online community messenger function			
Received from or provided to another network member a resource, tool, or instrument			
Collaborated on one or more documents with a member outside my own project			
Collaborated with members outside my own project on a joint program or research project			
Visited institution of another Network member			
Attended conferences and /or convenings
If answer to c is yes, answer i-ii; if no skip to c
Attended the NSF INCLUDES National Convening			
Attended one or more convenings/conferences hosted by a Network member other than NSF			
Other activity (Please specify): _________________________________			

2. Infrastructure to Support the National Network

The Coordination Hub is interested to understand your motivations for participating in the NSF INCLUDES National Network.

There are many ways to engage with members of the NSF INCLUDES National Network including participating in the online community at INCLUDESNetwork.org, interacting directly with other Network members outside the online community, and attending convenings and conferences.

Thinking about how you have interacted with the Network, please reflect on the motivating factors for participating in the Network.

1. How important do you think the following motivations are for your own participation in the National Network?

	Not Important	Somewhat Important	Very Important
Collective focus on broadening participation outcomes that I care about			
Hold a shared vision and collective responsibility across the Network for broadening participation			
Learn about emerging issues in broadening participation in STEM fields			
Identify potential policy and practice changes applicable to my organization or practice setting			
Expand my thinking about successful strategies for broadening participation			
Increase my understanding of how systems work to support or hinder participation in STEM			
Be part of a larger movement to support access and pathways to STEM careers			
Contribute to the research on broadening participation			
Connect with private funders that support broadening participation			
Connect with other Federal agencies to access broadening participation resources			
Learn from and or share resources and information with my peers outside my institution who are working on broadening participation in STEM			
Collaborate with others in the field on joint activities, programs, and/or research			
Amplify the influence of the work that I or my organization does by showcasing my work			
Access and/or share data to inform Network strategic planning, decision-making, and documentation of progress across the Network			
Other (Please specify): _______			

How Should the Network Be Structured?

The next set of questions ask about what structures are needed for the National Network to fulfill its functions. The structures outlined in this next question are found in many different types of networks to support exchange of knowledge and acceleration of impact across the field.

2. How important do you think the following structures would be in supporting how well a National Network would function?

	Not Important	Somewhat Important	Very Important
A formal agreement that Network members sign to commit their organization’s participation in the Network			
Subcommittees or work groups that engage in agreed-upon tasks and activities and report back to the full Network			
A leadership team and/or governance structure made up of Network members to guide the work of the Network			
In-person convenings or conferences for the whole Network			
In-person convenings or conferences for smaller regional or topical interest groups			
Virtual platform for online community sharing and learning			
Webinars and other online training opportunities			
Discussion boards and webchats			
Network member-led topical interest or affinity groups			
Dedicated financial resources and staff to support Network operations			
Other (Please describe): _____________________________________			

3. National Network Value/Benefit

For the following questions, think about your experience with the National Network and its value to you and your work. This includes interactions with the Hub, with NSF POs, with INCLUDESNetwork.org, and with others involved in broadening participation in STEM efforts.

1. Please rate the degree to which you see evidence of the following in the National Network:

I have seen the following with the Network	Strongly Disagree	Disagree	Agree	Strongly Agree	Do Not Know
My work has been featured in Network events and communications (e.g., webinars, blogs, social media posts)					
The Network has clear goals to which we can align our broadening participation work					
I feel a sense of ownership and responsibility to contribute to the Network					
The Network allows me to be a part of a bigger movement toward broadening participation					
I can articulate how my work fits within the larger Network					
Network members hold each other accountable to broadening participation goals					
Data is used to track shared progress and outcomes at the Network level					

Open-Ended Questions

For the Network to broaden participation and accelerate impact, it is important to leverage the unique skills, expertise, and talents that each member brings. Network success relies on active participation and collaboration among its members

2. Please take a moment to let us know what strengths, expertise, resources, and other assets you would be willing to contribute to the Network community.

One of the benefits of the Network is to share information across members, and to increase the knowledge of Network members about what are current trends and best practices in the field.

3. Based on where you are situated in the NSF INCLUDES ecosystem and landscape (e.g., as an institution of higher education, funder, project director, other interested party), what do you think are important trends and issues in the broadening participation field that the Network should be aware of or address collectively?

1. Demographic Questions

1. Which of the following best describes your race?

American Indian or Alaskan Native	
Asian or Pacific Islander	
Black	
White	
Multi-racial	
Other: ___________________	
Choose not to identify	

2. Which of the following best describes your ethnicity?

Hispanic origin	
Not of Hispanic origin	
Choose not to identify	

3. Which of the following best describes your gender?

Female	
Male	
Other: _____________________	
Choose not to identify	

4. Which of the following describes your disability status?

I have a disability	
I do not have a disability	
Choose not to identify	

5. Role in Broadening Participation in STEM Efforts

1. At what level(s) of the STEM education/workforce system are you working? (Please check all that apply)

Pre-K	
Elementary School	
Middle School	
High School	
Undergraduate	
Graduate	
Workforce Development (outside of K-12 and postsecondary education)	
Informal Education	
General Public	
Other (Please specify): __________	

2. Who is/are your target population(s)? (Please check all that apply)

If a-c are selected, “which of the following describes any targeted group you may be addressing (Select all that apply) ’ is displayed.

Latino, African American, Asian, Native

American, Pacific Islander, First Generation

College, Low-Income Students, Students

with Disabilities, Women, Other

If d-e are selected, “which of the following describes any targeted group you may be addressing (Select all that apply) ’ is displayed.

Women, People of color, New faculty/

teachers, Individuals with disabilities

Students	
Undergraduate students
Graduate students
Pre-K-12 teachers/faculty	
Postsecondary faculty	
K-12 schools/districts	
Postsecondary departments	
Employers / industry professionals	
Governmental agencies	
Nonprofits or other community-based organizations	
Other: ___________________	

3. What are your broadening participation goals? (Please check all that apply)

Equitable access to high-quality STEM education programs	
Success in STEM coursework	
Increasing awareness of STEM education/career opportunities	
Representational diversity of those participating in STEM education opportunities	
Representational diversity in STEM careers	
Equitable institutional programs, policies, and practices	
Alignment of career education and pathway opportunities	
Create or change policies to support access to and participation of under-represented groups in STEM education and/or careers	
An inclusive culture in STEM workplaces and/or educational settings	
Other: ______________________________________	

4. Which of the following best describes your connection to the National Network? [The answer serves as skip logic to the rest of the survey]

Affiliated with an NSF INCLUDES Alliance	
Affiliated with another project funded by NSF INCLUDES such as a DDLP, conference, or LSAMP	
NSF broadening participation project funded by a program other than NSF INCLUDES	
Other broadening participation in STEM project or effort (funded by an agency or foundation other than NSF)	
NSF staff member or program officer	
Other federal agency staff member (not NSF)	
National or state policymaker	
Interested in broadening participation in STEM and NSF INCLUDES but do not currently receive NSF INCLUDES funding [including representatives of business, industry, professional association, nonprofit, advocacy organization, etc.]	
Private funder or foundation program officer	

5. What state are you from? (select from drop-down menu)

PART B: NSF INCLUDES-Funded Projects Only Respond

The following questions about your NSF INCLUDES project will help the Coordination Hub support the scale and scope of your work and your partnerships with others in the National Network.

6. NSF INCLUDES Project Information

1. Which of the following categories best describes your role in your NSF-INCLUDES funded project?

Evaluator	
Principal Investigator/Co-Principal Investigator	
NSF INCLUDES funded Alliance or Project Team Member	
Other (please specify): ___________________	

2. What specific type of NSF INCLUDEs funded project best describes your current efforts?

   1. DDLP

   2. Alliance

   3. EAGER

   4. Conference

   5. Other (Please specify): _________

3. How many total NSF INCLUDES awards has your team received, either singly or co-funded with other institutions?

1	
2	
3 to 5	
More than 5	

4. How many NSF INCLUDES awards are you currently working on (either single award or collaborator)?

1	
2	
3 to 5	
More than 5	

5. How many partners are in your project’s network?

0-5	
6-10	
11-20	
More than 20	

6. Of your project’s network partners, how many are new, as a result of NSF INCLUDES funding?

All are new partners	
More than 75% are new	
About half are new	
Less than 25% are new	
No new partners	

7. In your project’s network, with what groups is your project partnering? (Select all that apply)

Higher education institutions	
PreK-12 schools/districts	
Nonprofit and/or community-based organizations	
Professional associations or networks (outside of the National Network)	
Local or state government agencies	
Federal government agencies other than NSF	
Accrediting agencies	
Funders	
Museums/science centers	
Business/Industry/Trade Organizations	
FFRDC (e.g., National Laboratories, Jet Propulsion Lab. NRAO (Radio observatory), etc.)
Other: ­____________________________________	

G. Collaborative Infrastructure

Foundational to the NSF INCLUDES National Network’s approach is its model of collaborative infrastructure, including—shared vision, partnerships, leadership and communication, goals and metrics, and expansion, sustainability, and scale.

Thinking about your own involvement in the Network (which could be through the online community, existing relationships with other members, interactions with the Coordination Hub, etc.), to what degree do you see the following characteristics or outcomes of the Network developing?

Based on my involvement with Network activities and members to date, I think the National Network. . .	Not yet	Beginning	Some progress	Significant progress	Do Not Know	NA
Has a clearly articulated common set of goals, vision and mission related to broadening participation						
Is guided by one or more collaborative change strategies that coordinates activities across members to achieve the vision						
Ensures that those whose perspectives have historically been marginalized significantly shape conversations about the goals, mission, issues, and solutions that the Network is acting upon						
Explicitly addresses power issues and differentials among Network members, institutions, and those served						
Is regularly adding new partners who have a stake in broadening participation efforts						
Includes influencers who champion the strategy/plan of action and bring new partners to the network						
Is comprised of a representative and diverse set of all sectors, institutions, and communities that have a stake in broadening participation efforts						
Uses a participatory process to develop a common set of indicators/metrics and data collection methods to track progress and outcomes						
Has robust shared data capacity to collect, track, and report progress on common metrics						
Has an established governance or decision-making structure comprised of network members						
Distributes decision-making authority and processes across members to ensure that members feel included						
Has strengthened relationships between funders and other Network members						
Focuses activities to support system-level solutions, policies and practices aimed at broadening participation in STEM and removing structural barriers						
Uses new information and approaches to the broadening participation field, to adjust actions and approach						
Views problems or issues as opportunities to learn and improve policy and practice						
Supports expanding and scaling evidence-driven BP innovations across the Network						
Contributes to accelerating National NSF INCLUDES efforts and goals						
Communicates effectively about events and resources available						
Amplifies individual project successes to the Network						

H. Impact of Participation in the NSF INCLUDES National Network (Network Member Practice Changes)

The next question focuses on your team’s participation in the NSF INCLUDES National Network as an NSF INCLUDES-funded project.

1. Since starting our most current NSF INCLUDES project, my project team . . .

	Strongly Disagree	Disagree	Agree	Strongly Agree	Do Not Know	NA
Built new relationships with members from other organizations through network activities						
Became inspired to take action toward our broadening participation goals						
Became inspired to further contribute to the network						
Sees our broadening participation work as part of something bigger than our individual project						
Better sees the value of working collaboratively with other members of the network						
Gained new knowledge or skills to better serve our target audience						
Exchanged resources and/or information with another network member						
Provided new professional development opportunities to our staff around diversity, equity, and inclusion in STEM fields						
Changed or adopted policies to open career pathways and remove barriers for our target population(s)						
Implemented new programs/curricula to increase participation in STEM for women, people of color, and people with disabilities						
Secured new and/or diversified funding to support our broadening participation work						
Collaborated with other network members who share similar interests and goals on joint programs or research						
Organized meetups and events for network members to come together						
Engaged local stakeholders (e.g., students, faculty, community members) in planning, implementation, and/or decision-making						
Increased local leadership support and institutional buy-in for broadening participation work						
Strengthened our own project’s collaborative infrastructure						
Conducted new research to inform broadening participation work						

1. Capacity Needs

In answering the following question think about the capacity that your project has to implement activities aimed at broadening participation in STEM.

1. How well does your project . . .

	Do not need support	Could use some support	Could use a lot of support	Expert at this and willing to teach others	Do Not Know	NA
Work with partners to create a shared vision, goals, and action plan						
Engage faculty in designing and implementing the project						
Include students in decision-making about broadening participation priorities and solutions						
Collaborate across partners on joint activities						
Create effective messages to communicate to stakeholders about broadening participation efforts						
Communicate effectively across all project partners						
Use data to improve continuous learning into broadening participation efforts						
Engage in culturally responsive evaluation practices						
Create or change policies and institutional structures to increase access to and participation in STEM education and career pathways						
Provide relevant professional development to staff on broadening participation approaches						
Build leadership and champion buy-in to broadening participation efforts						
Generate evidence on effectiveness of broadening participation efforts						
Establishing a strategy for expanding and scaling BP efforts to other settings						
Secure new and diverse funding sources						
Establishing a strategy for sustaining BP efforts beyond current grant funding						
Find relevant information on effective broadening participation interventions and approaches						
Understand the needs of our project’s target population(s)						

Open-ended Questions

The Coordination Hub is committed to providing high quality and relevant support to Network members. Your views on the value of the various topics/activities will inform the Hub’s future planning. Please take a few moments to let us know about your experiences with the activities and supports provided to the Network through the online community and the Coordination Hub.

2. What 2-3 topics/activities have been the most beneficial to you?

3. What 2-3 topics/activities have been the least beneficial to you?

4. What additional 2-3 topics/activities would you like to see that were not conducted?