CCPRP_CoP_Year_1_Evaluation_Form_Final 11.10.20

Child Care Policy Research Partnerships (CCPRP) Community of Practice (CoP Year 1 Evaluation Form

As we wrap up the first year of the Child Care Policy Research Partnerships Community of Practice, we want to hear from you what you enjoyed the most, what you’d like to see more or less often, and what types of conversations or presentations you think will be most helpful as you think about what is coming in the new year. We will use the information you provide to help us in planning for this next year of the Community of Practice.  Each member of your team is invited to complete the evaluation. Please complete and submit by December 4, 2020. This survey will take about 5-10 minutes to complete, and you may come back to the survey up to a week after beginning it (as long as it's before December 4th). 

Page Break

A. Please help us understand what you liked or valued the most about the Community of Practice and why. Below is a list of sessions held during our Community of Practice this year.

Q1. What were your top two favorite CoP sessions this year? Please write "1" next to your favorite session and "2" next to your second favorite session.

______ Full group discussions on provider surveys

______ Full group discussions on emerging challenges in COVID-19 times and how to pivot data collection

______ Expert presentation on collecting survey data during COVID-19 (Tim Triplett)

______ Expert presentation on interrupted time series (ITS) design (Mark Treskon)

______ Expert presentation about better data communication (Jonathan Schwabish)

______ Breakout session on conducting virtual focus groups

______ Breakout session on a general discussion of qualitative methods

______ Breakout session on collaborating on survey questions

______ Breakout session on being in the field during COVID-19

______ Breakout session on time trends in administrative data

______ Breakout session on estimating CCDF eligibility

______ Breakout session on a general discussion of "Quant" methods

______ Breakout session on information and issues for state administrators

Page Break

Q2. Click on all the reasons why “${Q1/ChoiceGroup/ChoiceWithLowestValue}” is your top choice.

The CoP coverage of the topic helped me resolve a current challenge

The CoP coverage of the topic helped me anticipate and avoid a potential challenge

I realized that others were facing similar challenges

Discussing with peers helped me figure out options for resolving a challenge

Expert discussion helped me validate options I was already considering

Expert discussion gave me new ideas about our research design

Other, please describe:

Q3. Click on all the reasons why “${Q1/ChoiceGroup/ChoiceWithHighestValue}” is your second choice.

The CoP coverage of the topic helped me resolve a current challenge

The CoP coverage of the topic helped me anticipate and avoid a potential challenge

I realized that others were facing similar challenges

Discussing with peers helped me figure out options for resolving a challenge

Expert discussion helped me validate options I was already considering

Expert discussion gave me new ideas about our research design

Other, please describe:

Page Break

Q4. Were there any CoP sessions you did not find effective or did not enjoy this year? Please click on up to two sessions that meet this description.

Full group discussions on provider surveys

Full group discussions on emerging challenges in COVID-19 times and how to pivot data collection

Expert presentation on collecting survey data during COVID-19 (Tim Triplett)

Expert presentation on interrupted time series (ITS) design (Mark Treskon)

Expert presentation about better data communication (Jonathan Schwabish)

Breakout session on conducting virtual focus groups

Breakout session on a general discussion of qualitative methods

Breakout session on collaborating on survey questions

Breakout session on being in the field during COVID-19

Breakout session on time trends in administrative data

Breakout session on estimating CCDF eligibility

Breakout session on a general discussion of "Quant" methods

Breakout session on information and issues for state administrators

There were no CoP sessions in year 1 that I did not find effective or did not enjoy

Q5. If there are any sessions you did not find effective or did not enjoy, please explain why in the text box below.

Page Break

We provide various formats to support you in learning from each other and experts during the monthly CoP meetings. During monthly CoP meetings in 2020, we had 3 discussions with experts, 3 times to break into small groups, 4 times to discuss emerging challenges as a large group, and 1 meeting with federal staff.  Please let us know if we got the balance “right” from your perspective. 

Q6. Reflecting across the year, please mark the circle that best reflects your perspective on the amount of time scheduled for each format.

	Too much	Just right	Not enough
The amount of time hearing from experts was
The amount of time to discuss challenges and solutions as a whole group was
The amount of time to discuss challenges and solutions in small groups was
The amount of time meeting with federal staff was
The amount of time to network and collaborate with other grantees was
The amount of time to share and discuss my project was
The amount of time to learn about other projects was

Page Break

Q7. What was your favorite CoP session format? Please click on one answer.

Expert presentation in large group

Peer sharing in large group

Small group discussion

Large group meeting with Office of Child Care representatives

Q8. What was your least favorite CoP session format? Please click on one answer.

Expert presentation in large group

Peer sharing in large group

Small group discussion

Large group meeting with Office of Child Care representatives

Q9. Do you have a suggestion for another format we might try (other than the 4 listed above)? For example, we could have 1 or 2 grantees present emerging findings to the large group. Please click on one answer.

Yes, please describe:

No

Page Break

Q10. Reflecting across the year, please mark the circle below that best reflects your perspective on the CoP.

	Strongly agree	Agree	Neither agree nor disagree	Disagree	Strongly Disagree
Overall, I felt that the monthly CoP was a good use of my time

Q11. If you have any suggestions for how we could make the monthly CoP a better use of your time and/or more valuable to you, please write them in the text box below.

Page Break

B. In the Community of Practice (CoP), we provide other supports to facilitate your collaboration outside the monthly CoP meetings too. These are listed below.

Q12. Please mark the circle that best indicates how helpful you found each of these other supports.

	I found this support very useful	I found this support moderately useful	I accessed this support and did not find it useful	I did not access this support	I was not aware of this support
Announcements to the CoP Basecamp Message Board
Posting of Monthly CoP Meeting Agendas and Notes to the CoP Basecamp site
Posting of Resources to the CoP Basecamp Site (e.g., copies of surveys)
Facilitating conversation among the Quant Team through a separate Basecamp team
Sharing resources through the Building Child Care Research Capacity web page
Facilitating joint conference presentations

Q13. Is there another type of support that you would like to see offered in the Community of Practice? For example, we could host a small group meeting outside of the monthly CoP meeting, schedule more time for project officers to discuss grant management, develop a new Basecamp team on a specified topic, provide more guidance on how to access Basecamp, host an occasional two-hour meeting, or other supports. Please click on one answer.

Yes, please describe:

No

Page Break

C. Please reflect for a moment on your research goals for the coming year. Please answer the following questions to help us in planning topics for next year.

Q14. Please click on all of the answers that reflect the stage(s) of research you expect to be performing between January 2021 - December 2021. We expect to be:

Designing or redesigning your approach on some parts of your work

Gathering, cleaning, or linking administrative data

Sampling/Recruitment of participants

Conducting interviews or focus groups

Gathering data through surveys

Performing time-trend analyses

Performing other quantitative analyses

Conducting an implementation or process analysis

Conducting other qualitative analyses

Providing short turn-around analyses to inform operational decisions

Translating some of your findings for a policy or other audience

Unsure

Other, please describe:

Page Break

Q15. Please click on up to TWO topics you would like to hear from an expert presenter in monthly CoP meetings between January 2021-December 2021. [Note: The next question will ask which of these topics you would like to discuss in a small group discussion with peers].

Designing or redesigning your approach on some parts of your work

Gathering, cleaning, or linking administrative data

Sampling/Recruitment of participants

Conducting interviews or focus groups

Gathering data through surveys

Performing time-trend analyses

Performing other quantitative analyses

Conducting an implementation or process analysis

Conducting other qualitative analyses

Providing short turn-around analyses to inform operational decisions

Translating some of your findings for a policy or other audience

Other, please describe:

Page Break

Q16. Please click on up to TWO topics you would like to discuss in a small group in monthly CoP meetings between January 2021-December 2021.

Designing or redesigning your approach on some parts of your work

Gathering, cleaning, or linking administrative data

Sampling/Recruitment of participants

Conducting interviews or focus groups

Gathering data through surveys

Performing time-trend analyses

Performing other quantitative analyses

Conducting an implementation or process analysis

Conducting other qualitative analyses

Providing short turn-around analyses to inform operational decisions

Translating some of your findings for a policy or other audience

Other, please describe:

Page Break

Q17. What is your grantee role? Please click on one answer.

CCDF Lead Agency policy staff

CCDF Lead Agency research staff

Principal Investigator or co-PI on grantee external research team

Other staff (non-PI and non-co-PI) on grantee external research team

Q18. If you have any additional comments regarding year 1 of the Community of Practice (e.g. things that worked well or things that did not work well), please write them in the text box below.

We thank you for your time spent taking this survey.
Your response has been recorded.

Paperwork Reduction Act Statement: This collection of information is voluntary and will be used to collect participant feedback to shape future meetings. Public reporting burden for this collection of information is estimated to average 8 minutes per response. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB number and expiration date for this collection are OMB #:0970-0401, Exp: 05/31/2021. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to [email protected].

Paperwork Reduction Act Statement: This collection of information is voluntary and will be used to collect participant feedback to shape future meetings. Public reporting burden for this collection of information is estimated to average 5 minutes per response. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB number and expiration date for this collection are OMB #:_____, Exp: _____. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to [email protected].

Paperwork Reduction Act Statement: This collection of information is voluntary and will be used to collect participant feedback to shape future meetings. Public reporting burden for this collection of information is estimated to average 5 minutes per response. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB number and expiration date for this collection are OMB #:_____, Exp: _____. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to [email protected].

Paperwork Reduction Act Statement: This collection of information is voluntary and will be used to collect participant feedback to shape future meetings. Public reporting burden for this collection of information is estimated to average 5 minutes per response. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB number and expiration date for this collection are OMB #:_____, Exp: _____. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to [email protected].

Paperwork Reduction Act Statement: This collection of information is voluntary and will be used to collect participant feedback to shape future meetings. Public reporting burden for this collection of information is estimated to average 5 minutes per response. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB number and expiration date for this collection are OMB #:_____, Exp: _____. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to [email protected].

Page 17 of 17

OMB Control #: 0970-0401

Expiration Date: 05/31/2021

File Type	application/vnd.openxmlformats-officedocument.wordprocessingml.document
File Title	CCPRP CoP Year 1 Evaluation Form
Author	Qualtrics
File Modified	0000-00-00
File Created	2021-05-10