CSRE Feedback from Grant Participants

_{OMB Control Number:} 0970-0401; Expiration Date: 6/30/2024

Center to Support Research and Evaluation Capacity of CCDF Lead Agencies (CSRE): Feedback from Grant Participants

The purpose of this voluntary information collection is to solicit feedback from participants of monthly web meetings, annual hybrid meetings, and other occasional virtual meetings run by the Center to Support Research and Evaluation Capacity of CCDF Lead Agencies (CSRE). The participants are ACF grant team members participating in one or more Communities of Practice (CoPs) aiming to support cross-project support and collaboration. Participant feedback will be collected during or between grantee meetings through a Zoom poll, a link to an online survey, or group discussion. This feedback will help the government understand the grant recipients’ experiences and preferences and will be used to improve future meetings and other supports for these grant recipients.

NOTE: This document includes a universe or bank of sample questions. We plan to ask an average of 3-4 questions or 5 minutes of burden each time feedback is requested. ACF will administer the poll up to 16 times over the next 24 months.

Many questions have brackets with information that will be identified based on Community of Practice discussions, planning needs, and feedback. A question may be asked more than once, using alternate versions of the information in brackets. We also may make additional small tweaks in wording to fit the circumstances. Many of the questions are drawn from previously approved polls for the individual Communities of Practice over the past 3-4 years (i.e., the CCDBG, CCPRP-2019, PROSPR, or CCPRP-2022 Community of Practice) but approval to use them has lapsed or they are only allowed to be used for one Community of Practice.

Question Bank

[We will provide 5-15 response options per administration of the question below]

1. Help us select and prioritize topics for future Community of Practice [discussions/activities]. Below is a list of potential topics for our meetings during [a time period within the next year] [the upcoming/final year of the Community of Practice] [the next annual meeting] [breakout rooms at a future meeting]. Please [rank each topic in order of preference/as high, medium or low interest; select 3/4/5 topics.]

   1. [grant recipient peer sharing on research methods and challenges]

   2. [grant recipient peer sharing on findings and policy implications]

   3. [data dashboards]

   4. [joint journal issue]

   5. [joint conference presentations]

   6. [communicating results to policy makers]

   7. [policy innovations in the states]

   8. [using maps to inform child care policy decisions]

   9. [informal networking through Gathertown or similar web-conferencing app]

   10. [trends in family child care]

   11. [non-traditional hour care]

   12. [ECE workforce supports and retention]

   13. [measuring quality]

   14. [other CCDF Policy topics]

   15. [evaluating the spending of ARPA funds]

   16. [analyzing COVID-era administrative data]

   17. [sampling/recruitment of participants]

   18. [building strength of agency-researcher partnerships]

   19. [research methods -administrative data]

   20. [research methods – primary data collection]

   21. [cross-team construct definition building]

   22. [cross-team construct selection]

   23. [cross-team measure selection and match with constructs]

   24. [new topic to be identified]

   25. [new topic to be identified]

   26. [new topic to be identified]

2. How familiar are you with [CCDF policy, research topic, or methodology]? Please select one of the following:

   1. Very familiar

   2. Somewhat familiar

   3. A little familiar

   4. Not at all familiar

3. How helpful would a(n) [expert presentation/discussion/resource] about [CCDF policy, research topic, or methodology] be for your team? Please select one of the following:

1. Very helpful

2. Somewhat helpful

3. A little bit helpful

4. Not helpful, at least not at this time

4. What questions do you have about [CCDF policy, research topic, or methodology]?

[One sentence FILL IN]

5. What are the top one or two challenges or difficult decisions your team [is facing at this time/expects to face] related to [research and evaluation/creating and sharing common measures/communicating findings to policymakers/CCDF policy or research topic/TBD area]?

[One sentence FILL IN]

6. Are there any [research or evaluation] methods your team is interested in learning more about to apply in your own work?

[One sentence FILL IN]

7. Please [rank in order of preference/as high, medium or low interest; select 3/4/5 of] the communications tactics that you are interested in learning more about.

1. Briefs

2. Reports

3. Fact sheets

4. Peer-reviewed journal articles

5. Presentations to policymakers

6. Conference presentations

7. Stakeholder outreach

8. Blog posts

9. Social media

10. Media outreach

11. Other. Please specify [_____________][in Zoom chat]

8. What would help facilitate successful peer support and collaboration in this community of practice, both within and across teams?

[One sentence FILL IN]

9. Think about positive community of practice experiences that you’ve had. What best practices would you like to see us carry forward into this community of practice?

[One sentence FILL IN]

10. Reflecting on discussions from [X meeting], please identify which [constructs, measures, data points, variables] you think have the most value in building the evidence across [states, territories, Tribes] and seem potentially feasible. Mark [all that apply, your top two, one].

    1. [Option 1]

    2. [Option 2]

    3. [Option 3]

    4. [Option 4]

    5. [Option 5]

    6. [Option 6]

[We will provide up to 8 response options per administration of the question below.]

11. Where do you see the most potential for [common measures or measurement/ cross team collaboration/ data sharing/topic to be identified]? Please [rank order in order of preference/as high, medium or low interest; select from] the options below.

    1. [Using some common survey questions and response options]

    2. [Adopting some common constructs and definitions]

    3. [Increasing standardization of administrative data for greater ease of collaboration]

    4. [Understanding broader implications of cross-project findings]

    5. [Informing future collaborative research efforts]

    6. [Shaping own research and evaluation goals]

    7. [new option to be identified]

    8. [new option to be identified]

12. Which of the following topics would you be interested in for a regular/one-time,] [small,] [cross-CoP] discussion group being held [during a Community of Practice] [as an additional meeting outside of regular CoP time]? Please [rank order in order of preference/rank as high, medium or low interest; select from] the options below.

    1. [Quantitative methods]

    2. [Primary data collection]

    3. [State partners]

    4. [Communication strategies]

    5. [new option to be identified]

    6. [new option to be identified]

    7. [new option to be identified]

    8. [new option to be identified]

    9. [I would be interested in a regular, small discussion group, but not for any of the topics listed.]

    10. [I would not be interested in a regular, small discussion group on any topic.]

13. What additional topic would you be interested in for a regular/one-time,] [small,] [cross-CoP] discussion group being held [during a Community of Practice] [as an additional meeting outside of regular CoP time]?

[One sentence FILL IN]

14. We are considering whether [next year’s annual meeting/meeting X] should be virtual or hybrid (with an in-person component and a virtual component). Please indicate your interest in attending an in-person meeting. For purposes of responding to the survey, assume COVID conditions are similar to what they are now and that the meeting follows COVID precautions such as [to be specified]. Please click one answer.

1. I would likely attend a [day-long] in-person meeting [in the District of Columbia].

2. I would only be interested in attending in-person if at least [half][other percentage] of other attendees are also planning to attend in-person.

3. I would support a hybrid meeting but would likely attend virtually.

4. I would prefer a virtual annual meeting [of xx-yy hours].

5. Other. Please specify[_____________][in Zoom chat]

[Each time administering the question below we would ask for input on 1-10 sessions]

15. We would like your feedback on recent sessions held during our Community of Practice. Please pick the rating that best reflects your perspective the session[s] listed below.

1. [Name of session/speaker, date]

1. Very helpful

2. Somewhat helpful

3. A little bit helpful

4. Not helpful

5. Did not attend or can’t remember

2. [Name of session [with speaker], date]

1. Very helpful

2. Somewhat helpful

3. A little bit helpful

4. Not helpful

5. Did not attend or can’t remember

3. [Name of session [with speaker], date]

1. Very helpful

2. Somewhat helpful

3. A little bit helpful

4. Not helpful

5. Did not attend or can’t remember

4. [Name of session [with speaker,] date]

1. Very helpful

2. Somewhat helpful

3. A little bit helpful

4. Not helpful

5. Did not attend or can’t remember

5. [Name of session [with speaker], date]

1. Very helpful

2. Somewhat helpful

3. A little bit helpful

4. Not helpful

5. Did not attend or can’t remember

16. Please provide input on how often we should meet [as a Community of Practice] [as an ad-hoc discussion group] during [time period to be specified] [, after the initial period of the grant has ended].

1. [Meet monthly]

2. [Meet every other month]

3. [Meet quarterly]

4. [Meet biannually]

5. [Other response to be identified]

6. [Other. Please specify [________________________________][in Zoom chat]

7. [Do not meet at all]

17. Please provide input on whether the Community of Practice should hold an annual meeting in the [first/second/third/four/fifth/last/next] year of the project [, after the initial period of the grant has ended] [in order for grantee teams to share their final findings?] Please select one answer.

1. I would favor an annual meeting, using a hybrid (in-person and virtual) format of [5-8 hours] [(with the in-person component in DC)].

2. I would favor an annual meeting, using a virtual format of [2-4 hours]

3. I do not favor holding an annual meeting after the one in [month, year of last annual meeting].

4. [other response to be identified]

5. Other. Please specify [________________________________][in Zoom chat]

18. To help us plan future [meetings to support grant teams], please indicate how often you personally plan to participate at future [Community of Practice meetings, special topics meetings, other CSRE-sponsored meetings] over the next [x months][year][other time period]. Please select one answer.

1. [My team has a new grant/no cost extension] and I plan to participate [mostly every month].

2. [My team has a new grant/no cost extension] and I plan to participate [frequently, but not every month].

3. [My team has a new grant/no cost extension] and I plan to participate [on occasion].

4. [My team has a new grant/no cost extension] and I plan to participate [at another frequency],

5. [My team’s grant has ended] and I still plan to participate [mostly every month].

6. [My team’s grant has ended] and I still plan to participate [frequently, but not every month].

7. [My team’s grant has ended] and I still plan to participate [on occasion].

8. [My team’s grant has ended] and I plan to participate [at another frequency] Please specify _______________________________________[in zoom chat]

   1. [other response to be identified]

   2. [other response to be identified]

19. If OPRE were to develop a product to support [policy members/research members] of your team in learning about [CCDF policy or research topic][ state/territory/tribal CCDF agencies and research partnerships in planning evaluations of [CCDF policy or research topic] , what product form would be preferred:

    1. [Webinar]

    2. [Written brief]

    3. [Step-by-step resource]

    4. [Bibliography]

    5. [Catalog or compendium]

    6. [other format]

    7. [other format]

    8. [Other. Please specify: __________________________]

    9. [None, as this topic would not be useful to cover in a product].

20. If OPRE were to develop a product to support state/territory/tribal CCDF agencies and research partnerships in planning evaluations, what topic or focus would you nominate:

[One sentence FILL IN]

21. What communication tactics have you used in the past to disseminate your [research or work products]?

    1. [Briefs]

    2. [Reports]

    3. [Fact sheets]

    4. [Peer-reviewed journal articles]

    5. [Presentations to policymakers]

    6. [Conference presentations]

    7. [Stakeholder outreach]

    8. [Blog posts]

    9. [Social media]

    10. [Media outreach]

    11. [other format]

    12. [other format]

PAPERWORK REDUCTION ACT OF 1995 (Pub. L. 104-13) STATEMENT OF PUBLIC BURDEN: The purpose of this information collection is to help ACF understand grant recipient preferences for future meetings and other supports. Public reporting burden for this collection of information is estimated to average 5 minutes per respondent, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. The OMB # is 0970-0401 and the expiration date is 06/30/2024. If you have any comments on this collection of information, please contact Teresa Derrick-Mills at [email protected].

11