Culture of Continuous Learning Project: Landscape Survey

Status: Original and derived artifacts are available for this document.

Download: docx | pdf | html





Instrument 7: QRIS Administrator or PD Director Survey: Culture of Continuous Learning Landscape Study	
Culture of Continuous Learning Landscape Study: QRIS Administrator or PD Director Survey 
This survey is intended to gather information regarding the ways in which states, territories, and Head Start regions design, implement, and evaluate their early care and education (ECE) quality improvement delivery systems. For the purpose of this survey, please consider the term “quality improvement” to include a variety of activities like training or professional development, technical assistance, coaching and consultation, and other quality improvement activities. We realize these systems can look different across states, territories, and Head Start regions; we are reaching out to you to help fill in our understanding of the landscape of quality improvement delivery systems across the U.S. Thank you for sharing information on this topic! 

This one-time, online survey should take no more than 20 minutes to complete. You can skip any question and you can stop the survey at any time. There are no right or wrong answers to any of our questions. Your name and contact information will not be shared outside our project team, and they will not be identified in any reports of study findings. Your responses will not be shared with your employer or have any impact on your employment status. Your answers will be combined with information from others who complete the survey. 

There is no direct benefit to you for completing this survey. We hope that the information you provide will benefit the early child care and education field. 

If you would like a copy of this information or have questions, please email our IRB at [email protected] or by phone at 1-855-288-3506.
Screening
Please confirm your location and job title below.
    1. Do you work for [STATE]?
        a. IF Yes -> continue to next question
        b. IF No -> end survey text. Thank you for your response!

    2. Are you the [STATE] [JOB TITLE]? 
        a. IF Yes -> continue to next question
        b. IF No -> end survey text
END survey text -> Thank you for your response. If you know the contact information for the [STATE] [JOB TITLE] please provide their name and work email address below. If you do not know the contact information for the [STATE] [JOB TITLE] please click “Submit” to end the survey. 
Name _______________
Email address_________________

    3. Is this position an interim role or permanent position? 
        a. Interim
        b. Permanent
Quality Improvement Infrastructure 
    4. What sources of funding has [STATE] used to provide professional development and quality improvement, such as training, technical assistance, and coaching in the past 12 months? For the purpose of this survey, please consider the term “quality improvement” to include a variety of activities like training or professional development, technical assistance, coaching and consultation, and other quality improvement activities. Select all that apply. 
        a. Federal Child Care Development Fund (CCDF) funds
        b. State Child Care Development Fund (CCDF) supplemental funds 
        c. Federal Head Start funds
        d. State Head Start supplemental funds 
        e. Early Head Start-Child Care Partnership funds 
        f. Public PreK funds
        g. Preschool Development Grants funds
        h. TANF funds
        i. Other public funds not specified here  
        j. Private funding 
        k. Something else______ (please describe) 
        l. I don’t know 

    5. What information does your [STATE] use to assess needs, monitor implementation, or evaluate the effectiveness of the professional development and quality improvement systems? For each option, select if you use it for planning, monitoring or evaluation, or that you do not use that type of information for these purposes.  

 Information source
Use to plan, monitor or evaluate effectiveness of activities
Not applicable/
Do not use 
Data about adherence to federal, state, or local regulations (e.g., licensing regulations) 



Compliance with requirements set by a privately funded initiative 



Data from statewide needs assessments 



Data from local community needs assessments 



Data from tribal needs assessments 



Data from Migrant and Seasonal needs assessments


Data from a quality rating and improvement system (e.g., changes in quality ratings over time) 



Input from teachers/providers (e.g., surveys, interviews, focus groups, listening sessions) 



Input from families (e.g., surveys, interviews, focus groups, listening sessions) 



Input from center directors/program leaders (e.g., surveys, interviews, focus groups, listening sessions) 



Input from community members and leaders (including leaders in local social service agencies, schools, advocacy organizations, etc.)  (e.g., surveys, interviews, focus groups, listening sessions) 



Data about children’s development (e.g., child assessments; teacher/provider surveys about children) 



Data from observations of classrooms and family child care programs 



Training attendance or participation information 



Training or technical assistance evaluations 



Web analytics/Web traffic information 



Something else_______(please describe) 



I don’t know



    6. Who provides training, technical assistance, or coaching to child care or Head Start programs participating in your QRIS? Select all that apply. 

Training, technical assistance, or coaching provider
Child Care only
Head Start only
Both
Neither/Not applicable
I don’t know
Child care resource & referral (CCR&R)





Regional Head Start Office





National Head Start Association





State Head Start Association





State Department of Human Services or Social Services





State Department of Health





State Department of Education





Another state-level agency





Private, for-profit organizations





Private, non-profit organizations





Colleges and universities 





Independent consultants





Someone else






IF “Another state-level agency” is selected -> What state-level agency? (open ended)

IF “Someone else” is selected -> Who else? (open ended)

IF any response other than “I don’t know” to QX -> Of these organizations or individuals, which are the top 2 providers in supplying training and technical assistance to programs? Select the top two.
a. Pipe in responses from QX 
b. Pipe in responses from QX 
c. Pipe in responses from QX 
. . .

    7. In what ways, if any, does [STATE] have formal or informal connections between participation in QRIS professional development and quality improvement activities, and other pieces of the ECE system at the state or local level? Select all that apply. 
    a. Offering higher subsidy reimbursement rates to programs that participate in QRIS training, TA, or coaching
    b. Offering continuing education credit(s) to those in programs that participate in QRIS training, TA, or coaching
    c. Waivers of certain requirements to those in programs that participate in QRIS training, TA, or coaching
    d. Eligibility for COVID-19 relief funds to those in programs that participate in QRIS training, TA, or coaching
    e. Eligibility for wage supplements or bonuses for staff employed in QRIS-participating programs
    f. Eligibility for quality awards or other financial awards to those programs that participate in QRIS training, TA, or coaching
    g. Training, TA, or coaching offered outside of QRIS counts towards QRIS requirements
    h. Something else ________(please describe)
    i. I don’t know
    j. None of these

    8. What are the considerations or conditions under which Head Start programs can access quality improvement supports in QRIS? (e.g., coaching/technical assistance, financial incentives, quality assessments) Select all that apply. 
    a. Head Start programs are eligible for quality improvement supports regardless of their participation in QRIS  
    b. Head Start programs must participate in the QRIS to be eligible for quality improvement supports  
    c. Head Start programs must participate in the QRIS and have a particular rating level to be eligible for quality improvement supports 
    d. Head Start programs are not eligible for QRIS supports 
    e. Something else_________(please describe) 
    f. I don’t know 

IF any response other than “I don’t know” to QX -> Approximately what percentage of Head Start grantees in your [STATE] receive supports through QRIS? 
        a. None
        b. Between 1%-25% 
        c. Between 26%-50%
        d. Between 51%-100% 
        e. I don’t know 

    9. What features has your state put in place to encourage participation in quality improvement activities? Select all that apply. 
        a. Fee reduction as needed/no fee for training itself
        b. Providing food and refreshments during training 
        c. Reimbursing or providing upfront funds to people for travel costs, parking fees, etc.
        d. Offering opportunities in multiple languages
        e. Offering opportunities offered at varying times of the day/week (i.e., nights, weekends, etc.)
        f. Offering opportunities in a variety of formats (i.e., in-person, virtual, hybrid)
        g. Offering trainings on-site (e.g., at a child care program) or near work-site
    h. Offering trainings at community sites (e.g., community centers, schools,  churches, etc.)
    i. Offering opportunities as part of the workday (i.e., participants are paid as they would for regular work activity) 
    j. Offering pay to cover substitute staff
    k. Using multiple forms of outreach and marketing to advertise opportunities 
    l. Providing training series or options for participants to progress from entry level to more advanced content
    m. Something else_______(please describe)
    n. I don’t know
    o. None of these

Equity in Quality Improvement
    10. Has [STATE] does any of the following to improve equity in its quality improvement activities? By improving equity in quality improvement activities, we mean working towards fair inclusion of all providers, especially those who have historically and persistently been marginalized by systemic inequities from opportunities, and prioritizing input from families and communities about the quality improvement system. Select all that apply. 
    a. Revised the QRIS (or begin a revision process) to update the quality standards
    b. Improved equity of access to financial resources (i.e., grants, quality awards) for providers
    c. Created or continued using established race equity-related goals for quality improvement implementation 
    d. Created or continued using established equity-related goals for quality improvement implementation (other than race equity)
    e. Examined ECE program characteristics data to understand patterns of participation in quality improvement and access to quality improvement resources
    f. Collected data from ECE professionals to learn how the QRIS or other quality improvement initiatives have affected them in their programs
    g. Collected data from families to understand their perspective on quality improvement initiatives
    h. Collected data from community partners to understand their perspective on quality improvement initiatives 
    i. Collected data related to equity-related goals
    j. Reported disaggregated data by race or ethnicity
    k. Reported disaggregated data by another characteristic (other than race or ethnicity)
    l. Offered equity-related content in training and technical assistance activities
    m. Made efforts to recruit quality improvement staff that are representative of children and families in your area
    n. Increased staff time dedicated to meeting equity-related goals
    o. Something else_________(please describe) 
    p. I don’t know 
    q. None of these
Types of Quality Improvement Activities 
    11. QRIS funds in [STATE] support training, technical assistance, and quality improvement for programs. For each topic listed below, please indicate which type(s) of training or coaching have been  supported through QRIS funds in the past 12 months that you are aware of. If it would be helpful, you could review language in contracts with professional development partners or vendors to answer this question. Select all that apply.  

Topic area
Training for individuals
Staff register and attend on their own. May or may not attend with anyone else they work with. 
Training for organizations
Program staff are trained in a group, and typically attend all together. 
Coaching for individuals
Staff receive one-on-one coaching or technical assistance. Goals may be set by the coach or the individual teacher/staff member. 
Coaching for organizations
Program staff receive support for their classroom or program. Coaching is directed at multiple staff from the program working on a shared goal. 
Something else 
Please describe.
I don’t know
None of these offered for this topic
Business practices 
Yes
No
Yes
No
Yes
No
Yes
No



Child screening & assessments
Yes
No
Yes
No
Yes
No
Yes
No



Children with disabilities and inclusion practices 
Yes
No
Yes
No
Yes
No
Yes
No



Using curriculum
Yes
No
Yes
No
Yes
No
Yes
No



Family engagement
Yes
No
Yes
No
Yes
No
Yes
No



Community engagement
Yes
No
Yes
No
Yes
No
Yes
No



Nutrition & physical health
Yes
No
Yes
No
Yes
No
Yes
No



Mental, emotional, behavioral health
Yes
No
Yes
No
Yes
No
Yes
No



Health & safety
Yes
No
Yes
No
Yes
No
Yes
No



Social emotional learning
Yes
No
Yes
No
Yes
No
Yes
No



Language & literacy
Yes
No
Yes
No
Yes
No
Yes
No



Math & science
Yes
No
Yes
No
Yes
No
Yes
No



Dual language learners
Yes
No
Yes
No
Yes
No
Yes
No



Diversity, equity, & inclusion
Yes
No
Yes
No
Yes
No
Yes
No



Staff wellness
Yes
No
Yes
No
Yes
No
Yes
No



Pyramid Model
Yes
No
Yes
No
Yes
No
Yes
No



Something else _____(please describe)
Yes
No
Yes
No
Yes
No
Yes
No




IF any response other than “I don’t know” to QX -> Of these types of support, which are the top 2 where QRIS invests the most funds ? Select the top two.
a. Pipe in responses from QX 
b. Pipe in responses from QX 
c. Pipe in responses from QX 
d. Pipe in responses from QX
e.  Pipe in responses from QX

IF any YES response to “Coaching for Organizations” above à What factors influence whether a 
program can participate in organizational coaching?  Select all that apply. 
    a. Program type________(please describe) 
    b. Program location ________(please describe) 
    a. Funding source ________(please describe) 
    b. Part of a pilot initiative ________(please describe) 
    c. Another type ________(please describe) 
    d. I don’t know 
    e. None of these

IF any YES response to “Coaching for Organizations” above -> Are you able to provide a website where our research team can learn more? Alternatively, you may upload a document that describes coaching for organizations. [text box with file upload option]  

Recent and Future Changes to QI Systems

    14. Are there any changes [STATE] will make to its quality improvement systems in the next 1-3 years in any of the following ways? 

Implementation of quality improvement opportunities
Yes, we will make these changes
We have made these recent changes to the QRIS system since 2020
No
Exploring this idea
I don’t know






About training





Changes in the mode of training delivery (i.e., in-person, virtual, or hybrid options)





Changes to waivers of training requirements





Changes to training costs to participants (i.e., decreased or increased)





Changes in availability of training





Changes to the availability of training in multiple languages





Changes to training topics





Changes in training staff





About coaching





Changes in the mode of coaching delivery (i.e., in-person, virtual, or hybrid options)





Changes to waivers of coaching requirements





Changes to coaching costs to participants (i.e., decreased or increased)





Changes in availability of coaching 





Changes to coaching topics





Changes in coaching staff





Other potential changes





Changes in resources on racial justice or culturally responsive care





Changes in the frequency of cross-agency collaboration





Something else ____ (please describe






IF Yes to a QX response option -> What changes will [STATE] make to its implementation of QI activities in the next 1-3 years? [PIPE IN RESPONSE OPTIONS] 

Implementation of QI opportunities





Availability of trainings or coaches 
Fewer options available


More options available
I don’t know
Availability of resources on racial justice or culturally responsive care
Fewer options available


More options available
I don’t know
Variety of training or coaching topics
Fewer options available


More options available
I don’t know
Frequency of collaboration 
Less collaboration


More collaboration
I don’t know


Demographics 
    15. How long have you been in your current position? 
        a. Drop-down, number of years

    16. What role(s) do you currently have within the Head Start or ECE system in [STATE]? Select all that apply.

Role
Currently have
CCDF administrator

Head Start Collaboration Office director

Head Start Education Manager

Head Start Regional Program Manager

Head Start Regional Manager

State PreK director

Local PreK administrator 

Child care licensing staff

QRIS staff

Child care subsidy staff

Part C or Part B of IDEA staff (early childhood special education)

Child Care Resource & Referral staff

Professional development/consultant/trainer

University or community college ECE instructor

Work at a professional association

Work in a school district

Work in an advocacy organization

Work in a child care center or was a home-based care provider

Work in a Head Start program

Other direct service with children and families (e.g., home visitor, nurse, social worker, parent educator)

Other policy work related to children and families (e.g., health care)

Something else ____(please describe)


    17. Which of the following best describes your gender identity? 
    a. Female
    b. Male
    c. Non-binary, Gender fluid, or Gender expansive
    d. Transgender
    e. A gender not listed here
    f. I prefer not to answer

    18. Are you of Hispanic, Latino/a, or Spanish origin?
    a. No, not of Hispanic, Latino/a, or Spanish origin
    b. Yes, Mexican, Mexican American, Chicano/a
    c. Yes, Puerto Rican
    d. Yes, Cuban
    e. Yes, Another Hispanic, Latino/a, or Spanish origin
    f. I prefer not to answer

    19. What is your race? (select one or more)
    a. American Indian or Alaska Native
    b. Asian Indian
    c. Chinese
    d. Filipino
    e. Japanese
    f. Korean
    g. Vietnamese
    h. Other Asian
    i. Black or African American
    j. Native Hawaiian
    k. Guamanian or Chamorro
    l. Samoan 
    m. Other Pacific Islander (please specify) ________
    n. White
    o. Another race (please specify) ________
    p. I prefer not to answer