Evaluation Question Matrix

Attachment 5: NBCCEDP Evaluation Question Matrix

Evaluation Question	Clinic Data	Survey
Clinic-Level Screening Rate Changes
What are trends in B/C screening rates over time across health system clinics? What are baseline B/C screening rates in clinics? Are clinics’ screening rates increasing over time? Are clinics meeting targets for B/C screening?	X
What are the characteristics of the health systems and clinics where EBIs are being implemented? What are the characteristics of the health systems and their clinics that both deliver NBCCEDP screening services and implement EBIs?	X
Patient Reach / Patient Demographics and Eligibility Criteria
What is the reach of the B/C screening program via health systems and their clinics? How many health systems and their clinics are grantees partnering with for health systems change? How many women within the age-eligible group for screening are served by these clinics? How many providers work at these clinics? What is the geographic location of health system clinics?	X
EBIs to Support B&C Screening
What EBIs are grantees implementing and/or enhancing within health system clinics? Are B/C resources used to support EBI implementation? What EBIs are being implemented with B/C resources? Are multiple EBIs being implemented within clinics? If so, which combinations are used?	X
What EBIs (or combination of EBIs) are associated with greater increases in B/C screening within health system clinics?	X
To what extent is implementation of the EBIs sustainable1 without NBCCEDP funding?	X
Partnerships to Support Screening
What are the characteristics of grantees’ screening provider sites delivering B/C clinical services? How many and what types of screening provider sites comprise the NBCCEDP screening provider network? How much funding is budgeted to support B/C clinical services?		X
What are the characteristics of the non-health system/clinic partners that grantees engage to support the B/C program? What types and how many non-health system/clinic partners do grantees engage to support the program? Are partnerships already established or newly formed? Are partnerships formalized (e.g., MOU, contract)? How much funding is budgeted to support these partnerships? What types of activities do these partners conduct?		X
Community Outreach and Patient Navigation
To what extent are health systems and their clinics utilizing community health workers to reach priority? How many CHWs are funded through the NBCCEDP? What types of community outreach activities are conducted to support community-clinical linkages?2	X	X
To what extent are health systems and their clinics utilizing patient navigators to support priority populations? How many women were served through patient navigation (including those who did and did not receive screening services at B/C provider sites)? How many women receive patient navigation at partner health system clinic sites where EBIs are delivered What patient navigation activities were delivered to patients?	X	X
Support of Healthy Lifestyle Behaviors
Do health system clinic partners have a comprehensive B/C screening policy in place?	X
Grantee Infrastructure (Including Health IT)
Are clinic data monitored for quality? What is clinics’ confidence in screening rates generated by EHRs? Do health systems validate their screening rates? What are the known data issues? What improvements have been made to EHR systems?	X	X
What types of health IT support are grantees providing to health systems?		X
Grantees’ Monitoring and Evaluation
What monitoring and evaluation activities are grantees implementing? Are grantees using data to inform programmatic decision-making and/or clinic-level service delivery? What types of data are used by grantees? How often are data used? Are grantees using data dashboards to inform decision-making? If so, what decisions are influenced by data dashboards? How frequently are grantees monitoring screening rates at clinics?	X	X
What metrics, if any, are used to track programmatic progress over time?		X
Program Management
What barriers and facilitators do grantees encounter when managing, implementing, and/or evaluating their programs?		X
What are grantees’ technical assistance and training needs?		X
What non-CDC financial resources do grantees have to support the NBCCEDP?		X
Incidence, Mortality, and Disparities
Are grantees tracking incidence and/or mortality rates for priority populations?		X
Are grantees tracking disparities for priority populations?		X

1 Definition of sustainability: High quality implementation that has been achieved and a supporting infrastructure is in place along with any financial support needed to maintain the intervention. The intervention has become an institutionalized component of the health system and/or clinic operations.

2 For the purposes of this FOA, community-clinical linkages are defined as interventions that coordinate services among health systems, communities, and public health organizations to facilitate access to clinical care and promote health behaviors.