Att C - NPHII: Summative Assessment Qs & D Sources

Attachment C – NPHII Summative Assessment Questions and Data Sources

I. To what extent did awardees achieve NPHII program outcomes?

Areas of inquiry	Specific questions	Data Source(s)
Increased efficiency and effectiveness	In what ways have NPHII awardees increased the efficiency and/or effectiveness of programs, services, or processes?	Progress reports, annual assessment
Achievement of public health standards	Which standards are NPHII awardees meeting? Working towards?	Progress reports, annual assessment
	To what extent have awardees applied for or achieved accreditation?	Progress reports
Reach of support to other public health agencies for QI, PM, or accreditation readiness	To what extent are NPHII funds being used to support other public health agencies? Which agencies are receiving this support? What are the associated results?	Progress reports
NPHII contribution to awardees achieving program outcomes	In what ways has NPHII funding been used to support achievement of program outcomes?	Progress reports, interviews, focus groups
	In what non-monetary ways has the implementation of NPHII supported program outcomes?	Interviews, focus groups
Additional outcomes beyond program objectives	What unanticipated outcomes have been achieved due to the implementation of NPHII?	Progress reports, interviews, focus groups

II. Did Awardees meet the program objectives for performance management, accreditation readiness and quality improvement?

Areas of inquiry	Specific questions	Data source(s)
Established infrastructure for QI/PM—dedicated staff and office, performance management activities (objective 4 – Year 4 FOA )	To what extent did awardees hire and maintain a PIM?	Progress reports
	To what extent did awardees meet the program objectives of: Completing one or more performance management activities? What types of activities were completed? Completing two or more quality improvement initiatives, and/ or helping groups they represent identify, conduct, and/or report on quality improvement activities? Making progress towards or developing one or more of the PHAB pre-requisites? Applying for and achieving accreditation? Advancing their ability to meet or conform with the national Public Health Accreditation Board (PHAB) standards, and/or helping the groups they represent prepare for accreditation? Completing a self-assessment against PHAB standards?	Progress reports
Completion of quality improvement initiatives		Progress reports
Increased accreditation readiness		Progress reports

III. What aspects of NPHII are deemed most valuable and should be continued or sustained?

Areas of inquiry	Specific questions	Data source(s)
Perceived value of NPHII	What is the perceived value of NPHII outcomes among awardee organization leadership and staff?	Progress reports, interviews
	How have awardee organizations changed through the implementation of NPHII? What are the benefits, if any, from these changes? Operations Capacity (including PIM)	Progress reports, interviews, focus groups
	How, if at all, has NPHII influenced public health practice and research at the national level in the areas of accreditation, performance management, and quality improvement?	Interviews
	What aspects of NPHII or NPHII-related work will continue after closeout?	Progress reports, interviews
Sustainability	What aspects of NPHII or NPHII-related work will no longer be supported by awardees after close-out?	Progress reports, interviews
Observed linkages from program objectives to outcomes	What aspects of the NPHII program are associated with successful achievement of program outcomes?	Determined via analysis of data from prior questions

2