Attachment A

ATTACHMENT A

Study Topics and Data Sources

Attachment A

Implementation Study Topics and Expected Data Sources

Topic/Key Subtopics	Sources
	Program Documents	Site Documents & Records	Notes from Site Selection and Monitoring	Site Visit Discussions	Observations	Youth surveys
PROGRAM
Program background	x		x
When, by whom, and how developed Extent and settings of prior use Prior evidence of effectiveness
Site background		x	x	x
Youth demographics and risk behavior levels Community and organizational setting Previous and other existing programming Process and rationale for selecting program
Program type and emphases	x	x	x
Abstinence until marriage Abstinence-based education Sexuality education Family planning education and outreach STD/HIV education and prevention Youth development
Core components of the program Core content Core pedagogy/instructional strategies Core implementation logistics	X	X	X	X
Planned adaptations to the existing program	X	X	X	X
Program goals and expected outcomes Sexual risk behavior Other	x	x	x	x
In each area: - Goals - Expected outcomes for youths, adults, schools, community
Intended target population	x	x	x	x
Age/grades Gender SES Organizational affiliation Risk indicators
Main messages conveyed to participants	x	x	x	x
Theory of change/logic model	x	x	x	x
Underlying developmental theory Underlying learning and influence theory Program-specific operational theory of change
School needs and values		x	x	x
Stakeholders Steps taken to gain and maintain school/district buy-in and support Coordination with other related school programs
Community needs and values		x	x	x
Stakeholders Steps taken to gain and maintain community buy-in and support
External events				x
Outside influences that may have affected the program outcomes targeted for change
Availability and features of other programs/services with similar goals (including pregnancy prevention and family planning programs)			x	x
School-based programs Clinic-based programs Community-based programs
Youth participation in other relevant programs/services				x		X
School-based programs Clinic-based programs Community-based programs
PROGRAM IMPLEMENTATION
Program administration and funding
Sponsor/organization administering program		x	x	x
National organization, and role Local sponsoring organization
Program partners and their roles		x	x	x
Formal and informal partners Roles in implementing program
Sources of financial and in-kind resources		x	x	x
Adequacy of resources		x	x	x
Key resources required/used to implement program
Program materials	x	x	x	x
Curriculum materials Teacher/leader guides Supplemental resources Assessment/monitoring tools
Staff structure and positions		x	x	x
Organizational chart Position descriptions Minimum qualifications for each position Use of volunteers
Training (pre-service and in-service) and technical assistance	x	x	x	x
Training offered or sanctioned by program developer Technical assistance offered or sanctioned by program developer Other training or technical assistance used by site Certification (availability, process, cost)
Facilities		x	x	x
Infrastructure required/used (technology, special facilities or space requirements)
Cost	x	x	x	x
Overall cost, cost per participant Cost of acquiring curriculum materials, etc Cost of external training and technical assistance
Key features/activities planned/implemented
Key features of program
(For each component, timeline, main topics, venue, format, materials, prescribed number, frequency and length of sessions, staffing)
Youth focused components (content and strategies)	x	x	x	x
Adult-led instruction/activities Peer-led instruction/activities Individual counseling/mentoring/tutoring Large group events/school assemblies Online resources/activities Referrals Direct health services Community service/experiences Other
Adult-focused components (content and strategies)	x	x	x	x
Parent training, train-the-trainer
Community-focused components (content and strategies)	x	x	x	x
Special events Media campaign Website Other
Planned/actual program time line		x	x	x
Time period during which program will be implemented Time of day/schedule of sessions/activities
Number and duration of sessions	x	x	x	x
Types of activities during sessions	x	x		x
Other types of participant contacts		x		x
Features of the program that distinguish it from others		x		x
Key dimensions of planned/actual program delivery
Number and characteristics of youth targeted/served in evaluation site(s)		x	x	x		X
Ages/grades Gender Race/ethnicity, language SES Organizational affiliation Risk indicators Legal status (court-ordered, foster care) Sexual orientation
Staff qualifications and experience		x		x
Education Degrees and certification Relevant experience Staff turnover
Quantity and quality of staff training		x		x
Training opportunities and participation levels Staff assessment of value of training
Key dimensions of planned participation
Outreach and recruitment to fill program spaces		x		x
Outreach strategies Recruitment procedures
Parental permission		x		x
Attendance at specific events/sessions		x
Mandatory vs. voluntary Attendance monitoring and followup Retention in the program
Parent outreach and involvement		x		x
Opportunities for parent input or participation Levels of parent participation
Links to other community agencies		x		x
Nature of agreements with community partners Coordination with community partners
Links to other school activities		x		x
Monitoring and Adaptations
Assessment/monitoring and program adaptation		x		x
Service tracking Outcomes data collection and analysis Processes for program assessment/monitoring
Unplanned adaptations of program to fit context				x
Information or events that led to changes Changes in messages/Curriculum changes Changes in schedule, duration or intensity Staffing changes Changes in target population Use of supplemental materials Other changes
IMPLEMENTATION FIDELITY
Implementation of core program components compared to plans and standards	x	x		x
Program performance standards Program self-assessment Fidelity assessed according to benchmarks established prior to implementation/evaluation Reasons for lack of adherence
Participant responsiveness		x		x	x	X
Participation patterns overall and in key activities Participant engagement in program activities Barriers to participation
Indicators of quality		x		x	x
Youth involvement in planning Group sizes and youth-staff ratios Interactions between staff and youth Parent involvement
Implementation challenges and successes				x