Appendix D SNAP Ed Scoring Tool

---

Overview

INTRODUCTION
OVERVIEW & DEVELOPMENT
EVALUATION & OUTCOMES
IMPLEMENTATION
TRAINING MATERIALS & RESOURCES
BONUS QUESTIONS
REVIEWER RECOMMENDATION

---

Sheet 1: INTRODUCTION

UNITED STATES DEPARTMENT OF AGRICULTURE Food and Nutrition Service SNAP-ED INTERVENTION SCORING TOOL	OMB APPROVED NO. 0584-0639 Expiration Date: XX-XX-XXXX
INSTRUCTIONS
I. This scoring tool is broken into six sections: 1) Intervention Overview & Development, 2) Evaluation & Outcomes, 3) Implementation, 4) Training Materials and Resources, 5) Bonus Questions, and 6) Reviewer Recommendations. Please refer to the Intervention Submission Form and accompanying documents to complete this scoring tool. Please use all information provided about the intervention to determine a score for each section. The Intervention Submission Form Questions or Materials to Review noted in column C throughout this scoring tool are suggestions. Enter your score for each review question in the yellow column labeled, "Score."
II. Use the yellow column labeled, "Reviewer Comments" if you would like to take notes on the submitters responses. We will only share your comments with the other reviewers if scores need alignment.
III. At the end of this scoring form, please select whether you recommend or do not recommend this intervention for inclusion in the SNAP-Ed's Clearinghouse of Evidence-Based Interventions. If an intervention is not recommended for inclusion, please provide your rationale at the end of the form in the open-ended text fields. FNS will provide intervention developers with the reasons it was not included, and the additional information or actions they can take for reconsideration. FNS will de-identify this feedback.
IV. Please be sure to complete all six tabs in this workbook:
1). Intervention Overview & Development
2). Evaluation & Outcomes
3). Implementation
4). Training Materials and Resources
6). Reviewer Recommendation
Form Approved OMB No. 0584-0639 | According to the Paperwork Reduction Act of 1995, an agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is [0584-0639]. The time required to complete this information collection is estimated to average 4.5 hours per response, including training and the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: U.S. Department of Agriculture, Food and Nutrition Services, Office of Policy Support, 1320 Braddock Place Alexandria, VA 22314, ATTN: PRA (0584-0639*). Do not return the completed form to this address. Expiration date: XX/XX/XXXX FORM FNS-885 Version 2 (04-21) Previous Editions Obsolete

---

Sheet 2: OVERVIEW & DEVELOPMENT

				OMB APPROVED NO. 0584-0639 Expiration Date: XX-XX-XXXX
Reviewer Name:
INTERVENTION OVERVIEW AND DEVELOPMENT
Review Question	Score	Intervention Submission Form Quesetions or Materials to Review	Maximum Points	Factors for Maximum Score	Reviewer Comments
Are the primary objectives of the intervention clearly described?		Questions 10, 11, 12, supporting documents	2	Primary objectives are clearly described and align with intervention description.
Does the intervention address the needs of the intended audience?		Questions 13, 14, 16	3	The intervention addresses the cultural needs, preferences, language, reading levels of the intended audience.
Was the intended audience and community partner involved in the development of the intervention?		Question 17 & supporting documents	3	Depth and quality of involvement (true partnership versus consultation). Demonstrated integration of target intended audience or community partner feedback. Thorough needs assessment completed prior to intervention development.
Were SNAP-Ed educators, participant and/or partner feedback involved in testing acceptability of the intervention?		Questions 18a, 18b	1	Formative evaluation results documented and incorporated. Reports from participants, stakeholders, and partners indicating acceptability.
Are the core components of the intervention clearly described and realistic for the audience and setting for which it is intended?		Questions 15, 16 supporting documents & intervention materials	5	Resources needed for implementation are clearly described. Appropriateness of the intervention for multiple audiences/settings.
Intervention Overview and Developmental Total:	0		14

---

Sheet 3: EVALUATION & OUTCOMES

EVALUATION AND OUTCOMES					OMB APPROVED NO. 0584-0639 Expiration Date: XX-XX-XXXX
Review Question	Score	Intervention Submission Form Quesetions or Materials to Review	Maximum Points	Factors for Maximum Score	Reviewer Comments
Does the supporting documentation indicate that the intervention is evidence-based at a level that is appropriate for the intervention's stage of development (Research-tested, Practice-tested)?		Questions 19, 20, 23, supporting documents, & intervention materials	8	Evaluation methods used. Evaluation type for lifespan of intervention specified. Quality of the supporting materials and conclusions appropriate for a SNAP-Ed eligible audience.
Behavior change theory   used and described in the development of the intervention and evaluation.		Question 21	2	Description of behavior change theory used and appropriate for intervention and evaluation.
Were the intended outcomes of the intervention achieved?		Questions 20, 22 & supporting documents	10	Number of intended outcomes achieved. Extent of achievement (proportion of participants/ organizations reporting positive results, statistical significance, difference from baseline). The evaluation was conducted with rigor and transparency.
Is the intervention aligned with the SNAP-Ed Evaluation Framework? (for example, individual, environmental setting, and sectors of influence)		Questions 20, 22, supporting documents & intervention materials	5	Intervention approaches and settings are specified. Outcomes and the extent to which they occurred are described. There is alignment with the SNAP-Ed Evaluation Framework.
Are the intervention's main components (critical features) reasonably feasible to replicate with fidelity?		Questions 15, 24, 26, 31 & intervention materials	5	Resources needed for implementation (including cost) are specified. Availability and feasibility of methods for ensuring intervention fidelity. Ability of organizations with limited resources to implement the intervention.
Are the methods described to ensure program fidelity appropriate for the interventions?		Questions 24, 26, & intervention materials	5	Data collection methods are specified and appropriate for ensuring program fidelity. Resources needed to ensure intervention is completed with fidelity (e.g., staff time for observations or physical materials) are described.
Any evidence of maintenance of outcomes? (After 6 months for individuals)		Questions 20, 22, 26 & supporting documents	2	Feasibility of maintaining outcomes. Maintenance outcomes are appropriate.
Evaluation and Outcomes Total:	0		37

---

Sheet 4: IMPLEMENTATION

IMPLEMENTATION					OMB APPROVED NO. 0584-0639 Expiration Date: XX-XX-XXXX
Review Question	Score	Intervention Submission Form Quesetions or Materials to Review	Maximum Points	Factors for Maximum Score	Reviewer Comments
Does the intervention collaboratively engage partners across multiple levels of the SNAP-Ed Evaluation Framework (or multiple levels of the Socio-Ecological Model)?		Questions 27, 28, 29, supporting documents, implementation materials	6	Variety of partners engaged. Ability of setting and partners to reach SNAP-Ed target audience.
Are implementation directions and materials clear and easy to follow?		Materials	2	Appropriate language level. Logical flow of implementation steps. Materials are provided to support successful implementation with fidelity. Materials are appropriate for knowledge and experience level of intended user (e.g., materials for lay persons avoid technical jargon).
Did most of the sites/settings/ partners engaged complete the intervention? Did partners play a role after SNAP-Ed work was complete?		Questions 28, 34, & supporting documents	2	Number of sites/settings/partners approached that completed all components of the intervention described. Rationale provided if sites/settings/partners who expressed desire to continue but were unable to complete due to reasons beyond the scope of the intervention (such as closure of business). Partners play a role in sustaining efforts.
Does the evidence provided support that the intervention would be effective if adopted by other SNAP-Ed agencies for the intended audience addressed? Is it reasonable to expect that this intervention will be effective in the field?		Questions 21, 22, 25, 28, 31, 32, 33, 34, supporting documents, intervention materials, & possible outside research by reviewer	4	Theories of behavior change used. Extent to which behavior change theory is addressed through intervention methods is described. Extent to which intervention has been implemented and evaluated by other SNAP-Ed agencies is described.
Can components of the intervention be adapted to be used in settings or communities other than those explicitly described in the submission criteria?		Questions 28, 32, 33	2	Intervention components can be adapted for different settings or communities.
Can the intervention be sustained? Are sustainability concerns reasonable?		Questions 28, 31, 34 supporting documents & intervention materials	4	Number and extent of sustainability concerns. Total resources needed for intervention adoption, implementation, and maintenance. Diversity of potential partners or funding streams. Number of potential partners or funding streams.
Implementation Total:	0		20

---

Sheet 5: TRAINING MATERIALS & RESOURCES

TRAINING MATERIALS & RESOURCES					OMB APPROVED NO. 0584-0639 Expiration Date: XX-XX-XXXX
Review Question	Score	Intervention Submission Form Quesetions or Materials to Review	Maximum Points	Factors for Maximum Score	Reviewer Comments
Are intervention and evaluation materials provided for the intervention?		N/A	2	Intervention and evaluation materials are provided.
Intervention and evaluation materials are described.		Questions 38, 40a, 40b, 40c	5	Description of materials included.
Are training materials available for staff, partners, and/or volunteers?		Questions 37, 38, 39 41, & intervention materials	2	Yes/No
Training Materials and Resources Total:	0		9

---

Sheet 6: BONUS QUESTIONS

BONUS QUESTIONS					OMB APPROVED NO. 0584-0639 Expiration Date: XX-XX-XXXX
Review Question	Score	Intervention Submission Form Quesetions or Materials to Review	Maximum Points	Factors for Maximum Score	Reviewer Comments
Does the intervention reach an underrepresented population/setting in SNAP-Ed’s Clearinghouse of Evidence-Based Interventions?		Questions 10,14, supporting documents & intervention materials	2	Interventions currently underrepresented in SNAP-Ed’s Clearinghouse of Evidence-Based Interventions address the following populations/settings: - Middle School - High School - Pregnant/Breastfeeding - People experiencing homelessness - African Americans - Asian Americans/Pacific Islanders - Native Americans/Alaskan Natives - Refugees/Asylees or Immigrant populations - Older adults - Rural communities - Faith-based settings - Health care - Senior centers
Does the intervention use an approach/strategy that is currently underutilized in SNAP-Ed’s Clearinghouse of Evidence-Based Interventions?		Question 10, 11, 12, 15	2	Less than 30% of interventions currently represented in SNAP-Ed’s Clearinghouse of Evidence-Based Interventions address the following: - Social marketing campaigns - Policy, Systems, and Environmental (PSE) approaches - Multi-sector initiatives **Consider if this intervention is appropriate for the intended audience and settings, would reach the SNAP- Ed intended audience, and if it is feasible for organizations to adopt and implement.
How would you rate the overall quality of the responses and materials?			5	Responses are comprehensive and use specific, concise language. Materials provide relevant supporting information and are clearly referenced.
Bonus Questions Total:	0		9

---

Sheet 7: REVIEWER RECOMMENDATION

	OMB APPROVED NO. 0584-0639 Expiration Date: XX-XX-XXXX
TOTAL SCORE (WITHOUT BONUS):	0
BONUS SCORE:	0
Question	Reviewer Comments
Based on the score above and your expert review, do you recommend this intervention for inclusion in the SNAP-Ed Clearinghouse of Evidence-Based Interventions ? (Yes or No)
If no to above, please describe your reasoning for exclusion:
If no to above, please describe what additional information or actions would be needed to recommend this intervention:
If yes to above, please describe your reasoning for inclusion: