Form FNS 885 FNS 885 SNAP-ED TOOLKIT INTERVENTION SCORING TOOL

OMB APPROVED NO. 0584-XXXX
Expiration Date: MM/DD/YYYY

Print

UNITED STATES DEPARTMENT OF AGRICULTURE

Food and Nutrition Service
SNAP-ED TOOLKIT INTERVENTION SCORING TOOL
Instructions
- Please enter your score next to each question in the "Score" column.
- The Intervention Submission Tool Questions or Materials to Review are suggestions, please feel free to use all information provided about the intervention to determine a score for each question.
- Please feel free to make comments for each question, these will only be shared with other reviewers if scores need to be aligned.
- If an intervention is not chosen to be included in the SNAP-Ed Intervention Toolkit, intervention developers will be provided the reasons it was not included, and the additional information or actions to
be taken for inclusion. This feedback will be de-identified.
- Mandatory questions on the Intervention Submission Tool are indicated with an asterisk (*).
- For more information about the RE-AIM Framework, please visit https://snapedtoolkit.org/training/online-training/
Review Question

Score

Intervention Submission Maximum
Tool Questions or
Possible
Materials to Review
Points

Reach
How many people are exposed or served and are they representative?
Did the intervention reach the
intended target audience?

Questions 16*, 17*,
18*, 20*, 21*, 21a, 22*,
23, 26*, & supporting
documents

Is the intervention
appropriate for the audience
for which it was intended?

Questions 17*, 18*,
19*, 20*, 21*, 21a,
supporting
documents &
intervention materials

Factors for High Score

Reviewer Comments

12

5

- Total persons/institutions reached
- High proportion of eligible persons/institutions reached
- Persons/institutions reached are representative of target
audience

7

- Language level
- Materials needed
- Resource commitment (time, space, capital, human
resources)

Reach Total:
Effectiveness
What is the impact of your intervention on the intended outcomes?

35

Was the target audience (or
community partner) involved in
the development of the
intervention?

Questions 20*, 21*,
21a, & supporting
documents

3

- Level of involvement (consultation vs formative
research)

If applicable, does participant or
partner feedback indicate
acceptability of the intervention?

Questions 20*, 20a,
& supporting
documents

1

- Reports from participants and partners

Do the intended outcomes
indicate that objectives were
appropriately addressed?

Questions 22*, 23, &
supporting
documents

10

- Number of outcomes achieved
- Extent of achievement (proportion of participants/
organizations reporting positive results, statisical
significance, difference from baseline)

Form Approved OMB No. 0584-NEW | According to the Paperwork Reduction Act of 1995, an agency may not conduct or sponsor, and a person is not required to respond to, a collection of information
unless it displays a valid OMB control number. The valid OMB control number for this information collection is [0584-xxxx]. The time required to complete this information collection is estimated to average
6 hours per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information.
Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: U.S. Department of Agriculture, Food and Nutrition
Services, Office of Policy Support, 3101 Park Center Drive, Room 1014, Alexandria, VA 22302, ATTN: PRA (0584-xxxx*). Do not return the completed form to this address. Expiration date: XX/XX/XXXX

FORM FNS-885 (12-17) Previous Editions Obsolete

SBU

Electronic Form Version Designed in Adobe 11 Version

Review Question

Does the intervention address
multiple levels of the SNAP-Ed
Evaluation Framework (or multiple
levels of the Socio-Ecological
Model)?

Score

Intervention Submission Maximum
Tool Questions or
Possible
Materials to Review
Points
Questions 26*, 27*,
28*, 30*, supporting
documents &
intervention materials

Factors for High Score

5

- Type of intervention
- Intervention setting(s)
- Outcomes and the extent to which they occurred

8

- Use the Checklist for Evidence-Based Approaches
(found at https://snaped.fns.usda.gov/materials/
checklist-evidence-based-approaches) to help you
determine if the intervention is considered evidencebased
- Evaluation techniques used
- Evaluation type for lifespan of intervention
- Supporting materials quality and conclusions as
appropriate for a low-income audience

Does the supporting
documentation indicate that the
intervention is evidence-based at
a level that is appropriate for the
intervention's stage of
development (Research-tested,
Practice-tested, Emerging)?

Questions 24*, 25*,
26*, supporting
documents, &
intervention materials

Does the evidence provided
support that the intervention
would be effective if adopted by
other SNAP-Ed agencies? Is it
reasonable to expect that this
intervention will be effective in
the field?

Questions 24*, 25*,
26*, supporting
documents,
intervention
materials, & possible
outside research by
reviewer

6

- Theory of behavior change
- Extent to which behavior change theory is
addressed through intervention methods
- Success of other interventions which have used
similar behavior change theories, intervention
strategies, and how generalizable this success is to
the field

Are process evaluation materials
provided?

Questions 27*, 27a,
27b, & intervention
materials

2

- Yes/No

Effectiveness Total:
Adoption
How many settings/sectors are involved and are they representative?

15

Are the intervention materials
available at no cost?

Questions 10* & 11*

1

- Yes/No

Has the intervention previously
been used with a low-income
audience?

Question 32*

1

- Yes/No

Page 2

Reviewer Comments

Review Question

Is the intervention appropriate for
the setting for which it was
intended?

Score

Intervention Submission Maximum
Tool Questions or
Possible
Materials to Review
Points
Questions 28*, 29*,
supporting
documents, &
intervention materials

Factors for High Score

5

- Resource needs for adoption (materials, time, space)
- Ability of setting to reach SNAP-Ed target audience
- Availability of setting in communities of need

Did most of the sites/settings/
partners engaged complete the
intervention?

Question 29* &
supporting
documents

2

- Number of sites/settings/partners approached
- Number of sites/settings/partners which completed all
components of the intervention
- Sites/settings/parnters who expressed desire to
continue but were unable to complete due to reasons
beyond the scope of the intervention (such as closure
of business)

Does the intervention
collaboratively engage partners
who can affect change in multiple
levels of the SNAP-Ed Evaluation
Framework (or multiple levels of
the Socio-Ecological Model)?

Questions 28*, 29*,
30*, 31*, supporting
documents,
implementation
materials, & possible
outside research by
reviewer

6

- Mix of partner sectors of influence
- Ability of setting to reach SNAP-Ed target audience
- Availability of setting in communities of need

Adoption Total:
Implementation
Were the required activities of your intervention successfully implemented?
Are training materials available
for staff, partners, and/or
volunteers?

Question 35* &
intervention materials

Are implementation directions
and materials clear and easy to
follow?

Intervention materials

Are the intervention's main
components (critical features)
reasonably feasible to replicate
with fidelity?

Questions 34*, 35*,
35a, 36*, 39*, 42* &
intervention materials

Are the methods described to
ensure program fidelity
appropriate for the interventions?

Questions 34*, 35*,
35a, 36*, &
intervention materials

20

2

- Yes/No

5

- Language level
- Logical flow of implementation steps
- Materials are provided to support successful
implementation with fidelity
- Materials are appropriate for knowledge and
experience level of intended user (for example,
materials for lay persons avoid technical jargon)

8

- Resources needed for implementation
- Availability and feasibility of methods for ensuring
intervention fidelity
- Ability of organizations with limited resources to
implement intervention

5

- Data collection methods
- Resources needed to ensure intervention is
completed with fidelity (such as staff time for
observations or physical materials)

Implementation Total:
Page 3

Reviewer Comments

Review Question

Score

Intervention Submission Maximum
Tool Questions or
Possible
Materials to Review
Points

Maintenance
Were are the long-term effects of your initiative, and is it sustainable?

Factors for High Score

18

2

- Feasiblity of maintaining outcomes
- Comparison of outcome maintenance to similar
interventions
- Are maintenance outcomes expected at this point in
the lifespan of the intervention (esp. if emerging)

Questions 10*, 11,
22*, 26*, 27*, 27a,
27b, 35*, 39*, 42*, 43
& intervention
materials

3

- Feasiblity of maintaining outcomes
- Comparison of outcome maintenance to similar
interventions
- Are maintenance outcomes expected at this point in
the lifespan of the intervention (esp. if emerging)

Are the core components of the
intervention clearly described and
realistic for the audience and
setting for which it is intended?
Can components of the
intervention be adapted to be
used in settings or communities
other than those explicitly
described in the submission
criteria?

Questions 34*, 35*,
36*, 39*, 40, 41,
supporting
documents &
intervention materials

5

- Resources needed for implementation
- Appropriateness of the intervention for multiple
audiences/settings

Has the intervention been adopted
by partners/in settings not directly
supported by SNAP-Ed?

Question 38*

1

- Yes/No

Are sustainability concerns
reasonable and able to be
addressed through routine
operation (if minimal) expressed
or expected partnerships or
diversified funding mechanisms?
Consider both expressed and
intuited concerns.

Questions 39*, 42*,
43, supporting
documents &
intervention materials

7

- Number and extend of sustainability concerns
- Total resources needed for intervention adoption,
implementation, and maintenance
- Diversity of potential partners or funding streams
- Number of potential partners or funding streams

5

Less than 30% of interventions currently
representated in the toolkit address this population:
- High school
- Pregnant/Breastfeeding women
- Older Adults
- Specific nonwhite race/ethnicity
- Language other than English or Spanish

Any evidence of maintenance of
outcomes? (After 6 months for
individuals)

Questions 22*, 23 &
supporting
documents

Are resources or materials
reuseable or available to
participants/partners at no/low
cost on an ongoing basis to
facillitate outcome maintenance?

Maintenance Total:

BONUS: Does the intervention
reach an underrepresented
audience in the toolkit?

Questions 17*, 18*
supporting
documents &
intervention materials

Page 4

Reviewer Comments

Review Question

Score

BONUS: Does the intervention
reach an underrepresented
setting in the toolkit?

Intervention Submission Maximum
Tool Questions or
Possible
Materials to Review
Points

Questions 28* & 31*

BONUS: Does the intervention
use an approach/strategy that is
currently underutilized in the
toolkit?

Question 14*

Factors for High Score

5

Less than 30% of interventions currently
representated in the toolkit address this setting
- Early childcare & education
- Faith-based
- Healthcare
- Food retail
- Worksite

5

Less than 30% of interventions currently
representated in the toolkit address this
implementation strategy
- Social marketing
**Consider if this intervention is appropriate for the
target audience and settings, would reach the SNAPEd target audience, and if it is feasible for
organizations to adopt and implement

Reviewer Comments

Bonus Total:
Total Score (No Bonus):

Based on the score above and your expert review, do you recommend this intervention for inclusion in the SNAP-Ed Nutrition Education and Obesity Prevention Toolkit?
Yes

No

If no to above, please describe your reasoning for exclusion from the Toolkit:

If no to above, please describe what additional information or actions would be needed to recommend this intervention for inclusion in the Toolkit:

If yes to above, please describe your reasoning for inclusion in the Toolkit:

Page 5