Assessment Plan

Attachment B: MAPP Assessment Plan

MAPP Assessment Plan
Primary Assessment Question: Does MAPP make a difference within participating communities?
Phase	Secondary Assessment Question	Indicator/Performance Measure	Assessment Method
Phase 1: Outcome Assessment	What are some of the short-term outcomes associated with the implementation of the MAPP program? Awareness and Collaboration Internal Changes within Agency External Changes between Agency and Community To what extent are communities implementing the MAPP process? Number of iterations MAPP steps completed MAPP final products	2014 Mobilizing for Action through Planning and Partnerships Outcome Assessment	The 2014 Mobilizing for Action through Planning and Partnerships (MAPP) data collection tool was initiated by the MAPP work-group to measure outcomes among the participating communities. Using their recommendations, this comprehensive data collection tool was developed to focus on the short-term outcomes associated with MAPP implementation. Additionally, the data collection tool aims to measure the degree of program implementation across communities in hopes to gain an understanding of how communities are defining a MAPP iteration. The phase 1 cohort will consist of all organizations that have or are currently using the MAPP program. (n=___).
Phase 2: Qualitative	What is the communities overall experience with the implementation of MAPP? How is the communities experience with the implementation of MAPP play a role in their short-term outcomes?	One-on-one qualitative interviews And/or Focus groups	The qualitative portion of the Assessment will focus on the short-term outcomes communities may/may not have experienced, as well as their overall experience with the implementation of MAPP. The phase 2 cohort will consist of select participants from the phase 1 assessment. This selection process will hinge on the distribution of effects among participants. Specifically, the number of both positive and negative changes experienced and the breadth of these changes. The ideal cohort for this phase would consist of both communities that reported positive changes in relation to utilizing MAPP and communities that reported negative changes in relation to utilizing MAPP. Based off of the final analysis of phase 1, an operational definition of what constitutes a positive or negative change will be developed. Using this definition, a cohort will be constructed that is representative of phase 1’s distribution of results. This phase will also include interviews with communities who did not complete a full iteration of MAPP. This will help answer questions specific to retention.
Phase 3: Follow-up	Based on themes derived from phase 2, what are some of the long-term outcomes associated with the implementation of MAPP?	To be determined at the close of Phase 2	Phase 3 will consist of a assessment that will focus on long-term outcomes associated with the implementation of MAPP. How the assessment defines and measures these long-term outcomes will fall in conjunction with themes derived from phase 2. The ideal cohort will be consist of all communities who have successfully completed 1 or more iterations of the MAPP program. (n=___)