ombsupportingstatement_5_1_13 B

TDV OMB Clearance

Supporting Statement

Information Collection Request

Supporting Statement Part B for the

Teen Dating Relationships: Opportunities for Youth to Define what’s Healthy and Unhealthy

also known as the

Understanding Abuse in Teen Dating Relationships through Concept Mapping Project

Project Officer: Carrie

F. Mulford, PhD

Crime, Violence and Victimization Research Division

Office of Research and Evaluation National Institute of Justice Office of Justice Programs Department of Justice

810 7th Street NW Washington, DC 20531

Phone: (202) 307-2959

Fax: (202) 616-0275

E-mail: carrie.mulford@usdoj.gov

Section B: Collections of Information Employing Statistical Methods

B.1. Respondent Universe and Sampling Methods……………………………………………………….

B.2. Procedures for the Collection of Information………………………………………………………..

B.3. Methods to Maximize Response Rates and Deal with Nonresponse………………………………...

B.4. Test of Procedures or Methods to be Undertaken……………………………………………………

B.5. Individuals Consulted on Statistical Aspects and Individuals Collection and/or Analyzing Data…..

References………………………………………………………………………………………………...

B. Collections of Information Employing Statistical Methods

B.1. Respondent Universe and Sampling Methods

The following table displays the number of individuals that will be invited to participate in the different information collection tasks:

Concept Mapping Participation Targets
Task			Teens (14-18)	Young Adults (19-22)	Adults	Total task target
Brainstorming	100			100	100	300
Sorting	50			50	50	150
Rating	125			125	125	375
Total group target						375
Facilitated Discussion Participation Targets
Suggested location		Teens (14-18)		Young Adults (19-22)	Adults	Total regional target
Washington, DC		10		10	20	40
Atlanta		10		10	20	40
Chicago or Kansas City		10		10	20	40
San Francisco		10		10	20	40

Total group target

0 40

40

80

160

This information collection will not require purposefully sampling on the basis of any specific social demographics other than age, although every effort will be made to include youth representing various demographic groups (e.g., racial, ethnic, SES, religious, sexual minority). As such, the target numbers for each age-group were selected to allow for a range of views from youth and young adults of varying backgrounds and adults with a range of professional experiences.

_{B.2. Procedures for the Collection of Information}

The information collection approach for this project will be to purposefully sample on the basis of heterogeneity, which is to non-randomly select a broad range of persons who are likely to reflect the full range of ideas as possible that are relevant to the topic under investigation. However, the adequacy of ideas captured is dependent upon whether there is a match between the focus and the participants selected to participate. We are not expecting that the results will be generalizable to the youth and adult populations at large; however, we will be looking for saturation of the topic, as bounded by the participant groups. Thus, we anticipate that in the brainstorming task, we will reach a point at which there will be a fair amount of redundancy and some homeostasis in the topic. The goal is to achieve a broad sampling of ideas rather than a representative sample of individuals. Youth respondents will be recruited through youth-serving organizations with collective access to a diverse group of youth ages 14-22 recommended by members of the project Planning and Advisory Groups. These groups will be selected in part through

a nomination process that solicited recommendations for organizations from the project’s Planning and Advisory Groups. Within this group of youth serving organizations, we are looking to purposefully stratify our sample by age across two age groups: 14-18 (teens) and 19-22 (young adult), to capture the variation of perspectives as they may be influenced by age. The organizations that will be used for recruitment purposes will be instructed by the research team to recruit a specific number of youth within

the specific age ranges for participation in each activity (see Appendices B1-B3). Inclusion of youth participants will be based on a first-come-first-serve criterion; those youth who are first to respond to the organizational representatives’ advertisements will have the opportunity to participate. In addition, adult participants will be selected from Planning and Advisory Group nominations, based on the relevance of their professional roles to the youth population and their relationships (e.g., practitioners, teachers, advocates, researchers).

In terms of quality control, the sorting, rating and demographic/background data will be gathered directly over the web, thus eliminating any concerns about mis-entering or mis-reading handwritten data. The software has some constraints built in that prevent errors in the data entry. For example, because this is an unstructured forced-choice sort method (Weller & Romney, 1988), the software does not allow a statement to be placed in more than one group simultaneously. For the ratings, the software only allows legitimate entries (e.g., the integers 1-to-5). Before any participant data can be used in data analysis, the

software requires that the concept map analyst visually inspect the data and indicate by checking a setting that the data are complete and useable. Without this check, the participant’s data will not appear in any subsequent screen that calls for data analysis. Because the Concept System® software was designed expressly to accomplish the concept mapping process and analysis, there is no danger that the statistical analysis procedure might be mis-specified by the analyst.

B.3. Methods to Maximize Response Rates and Deal with Non-Response

The brainstorming task will be conducted completely anonymously for all respondents. The number of statements elicited in response to the focus prompt will be measureable. However, there will be no way to determine the actual response rate, as respondents will be able to provide as many statements as they choose without any way to identify which respondents provided which statements. One limitation of the concept mapping method is that there is an inherent bias, such that the most motivated participants will provide the majority of the statements that the rest of the group will be asked to sort and rate.

The response rates for sorting and rating will be calculated over the course of the information collection, as the project website administrators will be able to monitor the progress of each participant according to their username. To maximize response rates for brainstorming, sorting and rating, a reminder notice will be e-mailed to all invited adult respondents at multiple points during the period for each task. Response rates for youth invited to participate in the sorting and rating also will be maximized by offering the incentives described in section A9 of this supporting statement, and by asking youth-serving organization representatives to remind youth participants to complete the activities. In addition, because the use of incentives to maximize completion of the sorting and rating tasks, we anticipate that our response rates will be higher than the estimates outlined in section B1 above.

The facilitated discussion response rate will be calculated based on how many invitees (10-14 per discussion) actually attend. Attendance rates will be maximized by sending invitees reminders of the discussions in advance of the sessions.

B.4. Test of Procedures or Methods to be Undertaken

_{Not applicable. No tests of procedures or methods will be undertaken.}

_{B.5. Individuals Consulted on Statistical Aspects and Individuals Collection and/or Analyzing Data}

Concept Systems, Inc. (CSI) is the contractor that will be consulted on statistical aspects of the design, and will collect and analyze the information for the agency. Individuals from CSI who will be contributing to the statistical design and analysis are as follows:

i. Mary Kane, Principal Consultant ii. Scott Rosas, Senior Consultant

iii. Alyssa Goldman, Project Manager iv. Jennifer Royer, Junior Consultant

These individuals can be reached by telephone at (607) 272-1206.

The NIJ staff listed below will be involved with statistical analysis or interpretation. All of them can be reached at (202) 307-2942.

i. Carrie Mulford, Social Science Analyst

ii. Dara Blachman-Demner, Social Science Analyst iii. Jaclyn Smith, Research Assistant

References

Anderberg, M. R. (1973). Cluster analysis for applications. New York, NY: Academic Press, Inc. Anderson L.A., Gwaltney M.K., Sundra D.L., Brownson R.C., Kane M., Cross A.W., et al. (2006). Using

concept mapping to develop a logic model for the Prevention Research Centers Program. Preventing Chronic Disease [3:1 serial online] 2006 Jan. Available from: URL: http://www.cdc.gov/pcd/issues/2006/jan/05_0153.htm.

Arriaga X. B., & Foshee, V. A. (2004). Adolescent dating violence. Do adolescents follow in their friends’ or their parents’ footsteps? Journal of Interpersonal Violence,19(2):162–84.

Barnett, O., Miller-Perrin, C. L., & Perrin, R. D. (2005). Family violence across the lifespan 2^nd Ed. Thousand Oaks, CS: Sage Publications.

Bayer, A. M., Cabrera, L. Z., Gilman, R. H., Hindin, M. J., & Tsui, A. O. (2010). Adolescents can know best: Using concept mapping to identify factors and pathways driving adolescent sexuality in Lima, Peru. Social Science & Medicine 70(12): 2085-2095.

_{http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3248349/pdf/nihms319533.pdf}

Bergman, L. (1992). Dating violence among high school students. Social Work; 37:21–7.

Brown, J. (2006). Rethinking concept mapping for youth participatory evaluation in the context of youth development programs. Journal of Youth Development, 1(2).

Burke, J., O'Campo, P., Salmon, C., & Walker, R. (2009). Pathways connecting neighborhood influences and mental well-being: Socioeconomic position and gender differences. Social Science & Medicine 68(7):

1294-1304.

Conrad, K. J., Iris, M., & Ridings, J. W. (2011). Conceptual model and map of psychological abuse of older adults. Journal of Elder Abuse and Neglect 23(2): 147-168.

Conrad, K. J., Ridings, J.W., & Iris, M. (2011). Conceptual Model and map of financial exploitation of older adults. Journal of Elder Abuse and Neglect 23(4): 304 - 325.

Cook, C., Heath, F., & Thompson, R. L. (2000). A meta-analysis of response rates in web- or internet- based surveys. Educational and Psychological Measurement, 60(6), 821-836.

Coxon, A. P. M. (1999). Sorting data: Collection and analysis. Thousand Oaks, CA: Sage.

Everitt, B. (1980). Cluster analysis. 2nd edition. New York, NY: Halsted Press, A Division of John Wiley and Sons.

Fox, B. J., Bialous, S. A., Trochim, W., Stillman, F. A., & Schmitt, C. L. (2006). Evaluating tobacco industry tactics as a counterforce to ASSIST. In National Cancer Institute (Ed.), Evaluating assist: A

blueprint for understanding state-level tobacco control (Vol. 17, pp. 213-264). Bethesda, MD: Department of Health and Human Services, National Institutes of Health, National Cancer Institute. Galliher, R. V., Enno, A. M., & Wright, R. (2008). Convergence and divergence across multiple methods for assessing adolescent romantic relationships. Journal of Adolescence, 31, 747-769.

Giordano, P. C., Soto, D. A., Manning, W. D., & Longmore, M. A. (2010). The characteristics of romantic relationships associated with teen dating violence. Social Science Research, 39(6), 863-874.

Hays, S., & Scholla, K. (2003). Engaging Youth In Tobacco Policy Change: Results from a Concept Mapping Project in Madison County, Illinois. Paper presented at the 2003 Annual Meeting of Midwest Political Science Association, Chicago, Illinois, April 4, 2003.

Iris, M., Ridings, J.W., & Conrad, K. J. (2010). The development of a conceptual model for understanding elder self-neglect. The Gerontologist 50(3): 303-315.

Johnson, S. L., Burke, J. G., & Gielen, A. C. (2011). Prioritizing the school environment in school violence prevention efforts. Journal of School Health 81(6): 331-340.

Kane, M., & Trochim, W. (2007). Concept mapping for planning and evaluation. Thousand Oaks, CA: Sage Publications.

Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004). A comparison of web and mail survey response rates. Public Opinion Quarterly, 68(1), 94-101.

Krippendorf, K. (2004). Content analysis: An introduction to its methodology (2nd ed.). Newbury Park, CA: Sage Publications.

Kruskal, J. B., & Wish, M. (1978). Multidimensional scaling. Beverly Hills, CA: Sage Publications. Levy, B. (1990). Abusive teen dating relationships: An emerging issue for the 90s. Response to the

Victimization of Women and Children. 13(1).

Levy B. (1991). Dating violence: Women in danger. Seal, Seattle, WA.

Mulford, C., & Giordano, P. C. (2008) Teen dating violence: A closer look at adolescent romantic relationships. NIJ Journal, 261, 34-40.

Murphy, K. & Smith, D. (2010). Adolescent girls’ responses to warning signs of abuse in romantic relationships. Journal of Interpersonal Violence, 25(4),626-647.

O’Keefe, M. (2005). Teen Dating Violence: A Review of Risk Factors and Prevention Efforts. VAWnet: The National Online Resource Center on Violence Against Women (www.vawnet.org: Applied Research Forum). .

Osborn, A. F. (1957). Applied imagination. New York: Scribner.

Patton, M. Q. (1990). Qualitative evaluation and research methods 2^nd Ed. Thousand Oaks, CA: Sage

Publications.

Ries, A., Voorhees, C., Gittelsohn, J., Roche, K. & Astone, N. (2008). Adolescents’ perceptions of environmental influences on physical activity. American Journal of Health Behavior, 32(1), 26-39.

Rosas, S. R., & Camphausen, L. C. (2007). The use of concept mapping for scale development and validation in evaluation. Evaluation and Program Planning, 30(2), 125-135.

Rosas, S. R., & Kane, M. (2012). Quality and rigor of the concept mapping methodology: A pooled study analysis. Evaluation and Program Planning, 35(2), 236-245.

Rosenberg, S., & Kim, M. P. (1975). The method of sorting as a data gathering procedure in multivariate research. Multivariate Behavioral Research, 10, 489-502.

Schwartz, R. M. (1994). The skilled facilitator: Practical wisdom for developing effective groups. San

Francisco: Jossey-Bass.

Shulman, S. & Kipnis, O. (2001). Adolescent romantic relationships: A look from the future. Journal of

Adolescence, 24,337-351.

Silverman J, Raj A, Mucci L, Hathaway J. (2001). Dating violence against adolescent girls and associated substance use, unhealthy weight control, sexual risk behavior, pregnancy, and suicidality. Journal of the American Medical Association, 286(5):572-9.

Simmons, C. A., Farrar, M., Frazer, K., & Thompson, M. J. (2011). From the voices of women: Facilitating survivor access to IPV services. Violence Against Women 17(10): 1226-1243.

Snider, C., Kirst, M. Abubakar, S. Ahmad, F. & Nathens, A. (2010). Community-based articipatory research: Development of an emergency department-based youth violence intervention using concept mapping. Academy of Emergency Medicine, 17,877-885.

Trochim, W. (1989). An introduction to concept mapping for planning and evaluation. Evaluation and

Program Planning, 12(1), 1-16.

Tuval-Mashiach, R. & Shulman, S. (2006). Resolution of disagreements between romantic partners, among adolescents, and young adults: Qualitative analysis of interaction discourse. Journal of Research on Adolescence, 16(4), 561-588.

Weller, S. C., & Romney, A. K. (1988). Systematic data collection. Newbury Park, CA: Sage

Publications.

2