SSA ChiCAS_06.21.21_Revised

SSA ChiCAS_06.21.21_Revised.docx

HIV prevention among Latina transgender women who have sex with men: Evaluation of a locally developed intervention

OMB: 0920-1266

Document [docx]
Download: docx | pdf


HIV prevention among Latina transgender women who have sex with men:

Evaluation of a locally developed intervention


OMB 0920-1266





Section A: Supporting Statement





June 21, 2021



CONTACT

Carla Galindo, MPH, CHES
Project Officer

Centers for Disease Control and Prevention
Division of HIV/AIDS Prevention
1600 Clifton Road, NE, Mailstop US8-5
Atlanta, GA 30333
Phone: 404-639-1902
Fax: 404-639-1950
E-mail: [email protected]







TABLE OF CONTENTS




EXHIBITS



LIST OF ATTACHMENTS


Attachment 1 Authorizing Legislation


Attachment 2

2a. 60-day Federal Register Notice published 8/23/2018

2b. 60-day Federal Register Notice new


Attachment 3 Recruitment Materials

3a. ChiCAS Recruitment Materials English

3b. ChiCAS Recruitment Materials Spanish


Attachment 4 Data Collection Instruments

4a. ChiCAS Screener English

4b. ChiCAS Screener Spanish

4c. ChiCAS Baseline Questionnaire English

4d. ChiCAS Baseline Questionnaire Spanish

4e. ChiCAS Follow Up Questionnaire English

4f. ChiCAS Follow Up Questionnaire Spanish

4g. ChiCAS Interview English

4h. ChiCAS Interview Spanish



Attachment 5 Consent Forms

5a. ChiCAS Consent English

5b. ChiCAS Consent Spanish

Attachment 6 Human Subjects Approvals

6a. ChiCAS IRB Approval

6b. ChiCAS IRB Triad Agreement

6c. ChiCAS IRB UNC Agreement

6d. ChiCAS IRB Amendment Assessment

6e. ChiCAS IRB Amendment Token

6f. ChiCAS IRB Amendment Virtual and OraQuick

6g. ChiCAS IRB Amendment Lewis

6h. ChiCAS IRB Amendment Catchment


Attachment 7 Data Use Plan


Attachment 8 Privacy Impact Assessment (PIA) Form


Attachment 9 Stay in Touch Cards

9a. ChiCAS Stay in Touch English

9b ChiCAS Stay in Touch Spanish


Attachment 10 Appointment Cards

10a ChiCAS Appointment Card English

10b ChiCAS Appointment Card Spanish

















  • Goals of the study: To evaluate the efficacy of ChiCAS (Chicas Creando Acceso a la Salud [Chicas: Girls Creating Access to Health]), a two-session Spanish language intervention that provides HIV prevention services to Hispanic/Latina adult transgender women who have sex with men.

  • Intended use: Data collected during this study will be used to evaluate the efficacy of the locally developed ChiCAS HIV prevention intervention for Hispanic/Latina transgender women.

  • Methods to be used to collect data: ChiCAS study participants will complete quantitative assessments at two intervals (baseline and 6-month). One-time qualitative interviews will also be conducted with a subset of intervention participants.

  • The subpopulation to be studied: 140 HIV-negative adult Latina transgender women who have sex with men and who live in metropolitan areas in and around North Carolina will be invited to participate in the intervention. Potential study participants will be invited to use the OraQuick In-home HIV test to confirm their self-reported HIV-negative serostatus and eligibility for the study, will complete the study’s consent process and baseline assessment, and will then be randomly assigned to receive the ChiCAS intervention (n=70) shortly after the consent process and completion of the baseline assessment, or to receive the intervention 6 months later, after completing 6-month follow-up assessment (n=70). Additionally, 30 of the 70 participants who receive ChiCAS shortly after completing the study consent and baseline assessment will be invited to participate in the semi-structured, qualitative interviews.

  • How data will be analyzed: The study design will use a randomization process to assign eligible Hispanic/Latina transgender women to the ChiCAS intervention condition or a waitlist (delayed-ChiCAS intervention) condition and will collect baseline data from participants in each condition following randomization. The study analysis will compare pre-intervention (baseline) and post-intervention (6-month follow-up) levels of participation by women assigned to the respective conditions in the primary intervention outcomes of consistent condom use and use of PrEP and medically supervised hormone therapy. The study design satisfies CDC criteria for rigorously evaluating the efficacy of HIV prevention interventions that, if determined to be efficacious, can be included in CDC’s Compendium of Evidence-Based Interventions and Best Practices for HIV Prevention. Qualitative data from the semi-structure interviews will be analyzed to describe intervention strengths and weaknesses to inform intervention improvements and future dissemination.



  1. Justification


  1. Circumstances Making the Collection of Information Necessary

The Centers for Disease Control and Prevention’s (CDC) Division of HIV/AIDS Prevention, (DHAP) requests OMB approval to extend data collection for 2 more years for OMB-approved project 0920-1266 entitled “HIV prevention among Latina transgender women who have sex with men: Evaluation of a locally developed intervention.”


This study will evaluate the efficacy of ChiCAS (Chicas Creando Accesso a la Salud [Chicas: Girls Creating Access to Health]), a two session Spanish-language small-group combination intervention designed to promote consistent condom use and the use of pre-exposure prophylaxis (PrEP) and medically supervised hormone therapy by HIV seronegative Hispanic/Latina transgender women who have sex with men.


Currently there are no known efficacious behavioral HIV prevention interventions targeting Spanish-speaking transgender women despite the extreme HIV burden that affects them. An estimated one in four transgender women is infected with HIV,1-3 and infection rates as high as 39% have been reported.4, 5 The odds of becoming HIV positive are estimated to be 34.2 times higher for transgender women than for other US adults.2 Furthermore, many transgender persons are not tested for HIV, 3, 6, 7 and less than half of HIV-positive transgender women may know their HIV status.1 Transgender women of color, including Hispanic/Latina transgender women4, 7-10 and transgender women who engage in sex work may be particularly affected by HIV.11, 12


Hispanic/Latina and other transgender women of color report high rates of condomless sex. A systematic review of 29 US-based studies of transgender women, 75% of whom were women of color, found that the average reported rate of receptive anal sex without a condom was 44.1%; the average rate of insertive anal sex without a condom was 27.4%.1 In a New York City study of transgender women, nearly half of whom were Hispanic/Latina, 35% reported not using a condom during vaginal or anal sex at last sex.13 Nearly half (47%) of transgender women of color in San Francisco with a history of exchanging sex for money or drugs reported condomless receptive sex with a primary partner in the past 30 days.14


Pre-exposure prophylaxis (PrEP) is a relatively new HIV prevention approach for use by HIV negative individuals who are at high risk of HIV infection. It entails taking daily doses of anti-retroviral medications (tenofovir and emtricitabine). However, studies of PrEP usage by transgender women for HIV prevention are limited. Our own research among Hispanic/Latina transgender women in NC suggest that they have very limited knowledge about and use of PrEP.15 A recent National Center for Innovation in HIV Care report emphasized the need for more PrEP-related information to be provided to transgender women.16


Transgender women may also obtain hormone therapy from non-medical sources, a pattern observed among more than one-third of those included in a systematic review. Hispanic/Latina transgender women may access medically supervised hormone therapy less than non-Hispanic/Latina white transgender women. This is illustrated by a San Francisco study: 9.5% of Hispanic/Latina transgender women in the study reported using no transition-related healthcare services, including hormone therapy, while all non-Hispanic/Latina white transgender women reported using some of these services.17 Hispanic/Latina transgender women in our NC studies report limited use of medically supervised hormone therapy.18 These use patterns may contribute to potential dangers associated with non-medically approved procedures and sources of hormones. They may also contribute to increased HIV risks. Transgender women, for example, who face financial barriers to obtaining hormone therapy may prioritize gaining access to those services over concerns about HIV prevention, leading to participation in sex work or transactional sex without condoms in order to pay for needed hormones.19, 20 By contrast, the use of medically supervised hormone therapy is associated with HIV-protective behaviors and lower rates of suicidal ideation and drug/alcohol use.17


The ChiCAS intervention supports HIV prevention and health promotion efforts by HIV-negative Hispanic/Latina transgender women by promoting consistent condom use and the use of PrEP and medically supervised hormone therapy. It provides tailored, detailed information to participants concerning where to obtain PrEP and medically supervised hormone therapy, the terms of accessing those services (e.g., eligibility requirements and costs), the conditions for accessing the services (e.g., availability of interpretation services and hours of operation), how to request services (e.g., making an appointment and what to bring), and what will happen during their medical visit (e.g., HIV testing for PrEP, informed consent process for hormone therapy, and follow-up appointments).


This project will advance the field of HIV prevention research by potentially identifying an efficacious intervention for use with Hispanic/Latina transgender women who have sex with men, who are disproportionately affected by HIV and for whom no known efficacious, behavioral HIV prevention interventions currently exist. Currently, only two risk reduction interventions focused on transgender women are included within Currently, CDC’s Compendium of Evidence-Based Interventions and Best Practices for HIV Prevention (http://www.cdc.gov/hiv/topics/research/prs/compendium-evidence-based-interventions.htm) and both of these interventions were developed, implemented, and evaluated prior to the approval of PrEP as a biomedical strategy to prevent HIV. If our study results determine that the ChiCAS intervention is efficacious, the results and products from this project may be disseminated to support public health practice and inform research and policy. Results and products from the study will include: (1) a Spanish-language combination HIV prevention intervention that is culturally congruent, designed to reduce risk among Hispanic/Latina transgender women, and ready for dissemination for use by service providers; and (2) a deeper understanding of HIV risk and intervention among Hispanic/Latina transgender women.


The project is in alignment with the following national HIV prevention goals:21

  • 1.A.2 Focus on high-risk populations (including transgender women)

  • 1.B.1 Design and evaluate innovative prevention strategies and combination approaches for preventing HIV infection in high-risk populations and communities, and prioritize and promote research to fill gaps in HIV prevention science among the highest risk populations and communities

  • 1.B.2 Support and strengthen integrated and patient-centered HIV and related screening (for sexually transmitted infections [STI], substance use, mental health, intimate partner violence [IPV], viral hepatitis infections) and linkage to basic services (housing, education, employment)

  • 1.B.3 Expand access to effective prevention services, including pre-exposure prophylaxis (PrEP) and post-exposure prophylaxis (PEP).

  • 3.B Adopt structural approaches to reduce HIV infections and improve health outcomes in high-risk communities.


The following section of the U.S. Federal Code is relevant to this data collection: 42 USC 241, Section 301 of the Public Health Service Act authorizes conduct of “research, investigations, experiments, demonstrations, and studies relating to the causes, diagnosis, treatment, control, and prevention of physical and mental diseases and impairments of man.” (Attachment 1)


  1. Purpose and Use of the Information Collection


The purpose of this information collection is to evaluate the efficacy of the ChiCAS intervention by comparing consistent condom use and the use of PrEP and medically supervised hormone therapy by Hispanic/Latina transgender women who receive the ChiCAS intervention shortly after enrolling in the study with these behavioral outcomes among participants (waitlist participants) who receive the intervention six months after enrolling. This information collection is needed in order to fill a gap in existing HIV prevention and health promotion resources for a population that is extremely vulnerable to HIV infection and associated health threats. Currently no known efficacious HIV prevention interventions exist for this vulnerable population. If the ChiCAS intervention is determined to be efficacious, it will provide the government and its health care provider partners with a much-needed HIV prevention tool.


ChiCAS is a small group, two-session Spanish language HIV prevention intervention designed exclusively for Latina transgender women and that will be delivered by experienced interventionists from the community: a self-identified Hispanic/Latina transgender women and a Hispanic/Latino gay man. ChiCAS is designed to increase knowledge and build the skills necessary to reduce HIV risk in a safe and culturally appropriate environment. Special emphasis is given to knowledge and engagement in PrEP care, consistent condom use and medically supervised hormone therapy. ChiCAS also provides the information needed to find local healthcare services. The ChiCAS intervention is based on social cognitive theory22-25 and the theory of empowerment education.26-28 Social cognitive theory emphasizes 4 components critical for promoting behavior change: (a) information, (b) mastery of self-protective skills and development of self-efficacy (e.g., role plays that will provide practice for participants around talking with providers), (c) enhancement of social proficiency, and (d) social support for personal change.22-25

The design of our proposed information collection is consistent with the intended use of the study data described above. One hundred and forty adult HIV negative Spanish-speaking Hispanic/Latina transgender women who have sex with men will be recruited to the study. Our plans for facilitating participant access to the intervention will promote the collection of needed information to assess a potentially effective HIV prevention method with this population. During our study, we will make the ChiCAS intervention available to participants in and around North Carolina- including seven CBOs and clinic provider locations in five metropolitan areas in North Carolina: Ashville (2 providers), Charlotte, Greensboro/Winston-Salem/High Point, Raleigh, and Wilmington (2 providers). Recruitment and screening will be carried out by study staff.


To publicize the study for recruitment purposes, we will post flyers in tiendas (small shops frequented by Hispanics/Latinos), laundromats, businesses that employ large numbers of Hispanics/Latinos (such as construction sites and hotels), English as a Second Language (ESL) classes, housing communities and apartment complexes, at community-based organizations, in Hispanic/Latino-serving restaurants throughout NC, and at festivals and events that attract large numbers of Hispanics/Latinos and transgender persons. We will post flyers and set up recruitment tables at various bars and clubs that are frequented by Hispanic/Latina transgender women. We will also use social media, such as Facebook and GPS-based “apps” that some sexual and gender-identity minorities use for social and sexual networking, to advertise the study. We will ask recruited participants to spread the word about the study to encourage persons in their social networks to call the study telephone number or meet with a member of the research team (Attachments 3a and 3b).


Interested participants will complete a brief screening process for eligibility and contact information will be collected (Attachments 4a and 4b). Study staff will schedule a follow-up appointment with potential participants to take an OraQuick In-home HIV test to confirm their eligibility and complete informed consent procedures (Attachments 5a and 5b). ChiCAS and wait-list group participants will complete an interviewer administered quantitative assessment at baseline (immediately following screening and consent) and again 6 months after the baseline assessment (Attachments 4c and 4d). The baseline and 6-month follow-up assessment instruments are identical. The study assessment includes socio-demographic characteristics; knowledge, practices and perceptions about PrEP, condoms and medically supervised transition services (the primary outcomes); psychosocial factors including social support and ethnic group pride; and other variables including acculturation, perceived discrimination and community attachments.


In order to identify and explore the strengths and weaknesses of the intervention based on participants’ self-reported behavior changes or lack thereof during the six months following their participation in ChiCAS, we will randomly select and interview up to 30 participants from the intervention group after they complete their 6-month follow-up assessments. The 30 participants will include ten women who report an increase in at least one HIV prevention behavioral outcome (PrEP or condom use) and who report an increase in the use of medically supervised hormone therapy; ten who do not report an increase in at least one HIV prevention behavioral outcome (PrEP or condom use) and do not report an increase in the use of medically supervised hormone therapy; and ten women with mixed results. We expect to be able to identify at least 10 individuals who will have experienced one of the outcomes described above from the 70 women in the intervention condition. The interview will include questions about general invention experiences and recommendations; knowledge, perceptions and use of PrEP, condoms and medically supervised hormone therapy and the role of the intervention in shaping these perceptions; and additional questions about sexual and general health and discrimination (Attachments 4e and 4f).


The study protocol and all data collection instruments have been approved by Wake Forest University Health Science IRB (Attachment 6a).


Exhibit 2.1: Overview of Key Variables

Baseline and Follow-up Assessments (Attachments 4c, 4d, 4e. and 4f)

  • Demographics (Baseline Assessment Only)

  • Perceived discrimination, internalized transphobia and social support (Baseline Assessment Only)

  • Self-reported health status, history of health care use, and HIV/STD testing history (Baseline Assessment Only)

  • Acculturation, ethnic group pride and community attachment (Baseline Assessment Only)

  • PrEP use

  • Use of medically supervised hormone therapy

  • Consistent condom use

  • Knowledge about HIV/STDs, PrEP and hormone therapy

  • Access/Barriers to HIV/STD testing, PrEP and medically supervised hormone therapy

  • Skills, intentions and readiness to use condoms, PrEP and medically supervised therapy

  • Trust and communication with health providers

  • Perceived discrimination, internalized transphobia and social support

  • HIV/STD testing (Follow-up Assessment Only)

Qualitative Interview (Attachments 4e and 4f)

  • General intervention experiences and perceptions

  • Intervention experiences and perceptions specific to the primary outcomes including

    • PrEP knowledge, awareness, interest and use

    • Condom skills and use

    • Hormone therapy knowledge, awareness, interest and use

  • Sexual health priorities

  • Discrimination (intervention and health outcomes mediator)


We will use multiple convenience and referral-based sampling methods rather than random sampling methods to identify and recruit study participants because transgender women are a unique and hidden population for which no known sampling frame exists. Because we are not using random sampling methods to recruit participants, the study results will not be generalizable beyond the specific populations and geographic contexts in which they are contacted. The results will be used to demonstrate a relationship between receipt of the ChiCAS intervention and improvements in sexual health and HIV prevention behaviors over time among participants in the study.

Results from this data collection will be used to assess the effects of ChiCAS intervention participation on the primary outcomes (PrEP use, use of medically supervised hormone therapy and consistent condom use). If ChiCAS is determined to be efficacious, it will be the first such intervention designed for and potentially available for use with Hispanic/Latina transgender women. We expect to report the study results in multiple manuscripts that will be published in peer reviewed journals and to present the results at national conferences. Links to these publications and presentations will be available through the CDC website.


  1. Use of Improved Information Technology and Burden Reduction


Our information collection will use person-to-person contacts and exchanges rather than the use of information technologies, and aim to minimize the information collection burden on study participants (see below). During study recruitment, we expect that interested participants will be screened for eligibility prior to enrollment during person-to-person contacts, while some may be screened by telephone (Attachments 4a and 4b). This will allow participants to complete the screening form at a place and time that is convenient for them. Participant contact information is collected on the screening form. For study enrollment, participants will begin the consent process by agreeing to use the OraQuick In-home HIV test to verify their eligibility based on their self-report during the screening process of being HIV negative. If they are verified to be eligible, they will complete the process of providing informed consent to participate in the study, sign the study consent form, complete the baseline assessment (Attachments 4c and 4d), and will be randomly assigned to receive the ChiCAS intervention (intervention participants) shortly after enrollment or after they complete the six-month follow-up assessment (waitlist participants). Study staff will schedule consent and assessment appointments at a time and location that is convenient to the selected participants.


The quantitative baseline (Attachment 4c and 4d) and 6-month follow-up assessments (Attachments 4e and 4f) will be administered by a trained interviewer. Question skip patterns in the assessment instrument are designed to minimize the number of questions that participants will need to answer and thus, will reduce the respondent burden. Findings from our earlier formative research indicate that study participants are more likely to engage with a well-trained interviewer who can establish rapport and trust; therefore, we will not use Audio Computer Assisted Self-Interviews (ACASI) for baseline and 6-month study assessments.29-34 Latino men and women, including transgender persons, in our formative studies have described our interviewer-administered assessments as being culturally congruent; some Hispanics/Latinos value personalismo, a shared cultural value that stresses the importance of interpersonal relationships.29-31, 35, 36 Interviewer-administered assessments can also overcome obstacles to using ACASI methods that may be associated with participants’ frequent low literacy levels and poor vision (resulting from lack of access to vision services) and limited experience with technology.30, 37


Study staff will conduct individual in-depth qualitative interviews (Attachments 4g and 4h) with randomly selected participants at a time and location of their choosing which offers privacy. Study staff will request participant permission to audio-record the interviews and transcribe the recordings after the interviews, and will do so only after participants give their permission.

  1. Efforts to Identify Duplication and Use of Similar Information


As noted above, our search of the published intervention research literature did not identify any efficacious behavioral HIV prevention interventions for Hispanic transgender women. Furthermore, the CDC Compendium of Evidence-based Interventions and Best Practices for HIV Prevention does not list any such interventions for them; therefore, we believe that our intervention study will address an important gap in prevention resources for this population.38 In addition and based on our reviews of research publications cited above, we believe that no other survey data collection effort has been conducted or has been planned to collect similar information for this population. Therefore, our evaluation of the ChiCAS intervention requires the collection of primary data not previously collected, as proposed in this Information Collection Request.



  1. Impact on Small Businesses or Other Small Entities


This information collection will not involve small businesses.

  1. Consequences of Collecting the Information Less Frequently


The study is designed to provide the quantitative and qualitative data needed to evaluate the efficacy of the ChiCAS HIV prevention intervention for Hispanic/Latina transgender women. We require an additional 2 years to complete data collection.


Quantitative assessment data will be collected twice from each intervention and wait list participant in the study - at baseline and again six months later. Collecting assessment data less frequently than twice over the 6-month period would make it impossible to rigorously assess changes over time in the measures of intervention effectiveness: consistent condom use and the use of PrEP and medically supervised hormone therapy, and to compare these changes among intervention and waitlist participants, respectively. The number of assessment surveys administered is the minimum required to assess any effects of the intervention and post-intervention decay.


Qualitative interview data will be collected once from 30 randomly selected intervention participants following the six-month assessment. This data will help us to better understand the effects of the ChiCAS intervention. If this qualitative data were not collected, it would not be possible to develop an in-depth understanding of intervention participants’ perceptions and experiences with the intervention and the effects of the intervention on their sexual health knowledge and awareness and the expected behavioral outcomes. Collecting this qualitative data will make it possible for us to tailor the intervention for purposes of eventual dissemination and increase its potential effectiveness with this vulnerable population.

  1. Special Circumstances Relating to the Guidelines of 5 CFR 1320.5


This data collection does not involve any special circumstances and fully complies with the regulation 5 CFR 1320.5.


  1. Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency


The 60-day FRN notice to solicit public comments was published on 02/25/2021, Volume 86, Number 36, Page 11533 (Attachment 2a).


In addition, Wake Forest University, University of North Carolina at Greensboro, and Triad Health Project were consulted for the development of this study. There were no unresolved issues associated with the consultation process.


Scott Rhodes, Principal Investigator

Department of Social Sciences and Health Policy

Wake Forest School of Medicine

Medical Center Boulevard

Winston-Salem, NC  27157

336-713-5080

[email protected]

Jorge Alonzo, Research Associate

Department of Social Sciences and Health Policy

Wake Forest School of Medicine

Medical Center Boulevard

Winston-Salem, NC  27157

336-713-5048

[email protected]


Beth Reboussin, Co-Investigator

Department of Biostatistical Sciences

Wake Forest School of Medicine

Medical Center Boulevard

Winston-Salem, NC  27157

336-713-5213

[email protected]


Lilli Mann Jackson, Senior Research Associate

Department of Social Sciences and Health Policy

Wake Forest School of Medicine

Medical Center Boulevard

Winston-Salem, NC  27157

336-716-7441

[email protected]

Amanda E. Tanner, Co-Investigator

University of North Carolina at Greensboro

Department of Public Health Education

437 Coleman Bldg

Greensboro, NC 27402

336-334-5878

[email protected]


Lisa Lewis, Project Manager

Department of Social Sciences and Health Policy

Wake Forest School of Medicine

Medical Center Boulevard

Winston-Salem, NC  27157

336-713-5074

[email protected]



  1. Explanation of Any Payment or Gift to Respondents


This study aims to recruit, enroll, and follow members of a population that is particularly vulnerable to HIV infection and, in addition, is a small, hard-to-reach, and possibly hidden population. Recent estimates, for example, suggest that transgender adults may make up only 0.3% of the US population.39 In addition, our study will ask participants sensitive questions about issues such as sexual behavior, HIV and sexually transmitted infection status, and substance use. The Hispanic/Latina transgender women in our study may also have limited access to transportation and need to pay for travel to and from the intervention sessions. They may also work very long hours and on weekends and need to take time off from their jobs to attend intervention sessions.


To enhance our ability to recruit and retain the required 140 Hispanic/Latina transgender women and retain at least 80% of those who are recruited to our study sample, we will provide participants with tokens of appreciation to better engage them in the intervention and the data collection processes, which are critical for the success of this evaluation. Study staff have developed a plan for administering tokens of appreciation to study participants based on their considerable experience of working with this population and their in-depth understanding of community values and social norms. We will give each participant in the ChiCAS intervention and the delayed-intervention comparison (waitlist) group cash tokens of appreciation for their participation: $30 will be provided to each participant after completing the baseline assessment, and $40 will be provided after completing each of the two intervention sessions. In addition, $40 will be provided to study participants who complete the 6-month follow-up assessment with a study staff member. Intervention group participants who participate in a qualitative in-depth interview will receive a cash token of appreciation of $40. Participants will be provided cosmetic bags with logos and a framed signed certificate of completion after completing the two-session intervention. We have found this certificate to be another important component in our research with Hispanics/Latinos.


The Office of Information and Regulatory Affairs Office of Management and Budget has issued the following guidance for justifying the use of incentives as part of Information Collection Requests (ICRs), “Incentives are most appropriately used in Federal statistical surveys with hard-to-find populations or respondents whose failure to participate would jeopardize the quality of the survey data (e.g., in panel surveys experiencing high attrition), or in studies that impose exceptional burden on respondents, such as those asking highly sensitive questions…”40


Tokens of appreciation can be particularly useful when recruiting minorities and historically underrepresented groups to research. We know from our previous intervention studies of non-English-speaking populations (see details below) that cash is preferred to gift cards as tokens of appreciation because cash is easier for study participants to use. Cash tokens of appreciation are particularly well-received by immigrant populations who may not trust gift cards, experience barriers when trying to use gift cards (e.g., transportation, language, and misunderstanding the rules for their use), and who may worry about their identification being checked. Based on formative data we have collected among Hispanics/Latinos over the past 15 years, we have learned that cash is an important factor in recruitment and retention.29, 41 In each of the following intervention studies that were implemented and evaluated with CDC or NIH funding, cash was successfully used as a token of appreciation: HoMBReS,42 which is listed in the CDC Compendium of Evidence-based Interventions and Best Practices for HIV Prevention as a best-evidence community-based behavioral intervention;38 HoMBReS Por Un Cambio;31, 43 HoMBReS-2;30 HOLA en Grupos (OMB 0920-0942, exp. 3/31/2018),44, 45 also listed in CDC’s Compendium as a best-evidence behavioral intervention; HOLA;46, 47 and CAPRELA.41, 48 In each of these intervention studies, enrollment and retention rates were high, ranging from 88% to 99%. Our follow-up retention rates included the following: 95% at 24-month follow-up,46 89% at 18-month follow-up,42 100% at 6-month follow-up,44 and 98% at 3-month follow-up.30 Within each of these interventions, cash amounts provided as tokens of appreciation ranged between $30 and $50. These amounts were determined based on the amount of each participant’s time involved in completing assessments and attending the sessions.



  1. Protection of the Privacy and Confidentiality of Information Provided by Respondents


The NCHHSTP Associate Director for Science Office has reviewed this project and determined the Privacy Act applies to this information collection activity. However, no participant names or contact information collected during the study will be transmitted to the CDC.


The grantee, Wake Forest University and partners, University of North Carolina at Greensboro and Triad Health Project, will be responsible for collecting all data for this study. Study staff will inform study participants that their responses will be kept private to the extent permitted by the law. All study participants interviewed will be informed that the information collected will not be attributable directly to them and will only be discussed among members of the research team. Terms of the CDC Cooperative Agreement authorizing data collection require the grantee to maintain the privacy of all information collected. Section 301(d) of the Public Health Service (PHS) Act, as amended by Section 2012 of the 21st Century Cure Act, P.L. 114-255 (42 U.S.C. 241(d), states that the Secretary shall issue Certificates of Confidentiality to persons engaged in biomedical, behavioral, clinical, or other research activities in which identifiable, sensitive information is collected. This study meets those requirements. The Certificate of Confidentiality further protects the privacy of subjects by limiting the disclosure of identifiable, sensitive information. With this Certificate, the research team cannot be forced (for example, by court subpoena) to disclose identifying information from study participants for any civil, criminal, administrative, legislative, or other proceeding, whether at the federal, state, or local level.


As this study will collect several types of sensitive information – including HIV test results, PrEP use and sex behaviors – from transgender women who have sex with men, we are sensitive to the need to protect personal health information (PHI). To ensure that respondents’ PHI is protected, we will take several measures to separate personally identifiable information from study-related data.


All participants will be assigned a unique identification number for the study. Data sent to CDC will not contain participant names or contact information, and each person’s data will be identified only by a study participant ID. There will be four types of files that contain participant names and contact information: the consent form file, the contact information file, the intervention attendance log file, and the linkage file. Access to these study files will be limited to key study staff. Consent, Contact and Attendance files will be maintained as paper documents, kept in a locked cabinet, separate from other study files in the offices of the principal investigator at Wake Forest University School of Medicine. Attendance data will be de-identified and uploaded as password protected electronic files to a secure server. The linkage file, used to link participant names and identification numbers, will be stored as a password protected file on a secure server and accessible only to the Data Manager (Lilli Mann Jackson).


Screening and assessment data will be collected on paper forms. Immediately after completing screening and assessment, personal contact information will be separated from the paper forms, therefore no personal-identifying information will be attached to the forms. The de-identified assessment data from the paper questionnaires will be scanned using the TELEForm software system and uploaded and saved on a secure and password protected network maintained by Wake Forest School of Medicine. Screening data will be maintained as a de-identified paper document. Hard copies of study data will be kept in separate locked file cabinets in the Department of Social Sciences and Health Policy, Divisions of Public Health Sciences, Wake Forest School of Medicine. All assessment information collected will be stored securely in a de-identified format.


During data collection outside of the Wake Forest university office, completed assessments, participant contact information, and consent forms will be stored in 3 separate locked boxes to ensure that each participant’s information cannot be linked to their responses. The locked boxes will never be left in the car of a data collector overnight. Within 48 hours, all assessments, contact information, and consent forms will be transferred to Wake Forest School of Medicine.


In-depth interview data will be collected utilizing only a Participant ID. Because in-depth interviews will be digitally recorded, verbal consent to record the interview also will be secured prior to recording. Participants will be informed of their right to have the digital recorder turned off and/or to stop the interview at any time. The digital recordings will be stored as password protected files on a secure server maintained by the Department of Social Sciences and Health Policy, Division of Public Health Sciences, Wake Forest School of Medicine. Digital audio files will be transcribed into MS Word documents. Names or other identifying information inadvertently disclosed during the interview will be excluded from interview transcripts. Digital recordings will be destroyed by erasing after the recording transcriptions are verified.


De-identified, summary data may be used in manuscripts, presentations and reports that highlight the activities and successes of this program. Public access to the data will be provided at the completion of the study and after the dissemination of the main outcome findings. Data on individual participants will not be released to the public. Any data made publicly available after the completion of the study will be de-identified and will not be linked to participant contact information (Attachment 7).


All recordings of qualitative interviews will be destroyed by erasing after the recording transcriptions are verified. All study records containing personally identifiable information (PII) will be destroyed by the Wake Forest University Principal Investigator no later than three years after closure of the study protocol by the Wake Forest IRB.

  1. Institutional Review Board (IRB) and Justification for Sensitive Questions


IRB Approval


The study protocol, the data collection instruments, and all accompanying documents have been reviewed and approved by the Wake Forest University Health Sciences IRB (Attachment 6a). For purposes of this study and information collection, the study research partners, the Triad Health Project and the University of North Carolina, Greensboro, defer to the IRB of Wake Forest University Health Sciences (Attachments 6b and 6c). Amendments to the study protocol, data collection instruments, and all accompanying documents have been reviewed and approved by the Wake Forest University Health Sciences IRB (Attachments 6d, 6e, 6f, 6g, and 6h).


Sensitive Questions


This study is designed to evaluate the efficacy of an HIV prevention intervention for Hispanic/Latina transgender women at high risk for HIV infection. As such, our study entails the collection of sensitive HIV risk-related information. All study staff will be trained to provide respondents with referrals to sources of prevention and care, such as mental health organizations, as needed. Sensitive questions will be asked to identify the HIV risk level of participants. We will inform all participants that they may skip any question or stop participation at any time for any reason.


  1. Estimates of Annualized Burden Hours and Costs


12A. Estimates of Annualized Burden Hours


This study will enroll up to 140 Hispanic/Latina transgender women to participate in the intervention and assessment survey. In addition, 30 of the 70 intervention participants will be selected to participate in a semi-structured qualitative interview.


Transgender women will be recruited either online through web advertisements or in-person through venue-based sampling and outreach, print advertisements, or word of mouth (Attachments 3a and 3b). All potential participants will complete a screening process for eligibility (Attachments 4a and 4b) prior to consent and data collection. Eligible participants will be consented for participation (Attachments 5a and 5b). All recruitment and data collection activities will be carried out by study staff.


Study data collection is requested for 2 more years. We expect to screen 280 Hispanic/Latina transgender women. Of these, we expect 50% to be eligible and to enroll in the ChiCAS intervention. We expect that screening will take 3 minutes and providing contact information will take about one minute (Attachments 4a and 4b). Data collection will include a quantitative assessment administered to each participant at baseline and again at 6 months post-intervention. The baseline assessment will take about 60 minutes to complete (Attachments 4c and 4d). The 6-month follow-up assessment will take about 45 minutes to complete (Attachments 4e and 4f). Data collection will also include a qualitative assessment administered one time to a subsample of 30 intervention participants. We anticipate that it will take 90 minutes to complete each interview (Attachments 4g and 4h). The total number of burden hours over the entire data collection period is 310 hours. The estimated annualized burden (for a 12-month period) is 155 hours. Per OMB recommendations for total burden hours, all fractions have been rounded up to the nearest whole hour. Exhibits 12.1 and 12.2 provide further details about how the estimates of annualized burden hours and costs were calculated.


Exhibit 12.1: Estimated Annualized Burden Hours



Type of Respondent

Form Name

No. of Respondents

No. of Responses Per Respondent

Average Burden Per Response (in Hours)

Total

Burden

Hours

General Public- Adults

Eligibility Screener (Attachments 4a and 4b)

140

1

3/60

7

General Public-Adults

Contact Information (Attachments 4a and 4b)

70

1

1/60

2

General Public- Adults

Baseline Questionnaire

(Attachments 4c and 4d)

70

1

1.0

70

General Public-Adults

Follow Up Questionnaire (Attachments 4e and 4f)

70

1

45/60

53

General Public- Adults

Interview

(Attachments 4e and 4f)

15

1

1.5

23

Total

155



12B. Estimated Annualized Burden Costs


The annualized costs to the respondents are described in Exhibit 12.2. The United States Bureau of Labor Statistics’ employment and wages estimates from May, 2019 (http://www.bls.gov/oes/current/oes_nat.htm) were used to estimate the hourly wage rate for the general public for the purpose of this request. The estimated annualized burden cost is $4423.84. This cost represents the total burden hours of general respondents multiplied by the average hourly wage rate ($25.72).


Exhibit 12.2: Estimated Annualized Burden Costs

Type of Respondent

Form Name

Total Burden

Hours

Hourly Wage Rate

Respondent Costs

General Public- Adults

Eligibility Screener (Attachments 4a and 4b)

7

$25.72

$180.04

General Public-

Adults

Contact Information (Attachments 4a and 4b)

2

$25.72

$51.44

General Public- Adults

Baseline Questionnaire

(Attachments 4c and 4d)

70

$25.72

$1800.40

General Public-Adults

Follow Up Questionnaire (Attachments 4e and 4f)

53

25.72

1363.16

General Public- Adults

Interview

(Attachments 4g and 4h)

23

$25.72

$591.56

Total $3986.60

  1. Estimates of Other Total Annual Cost Burden to Respondents and Record Keepers


There are no other costs to respondents for participating in this survey.

  1. Annualized Cost to the Federal Government


The annual cost to the government for the data collection is estimated to be $695,535 (Exhibit 14.1).


Exhibit 14.1: Annualized Cost to the Government

Expense Type

Expense Explanation

Annual Costs (dollars)

Direct Costs to the Federal Government

CDC, Project Officer (GS-13 0.40 FTE)

$40,810


CDC Scientist (GS-13, 0.20 FTE)

$20,405


CDC Project Coordinator (GS-12, 0.40 FTE)

$34,320


Subtotal, Direct Costs

$95,535

Cooperative Agreement Costs

Annual Cooperative Agreement #PS15-002 Costs

$600,000


ANNUALIZED COST TO THE GOVERNMENT

$695,535



  1. Explanation for Program Changes or Adjustments


This is a request to extend the project expiration date for 2 additional years for OMB-approved project 0920-1266, HIV prevention among Latina transgender women who have sex with men: Evaluation of a locally developed intervention. The current OMB expiration date for the project is June 30, 2021 and this request would extend the project to 06/30/2023. Due to COVID-19 restrictions including shelter-in-place, stay-at-home orders, and continuing social distancing recommendations, the study had to suspend recruitment, enrollment and data collection activities in March 2020. In addition, the development and incorporation of new study procedures to ensure participant and staff safety during the ongoing pandemic will likely cause delays in restarting the study. We are requesting the extension to ensure that the study has adequate time to meet all study goals and objectives. CDC is also requesting approval for 310 burden hours, a reduction in 34 burden hours from our originally approved 344 burden hours. The reduction was achieved by the removal of redundant questions from the second follow-up assessment. In addition, CDC is also requesting an expansion of the recruitment area to metropolitan areas adjacent to North Carolina. This increased catchment area will ensure that highly mobile populations with close economic and community ties to metropolitan areas in and around North Carolina will have the opportunity to participate in this evaluation.

  1. Plans for Tabulation and Publication and Project Time Schedule


Our analysis will focus on questions related to the study objectives. Our analysis plans for assessing the efficacy of the intervention include a tabular analysis to compare the pre- (baseline) and post-intervention (6 month) distribution of study variables among participants who have received the intervention and participants who have not yet received the intervention (delayed-intervention or waitlist group). Specifically, we will measure the number of behaviors critical to HIV prevention (PrEP engagement, condom use and medically supervised hormone therapy) at baseline and 6 months.


Data collection is requested for an additional 2 years. The project timeline is detailed in exhibit 16.1.


Exhibit 16.1: Project Time Schedule

 

Activity

 

Time Schedule

OMB Approval Date

June 2021

Develop data collection tools, sampling and data plans, study protocol

September 2016 – June 2019



Recruitment  

9 months

Data Collection  

15 months

Data analysis finalized and report drafted

24 months

Final de-identified data set submitted to CDC

24 months


In compliance with the CDC policy on data management and access, we will develop final, de-identified (names, other personally identifiable information, and locations will be removed) quantitative and qualitative datasets for this study along with the corresponding data documentation, which will be made publicly available within 30 months of the end of data collection. It is anticipated that the data collected through this study will be shared as summary data tables and restricted use dataset(s). A data use plan for information collected during this study has been developed. The plan describes in detail how data access will be provided and the provisions for protection of privacy, security, intellectual property, or other rights (Attachment 7).

  1. Reason(s) Display of OMB Expiration Date is Inappropriate


We do not seek approval to eliminate the expiration date.


  1. Exceptions to Certification for Paperwork Reduction Act Submissions


There are no exemptions to the certification.


References


1. Herbst JH, Jacobs ED, Finlayson TJ, McKleroy VS, Neumann MS, Crepaz N. Estimating HIV prevalence and risk behaviors of transgender persons in the United States: A systematic review. AIDS and behavior. 2008;12(1):1-17.

2. Baral SD, Poteat T, Stromdahl S, Wirtz AL, Guadamuz TE, Beyrer C. Worldwide burden of HIV in transgender women: A systematic review and meta-analysis. The Lancet Infectious diseases. 2013;13(3):214-22.

3. Lippman SA, Moran L, Sevelius J, Castillo LS, Ventura A, Treves-Kagan S, et al. Acceptability and feasibility of HIV self-testing among transgender women in San Francisco: A mixed methods pilot study. AIDS and behavior. 2015.

4. Rapues J, Wilson EC, Packer T, Colfax GN, Raymond HF. Correlates of HIV infection among transfemales, San Francisco, 2010: results from a respondent-driven sampling study. American journal of public health. 2013;103(8):1485-92.

5. De Santis JP. HIV infection risk factors among male-to-female transgender persons: A review of the literature. The Journal of the Association of Nurses in AIDS Care : JANAC. 2009;20(5):362-72.

6. Schulden JD, Song B, Barros A, Mares-DelGrasso A, Martin CW, Ramirez R, et al. Rapid HIV testing in transgender communities by community-based organizations in three cities. Public health reports (Washington, DC : 1974). 2008;123 Suppl 3:101-14.

7. Habarta N, Wang G, Mulatu MS, Larish N. HIV testing by transgender status at Centers for Disease Control and Prevention-funded sites in the United States, Puerto Rico, and US Virgin Islands, 2009-2011. American journal of public health. 2015;105(9):1917-25.

8. Reback CJ, Fletcher JB. HIV prevalence, substance use, and sexual risk behaviors among transgender women recruited through outreach. AIDS and behavior. 2014;18(7):1359-67.

9. Nuttbrock L, Hwahng S, Bockting W, Rosenblum A, Mason M, Macri M, et al. Lifetime risk factors for HIV/sexually transmitted infections among male-to-female transgender persons. Journal of acquired immune deficiency syndromes (1999). 2009;52(3):417-21.

10. Kellogg TA, Clements-Nolle K, Dilley J, Katz MH, McFarland W. Incidence of human immunodeficiency virus among male-to-female transgendered persons in San Francisco. Journal of acquired immune deficiency syndromes (1999). 2001;28(4):380-4.

11. Operario D, Soma T, Underhill K. Sex work and HIV status among transgender women: systematic review and meta-analysis. Journal of acquired immune deficiency syndromes (1999). 2008;48(1):97-103.

12. Wilson EC, Garofalo R, Harris RD, Herrick A, Martinez M, Martinez J, et al. Transgender female youth and sex work: HIV risk and a comparison of life factors related to engagement in sex work. AIDS and behavior. 2009;13(5):902-13.

13. Taylor RD, Bimbi DS, Joseph HA, Margolis AD, Parsons JT. Girlfriends: Evaluation of an HIV-risk reduction intervention for adult transgender women. AIDS education and prevention : official publication of the International Society for AIDS Education. 2011;23(5):469-78.

14. Nemoto T, Sausa LA, Operario D, Keatley J. Need for HIV/AIDS education and intervention for MTF transgenders: Responding to the challenge. Journal of homosexuality. 2006;51(1):183-202.

15. Mann L GM, Tanner A, Alonzo J, Arellano E, Rodriguez R, Rhodes SD. . Exploring the experiences of participants in a lay health advisor HIV prevention intervention for Latino/a gay and bisexual men, other MSM, and transgender women. . American Public Health Association, 144th Meeting; October 29-November 2, 2015.; Denver, CO.

16. Marquez S, Cahill S. Transgender Women and Pre-Exposure Prophylaxis for HIV Prevention: What We Know and What We Still Need to Know. Boston, MA: National Center for Innovation in HIV Care, 2015.

17. Wilson EC, Chen YH, Arayasirikul S, Wenzel C, Raymond HF. Connecting the dots: Examining transgender women's utilization of transition-related medical care and associations with mental health, substance use, and HIV. Journal of urban health : bulletin of the New York Academy of Medicine. 2015;92(1):182-92.

18. Rhodes SD, Alonzo J, Mann L, Sun CJ, Simán FM, Abraham C, et al. Using photovoice, Latina transgender women identify priorities in a new immigrant-destination state. International Journal of Transgenderism 2015;16(2):80-96.

19. Sevelius JM. Gender affirmation: A framework for conceptualizing risk behavior among transgender women of color. Sex roles. 2013;68(11-12):675-89.

20. Sevelius JM, Patouhas E, Keatley JG, Johnson MO. Barriers and facilitators to engagement and retention in care among transgender women living with human immunodeficiency virus. Annals of behavioral medicine : a publication of the Society of Behavioral Medicine. 2014;47(1):5-16.

21. Policy OoNA. National HIV/AIDS Strategy for the United States: Updated to 2020. Washington, DCJuly 2015.

22. Bandura A. Social foundations of thought and action: A social cognitive theory. Englewood Cliffs: Prentice-Hall; 1986.

23. Bandura A. Social cognitive theory and the exercise over HIV infection. In: DiClemente RJ, Peterson JL, editors. Preventing AIDS: Theories and Methods of Behavioral Intervention. New York, NY: Plenum Press; 1994. p. 25-59.

24. Baranowski T, Perry CL, Parcel GS. How individuals, environments, and health behavior interact: Social cognitive theory. In: Glanz K, Rimer BK, Lewis FM, editors. Health Behavior and Education: Theory, Research, and Practice. 3rd ed. San Francisco: Jossey-Bass; 2002. p. 165-84.

25. Kohler CL, Grimley D, Reynolds K. Theoretical approaches guiding the development and implementation of health promotion programs. In: Raczynski JM, DiClemente RJ, editors. Handbook of Health Promotion and Disease Prevention. New York, NY: Kluwer Academic/Plenum publishers; 1999. p. 23-49.

26. Freire P. Education for critical consciousness. New York, NY: Seabury Press; 1973.

27. Freire P. Pedagogy of the oppressed. New York, NY: Herder and Herder; 1970.

28. Wallerstein N. Empowerment education applied to youth. In: Matiella AC, editor. The Multicultural Challenge in Health Education. Santa Cruz, CA: ETR Associates; 1994. p. 153-76.

29. Rhodes SD, Duck S, Alonzo J, Downs M, Aronson RE. Intervention trials in community-based participatory research. In: Blumenthal D, DiClemente RJ, Braithwaite RL, Smith S, editors. Community-Based Participatory Research: Issues, Methods, and Translation to Practice. New York: Springer 2013. p. 157-80.

30. Rhodes SD, McCoy TP, Vissman AT, DiClemente RJ, Duck S, Hergenrather KC, et al. A randomized controlled trial of a culturally congruent intervention to increase condom use and HIV testing among heterosexually active immigrant Latino men. AIDS and behavior. 2011;15(8):1764-75.

31. Rhodes SD, Duck S, Alonzo J, Daniel J, Aronson RE. Using community-based participatory research to prevent HIV disparities: Assumptions and opportunities identified by The Latino Partnership. Journal of Acquired Immunodeficiency Syndromes. 2013;63(Supplement 1):S32-S5.

32. Rhodes SD, Eng E, Hergenrather KC, Remnitz IM, Arceo R, Montano J, et al. Exploring Latino men's HIV risk using community-based participatory research. Am J Health Behav. 2007;31(2):146-58.

33. Vissman AT, Eng E, Aronson RE, Bloom FR, Leichliter JS, Montaño J, et al. What do men who serve as lay health advisors really do?: Immigrant Latino men share their experiences as Navegantes to prevent HIV. AIDS Education and Prevention. 2009;21(3):220-32.

34. Rhodes SD, Hergenrather KC, Aronson RE, Bloom FR, Felizzola J, Wolfson M, et al. Latino men who have sex with men and HIV in the rural south-eastern USA: findings from ethnographic in-depth interviews. Culture, health & sexuality. 2010:1.

35. Marsiglia FF, Kulis S. Diversity, Oppression, and Change. Chicago, IL: Lyceum; 2009.

36. Cashman R, Eng E, Simán F, Rhodes SD. Exploring the sexual health priorities and needs of immigrant Latinas in the southeastern US: A community-based research approach. AIDS Education and Prevention. 2011;23(3):236-48.

37. Grzywacz JG, Arcury TA, Marín A, Carrillo L, Coates ML, Burke B, et al. Using lay health promoters in occupational health: outcome evaluation in a sample of Latino poultry processing workers. New Solutions 2009;19:449-66.

38. Prevention CfDCa. Compendium of Evidence-Based Interventions and Best Practices for HIV Prevention [updated February 6, 2018. Available from: https://www.cdc.gov/hiv/research/interventionresearch/compendium/index.html.

39. Gates GJ. How many people are lesbian, gay, bisexual, and transgender? The Williams Institute. 2011;Available at: http://williamsinstitute.law.ucla.edu/wp-content/uploads/Gates-How-Many-People-LGBT-Apr-2011.pdf.

40. Office of Information and Regulatory Affairs OoMaB. Questions and Answers When Designing Surveys for Information Collections. Washinton, DCJan 2006 (Last Modified Oct 2016).

41. Rhodes SD, Mann L, Alonzo J, Downs M, Abraham C, Miller C, et al. CBPR to prevent HIV within ethnic, sexual, and gender minority communities: Successes with long-term sustainability. In: Rhodes SD, editor. Innovations in HIV Prevention Research and Practice through Community Engagement. New York, NY: Springer; 2014. p. 135-60.

42. Rhodes SD, Hergenrather KC, Bloom FR, Leichliter JS, Montano J. Outcomes from a community-based, participatory lay health adviser HIV/STD prevention intervention for recently arrived immigrant Latino men in rural North Carolina. AIDS education and prevention : official publication of the International Society for AIDS Education. 2009;21(5 Suppl):103-8.

43. Rhodes SD, Leichliter JS, Sun CJ, Bloom FR. The HoMBReS and HoMBReS Por un Cambio interventions to reduce HIV disparities among immigrant Hispanic/Latino men. MMWR Morb Mortal Wkly Rep. 2016;65(1):51-6.

44. Rhodes SD, Alonzo J, Mann L, Song E, Tanner AE, Arellano JE, et al. Small-group randomized controlled trial to increase condom use and HIV testing among Hispanic/Latino gay, bisexual, and other men who have sex with men. American journal of public health. 2017;107(6):969-76.

45. Rhodes SD, Alonzo J, Mann L, Freeman A, Sun CJ, Garcia M, et al. Enhancement of a locally developed HIV prevention intervention for Hispanic/Latino MSM: A partnership of community-based organizations, a university, and the Centers for Disease Control and Prevention AIDS Education and Prevention. 2015;27(4):312-32.

46. Rhodes SD, Daniel J, Alonzo J, Duck S, Garcia M, Downs M, et al. A systematic community-based participatory approach to refining an evidence-based community-level intervention: The HOLA intervention for Latino men who have sex with men. Health Promotion Practice. 2013;14(4):607-16.

47. Tanner AE, Reboussin BA, Mann L, Ma A, Song E, Alonzo J, et al. Factors influencing healthcare access perceptions and care-seeking behaviors of Latino sexual minority men and transgender individuals: HOLA intervention baseline findings. Journal of Health Care for the Poor and Underserved. 2014;25(4):1679-97.

48. Rhodes SD, Kelley C, Simán F, Cashman R, Alonzo J, Wellendorf T, et al. Using community-based participatory research (CBPR) to develop a community-level HIV prevention intervention for Latinas: A local response to a global challenge. Womens Health Issues. 2012;22(3):293-301.



19

File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
File Modified0000-00-00
File Created2021-06-25

© 2024 OMB.report | Privacy Policy