Crisis Counseling Assistance and Training Program Data Toolkit
SUPPORTING STATEMENT PART B
B. STATISTICAL METHODS
1. Sampling Methods
Efforts used to inform this section of the OMB Support Statement: 1) a retrospective evaluation of the CCP, 2) a cross-site evaluation of CCP grants funded as a result of the 2005 Gulf Coast hurricanes, and 3) analysis of the data from 2009 to 2011. The first two studies were performed by the National Center for PTSD as an interagency agreement with SAMHSA CMHS. The retrospective evaluation involved an archival analysis of all available reports for crisis counseling grants implemented in the 50 United States that closed out over a 5-year interval. As such, all crisis counseling projects that closed out between October 1, 1996 and September 30, 2001, and were administered by States rather than Territories, were eligible for analysis. Reports from 44 grants covering 28 disaster events were included in the quantitative analysis for the retrospective evaluation. Given the catastrophic nature of the 2005 Gulf Coast hurricanes, a disaster-specific cross-site evaluation of funded CCPs was supported by SAMHSA CMHS. The cross-site evaluation of the 2005 Gulf Coast hurricane programs consisted of 22 grants in 17 States active between November 2005 and February 2007, thus 3 to 18 months after Hurricane Katrina. These grants utilized the 2005 OMB-approved CCP data collection forms. The means (or averages) from these studies, combined with a review of the data trends from the past 2 years and consideration of the current CCP grants, were used to inform this section of the OMB Support Statement. The estimated number of respondents is 53,000 per year for the CCPs, distributed as follows:
Individual/ Family Crisis Counseling Services Encounter Log = 39,200
Service providers (i.e., crisis counselors/outreach workers) will be required to complete this form for all service recipients who access individual or family crisis counseling services.
Group Encounter Log = 3,300
Service providers will be required to complete this form for each group of service recipients who access group crisis counseling services and/or group public education services.
Weekly Tally Sheet = 6,600
Service providers will be required to complete this form for all contacts for whom data are not captured on either the Individual/Family Crisis Counseling Services or Group Encounter Logs.
Assessment and Referral Tools = 2,800
These tools (Adult or Child/Youth) are intended for intense users of services, defined as all individuals receiving a third or fifth individual crisis counseling visit, or those experiencing serious reactions to the disaster. This tool will be used beginning 3 months after the disaster.
Participant Feedback Form = 1,000
These forms will be collected from a sample of service recipients, not every recipient. The use of a time sampling approach is recommended, e.g., soliciting participation from all counseling encounters 1 week at either at 6 months and/or 1 year after the disaster.
Service Provider Feedback Form = 100
These forms will be administered to all service providers, and data will be collected anonymously at least once either at 6 months and/or 1 year after the disaster.
Most service provider programs will collect their client information using a paper-and-pencil method on forms that can be forwarded to a central location for data entry into the online system and analysis, although he Service Provider Feedback Form may also be administered online. The completion of forms is a part of the daily work requirements for service providers and does not interfere with ongoing program operations.
2. Information Collection Procedures
CCP crisis counselors and outreach workers will complete the Individual/Family Crisis Counseling Services Encounter Log Form the Group Encounter Log after the service recipient(s) has/have left the encounter location. These forms will not be used as a checklist and will not be completed while the service recipient(s) is/are present. Service providers will select variables based on their own perceptions of the service recipient or on information that recipients spontaneously reveal during the encounter.
The Weekly Tally Sheet will also be completed by the CCP crisis counselor or outreach worker at the end of the designated “week” period (e.g., Sunday through Saturday as determined by the CCP and the SAMHSA CMHS project officer).
The Assessment and Referral Tools will be used as a checklist with the service recipient present. These tools will be read aloud to the recipient by the crisis counselor, and the recipient will respond to questions accordingly.
Both the Service Provider and Participant Feedback Forms will be completed in private and anonymously. The Provider Feedback Form is administered online, and the Participant Feedback Form will be returned by mail. Both methods assure the anonymity of the respondent. The SAMHSA CMHS project officer along with FEMA staff will provide guidance to the State to determine the most appropriate method for the collection, processing, and sharing of findings for these data.
3. Methods to Maximize Response Rates
Response rates for the encounter logs (i.e., Individual/Family Crisis Counseling Services Encounter Log, Group Encounter Log, and Weekly Tally Sheet) and the Assessment and Referral Tools are intended to be 100 percent. However, it is acknowledged that a 100 percent completion rate is not always possible due to various reasons (e.g., the counselor may fail to complete a form, a form may not be available, or a form may be lost in the administrative process). Therefore, we estimate there may be a loss rate of up to 5 percent yielding a completion rate of 95 percent for each of these forms.
The Individual/ Family Crisis Counseling Services Encounter Log will be completed by the crisis counselor for all individuals who access this service. The Group Encounter Log will be completed by the crisis counselor for all groups that meet for crisis counseling or for public education. The Weekly Tally Sheet will be completed by the crisis counselor for all brief educational or supportive encounters not captured by any other form.
The Assessment and Referral Tools are intended to be completed by a trained crisis counselor for 100 percent of all service recipients who access individual crisis counseling for the third or fifth time or express an imminent need for intensive services. However, rates may be as low as 95 percent. Analysis of previously collected data indicated that that number of individuals to whom this will apply will be approximately 5 percent of all service users.
The Participant Feedback Form will be completed by service recipients. The Participant Feedback Form is given to a sample of persons for whom individual or group crisis counseling services were provided (i.e., not for persons denoted only on a Weekly Tally Sheet or who participated in group public education activities). It is given only to adults. The form is administered at 6 and 12 months after the event. At 6 and 12 months after the event, the program chooses a 1- or 2-week period during which all appropriate persons are asked to complete an anonymous feedback form. The number of respondents is compared to the total number of eligible adults served in individual crisis counseling or group crisis counseling (not including public education groups) during that administration period to estimate the response rate.
Service recipients will be provided with stamped return envelopes to increase their anonymity. The form is also accompanied by letters from the program director encouraging participation. The form is brief enough to also facilitate completion.
A review of recent data collected in the Online Data Collection System indicates that the typical response rate for the Participant Feedback form is approximately 25 percent. That is, of the total number of survivors receiving the Participant Feedback Form during a particular one to two week period, approximately 25 percent of them complete and return the form. We anticipate the same response rate for the current collection request. However, we may have a slight increase in reporting from previous years, as we are seeking to require CCPs to administer this form at least once during the RSP grant period.
When findings are reported, the response rate and the likelihood of bias will be communicated clearly, and aggregate level characteristics of responders as they relate to the program will be provided.
The Service Provider Feedback Form will be made available via an online link or paper distribution to all CCP service providers (i.e., crisis counselors/outreach workers) at 6 months and/or 1 year after the disaster. Service providers will be encouraged to complete these forms.
4. Tests of Procedures
Many instruments in the CCP Data Toolkit have been taken from established data collection tools that have already been tested for validity and reliability. SAMHSA CMHS staff members have had an opportunity to review the revised tools and all are in agreement with the data items. The Assessment and Referral Tools, the Participant Feedback Form, and the Service Provider Feedback Form contain elements of the Short PTSD Rating Interview, or SPRINT, and the SPRINT-E, an expanded version of this form, both of which have been determined in the research to be reliable and internally consistent. The Child/Youth Assessment and Referral Tool has items from the UCLA Posttraumatic Stress Disorder Reaction Index. Other questions for these three forms, as well as for the Individual/Family, and Group Encounter Log forms, contain items that evolved directly from previous studies (e.g., retrospective and cross-site evaluation of 2005 Gulf Coast hurricanes), and through site visits, interviews, and focus groups with States, direct service providers, and Federal staff. Demographics collected across all forms are considered standard items for collection in the research literature and speak directly to the goals of the CCP.
5. Statistical Consultants
The names and phone numbers of project officer and consultant are as follows:
Federal Project Officer
Nikki D. Bellamy, Ph.D.
Center for Mental Health Services
Division of Prevention, Traumatic Stress, and Special Programs
Emergency Mental Health and Traumatic Stress Services Branch
1 Choke Cherry Road, Room 6-1003
Rockville, MD 20875
Phone: 240-276-2418
Fax: 240-276-1890
Statistical Consultants
Min Q. Wang, Ph.D.
Expert Health Data Systems, Inc.
12530 Stratford Garden Drive
Silver Spring, MD 20904
Phone: 202-415-2211
Fran Norris, Ph.D.
Dartmouth Medical School
National Center for PTSD
215 N. Main Street
White River Junction, VT 05009
Phone: 802-296-5132
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| File Modified | 0000-00-00 |
| File Created | 2021-01-31 |