SUPPORTING STATEMENT FOR THE ADDICTION TECHNOLOGY TRANSFER CENTERS (ATTC) NETWORK PROGRAM MONITORING

A.	JUSTIFICATION 

1.	Circumstances of Information Collection 

The Substance Abuse and Mental Health Services Administration’s (SAMHSA) Center for Substance Abuse Treatment (CSAT) is seeking Office of Management and Budget (OMB) approval for the revision of data collection activities for monitoring program performance of the Addiction Technology Transfer Centers (ATTC) Network, formerly the National Cross-Site Assessment of Addiction Technology Transfer Centers (ATTC) Network. The 5 instruments are used for program monitoring of ATTC events as well as for ongoing quality improvement. The instruments are: the Event Description Form, the Pre-Event Form for Meetings and Technical Assistance, the Pre-Event Form for Training, the Post Event Customer Satisfaction Survey –Training, and the Follow-up Event Customer Satisfaction Survey -Training. There are no changes to any of the forms (see Attachment 1) but there is an expected increase in the number of persons to be served by the ATTC Network. The current approval is OMB No. 0930-0216 which was extended to January 31, 2007. SAMHSA’s CSAT funds this program under legislative authority of Section 509, Priority Substance Abuse Treatment Needs of Regional and National Significance, of the Public Health Service Act, as amended. 

In addition, for program monitoring of the ATTC Network meetings and technical assistance, CSAT utilizes the CSAT Government Performance and Results Act (GPRA) Customer Satisfaction instruments in which the burden is approved under OMB No. 0930-0197. (See Attachment 2 for GPRA Customer Satisfaction Surveys for the CSAT Knowledge Application Programs). The ATTCs are using currently approved forms in Attachments 2-1 through 2-4 for meetings and technical assistance. Attachments 2-5 and 2-6 are included to show the basis for the ATTC Training Post Event and Follow-up instruments. 

The ATTC Network, a nationwide, multidisciplinary resource that draws upon the knowledge, experience and latest research of recognized experts in the field of addictions, is a unique CSAT initiative, formed in 1993 in response to a shortage of well-trained addiction professionals in the public sector. The ATTC Network works to enhance the knowledge, skills and aptitudes of the addiction treatment and recovery services workforce by disseminating current health services research from the National Institute on Drug Abuse, National Institute on Alcohol Abuse and Alcoholism, National Institute of Mental Health, Agency for Health Care Policy and Research, National Institute of Justice, and other sources, as well as other SAMHSA programs. To accomplish this, the ATTC Network (1) develops and updates state-of-the-art, research based curricula and professional development training, (2) coordinates and facilitates meetings between Single State Authorities, Provider Associations and other key stakeholders, and (3) provides ongoing technical assistance to individuals and organizations at the local, regional and national levels.

Currently, CSAT funds a network of fourteen Regional Centers and a National Office, which serve all 50 states, the District of Columbia, Puerto Rico, the U.S. Virgin Islands, and the Pacific Islands (Attachment 3). Of the fifteen sites, twelve are located at academic institutions, two are located within nonprofit institutes, and one is a project of a state certification board. Although the individual sites vary in the number of states served and areas of emphasis, each is charged, as is the Network as a whole, with seven key objectives: 

•	Building and maintaining collaborations and facilitating systems change to improve the provision of substance use disorders treatment and recovery services among key organizations and groups; 
•	Using innovative technologies to create partnerships with, and disseminate current behavioral health research from various federal sources; 
•	Developing and updating state-of-the-art research-based curricula; 
•	Enhancing the clinical and cultural competencies of professionals in a variety of disciplines to address the treatment/recovery needs of individuals with substance use disorders; 
•	Upgrading standards of professional practice for addictions workers in a variety of settings; 
•	Serving as a technical resource on state-of-the-art treatment and recovery services for community-based and faith-based organizations, consumers and recovery organizations, and other stakeholders; and 
•	

Providing feedback from the field to CSAT regarding the development of a comprehensive agenda for learning about and applying state-of-the-art treatment approaches. 

The ATTC Network is a major resource in ensuring that treatment and recovery services professionals have the latest information on recommended approaches to addictions treatment and recovery management techniques. The Network provides ongoing dissemination of research-based addictions knowledge in a number of ways, including training events, technical assistance, meetings, print resources such as brochures and newsletters, and electronic media such as Web sites. 

Training events take the form of workshops, conferences, continuing education courses, university courses, and community college courses. While the majority of training events are done in the traditional classroom format, there are a growing number of distance education opportunities, including online and video courses. Training participants come from diverse populations, ranging from addictions counselors to correctional officers and health professionals. Technical assistance events are jointly planned consultations generally involving a series of contacts between an ATTC and an outside organization/institution during which the ATTC provides expertise and gives direction toward resolving a problem or improving conditions. Meeting events are ATTC sponsored or co-sponsored events in which a group of people representing one or more agencies other than the ATTC work, cooperatively on a project, problem, and/or a policy. 

2. 	Purpose and Use of Information 

SAMHSA’s legislative mandate is to increase access to high quality prevention and treatment services and to improve outcomes. Its mission is to improve the quality and availability of treatment and prevention services for substance abuse and mental illness. To support the Agency’s mission, SAMHSA’s overarching goals are:

1)	Accountability—Establish systems to ensure program performance measurement and accountability
2)	Capacity—Build, maintain, and enhance mental health and substance abuse infrastructure and capacity
3)	Effectiveness—Enable all communities and providers to deliver effective services

SAMHSA strives to coordinate the development of these goals with other ongoing performance measurement development activities. Below are the measures delineated in the Government Performance and Results Act (GPRA) Performance Plan for the Best Practices programs, including the ATTC Network:
Measure 1: Increase the number of individuals trained per year - This is a key measure tracking CSAT’s mission of promoting effective treatment through the adoption of evidence-based practices. Tracking the number of individuals trained is critical in documenting the delivery of service and dissemination of relevant information to the field.  

Measure 2: Increase percentage of drug treatment professionals trained by the program who (a) would rate the quality of the events as good, very good, or excellent; (b) shared any of the information from the events with others; (c) report implementing improvements in treatment methods on the basis of information and training provided by the program.

Measure 3: Increase the percentage of grantees in appropriate cost bands.

Outcome data reflect the Agency’s desire for consistency in data collected within the Agency. SAMHSA is implementing specific performance domains called the National Outcome Measures (NOMS) to assess the accountability and performance of its discretionary and formula grant programs. These domains represent SAMHSA’s focus on the factors that contribute to the success of substance abuse treatment, one of which is the use of evidence-based practices. The ATTC Network directly assists CSAT promote effectiveness through evidence-based practice programs, which help communities and providers to identify, adapt, implement, and evaluate evidence-based practices. Programs include activities to bridge the gap between knowledge and practice by promoting the adoption of evidence-based practices, and by ensuring that services availability meets targeted needs. These programs also are used to disseminate information about systems and practices shown to be most effective.

Information collected from these instruments will continue to assist CSAT in documenting the numbers and types of participants in ATTC events, describing the extent to which participants report improvement in their clinical competency, and which method is most effective in disseminating knowledge to various audiences. This type of information is crucial to support CSAT in complying with GPRA reporting requirements and will continue to inform future development of knowledge dissemination activities. Moreover, this information will be collected and examined on a regular basis by the ATTC Network itself for ongoing quality improvement purposes. Questions that the ATTC Network considers while examining the data include: 
•	

What are the characteristics of the participants at ATTC events across the 15 sites, and what are their purposes for attending? 

•	Do ATTC training events lead to an increase in knowledge and/or skills in participants? 

•	Are certain training formats more effective than others in transferring knowledge and skills to participants? 

•	How is training effectiveness affected by participant type, training format and/or training topic? 

Event Definitions

The definitions for the three types of events from which data will continue to be collected have not changed. They are as follows: 

Training Event --A training event is defined as an ATTC sponsored or co- sponsored event lasting at least three (3) hours that focuses on the enhancement of knowledge and/or skills. Higher education classes must be included in this definition with each course considered as one training event. 

Technical Assistance --Technical assistance is defined as a jointly planned consultation generally involving a series of contacts between the ATTC and an outside organization/
institution. During the consultation, the ATTC provides expertise and gives direction toward resolving a problem or improving conditions. This may be a time-limited consultation or an ongoing series of consultations. The ATTC reports technical assistance at the end of the series of contacts or yearly if contacts are ongoing. 
	
Meeting --A meeting is defined as an ATTC sponsored or co-sponsored event in which a group of people representing one or more agencies other than the ATTC work cooperatively on a project, a problem, and/or a policy. These groups may be established and ongoing, or may exist only to accomplish a single purpose. Included in this definition would be consortia meetings and workgroup meetings. The ATTC reports activities as "meetings" only when they are NOT appropriate to report under any other category. 

Description of Data Collection and Purposes

Data collected on the forms continue to be entered into an online system maintained by a CSAT contractor. Data entered into this online system are immediately live and accessible to CSAT Project Officers for administration purposes. Table 1 summarizes the data collection instruments. There are no changes to any of the current OMB approved instruments (OMB No. 0930-0216).  

Event description data will continue to be reported by ATTC faculty/staff on all three types of events using the approved event description instrument (Attachment 1-1). This instrument asks approximately 10 questions of ATTC faculty/staff relating to the event focus and format, as well as publications to be used during the event. It allows the ATTC Network and CSAT to track the number and types of events held.

Pre-event data will be collected on participants prior to the beginning of all three types of events to allow the ATTC Network and CSAT to determine the demographics of people receiving services. Since this demographic information is collected at both pre and post event, it is also used in two additional ways at the regional level. First, the information is used to check the accuracy of the personal ID system, to make sure that matching ID codes are likely to be from the same participant. Furthermore, it is used regionally to analyze attrition rates, to determine if there is a difference between participants that complete events and those that do not. 

Pre-event Form for Meetings and Technical Assistance: For meeting and technical assistance events, the Pre-Event instrument asks approximately 10 questions of each individual that is participating in the event. The approved instrument asks the participants to report their demographic information, education, work setting, responsibilities, and training goals (Attachment 1-2).  

Pre-event Form for Trainings: The Pre-Event instrument for training (Attachment 1-3) will continue to include four additional items that are not part of the instrument used for technical assistance and meetings. These additional items relate to participant-reported competency in the training’s topic area, and, when compared with post-event and follow-up data, allow both the ATTC Network and CSAT to monitor the quality and effectiveness of the training delivered, including the relative effectiveness of various training formats for various topics and audiences. Such monitoring plays a fundamental role in future program planning and ongoing improvement of training activities over the life of the effort.

Post-event data will be collected on participants of all three types of events according to CSAT requirements. 
 
Post-event and Follow-up Forms for Meetings and Technical Assistance: The Government Performance and Results Act Customer Satisfaction Surveys for the Center for Substance Abuse Treatment Knowledge Application Programs (OMB No. 0930–0197), will be administered to participants of technical assistance and meeting events both immediately following the event and 30 days after the event for follow-up (Attachments 2-2 and 2-3). 

Post Event Form for Training: The Post-Event Information Instrument for Training, which is administered immediately following the event, asks approximately 25 questions of each individual that participated in the training (Attachment 1). The instrument asks the participants to report demographic information, satisfaction with the quality of the training and training materials, and to assess their level of skills in the topic area. This instrument is nearly identical to the CSAT Customer Satisfaction instrument for training (OMB No. 0930-0197) except that it includes two (2) additional questions.  

Follow-up Form for Training: The Follow-up Information Instrument for Training, which is administered 30-days after the event, also asks about 25 questions (Attachment 1-5). The approved instrument asks the participants to report demographic information, satisfaction with the quality of the training and training materials, and to assess their level of skills in the topic area. This instrument is nearly identical to the CSAT Customer Satisfaction instrument for training (OMB No. 0930-0197) except that it includes four (4) additional questions.

While the instruments administered immediately at the end of each event are given to all participants, the instruments administered 30 days after each event are sent to a random sample of 25% of those participants who consented to follow-up. This sampling rule applies to all three types of events.

Table 1: Data Collection Instruments 

Form	Timeline	Type of Information	
ATTC Faculty/Staff	
ATTC Event Description Form (EDF) (Attachment 1-1)	Prior to each event 
	Format and content of event 
	
Participants	
ATTC Pre-Event Form (PRE) for meetings and technical assistance (Attachment 1-2)	Beginning of each event (all participants) 
	Demographic information, job responsibilities 	
ATTC Pre-Event Form (PRE) for training  (Attachment 1-3)	Beginning of each training (all training participants) 
	Demographic information, job responsibilities, additional items on knowledge, skills and effectiveness in topic area of training event. 	
Government Performance and Results Act Customer Satisfaction Surveys for the
Center for Substance Abuse Treatment Knowledge Application Programs
(Attachments 2-1 through 2-4)
Approval is not being requested in this submission.	Completion of each technical assistance event or meeting and 30 days after completion of each technical assistance event or meeting (all participants)	CSAT GPRA Customer Satisfaction Survey instruments

CSAT Form  Approved under OMB No. 0930-0197	
ATTC Post-event Form for Training (Attachment 1-4)	Completion of each training event (training participants only). 	CSAT Customer Survey (OMB No. 0930-0197)  instrument for training, PLUS 2 questions on knowledge and skills in topic area of training event	
ATTC Follow-up Form for Training (Attachment 1-5)
	30 days after completion of training event (random sample of 25% of consenting training participants only). 
	CSAT Customer Survey (OMB No. 0930-0197)  instrument for training follow-up, PLUS 4 questions on knowledge, skills and effectiveness in topic area of training event, and barriers to implementation 	

3. 	Use of Information Technology 

Sixty percent of the ATTC performance monitoring instruments are administered in person to participants at ATTC events, who complete the forms by paper and pencil. Ten percent of the training courses are online, and thus, those instruments are administered online. Data collection for the PRE and GPRA baseline instruments is incorporated into the class procedure. The remaining thirty percent is made up of those 30- day follow-up instruments that are distributed to consenting participants via electronic mail using an online survey tool.

All data collected will be managed in electronic databases. The ATTC Regional Centers are responsible for data collection and entry for their events. Data collected on all the instruments are entered into the online database maintained by CSAT's contractor. Once data are entered into the system, they are available to CSAT for review. These data can also be downloaded by the Regional Centers for their use. At least once a year, the ATTC National Office requests all ATTC data from that year from the CSAT contractor. The ATTC National Office keeps a record of the data collected, and merges files for data examination as requested. 

4.	Efforts to Identify Duplication 

The data to be collected are unique and are not otherwise available. 

5. 	Involvement of Small Entities 

Participation in the ATTC Network program monitoring will not be a significant burden on small businesses or small entities or on their workforces. 
 
6. 	Consequences If Information Collected Less Frequently 

Comparisons of data are crucial for CSAT and the ATTC Network to be able to monitor the effectiveness of the training events, and to make necessary adjustments accordingly. The Pre-Event Training Questions are needed to give a baseline measure of participants' knowledge, skills and effectiveness in the topic area of the training event attended. The Post-Event Training Questions provide the first comparison point to measure a change in knowledge and skills. The Follow-up Training Questions demonstrate whether the information learned in the training event has been used in the workplace. 

All of the information collected from participants is critical for assessing the effectiveness of the training events of the ATTC Network. Without this information, CSAT will be unable to: 

•	Determine the effectiveness of ATTC training events in increasing the knowledge and skills of training participants; 

•	Determine the effectiveness of various training formats to transfer knowledge and skills to participants. 

7.	Consistency with the Guidelines in 5 CFR 1320.5ld}(2} 

This information collection fully complies with the guidelines in 5 CFR 1320.5(d)(2).

8. 	Consultation Outside the Agency 

The notice required by 5 CFR 1320.8(d) was published in the Federal Register on June 28, 2006 (71 FR 36820-36821). No comments were received in response to this notice. 

Since the instruments for which clearance is being requested have not changed from the prior OMB approval, no further outside consultation has been initiated.

9. 	Payment to Respondents 

Some ATTC sites may provide minimal payment for the follow-up instruments. This varies across the Network due to regional and local differences. For those ATTC sites that do provide payment, survey research literature suggests that monetary incentives have a strong positive effect on response rates and no known adverse effect on reliability.  

10. 	Assurance of Confidentiality 

Each of the instruments used for data collection asks a number of questions that are used to create a unique identification code. This code does not change over time, but also does not include personal identifiers. This code is used to match responses from pre-training to post-training to follow-up without personal identifiers. Though the use of this code, it is possible to assure participants that their responses are confidential. See the Personal Code section at the top of each of the attached instruments in Attachment 1. 

11. 	Questions of a Sensitive Nature 

No forms collect information that is sensitive to individuals. 

12. 	Estimates of Annualized Hour Burden 

The total annualized burden to an estimated 30,200 respondents for the ATTC Network program monitoring is estimated to be 9,200 hours. Burden estimates are based on previous use of related data collection instruments by the ATTC Network. The annualized hourly costs to respondents are estimated to be $142,140.50. Hourly wage information is based on estimated average hourly wages of $15.45 an hour for counselors from Bureau of Labor Statistics, U.S. Department of Labor, Occupational Outlook Handbook, 2006-07 Edition (http://www.bls.govoco/ocos067.htm).
There are no direct costs to respondents for participation aside from their time. Burden estimates are detailed in Table 2. The Event Description Form is filled out by ATTC faculty or training staff. 

Table 2: Annualized Burden Estimates 

Instrument	
No. of Respondents	Responses per Respondent	Hours
per Response	Total Hour Burden	Hourly Wage Cost	
Total Hour Cost	
ATTC Faculty/Staff	
Event Description 	200	1	.25	50	$15.45	$772.50	
Meeting and Technical Assistance Participants	
Pre-Event	3,000	1	.08	240	$15.45	$3,708	
Training Participants	
Pre-Event	27,000	1	.13	3,510	$15.45	$54,230	
Post-Event	27,000	1	.16	4,320	$15.45	$66,744	
Follow-Up	6,750	1	.16	1,080	$15.45	$16,686	
TOTAL	30,200	-	-	9,200	-	$142,140.50	

13.	Estimates of Annualized Cost Burden to Respondents

There are neither capital or startup costs nor are there any operation and maintenance costs.

14. 	Estimates of Annualized Cost to the Government 

The annual estimated cost to the government for the ATTC Network program is $8.2 million. This includes an estimated annual amount of $8.1 million for cooperative agreements for three years. Approximately $104,202 per year represents SAMHSA costs to manage/administrate the network for 90% of one employee (GS-14).

15. 	Changes in Burden 

Currently, there are 7,010 burden hours in the OMB inventory. The Program is requesting 9,200 hours, an increase of 2,190 hours. This increase is due to a program change that results from an increase in the number of persons to be served by the ATTC Network. 

16. 	Time Schedule. Publication and Analysis Plans 

Data collection will occur as individuals participate in ATTC-sponsored events across the 14 regional sites and the National Office. Because this assessment is used to monitor and improve upon the quality of ATTC services, ongoing examination is critical. Fortunately, CSAT’s electronic database in which the data will continue to be entered allows reports to be run on the data in a quick and timely manner. ATTC sites will, therefore, periodically run such reports to examine their data. Furthermore, each ATTC site must, according to CSAT funding requirements, prepare two biannual reports each fiscal year. In these reports, each ATTC site is required to include a summary report of its performance monitoring data as it relates to SAMHSA’s matrix of priority programs and cross-cutting principles. The biannual reports are completed regionally by ATTC staff and Directors using a Network template, and are sent to CSAT electronically. In addition, at least once a year the ATTC National Office requests aggregated, Network-wide data on the following categories from CSAT’s electronic database contractor:

•	Total events;

•	Total events in each of the three event categories;

•	Total participants;

•	Total participants in each of the three event categories;

•	Percentages of participants of various races and ethnicities combined for all three event types;

•	Percentages of participants of each gender combined for all three event types;

•	Percentages of participants who are overall satisfied with ATTC events taken as a whole;

•	Percentages of participants who are overall satisfied with each of the three types of events;

•	Percentages of participants who shared information from all ATTC events combined with others;

•	Percentages of participants who shared information from each of the three types of events with others;

•	Percentages of participants who shared materials from all ATTC events combined with others;

•	Percentages of participants who shared materials from each of the three types of events with others;

•	Percentages of participants who applied what they learned from all ATTC events combined to their work;

•	Percentages of participants who applied what they learned from each of the three types of events to their work.

The National Office then presents the data in a brief, easy-to-read format for dissemination to key stakeholders. 

17. 	Display of Expiration Date 

The expiration date for OMB approval will be displayed on all data collection instruments for which approval is being sought. 

18.	Exceptions to Certification Statement 

There are no exceptions to the certification statement. 

B. 	COLLECTIONS OF INFORMATION EMPLOYING STATISTICAL METHODS

1.	Respondent Universe and Sampling Methods 

The Center for Substance Abuse Treatment has funded the Addiction Technology Transfer Center Network to provide training to an estimated 27,000 individuals per year across 14 Regional Centers and the National Office. A wide variety of training participants are anticipated, ranging from addictions counselors to professionals in other fields who work with individuals with substance use disorders. The ATTC Network also provides technical assistance and meetings, attendees of which are included as part of the pool of participants. Meeting and technical assistance attendees will complete the Pre-Event Form at the beginning of the event, and afterwards will complete the GPRA Customer Satisfaction Surveys for the CSAT KA Programs surveys associated with the event they attended. Participants self-refer to all events provided by the ATTC Network. Since this is the case, the respondent universe is made up of participants of events of the ATTC Network. 

Consistent with the approach used in the GPRA Customer Satisfaction Surveys for the CSAT KA Programs, sampling methods will be used for the follow-up portion of this project. It was determined that the use of sampling in the follow-up phase of the performance monitoring would be most efficient because of the wide variety of training topics and formats offered by the ATTC Network. Sampling allows the ATTC Network to collect information on the entire variety of training events, and to allow for comparisons by topic of training and by format of training. The Event Description Form collects information about the format and topic of training events, allowing for comparisons between training topics and formats. A random sample of 25% of participants who have consented for follow-up will be contacted 30 days after the event by e-mail or traditional mail to complete follow-up forms. 

In 2000, a follow-up response rate pilot showed that the methodology that consistently reached 80% was phone follow-up; however, the cost was prohibitive for adoption across the ATTC Network. The Center using that methodology compared doing 80% response rate with a 20% random sample, and found that there was no difference between the results from the two groups. ATTC Directors and CSAT agreed on a 25% sampling plan for follow-up, with the aim of 80% response rate of that sample. Participants are asked at registration if they are willing to participate in a 30-day follow-up survey, and if so, how they would prefer to be contacted (e-mail or traditional mail). The sample is drawn randomly from the pool of consenting participants. ATTC Regional Centers are using a standard method for follow-up, with changes based on the contact method (e-mail or traditional mail). Sample cover letters for follow-up are attached (Attachment 4). 

2. 	Information Collection Procedures 

As explained previously in Section A2, five instruments have been previously approved and are being used to monitor the ATTC Network’s performance in addition to the GPRA Customer Satisfaction Surveys for the CSAT KA Programs. There are no changes to these instruments. The data collection instruments are described below, summarized in Table 3, and are provided in Attachment 1. Attachment 2 clarifies the derivation of the post-event and follow-up training forms. Attachments 2-1 through 2-4 are currently being used by CSAT Best Practices Programs for baseline and follow-up meetings and technical assistance.

•	Event Description Form (EDF). The EDF collects descriptive information about each of the events of the ATTC Network. This form is completed by ATTC staff.

•	Pre-Event Form (PRE). The PRE is used to collect demographic information about participants of ATTC events. The PRE is distributed to participants and completed prior to the beginning of the meetings or technical assistance events. 

•	Pre-Event Form plus Pre-Training Questions. Four supplementary questions are included with the PRE for training events. These questions ask training participants their perceptions of their knowledge, skills and effectiveness of the training topic prior to the training event. These questions are found on the back of the PRE Form for training events. They are completed by training participants along with the PRE Form prior to the beginning of the training event. 

•	Post-event Customer Survey -Training. This form is the same as the GPRA Customer Satisfaction Survey for CSAT KA Programs for Training (OMB No. 0930-0197), but with two additional questions on the participants' perceptions of their skills and knowledge in the topic area directly after the training event. This form is distributed to training participants at the end of the training activity, and collected from them before they leave. For training events which take place over an extended period of time, this form is completed after the final session of training. 

•	Follow-up Customer Survey -Training Follow-Up. This is the same as the one used for the GPRA Customer Satisfaction Survey for CSAT KA Programs for Training Follow-up, but with four additional questions on the domains covered in both the PRE and POST, and on actual barriers to implementation. The follow-up is sent to a random sample of training participants 30 days after the end of the training event. 

Event participants will be asked to complete the Pre-Event Form during the registration process. At this time, they will receive the Cover Page for Instruments (Attachment 5) and will be told about the purpose of the data collection (See Model Statement, Attachment 6). Participants are also asked if they are willing to participate in the 30-day follow-up and if so, to provide contact information for their preferred method of contact (e-mail or traditional mail; see Attachment 7). This is often done in conjunction with the completion of a consent form (See Model Consent Form in Attachment 8). 

At the end of the event, participants are asked to complete a Customer Survey for the type of event they attended (meeting, technical assistance or training), which is collected prior to participants leaving the event. The Post-event Customer Survey-Training (Attachment 1-4) form includes questions used to examine the changes in perceived knowledge, skills and effectiveness from pre to post to follow-up. 

Follow-up Customer Survey forms are sent 30 days after the end of the event to a random sample of 25% of the participants willing to be contacted (See Attachment 4 for sample cover letters). The Follow-up Customer Survey - Training (Attachment 1-5) includes questions to assess changes in perceived knowledge, skills and effectiveness and to ask about barriers to implementation. 

Table 3: Data Collection Methods 

Form	Data Collection Method	Timeline	
ATTC Faculty/Staff	
Event Description Form	Paper and pencil instrument	Beginning of each training event	
Training Participants	
Pre-Event Form for Meetings and Technical Assistance	Paper and pencil instrument (10% online)	Beginning of each event	
Pre-Event Form for Training	Paper and pencil instrument (10% online)	Beginning of each training event	
Post-Training Form	Paper and pencil instrument (10% online)	Completion of each training event	
Follow-up Training Form	Mail-out instrument 
(Estimated 75% online via online survey tools) 	30 days after completion of training event	

Methods to Maximize Response Rate 

The ATTC Network anticipates an 80% overall response rate for this performance monitoring project. The ATTC expects receiving at least 90% of the Pre-Event and Post-event forms, as these forms are completed at the time and location of the event. The ATTC anticipates a 100% response rate on the Event Description Form, as this is completed by ATTC staff and/or faculty, and is a requirement of their position. The ATTC Network anticipates receiving 80% of the follow-up forms. The 25% sampling strategy described above is in place to allow for repeated attempts to contact participants for follow-up. 

Methods to maximize response rates include: 

•	Brief and easy to complete instruments; 

•	Two of the instruments are completed at the time and location of the training event; 

•	One instrument is completed by ATTC training staff; 

•	Standard language in the grant announcement requiring all ATTC regional sites to participate in the program monitoring; 

•	Biannual reports summarizing findings to ATTC directors and CSAT;

•	Annual summary reports of findings for broader dissemination;

•	All sites will emphasize the importance of completing these instruments in order to continue the funding that provided the opportunity for the event for no cost or at low cost; 

•	

Ease and convenience of electronic reporting; and 
•	
The ATTC Network has a history of a strong positive relationship with event participants who are receptive to the request for follow-up participation with a traditional single mailing methodology. 

4.	Tests of Procedures 

For approximately the past ten years, the ATTC Network has successfully collected data for performance monitoring. Since no procedure or form has changed since the last OMB approval, no difficulty is anticipated in maintaining and continuing the past successes.

5. 	Statistical Consultants 

Government Project Officer
Catherine Nugent
Substance Abuse and Mental Health Services Administration
Center for Substance Abuse Treatment
1 Choke Cherry Road, Room 5-1079
Rockville, MD
(240) 276-1577 (p)
(240) 276-2970 (f)
Cathy.nugent@samhsa.hhs.gov

ATTC National Office Coordinators

Mary Beth Johnson
Director 
Addiction Technology Transfer Center National Office
University of Missouri-Kansas City
5100 Rockhill Road
Kansas City, MO 64110
(816) 235-6984 (p)
(816) 235-6580 (f)
johnsonmb@umkc.edu

Laurie Krom
Associate Director
Addiction Technology Transfer Center National Office 
University of Missouri-Kansas City
5100 Rockhill Road
Kansas City, MO 64110
816.235.6985 (p)
816.235.6580 (f)
kroml@umkc.edu

ATTACHMENTS

Attachment 1:	ATTC Customer Satisfaction Surveys

1-1 	ATTC Event Description Form
1-2 	ATTC Pre-Event Form ─ Meetings and Technical Assistance
1-3 	ATTC Pre-Event Form ─ Training
1-4 	ATTC Post Event Customer Satisfaction Survey ─ Training
1-5 	ATTC Follow-up Event Customer Satisfaction Survey ─ Training

Attachment 2:	Government Performance and Results Act Customer Satisfaction Surveys for the Center for Substance Abuse Treatment Knowledge Application Programs (OMB No. 0930-0197)

2-1 	CSAT Customer Satisfaction Survey ─ Meeting
2-2 	CSAT Customer Satisfaction Survey ─ Meeting Follow-up
2-3 	CSAT Customer Satisfaction Survey ─ Technical Assistance
2-4 	CSAT Customer Satisfaction Survey ─ Technical Assistance Follow-up
2-5 	CSAT Customer Satisfaction Survey ─ Training
2-6 	CSAT Customer Satisfaction Survey ─ Training Follow-up

Attachment 3	ATTC Network Regional Centers

Attachment 4:	Sample Cover Letters

Attachment 5	Cover Page for Instruments

Attachment 6:	Model Statement

Attachment 7:	Contact Information Form

Attachment 8:	Statement of Informed Consent for Follow-up Interview