Supporting Statement Part B

B. COLLECTIONS OF INFORMATION EMPLOYING STATISTICAL METHODS

B1. Describe the potential respondent universe and any sampling or other respondent selection methods to be used.

B1.1 Potential Respondent Universe

The sampling frame is the set of all police-reported traffic crashes that include motorcycles in the United States. An ideal sample would be drawn randomly from the 103,000 such police reported crashes that occur each year (NHTSA, Traffic Safety Facts, 2005). However, such a sampling plan would require research teams to respond to a randomly drawn sample of those 103,000 different crash locations, something beyond the budget for this project. Alternatively, a clustered sampling plan could be used similar to that used in the National Automotive Sampling System. However, this also is well beyond the budget allotted by Congress for this study. Therefore, operational considerations dictate that a limited geographic area be selected from which to draw the crash sample. The plan is to draw from one or two large police jurisdictions in a single geographic area. These areas will cover diverse demographic and geographic characteristics and experience substantial numbers of motorcycle operators year-round. Consideration will be given to sites in Florida, Texas and California that have large numbers of motorcyclists with diverse population and geographic characteristics. Precedents exist for performing studies on vehicle crashes from investigations conducted in a single geographic location. Nevertheless, it is recognized that this study is not nationally representative, although it is anticipated that the most common crash types and most common antecedent conditions leading up to the acquired crashes will be represented in the study.

B1.2 Crash Sample Acquisition

The pilot study will develop and evaluate data collection forms, field methods, coding instructions, training materials and crash notification systems. The research samples for the pilot study and for the full-scale study will include all police reported, motorcycle-related crashes that occur in the selected police jurisdictions within the study period. For the pilot study, it is anticipated that approximately 35 such crashes will be investigated during a three-month period. For the main study, a maximum of 1200 crash investigations are planned, along with 2,400 matched case controls. A sample size of 1200 was chosen because it is anticipated that this size sample can be acquired within the geographic area, and a sample this size can be acquired in a single large jurisdiction (e.g. LA County) in a two-year period.

The acquisition of motorcycle-related crashes will be identified through cooperative agreements with the selected police jurisdictions. The crash investigators will be notified by police dispatchers when an applicable crash is reported, and will initiate their investigations on-scene in concert with first responders. Crashes of all severities from minor property damage to fatality will be included.

An advantage that was not available in the Hurt study is that the data elements for this study that are in common with those collected by National Automotive Sampling System and the National Motor Vehicle Crash Causation Study have been identified so that they can be cross-referenced. This allows the results from the current study to be compared to the in-common nationally representative data from these other NHTSA programs. This study is anticipated to provide more detailed information on motorcycle crashes and motorcyclist characteristics than is available in the other programs because of the unique data elements that will be collected pertaining to motorcycle and operator factors. Examples include operator training, experience and behaviors, and specific motorcycle features and condition.

B1.3 Control Sample Acquisition

The collection of control data also has antecedents in passenger vehicle safety research projects and motorcycle research projects. The current study will use a more stringent procedure than either of these studies for acquiring similarly at risk motorcyclists by capturing data from non-crash involved motorcyclists and passenger vehicle drivers (control subjects) matched on location, travel direction, and day of week, and time of day as the selected crash-involved parties. Acquiring data on controls matched this way (that is, similarly-at-risk controls) allows for the calculation of relative risks that can be used for developing countermeasures. In the Hurt study in the 1970s, this approach identified several significant risk factors for crashes. One was that riders who had received formal training were less likely to be involved in a crash or to suffer serious injury. Also, crash involved motorcyclists used daytime headlamps only about half as often as did those in the control group.

B2. Describe Collection of Information Procedures.

The OECD identifies two complementary procedures to be performed for acquiring the data needed to understand the causes of motorcycle crashes. The first of these is the traditional in-depth crash investigation that focuses on the sequence of events leading up to the crash, and on the motorcycle, rider, and environmental characteristics that may have been relevant to the crash. The second procedure, known as the case-control procedure, complements the first. It requires the acquisition of matched control data to allow for a determination of the extent to which rider and driver characteristics, and pre-crash factors observed in the crash vehicles, are present in similarly-at-risk, non-crash involved control vehicles.

Such a dual approach offers specific advantages to the understanding of crashes and the development of countermeasures. The in-depth study of the crash by itself allows for analysis of the events antecedent to the crash, some of which, if removed or altered, could result in a change in subsequent events that would have led to a non-crash, or reduced crash severity outcome. For example, an in-depth crash investigation may reveal that an automobile approaching an intersection was in a lane designated for straight through traffic only, but the motorist proceeded to make a left turn from that lane into the path of an oncoming motorcycle. That finding can, by itself, be used to develop countermeasures, and does not require matched control data. However, acquiring matched control data from similarly-at-risk riders and drivers provides additional critical information about crash causes that cannot be obtained if only crashes are examined. Perhaps the crash-involved motorcycle operator was not using daytime running lights, but the matched controls both used such conspicuity features.

B2.1 Crash Investigation Procedures

Once a crash notification has been received, several activities are initiated by the research team. Crash investigators immediately locate, visit, measure, and photograph the crash scene (while the vehicles are still there, to the extent possible). They locate, inspect, and photograph all involved vehicles. The investigators conduct an in-person or telephone interview with each involved person or surrogate. Because inclusion in the research is strictly voluntary, the investigators will use a script similar to the following:

“Hello, we are conducting a study of motorcycle safety for the NHTSA/FHWA and would like to ask you a few questions. This is expected to take about 25 minutes of your time. All information that you provide will be kept strictly confidential. We do not include any names, addresses or other personal identifiers in our records”.

Injury information from hospital or emergency room records or medical examiner reports is obtained and encoded for all injured victims. Surrogate interviews are used when a person is not able to be interviewed because of hospitalization or incarceration. Note that participation in the study is completely voluntary and the confidentiality safeguards described in Section A above will be strictly followed. During each activity the researchers record information on the appropriate crash, vehicle, and environment data forms. No personal identifiers are ever entered into any system of records.

B2.2 Control Data Collection Procedures

For the control data, researchers will interview motorcycle operators and motor vehicle drivers who pass by the site of a selected crash either for one hour immediately following the crash occurrence, or at one week after the crash at the same time of day. The timing of the control data collection effort will be determined by the current circumstances at each site (traffic congestion, police permission, and crash-data availability). Priority will also be given to obtaining crash data as rapidly as possible before it can be affected by traffic, weather or clean-up activities. If weather (or other) conditions differ substantially on the week following the crash, then the control sample collection will be moved to the week following.

Police help may be enlisted in asking motorcyclists and motor vehicle drivers to participate in the study if the police jurisdiction determines that this is necessary, or the site characteristics make such data collection tasks risky. Vehicles will be selected by type (passenger cars, trucks, etc. similar to those involved in the fatal crash). Interviews will be conducted with the operators and passengers (who can influence a crash) of the motorcycle and the drivers of the targeted other vehicles. Motorcycle inspections will also be conducted so that the type and condition of the vehicle can be recorded. Two control motorcyclist interviews will be captured for each single vehicle motorcycle crash. For two-vehicle crashes, one control motorcyclist and one control motor vehicle driver (similar to the crash-involved vehicle) will be interviewed. The number of controls captured per crash is relatively small because increasing the control sample size beyond the size of the crash sample yields diminishing returns on statistical power. One general problem these kinds of studies face is response bias. This problem is recognized and will be acknowledged in the final report.

B3. Describe methods to maximize response rates and to deal with issues of non-response.

Motorcycle operators, passengers and the drivers of other involved vehicles will be interviewed at the scene of the crash whenever possible. If these individuals have been medically transported, arrested or are otherwise not available for immediate interview, follow-up efforts will be initiated. Occupants will be contacted by telephone to arrange for an in-person interview if one can be arranged. Telephone interviews will be conducted only when necessary. Several methods are used to maximize response rates. Researchers call at varying hours (often in evenings or on weekends) until they have located the driver, operator, or passenger sought. When the person is unavailable (for medical or legal reasons), other family members or witnesses may be contacted to provide whatever limited information is available to them. Each researcher is given special training in interviewing. This increases the possibility that crash-involved persons will cooperate once they have been located and contacted. At least four follow-up phone calls will be made to reach necessary respondents.

Attempts will be made to recruit control drivers for interviewing at site-time matched locations (see Section 2.1.2). During the designated time period, the recruitment effort will continue until a control driver has accepted to participate, or the matched time period has ended. In the latter case, the same recruitment effort will be repeated at the same location during a second time period a week later, and if needed in subsequent weeks. We note that even if a motorcyclist does not co-operate, Westat will be able to identify the approximate size and type, the rider’s approximate age and gender by observation, and so Westat might also be able to match non-responding riders to crash-involved riders on a few key variables such as use of protective equipment, riding speed, etc.

It is anticipated that some information items may not be obtained even for riders who are willing to participate in the research. Westat plans to impute such missing item responses using traditional methods of imputation such as the hot deck.

Regarding the problem of refusals and bias that may be introduced by non-responders, it should be noted that response rates have been exceptionally high in prior crash investigation research and therefore non-response bias is not expected to be a problem in this project. In the most important prior motorcycle crash study conducted ion the US, (Hurt, Ouellette, Thom, 1981) refusal rates for both crash and control motorcyclists were near zero (personnel communication, Ouellette, 2007). However for drivers of cars involved in crashes with motorcycles they were about 25%. In a more recent automotive crash study focused on alcohol involvement that was conducted by NHTSA (see Compton, R. P., Blomberg, R. D., Moskowitz, H., Burns, M., Peck, R. C., & Fiorentino, D., Crash Risk of Alcohol Impaired Driving, in D. R. Mayhew and C. Dussault (Eds.), Proceedings of the 16^th International Conference on Alcohol, Drugs) refusal rates were 7.55% for crash drivers and 2.12% for control drivers. For NHTSA’s National Automotive Sampling System (NASS) annual crash study, refusal rates in 2006 were in the 26% range). However, most NASS interviews are conducted by telephone, and refusal rates in this current study are expected to be much lower as interviews will be conducted at the crash scenes. Regarding the matter of analyses to be performed on sub samples, FHWA and NHTSA recognize that the matter of non-response is to be given careful attention with respect to the potential of bias when sample sizes are effectively reduced in sub sample analyses.

B4. Describe any tests of procedures or methods to be undertaken.

The Pilot Study serves as a test of the procedures to be used for the Main study. If it turns out that certain of the OECD procedures are inapplicable to the U.S. environment, they will be modified as necessary. For example, if the Pilot study shows that certain questions on alcohol are being refused at an unacceptably high rate, then such items will be dropped. Or, if the on-scene data gathering procedures are shown to result in unacceptably long delays in clearing the crash scenes, the those procedures will be streamlined. As a third example, if it is discovered in the Pilot study that interviewers cannot properly enter data because some questions have too many alternatives (even though they comply with the OECD protocol), such items will be modified.

B5. Provide the name and telephone number of individuals consulted on statistical aspects of the design and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.

B5.1 Statisticians Consulted

Ms. Roya Amjadi, Safety Research and Development, reviewed the statistical approach for FHWA. She can be reached at 202.493.3383

Paul Zador, Ph.D, Senior Statistician, Westat Corporation provided consulting services.

Tel. 301.294.2825.

B5.2 Agency, Contractors, Grantees

NHTSA

Jennifer Percer, Ph.D, NHTSA Office of Behavioral Safety Research is responsible for the Pilot Study and for NHTSA recommendations regarding the Main Study. She can be reached at 202.366.9785

FHWA

Carol Tan, Ph.D, Safety Research and Development, Federal Highway Administration, is responsible for the large-scale study. She can be reached at 202.493.3315.

Contractors

The contract for the Pilot Study–Motorcycle Crash Causes and Outcomes, contract DTNH22-05-C-05079, was awarded to Westat in September, 2005. Ms. Frances Bents is the Project Director 240.314.7557.

The Grant for the Motorcycle Crash Causation Study (DTFH61-06-H-00034) was awarded to the Oklahoma Transportation Center (OTC). Dr. Samir Ahmed is the Principal Investigator. He can be reached at 405.744.5261. OTC has not yet selected any firm to support main study project.