03.02.2011
ICR Supporting Statement Part B
Project Title: Division of Behavioral Surveillance (DBS) Gulf States Population Survey
COTR/Project Officer: Deborah Gould, PhD
Phone: 404-498-0562
Fax: 404-498-0595
E-Mail: [email protected]
03/02/2011
B. Collection of Information Employing Statistical Methods 3
1. Respondent Universe and Sampling Methods 3
2. Procedures for the Collection of Information 5
3. Methods to Maximize Response Rates and Deal with Nonresponse 6
4. Tests of Procedures or Methods to be Undertaken 7
5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data 8
The Division of Behavioral Surveillance (DBS) Gulf States Population Survey (GSPS) will include interviews from target and comparison areas. The target geographic area for inclusion in the GSPS was selected by determining the coastal counties within the states of Florida, Louisiana, Alabama, and Mississippi which are within 32 miles of areas closed to fishing as a result of the Deepwater Horizon Event. The table below indicates the counties within the targeted area and the 2009 population estimates for each county. The total population residing within the targeted area is 3.5 million.
2009 POPULATION ESTIMATE BY COUNTY OF TARGETED AREA |
|
|
2009 Population Estimate |
Louisiana |
|
Jefferson Parish |
443,342 |
St. Tammany Parish |
231,495 |
Tangipahoa Parish |
118,688 |
Lafourche Parish |
93,682 |
Iberia Parish |
75,101 |
Vermilion Parish |
56,141 |
St. Mary Parish |
50,815 |
St. Bernard Parish |
40,655 |
Jefferson Davis Parish |
31,097 |
Assumption Parish |
22,874 |
Plaquemines Parish |
20,942 |
Calcasieu Parish |
187,554 |
Cameron Parish |
6,584 |
Terrebonne Parish |
109,291 |
St. Charles Parish |
51,611 |
Orleans Parish |
354,850 |
Total targeted population for Louisiana |
1,894,722 |
Mississippi |
|
Hancock County |
40,962 |
Harrison County |
181,191 |
Jackson County |
132,922 |
Total targeted population for Mississippi |
355,075 |
Alabama |
|
Mobile County |
411,721 |
Baldwin County |
179,878 |
Total targeted population for Alabama |
591,599 |
Florida |
|
Escambia County |
303,343 |
Santa Rosa County |
151,759 |
Walton County |
55,105 |
Okaloosa County |
178,473 |
Total targeted population for Florida |
688,680 |
TOTAL TARGETED AREA POPULATION |
3,530,076 |
The table below illustrates the 2009 population estimates for the balance of each state, which will be the comparison population.
2009 POPULATION ESTIMATE BY COUNTY OF COMPARISON AREA |
|
State |
2005-2009 ACS Population Estimate For Comparison Area |
Louisiana |
2,516,842 |
Mississippi |
2,567,165 |
Alabama |
4,041,761 |
Florida |
17,533,740 |
The GSPS will collect data from a random sample of telephone households which include landline and cellular telephones. This is accomplished by selecting a random sample of phone numbers. The sampled phone numbers are called and screened to determine whether the numbers dialed are residential numbers. For landline phone numbers, a random selection of eligible adults will be administered the survey. Surveys conducted by cell phone will be completed with eligible respondents without further random selection. Cell phone numbers are selected using random digit dialing (RDD) protocols.
The GSPS will use a list-assisted method to improve efficiency and reduce unproductive calling for landline samples. Samples of landline telephone numbers purchased using this method have been prescreened to ensure that they are residential phone numbers. Dedicated FAX and computer lines, ported cell phone numbers, business numbers and other ineligible numbers have been identified prior to implementation of the survey. The list-assisted design reduces the number of unproductive screening calls while maintaining sampling weights that are roughly equal.
For landline, list-assisted frames, sampling frames of 100-number banks are created from all known area codes and telephone exchanges, and then matched against published residential telephone directories, and a count of the number of listed residential numbers is determined for each 100-number bank. The sampling frame is then restricted to 1+ bank—that is, 100-number banks that contain at least one listed household phone number. An unclustered sample of all telephone numbers contained in the sampling frame of 1+ banks is then drawn and interviewed.
Stratification will be used to select a random sample of phone numbers from the 1+ banks. Because residency rates and cooperation rates are higher for listed phone numbers (those present in a directory of household telephone numbers) than they are for unlisted numbers, the cost per completed interview for a listed number is less than for an unlisted number. Hence, stratifying phone numbers by listed status and then sampling listed numbers at a higher rate than unlisted numbers allows one to complete more cases subject to a fixed survey budget compared to sampling listed and unlisted phone numbers at the same rate. This stratification approach is used in the BRFSS Disproportionate Stratified Sampling (DSS) design, in which listed numbers are sampled at a rate 1.5 times greater than unlisted numbers.
The sample designer for the GSPS will then use the specified number of completed interviews to predict how many telephone numbers to select from the sampling frame of 1+ banks. In this case the number of completes per month for the target areas is 2,500 and the number of completes per month for the comparison areas is 1,250. In order to reduce bias, small subsamples are released into the working sample in groups (also know as replicates) of 30. This process will continue until the desired number of completed interviews is achieved.
The GSPS questionnaire was developed by DBS in partnership with the Substance Abuse and Mental Health Services Administration (SAMHSA) and state public health and mental health departments from Louisiana, Mississippi, Alabama, and Florida, where the survey is being conducted. A copy of the questionnaire is submitted with this new ICR submission. In addition to English, interviews will also be translated into Spanish for respondents who speak Spanish only. Estimates for the number of Spanish speaking individuals within select coastal counties ranges from 2% to 10%. Offering the survey in Spanish will allow for the inclusion of Spanish speaking people who otherwise could not participate in the survey due to a language barrier. The survey methodology is the same for all respondents and no specific recruitment efforts will be used for Spanish speaking participants.
Macro International Inc., under contract with CDC/DBS, will implement the survey including fielding questions using CATI and data cleaning. The DBS will provide the sample to Macro. The sample will be purchased by DBS from AUS Marketing Research Systems, Inc. Macro will receive the sample from DBS and conduct interviews during each month in accordance with a prescribed protocol, and incorporate surveillance results into CATI computer files. Macro must ask all survey questions without modification. Systematic, unobtrusive electronic monitoring will be a routine and integral part of monthly survey procedures for all interviewers. Macro will edit and correct completed interviews each month prior to submission of data to the DBS. Macro will also submit monthly disposition files on calling attempts and outcomes.
Macro will follow standard Behavioral Risk Factor Surveillance System (BRFSS) protocol during the implementation of the GSPS, including:
An eligible household is a housing unit that has a separate entrance, where occupants eat separately from other persons on the property, and that is occupied by its members as their principal or secondary place of residence. Noneligible households are (1) vacation homes not occupied by household members for more than 30 days per year, (2) group homes, and (3) institutions.
Eligible household members include all related adults (aged 18 years or older), unrelated adults, roomers, and domestic workers who consider the household their home, even though they may not be home at the time of the call. Household members do not include adult family members who are currently living elsewhere.
Proxy interviews are not conducted within the BRFSS. Individual respondents are randomly selected from all adults’ aged 18 years and older living in a household and are interviewed in accordance with BRFSS protocol.
An interview is considered complete if data are collected for age, race, and sex. If values on age or race are not entered, imputed values will be generated and used only to assign post-stratification weights.
Unless electronic monitoring of interviewers is being routinely conducted, a 5% random sample of each month’s interviews must be called back to verify selected responses for quality assurance.
Eligible persons who initially provide a soft refusal to be interviewed will be contacted at least one additional time and given the opportunity to be interviewed. Preferably, this second contact will be made by a supervisor or a different interviewer.
Call attempts on all sample pieces should be completed during the calendar month of the sample selection. However, if there are unresolved sample pieces remaining without the required call-backs at the end of the month, calls should continue until each sample piece can be given a final disposition.
DBS will weight data monthly according to county-specific population estimates. The survey will not include advance letters, respondent incentives, and/or other modes of respondent contact other than RDD telephone interviews. Appointments with respondents may be made by interviewers during the calling process, but advance interviews will not be established prior to calling.
Response rates for the 2009 BRFSS in Mississippi, Alabama, Louisiana and Florida are presented in the table below. It is anticipated that response rates for the GSPS will be within the ranges of the BRFSS in these areas.
State |
RDD Response Rate (CASRO) |
Florida |
50.7 |
Louisiana |
51.9 |
Mississippi |
65.1 |
Alabama |
52.7 |
Nonresponse may be a result of two sources: Unit nonresponse, in which an eligible respondent and/or respondent household is not included, and item nonresponse, in which data are missing for one or more variables for respondents who complete other portions of the survey. The GSPS will address unit nonresponse through weighting of respondents to known characteristics of the target populations.
Weighting will be accomplished in the standard procedures in place for the BRFSS. The formulae for the weighting process are described in the section below:
FINALWT = STRWT * 1 OVER NPH * NAD * Raking
FINALWT is the final weight assigned to each respondent.
STRWT accounts for differences in the basic probability of selection among strata (subsets of area code/prefix combinations). It is the inverse of the sampling fraction of each stratum. There is almost never a complete correspondence between strata, which are defined by subsets of area code/prefix combinations, and regions, which are defined by the boundaries of government entities.
1/NPH is the inverse of the number of residential telephone numbers in the respondent's household.
NAD is the number of adults in the respondent's household.
Raking represents process of iterative weighting.
Raking weighting adjusts for non-coverage and non-response and adjusts for different probabilities of selection by region, where applicable. The DBS will use raking weighting for the post stratification process. Once data are collected, weighting is completed using Iterative Proportional Fitting or Raking Weighting. Raking weighting methodology adjusts the data so that groups which are underrepresented in the sample can be accurately represented in the final dataset. Raking methodologies allow for the introduction of additional demographic characteristics and more accurately match sample distributions to known demographic characteristics of the populations. The use of Raking reduces nonresponse bias and has been shown to reduce error within estimates. Raking is completed by adjusting for one demographic variable (or dimension) at a time. Iterations of weighting continue until weights across all demographic characteristics are similar to those of the population. For example, when weighting by age and gender, weights would first be conducted for gender groups, then those estimates would be adjusted by age groups. This process would continue in an iterative process until all group proportions in the sample match to a specified margin of the total population. Raking includes categories of age by gender, detailed race and ethnicity groups, education levels, marital status, regions within states, gender by race/ethnicity, and age group by race/ethnicity.
Item nonresponse will be address through the use of imputation. Imputation is used to infer missing demographic information. Based on the missing at random assumption, the hot-deck method is often used. In this method, a missing value is imputed using a randomly selected respondent value within an appropriately defined imputation cell. The imputation cells are defined using cross-classified groups of survey respondent units by categorical variables without missing values. Under the assumption of the missing at random nonresponse mechanism, the hot-deck method produces unbiased imputed data.
The GSPS uses established protocols of the BRFSS which has been in continuous implementation for over 30 years. These BRFSS protocols have been adapted over time to meet the needs of the data collection process and maximize response rates while minimizing respondent burden.
The GSPS questionnaire submitted with this ICR request has been used in the field since December 14, 2010 (OMB emergency clearance control # 0920-0868, expiration April 30, 2011). The GSPS questionnaire includes health related questions taken from the ongoing BRFSS as well as additional questions taken from standardized scales or from other surveys designed to measure anxiety, depression, and potential stress-associated physical health effects. All GSPS questions taken from the BRFSS have been used over many years and previously cognitively tested. Minor modifications in some questions taken from the BRFSS have been made in order to define time periods for respondents.
DBS personnel are responsible for all statistical aspects of the GSPS including data analyses and reporting.
Name |
Title |
Phone |
|
Fred Shaw, MD, JD |
Acting Director, DBS |
404- 498-6364 |
|
Lina Balluz, PhD |
Branch Chief, BRFSS |
404-498-0496 |
|
Carol Pierannunzi, PhD,
|
Senior Survey Methodologist |
404-498-0501 |
|
Sally Lin, PhD |
Mathematical Statistician |
404-498-0560 |
|
Machell Town, MS |
Lead Statistician |
404-498-0503 |
|
Tara Strine, PhD |
Epidemiologist |
404-498-0507 |
Macro, International, Inc. is responsible for the GSPS data collection.
Name |
Title |
Phone |
|
Jamie Dayton |
Sr. Vice President |
802-264-3723 |
|
Naomi Freedner |
Principal |
802-264-3730 |
|
Beth Tarallo |
Project Manager |
802-264-3719 |
The following DBS personnel are responsible for receiving and approving contract deliverables.
Name |
Title |
Phone |
|
Deborah Gould, PhD |
Special Advisor and Contracting Officers Technical Representative (COTR) |
404-498-0562 |
|
Suzianne Garner |
Acting Deputy, DBS |
404-498-0498 |
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | cww6 |
File Modified | 0000-00-00 |
File Created | 2021-02-01 |