SUPPORTING STATEMENT
MARINE RECREATIONAL FISHING EXPENDITURE SURVEY
OMB CONTROL NO. 0648-0693
B. COLLECTIONS OF INFORMATION EMPLOYING STATISTICAL METHODS
1. Describe (including a numerical estimate) the potential respondent universe and any sampling or other respondent selection method to be used. Data on the number of entities (e.g., establishments, State and local governmental units, households, or persons) in the universe and the corresponding sample are to be provided in tabular form. The tabulation must also include expected response rates for the collection as a whole. If the collection has been conducted before, provide the actual response rate achieved.
The potential respondent universe consists of saltwater recreational anglers in the contiguous U.S., Hawaii, and Alaska. The sampling frame will be based on anglers intercepted after a fishing trip, the National Registry of Saltwater Anglers which contains contact information for anglers who purchased a saltwater fishing license during the last year, and state angler license frames. For Hawaii, in addition to the National Registry of Saltwater Anglers (which has very few anglers in the state registered), registered private boat owners who indicated on the boat license that they use their boat for fishing will be used as a sample frame. Also, angler intercepts will be done with charter anglers in Hawaii to collect mail and email contact info for the mail/web instrument. Note that some states collect their own license information but provide that information to the National Registry. For states that are exempted from the National Registry (CA, WA, OR, AK, TX) we will obtain license data that includes angler contact information from either the Pacific States Marine Fisheries Commission or the state agency that collects the data, as they are required to provide NMFS with the data necessary to conduct surveys (i.e., contact information) if they are exempt from the National Registry.
For the durable good portion of the survey, respondents will be stratified by state of fishing license and resident status. For the trip expenditure portion, respondents will be stratified by the state of intercepted fishing trip or by state of fishing license. NOAA Fisheries will use a stratified random sample (proportionally sampled from each state) to select the sampling population from the license frames. The sampling frame will be cleaned to remove duplicates. Table 1 describes data on each stakeholder entity.
Response rates for the intercept based trip expenditure questions have averaged about 72% in past expenditure surveys. For the mail based surveys, response rates varied by state, but average around 35%.
Table 1. Intercept based sample
Column A. Respondent Entity |
Column B. Number of Entries in Sampling Frame (number of MRIP APAIS interviews per year) |
Column C. Response rate from previous economic add-on surveys to APAIS |
Column D. Expected number of respondents (Column C * 72%) |
Trip Expenditures, Intercept survey for states from Maine to Alabama. |
90,000 |
72% |
64,800 |
Table 2. License–frame based sample
Column A. Respondent Entity |
Column B. Number of Entries in Sampling Frame |
Column C. Minimum observations required to estimate true population value1 using proportional sampling rate for each strata2 (see Equation 1) |
Column D. Sample size required under assumption of 35% response rate (Column C / 35%) – Number mailed out |
Column E. Sample size with 15% Buffer (Column D * 115%) – Number mailed out with buffer |
Trip Expenditures, Shore mode -license frame based survey (CA, OR, WA, TX, LA, AK, HI) |
3,035,449 |
1,946 |
5,560 |
6,394 |
Trip Expenditures, Private Boat mode -license frame based (CA, OR, WA, TX, LA, AK, HI) |
3,035,449 |
1,946 |
5,560 |
6,394 |
Trip Expenditures, For-Hire mode -license frame based survey (CA, OR, WA, TX, LA, AK, HI) |
3,067,449 |
1,946 |
5,560 |
6,394 |
Durable Good expenditures |
17,367,800 |
12,788 |
36,537 |
42,018 |
Total |
26,506,147 |
18,626 |
53,217 |
61,200 |
1 n = 278 is the minimum number of observations required for true population estimate for each state and mode within a state for trips and for each state and resident status for durable goods.
2 proportional sampling rate per strata = 0.0638%.
2. Describe the procedures for the collection, including: the statistical methodology for stratification and sample selection; the estimation procedure; the degree of accuracy
needed for the purpose described in the justification; any unusual problems requiring specialized sampling procedures; and any use of periodic (less frequent than annual) data collection cycles to reduce burden.
For the intercept based trip expenditure portion of the survey, the sampling design will follow the procedures described for the APAIS survey approved under OMB Control No. 0648-0659, which is a multi-stage, stratified cluster sampling design that is based on fishing effort at available public access fishing sites within coastal counties within coastal states. The sample is stratified by state, two-month wave, type of day (weekday or weekend) and fishing mode (for-hire boats, private boats, and shore). The primary sampling unit is a specific site-day combination within a state and wave. For the shore mode, secondary sampling units are anglers; for the boat modes, secondary sampling units are boat trips and tertiary units are anglers. For more information on the statistical design, please see the supporting statement for OMB Control No. 0648-0659, included as a supplementary document. All anglers 16 years of age and older who complete the basic catch portion of the APAIS are eligible for the economic add-on.
A stratified random sample of the frame will be used to draw the sample population from the angler license frames for the durable good portion of the survey and for the trip expenditure portion of the survey for those states which do not participate in the angler intercept surveys. The allocation method for each of the l strata (Respondent Entity) will be a proportional allocation (n1/N1 = n2/N2…nl /Nl ). This allocation method is appropriate when unequal variances for each stratum are assumed, which NOAA Fisheries assumes to be true for stakeholder entities in the frame (Rice 1995).
Note that each state is represented within each l strata. The survey instrument provided is an example of a state specific survey (only variation among states is the state name and reference to the state of expenditure).
Following Equation 1 (Yamane 1967) approximately 278 observations are required to represent the true value for a population of > 100,000, assuming a +/- 6% precision rate,
Equation 1.
Equation 1, Example.
where n is the sample size, N is the population size, and e is the level of precision required. The equation assumes a confidence interval of 95% and maximum variability in the sample (.50). An observation unit is an individual respondent. The example shows the calculations given a hypothetical population size of N=435,700.
To ensure proportional allocation among the strata and to ensure that the minimum number of observations is met for each strata (278 observations) requires a sampling rate of 0.0638% (278/435,700 = 0.0638%). Applying this rate to each stratum (state and resident status) results in a combined sample of observations (Table 2).
We assume a 72% response rate for the trip expenditure APAIS add-on survey (Table 1). For the web/mail surveys, we assume an average 35% response rate nationwide.
As described in Dillman (2000):
Each respondent with email addresses will receive an invitational email informing the potential respondent of the survey effort, purpose, a secure link to the web based survey instrument.
After 3 days, a reminder email will be sent.
After 1 week from the email, for anglers without email addresses or anglers who did not yet complete the survey on the web, a pre-notice letter will be mailed out.
Approximately 9 days after the pre-notice, a survey instrument and cover letter will be mailed to all sampling units.
A reminder postcard will be sent to all respondents 2 weeks after the survey mailing, and
A second survey mailing may be sent to all respondents who have not completed and returned their survey within 2 weeks of the reminder postcard.
NOAA Fisheries has previously conducted a non-response test as part of these surveys in order to determine any effects from non-response and both in 2006 and in 2011 has not found any statistically significant differences between responders and non-responders in terms of household income, demographics, fishing experience, or age.
This collection is a periodic, recurring data collection every 3 years.
3. Describe the methods used to maximize response rates and to deal with nonresponse. The accuracy and reliability of the information collected must be shown to be adequate for the intended uses. For collections based on sampling, a special justification must be provided if they will not yield "reliable" data that can be generalized to the universe studied.
The mail survey implementation will follow state-of-the-art protocols described in ‘The Tailored Design Method’ (Dillman, 2000). Protocols include 3-4 mailings with approximately 2 weeks between mailings: (1) a pre-notice letter informing the respondent that they have been selected to receive a survey within the next two weeks; (2) a cover letter describing the importance of filling out the survey completely and the survey questionnaire; (3) a post-card follow up thanking respondents who returned their survey and reminding respondents to complete their survey and return it if they have not already done so; (4) a final mailing including a cover letter and survey instrument. The tailored design method is designed to maximize response rates, and components of the design have been scientifically tested and determined to increase response rates for mail surveys (Dillman, 2000).
4. Describe any tests of procedures or methods to be undertaken. Tests are encouraged as effective means to refine collections, but if ten or more test respondents are involved OMB must give prior approval.
The changes from the 2014 surveys approved under OMB Control No. 0648-0693 were:
Removal of the HMS sample, Puerto Rico sample, and the addition of a Hawaii durable goods component.
Removal on the CA survey, of two questions asking about location within the state where durable goods were purchased.
Removal of the question asking about the number of trips in the past 2 months.
No testing was considered necessary for these changes.
5. Provide the name and telephone number of individuals consulted on the statistical aspects of the design, and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.
Sampling Design, Data Analysis and Report Writing:
Sabrina Lovell, NOAA Fisheries, Office of Science and Technology; 301-427-8153
Scott Steinback, NOAA Fisheries, Northeast Fisheries Science Center; 508-495-2371
References
Dillman, D., 2000. Mail and Internet Surveys. The Tailored Design Method, John Wiley and Sons, Inc., New York, New York.
Rice, J., 1995. Mathematical Statistics and Data Analysis, Second Edition, Wadsworth Publishing Company, Belmont, California.
Yamane, Taro, 1967. Statistics, An Introductory Analysis, 2nd Ed., New York: Harper and Row.
Lovell, Sabrina, Scott Steinback and James Hilger, 2013. The Economic Contribution of Marine Angler Expenditures in the United States, 2011. U.S. Dept. of Commerce, NOAA Tech Memo. NMFS-F/SPO-134.
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | Sarah Brabson |
File Modified | 0000-00-00 |
File Created | 2021-01-22 |