Justification Crawford Path Survey

Justification for Submission under Federal Lands Transportation Generic Clearance (OMB Control Number 0596-0236)

U.S. Department of Agriculture-Forest Service Office of Regulatory and Management Services

Forest Service Tracking Number: (for internal use only)

				Date Submitted to Forest Service/USDA:
1.	IC Title:	Visitor Use Monitoring to Inform Recreation Planning on the White Mountain National Forest – Crawford Path
2.	Bureau/Office:	USDA Forest Service
3.	Abstract: (not to exceed 150 words) The purpose of this project is to collect information that will help the U.S. Forest Service (USFS) implement, evaluate, and improve visitor use and recreation management for the White Mountain National Forest (WMNF). In particular, the survey instruments in this study are designed to collect information about visitors’ perceptions, experiences, and expectations, with respect to transportation and recreation conditions and management, and visitor experience quality. The information collection is also designed to help identify recreation issues experienced by visitors, and assess visitors’ opinions about potential forest and recreation management. Respondents will be asked a variety of questions about their visit to the recreation area, forest recreation activities they participate in, perceptions of recreational conditions at the recreation area, preferences for potential recreation conditions, and socio-demographic characteristics. The survey is designed to ensure that the results are adequately accurate, reliable, and applicable for its intended purpose.
4.	Bureau/Office Point of Contact Information
	First Name:	Marianne
	Last Name:	Leberman
	Title:	Assistant Recreation and Wilderness Program Manager
	Bureau/Office:	White Mountain National Forest
	Address:	71 White Mountain Drive
	City:	Campton	State:		NH	Zip code:		03223
	Phone:	603-536-6236	Fax:
	Email:	[email protected]
5.	Principal Investigator (PI) Information [If different from #4]
	First Name:	Robert
	Last Name:	Manning
	Title:	Professor
	Bureau/Office:	University of Vermont
	Address:	313A Aiken Center, 81 Carrigan Drive
	City:	Burlington	State:		VT	Zip code:		05405
	Phone:	802-656-3096	Fax:
	Email:	[email protected]

6.

Lead Agency IC Clearance Officer Reviewing the IC:

First Name:

Last Name:

Title:

Phone:

Email:

7.

Description of Population/Potential Respondents

Surveys will be conducted with recreational visitors (18 years of age and older) who visit the study areas (Crawford Path) during the study Period.

8.

IC Dates

08/15/2015

To

09/31/2016

9.

Type of Information Collection Instrument (Check ALL that Apply)

X Intercept

__ Telephone

__ Mail

__ Web-based

__ Focus Groups

__ Comment Cards

__ Other

Explain:

10. Instrument Development:

(Who assisted in content development? Statistics? Was the instrument pretested? How were improvements integrated?)

The survey methods and instruments for this study were reviewed by Project Managers at the WMNF, Park Planners at Grand Canyon National Park (NP), and by University Faculty and Scientists at the University of Vermont, the Pennsylvania State University, and Applied Trails Research. Further, the questions in this survey are similar to those used in previous studies at several other National Forest recreation areas and NPs that were reviewed and approved by the Office of Management and Budget as part of the Federal Land Management Agencies Compendium of Questions (OMB Control No. 0596-0236).

Moreover, pre-testing and consultation were conducted with 5 volunteer participants identified by the USFS contractor and with no specific background or training in survey research methods or analysis (i.e., representative of the general public, rather than survey experts). In particular, the individuals were asked to complete the questionnaire, and asked a series of debriefing questions after to elicit their feedback on the practical utility of the study, questionnaire/respondent burden, quality and clarity of the questionnaires and instructions, and ways to minimize respondent burden.

11. Which of the five areas from the Compendium of Questions will be addressed in your IC? (Check all that apply). .

X Topic Area #1: Respondent characteristics

• Topic Area #2: Traveler Information

X Topic Area #3: Trip behaviors

X Topic Area #4: Assessment of Visitor Experiences and Transportation-Related Facilities, Conditions, and Services

• Topic Area #5: Economic Impact and Visitor Spending/Costs

In addition, for each question in your survey instrument (or discussion guide, comment card, etc.), please indicate the Compendium Topic Area and the unique question identifier from the Compendium. If the question is not taken from the Compendium, indicate “NEW”.

Survey Question Number	Compendium Topic Area	Compendium Question Identifier
Q1	#1- Respondent characteristics	GROUP5
Q2	#1- Respondent characteristics	GROUP1
Q2a	#1- Respondent characteristics	GROUP2
Q3	#1- Respondent characteristics	VHIS4
Q4	#3- Trip behaviors	TRANUSE35
Q5	#3- Trip behaviors	TDUR10
Q6	#3- Trip behaviors	TDUR3
Q7	#1- Respondent characteristics	VHIS7
Q8	#3- Trip behaviors	TACT8
Q9	#4 – Assessment of visitor experiences	OPIN27
Q10	#4 – Assessment of visitor experiences	OPIN29
Q11	#4 – Assessment of visitor experiences	OPIN18 (modified)
Q12	#4 – Assessment of visitor experiences	OPIN18
Q13	#4 – Assessment of visitor experiences	OPIN25
Q14	#4 – Assessment of visitor experiences	OPIN25 (modified)
Q15	#3- Trip behaviors	TRANCOND18
Q16	#3- Trip behaviors	TRANCOND17
Q17	#4 – Assessment of visitor experiences	OPIN27
Q18	#4 – Assessment of visitor experiences	OPIN20
Q19	#4 – Assessment of visitor experiences	OPIN18 (modified)
Q20	#4 – Assessment of visitor experiences	OPIN18
Q21	#4 – Assessment of visitor experiences	OPIN19
Q22	#4 – Assessment of visitor experiences	OPIN19 (modified)
Q23	#4 – Assessment of visitor experiences	EVAL33
Q24	#4 – Assessment of visitor experiences	OPIN4
Q25	#1- Respondent characteristics	RES3
Q26	#1- Respondent characteristics	AGE5
Q27	#1- Respondent characteristics	GEN1
Q28	#1- Respondent characteristics	EDU1
Q29	#1- Respondent characteristics	ETHNIC1
Q30	#1- Respondent characteristics	RACE1

12. Methodology:

(Use as much space as needed; if necessary include additional explanation on separate page).

Respondent Universe

The respondent universe for the on-site questionnaire will be all summer and fall visitors (age 18 and over) to the Crawford Path trailhead in the WMNF between August 16, 2015 and September 30, 2016. Since the survey will begin late in the primary visitor season, the survey will be conducted over two seasons to represent the entire summer and fall visitor season.

Sampling Plan/Procedure

The sampling period includes the area’s peak use periods, during the season and during the day (between 8 a.m. and 5 p.m. - the time of day when the majority of visitation occurs). Sampling will be conducted at the trailhead as visitors are finishing their trip. There will be seven sampling days in each summer and fall month (June, July, August, September and October) for a total of 35 sampling days, with both weekday periods and weekend periods represented proportional to use. This will ensure that a sufficient number of questionnaires will be completed to make inferences to the visitor populations with an acceptable degree of precision.

During each sampling period, a trained surveyor will be stationed at the Crawford Path trailhead. When the sampling period begins, the surveyor will approach groups exiting the trail and ask them to participate in the survey. If members of the visitor groups agree to participate, the eligible person in the group whose birthday is closest to the sampling day will be asked to complete the questionnaire. After he/she completes the questionnaire, he/she will return it to the survey attendant. When the surveyor has completed his/her contact with the group, the surveyor will ask the next available group exiting the trailhead, to participate in the survey. This process will continue throughout the sampling period. Visitors will be asked to complete the on-site questionnaire in the presence of the survey attendant, who will answer any questions that arise and collect the questionnaires upon completion.

Instrument Administration

Visitors at the study sites will be read the following script:

"Excuse me, sir/ma'am. We're conducting a study for the White Mountain National Forest to better understand visitor experiences during their visit. Your participation is voluntary and all responses are anonymous. Would you be willing to take 10 minutes to help?”

If YES: "Thank you. Who in your personal group (who is at least 18 years of age) has the next birthday? Would you be willing to complete this questionnaire?”

Visitors will then be given a paper questionnaire to complete. The questionnaire will instruct respondents to view a series of 6 images which represent different use levels on the trail. The images will be presented in a binder with an 8 inch by 10 inch laminated copy of each photo. Respondents will then answer a series of questions in the questionnaires while seeing these images. After completing this portion of the questionnaire, respondents will continue to answer the remaining questions.

If NO: “I understand. I hope you enjoy your visit.”

Expected Response Rate and Confidence Levels

The overall survey sample size is expected to be approximately 429 visitors. Based on previous experience in conducting similar surveys, it is expected that about 70% of visitors (about 300 individuals) will be willing to participate. In a similar study in Acadia National Park in 2012 that used similar sampling methods, a response rate of 70% was attained. Study findings are estimated to be accurate within 6 percentage points, based on a sample size of approximately 300 using a 95% confidence level. This will be sufficient for planning purposes. The number of people in each visitor party and date and time of refusals will be recorded and reported on a refusal log.

Strategies for dealing with potential non-response bias

Non-response bias will be examined by comparing selected characteristics of the sample population with characteristics observed and recorded in every group contacted (e.g., group size, gender and group type). Additionally, all visitors approached will be asked to answer three key questions from the survey:

1. Have you visited the Crawford Path near Mt. Washington’s summit before today?

2. What is the maximum number of encounters per hour you think the U.S. Forest Service should allow on the Crawford Path near Mt. Washington’s summit? In other words, at what point should the number of visitors hiking the Crawford Path be limited?

3. Please use the scale below to rate (from 1 to 5) how crowded you felt by people during this visit to the Crawford Path today.

These results and observational data will be recorded and compared to results from the respondents completing and returning the questionnaire to see if non-response bias is present. The results of the check for non-response bias will be reported and implications for data interpretation will be discussed in any reports prepared for the WMNF managers.

Description of any pre-testing and peer review of the methods and/or instrument (recommended)

The survey methods and instruments for this study were reviewed by Project Managers at the WMNF, Park Planners at Grand Canyon NP, and by University Faculty and Scientists at the University of Vermont, the Pennsylvania State University and Applied Trails Research. Further, the questions in this survey are similar to those used in previous studies at several other national forest recreation areas and national parks that were reviewed and approved by the Office of Management and Budget as part of the Federal Land Management Agencies Compendium of Questions (OMB Control No. 0596-0236).

Moreover, pre-testing and consultation were conducted with 5 volunteer participants identified by the USFS contractor, and with no specific background or training in survey research methods or analysis (i.e., representative of the general public, rather than survey experts). In particular, the individuals were asked to complete the questionnaire, and asked a series of debriefing questions after to elicit their feedback on the practical utility of the study, questionnaire/respondent burden, quality and clarity of the questionnaires and instructions, and ways to minimize respondent burden. Participants were also asked to indicate if they had any difficulty or confusion with skip patterns, multi-item response scales, and/or instructions for recording responses (e.g., “Check one box” or “Check all that apply”).

The feedback from the pre-test participants was positive. Participants indicated that the layout of the questionnaires, and question wording were straightforward, which helps to minimize respondent burden. Participants reported no trouble with skip patterns, multi-item response scales, and instructions for recording responses.

The time it took each respondent to complete the questionnaire was recorded by the pre-test administrators: 8-10 minutes was the typical response time. This finding helps to validate the burden estimates reported in the submission, and suggests that participation in the study does not cause undue/excessive respondent burden. Finally, the completed questionnaires were inspected by the pre-test administrators, after the pre-test was concluded. Inspection of the completed questionnaire indicated that respondents followed skip patterns correctly, answered all of the relevant questions, and recorded their answers correctly.

Participants in the pre-test offered minor suggestions to improve the wording or format of specific questions in the survey instruments, and revisions to the questionnaires were made accordingly.

13.

Total Number of Initial Contacts and Expected Number of Respondents

Initial Contacts: 429

Expected Respondents: 300

14.

Estimated Time to Complete Initial Contact and Time to Complete Instrument

Initial contact: 1 minute

Instrument completion: 10 minutes

15.

Total Burden Hours

Contacts

Respondents

-------------------

Total

7 hours

50 hours

-------------------

57 hours

16. Reporting Plan: Presentations will be made to Forest Supervisors, resource managers, transportation planners and engineers, and stakeholder groups to explain the findings and their implications. The results of this information collection activity will be presented in an internal agency report to WMNF. The project results will also be published in a peer-reviewed scientific publication discussing the methods, results, and conclusions, and recognizing the support given by the USFS.

17. Justification, Purpose, and Use:

IC Justification and Purpose

The following laws, regulations, and statutes mandate or authorize the collection of information in this study (copies of the appropriate section of each are contained in Appendix A):

• Forest Service Administration Organic Act of 1897 [16 U.S.C. §§ 473-478, 479-482, and 551] as amended by the Transfer Act of 1905 [16 U.S.C. §§ 472, 524, 554]

• Multiple Use Sustained Yield Act of 1960 [P.L. 86-15, § 3]

• Forest and Rangeland Renewable Resources and Planning Act of 1974 [P.L. 93-378 § 3(2,3)] as amended

• National Forest Management Act of 1976 [P.L. 94-588, §§ 2(3), 6(d)], as amended

• Government  Performance and Results Act of 1993 [P.L. 103-62] as amended

• Executive Order 12862 of September 11, 1993

• 1997 Revision, Arapaho-Roosevelt National Forest and Pawnee National Grassland Resource Management Plan [Chapter 1, Part 4]

• Executive Order 13571 of April 27, 2011

The WMNF is within a day’s drive of nearly 60 million residents of the United States and Canada, including more than 3 million potential recreationists residing within 100 miles of the forest. A range of recreational opportunities are available to WMNF visitors. These include typical forest recreation activities including hiking, camping, nature viewing and dispersed motorized recreation. The WMNF also offers diverse developed recreational opportunities like scenic driving and picnicking. In addition to these typical recreation opportunities, the WMNF also offers characteristic and special recreation opportunities including rock climbing, alpine recreation, and a diversity of motorized, non-motorized, developed, and primitive winter recreation activities. Annual recreational visits for all of these activities combined total nearly 5 million.

The Crawford Path has been identified as a priority for recreation monitoring and evaluations because of its significance to forest recreational experiences. The intensive recreational use received by this site has potential to impact the quality of forest resources and visitor experiences. These impacts can be diverse, affecting natural, social and administrative elements of the WMNF. Natural resource impacts affect the quality of air, water, soils, vegetation, wildlife, soundscapes, scenery, and night skies, among other resources. Social impacts can include crowding among recreationists, conflict between recreationists, and depreciative behavior that intentionally or unintentionally propagates impacts. Forest infrastructure, including trails, roads, parking, and other facilities, can also be impacted by the magnitude, distribution or behavior of recreation use on the Crawford Path.

IC Justification and Purpose

(continued)

The full range of impacts from recreation occurs on the WMNF, and their extent is documented in the series of annual Monitoring and Evaluation Reports available at: http://www.fs.usda.gov/detail/whitemountain/maps-pubs/?cid=STELPRDB5187780.

The purpose of this project is to collect information that will help the USFS implement, evaluate and improve visitor use and recreation management for the WMNF. In particular, the survey instrument in this study is designed to collect information about visitors’ perceptions, experiences, and expectations, with respect to recreation conditions and management, and visitor experience quality. The information collection is also designed to help identify recreation issues experienced by visitors, and assess visitors’ opinions about potential forest and recreation management.

Thus, the information collection planned for this project is a key tool for the Agency to obtain information in an efficient, timely manner, for the purposes of improving transportation systems, visitor experience quality, and resource management at the recreation site. The survey instrument included in this study is designed to ensure that the results are adequately accurate, reliable, and applicable for their intended purposes - to help the USFS improve recreation and resource management on the WMNF.

IC Goals

The goal of this project is to collect information that will help the USFS implement the 2005 WMNF Forest Plan as well as inform upcoming recreation planning efforts on the forest. In particular, the survey instrument in this study is designed to collect information about visitors’ perceptions, experiences, and expectations, with respect to recreation opportunities, and visitor experience quality at this site on the WMNF. The information collection is also designed to help identify recreation related issues experienced by visitors at the site, and assess visitors’ opinions about recreation planning and management.

Utility to Managers

Results of the study will be incorporated into future resource management and transportation planning for the WMNF, and used to help develop grant applications for transportation improvements at the recreation areas.

How will the results of the IC be analyzed and used?

Information from the paper questionnaire will be coded using an Excel spreadsheet, and then converted for analysis into IBM SPSS Statistics Version 21, which is a well-known and respected statistical software package. All data will be stored in electronic and hardcopy, and archived according to established data management procedures required by the Federal Government. The project manager will verify the quality of questionnaire electronic data entry. Upon study completion, the survey data collected in this study will be available from the USFS in a suitable electronic format, along with proper documentation.

How will the data be tabulated? What Statistical Techniques will be used to generalize the results to the entire customer population? How will limitations on use of data be handled? If the survey results in a lower than anticipated response rate, how will you address this when reporting the results? (Use as much space as needed; if necessary include additional explanation on separate page).

Based on the projected sample size (300 completed questionnaires), there will be 95% confidence that the findings from each survey will be accurate to within 5 percentage points, and will have a power level greater than 0.80 for the range of statistical tests that will be conducted with the data in this study (two-tailed independent samples t-test, chi-square tests of independence, and simple linear and multivariate regression), at the .05 alpha-level. This level of accuracy and statistical power is generally accepted as sufficient in peer-reviewed social science quantitative study findings. Thus, the proposed sample size will be adequate for bi-variate comparisons. Analysis of the quantitative survey data collected in this study will use standard methods for survey research in parks and recreation settings. Key estimates from the data will be descriptive in nature, primarily measures of central tendency (mean and median), dispersion (standard deviation), and frequency distributions. Some tests for differences in means and proportions by various sub-groups are expected.

Is this survey intended to measure a Government Performance and Results Act (GPRA) performance measure? If so, please include an excerpt from the appropriate document. (Use as much space as needed; if necessary include additional explanation on separate page).

This IC is not intended to measure a GPRA performance measure.