124-0224 Programmatic Review Form

NPS Form 10-201 (Rev. 09/2019) OMB Control No. 1024-0224

National Park Service Expiration Date 05/31/2023

PROGRAMMATIC REVIEW AND CLEARANCE PROCESS

FOR NPS-SPONSORED PUBLIC SURVEYS

The scope of the Programmatic Review and Clearance Process for NPS-Sponsored Public Surveys is limited and will only include individual surveys of park visitors, potential park visitors, and residents of communities near parks. Use of the programmatic review will be limited to non-controversial surveys of park visitors, potential park visitors, and/or residents of communities near parks that are not likely to include topics of significant interest in the review process. Additionally, this process is limited to non-controversial information collections that do not attract attention to significant, sensitive, or political issues. Examples of significant, sensitive, or political issues include: seeking opinions regarding political figures; obtaining citizen feedback related to high-visibility or high-impact issues like the reintroduction of wolves in Yellowstone National Park, the delisting of specific Endangered Species, or drilling in the Arctic National Wildlife Refuge.

SUBMISSION DATE: 11/29/2021

PROJECT TITLE: Wolf Trap National Park for the Performing Arts (WOTR) Visitor Use Management and Planning Survey

ABSTRACT: (not to exceed 150 words)

The National Capital Area (NCA) Region 1 of the National Park Service (NPS) is seeking to better understand visitors’ preferences for performances and amenities, facilities, and infrastructure at Wolf Trap National Park for the Performing Arts (WOTR). The unit is scoping changes in visitor services and require focused research to help guide future visitation and identify appropriate activities, facilities, and services. The overall purpose of this project is to gather useful information that will help support visitor use management decisions for the NCA managed areas in this study. The purpose of this Importance Performance survey is to understand visitors’ preferences about park attributes and their quality. This request is to replicate portions of surveys for MONO and PRWI approved by OMB on 12/1/2020 (1024-0224 National Capital Region Visitor Use Management and Planning) and extend on-site data collection to WOTR. All questions were sourced from the Pool of Known Questions.

PRINCIPAL INVESTIGATOR CONTACT INFORMATION:
NAME:	Dr. Chris Zajchowski
TITLE	Assistant Professor
AFFILIATION:	Old Dominion University.
ADDRESS:	2015 Student Recreation Center, Norfolk, VA 23505
EMAIL:	[email protected]	PHONE:	757-683-5078

PARK OR PROGRAM LIAISON CONTACT INFORMATION:
NAME:	Tammy Stidham
TITLE	Deputy Associate Area Director - Lands and Planning
AFFILIATION:	National Capital Region
ADDRESS:	1100 Ohio Drive SW, Washington DC 20242
EMAIL:	[email protected]	PHONE:	202-438-5078

PROJECT INFORMATION:

Where will the collection take place? Wolf Trap National Park for the Performing Arts
Sampling Period Start Date: 4/6/2022		Sampling Period End Date: 8/1/2022
Type of Information Collection Instrument: (Check ALL that Apply)
 Mail-Back Questionnaire  Face-to-Face Interview	X On-Site Questionnaire  Focus Groups		 Telephone Survey X Other (List) - online survey
Will an electronic device be used to collect information?		 No X Yes

SURVEY JUSTIFICATION:

Social science research in support of park planning and management is mandated in the NPS Management Policies 2006 (Section 8.11.1, “Social Science Studies”). The NPS pursues a policy that facilitates social science studies in support of the NPS mission to protect resources and enhance the enjoyment of present and future generations (National Park Service Act of 1916, 38 Stat 535, 16 USC 1, et seq.). NPS policy mandates that social science research will be used to provide an understanding of park visitors, the non-visiting public, gateway communities and regions, and human interactions with park resources. Such studies are needed to provide a scientific basis for park planning and development.

The proposed research aligns with Secretary of the Interior priorities and strategic plan for 2018-2022. The outcomes of this project will provide information that will directly align with three key mission areas: (1) conserving land and water, (2) expanding outdoor recreation and access, and (3) modernizing organization and infrastructure for the next 100 years. These three mission areas will be fulfilled by a) informing land use planning processes for public use and access, b) fostering partnerships to achieve balanced stewardship and use of public lands, c) and enhancing public satisfaction at CHOH and ROCR. (Interior FY 2018-2022 Strategic Plan, 2018).

The research contributes to current park initiatives designed to increase access for urban and rural populations to nearby national park units. WOTR provides unique settings to connect Americans residing in urban areas. The research will seek visitor input and visitor characteristics that will inform strategies to manage access for urban visitors. These strategies will additionally bolster the NPS in its efforts to stay relevant to a critical base of supporters by managing access and quality experiences to a diverse visitor population.

This work is guided by the steps and principles of the Interagency Visitor Use Management Framework, which identifies the interdependent relationship between resource conditions, visitor experiences, and management actions as a strategic area of focus (VUM, 2016). The outcomes of this project will provide information that will assist WOTR managers to a) understand who is visiting (e.g., demographics), including how and when they visit the unit, b) identify visitors' recreation/leisure preferences, desires and motivations, c) understand visitors' needs and desires for activities, services, facilities and performance opportunities, and d) forecast infrastructure, visitor services and facility improvements. The resulting work will have high capacity to be used in park strategic planning efforts to identify efficient paths towards infrastructure improvements, visitor services, amenities, and appropriate staffing.

SURVEY METHODOLOGY

1. Respondent Universe:

On-Site Survey - The respondent universe for this collection will be a systematic sample of all adult non-performance recreation and leisure users (age 18 or older) at various sites within WOTR.

Online survey – The respondent universe will consist of 2021 WOTR performance attendees (age 18 or older) contacted using email addresses provided by the Park and WOTR Foundation.

2. Sampling Plan / Procedures:

On-site Survey:

To accurately gauge experiences, visitors will be approached at pre-determined points of interest in WOTR (Table 1). These locations are the primary points of recreational use within WOTR, thus most visitors will pass through at least one of these areas to access the Park. The current yet flexible plan is to be on-site sampling Spring and Summer 2022 (April – June) yielding a sample size of 400. The sampling strategy is random, with every visitor group being intercepted on-site from 9 am – 5pm daily. A strategy to randomly choose one person in the group who is over 18 to take the survey will be used (e.g., asking the individual with the next birthday to serve as the respondent). The random sampling strategy will be used to ensure that a representative sample of the visiting population is reached. On-site sampling is expected to yield a 50% response rate and 400 surveys (Table 2).

						Table 1. Example On-site intercept survey schedule
			April				May		June		July
Location			Week day	Weekend			Week day	Weekend	Week day	Weekend	Week day	Weekend
Meadow Pavilion			3	1			0	2	2	2	2	2
West Lot Picnic Tables			3	1			0	2	2	2	2	2
Farm Pond Bridge			3	1			0	2	2	2	2	2
Cart Bridge			3	1			0	2	2	2	2	2
TOTAL			--	--			--	--	--	--	--	--

All sites were chosen based on conversations with park staff, planners and researchers, and are a representative sample of all locations for non-performance recreation/leisure use. These locations will be sampled during the proposed study period 4/6/2022 – 8/1/2022. The four sampling periods will occur for a total of 14 days (Table 1). The first on-site survey period will consist of 3 week days and 1-weekend days with different researchers at multiple sites each day. The second and third on-site survey periods will consist of 2-weekend days each. The fourth and fifth on-site survey period will consist of 2-week days each, and the final sampling period will consist of two weekend days. Researchers will intercept visitors at alternating locations in WOTR during the sampling period, yielding a total of 800 visitor contacts.

To accurately gauge visitor preferences’, visitors will be approached at determined points of interest in WOTR. These locations are the primary points of use within the unit; thus most visitors will pass through at least one of these areas to access the park. Sampling will occur at each of the locations on a rotating basis from 8am-5pm during the sampling period.

Table 2: Estimated number of contacts for on-site survey

Method	Total number of onsite intercepts	April - July (’22) completed on-site surveys	Total
On-site Survey	800	400	400

Online Survey:

Due to the congestion and high use during performance events, the research team worked with park staff to identify ways to reduce the impact of survey dissemination during performances. NPS regional planning contacts identified email addresses of past concert goers as a viable way to sample performance attendees. The research team will administer the online version of the same survey provided to on-site recreational visitors during the same sampling period (4/6/2022 – 8/1/2022) using the online survey platform, Qualtrics. This survey will remain open for four months (April – July, 2022) to afford time for participants to respond. All e-mails provided by NPS regional contacts and will be contacted, with an anticipated completion of 400 surveys.

Table 3: Estimated number of contacts for on-line survey

Method	Total number of email contacts	April - July (’22) completed surveys	Total
Online Survey	800	400	400

3. Instrument Administration:

On-site Survey:

Every other on-site visitor group seen will be contacted, and 1 adult from each group will be asked to participate. Interviewers will use tablet computers (e.g., i-Pads) to administer the surveys utilizing an online survey platform developed specific to the survey method. The initial contact with visitors will be used to explain the study and determine if visitors are interested in participating (see script below). This should take approximately one minute. If a group is encountered, the survey interviewer will ask the individual within the group with the next birthday to serve as the respondent. All individuals approached will be asked the non-response bias questions to collect information that will be used in the final analysis (see item E below).

An alternate approach using business cards may be used to reduce person-to-person contact. The research team will distribute business cards explaining the survey and the request to participate. Business cards would be kept on a table, hand sanitizer and sanitizing wipes will be available at all sampling locations. Research staff will be masked and gloved during any person-to-person contact during the administration of the survey.

Visitors selected for participation will be read the following script:

"Hello, my name . I am conducting a survey for the NPS to better understand your opinions related to your overall experience and preferences at WOTR. Your participation is voluntary, and all responses will be kept anonymous. Would you be willing to take a 10-minute survey?"

• If yes – the interviewer will make sure no one in the group has already been asked to take the survey - then say, "Thank you for agreeing to participate. Who in your group that is at least 18 years old has the next birthday?" Ask them to start by answering the non-response bias questions (listed below). Record response in spaces provided on the tracking sheet. Tablets will be then administered to participants to complete the survey.

• If no (soft refusal) - ask them if they would be willing to answer the non-response bias questions and then thank them for their time.

Record responses on tracking sheet. If no (hard refusal) - end the contact and thank them for their time.

Online Survey:

For the online stakeholder survey, an initial introduction email will be sent to approximately 800 possible participants (past performance attendees). Those attendees who clicked on the link but did not participate after several reminders will receive a follow up e-mail with the same non-response bias questions identified above. The number of refusals will be recorded and used to calculate the overall response rate for the collection.

4. Expected Response Rate / Confidence Level:

The response rate for this collection is based on surveys at similar park sites. Based on the survey sample sizes, there will be a 95% confidence that the survey findings will be accurate within 3-5 percentage points. Although we aim to achieve this level of confidence, the lack of precise visitor numbers within the park may make this difficult to know. The email distribution list for the online survey, provided by the park will be approximately 800. Assuming a 50% response rate, we will need to contact approximately 400 at WOTR.

Table 4: Anticipated Response Rates

Method	Initial Contacts	Acceptance 50%	Non-respondents (Soft refusals) 50%	Non-response survey (20% of soft refusals)	Hard Refusals (80% of soft refusals)
On-site Survey	800	400	400	80	320
Online Survey	800	400	400	80	320
Est TOTAL	1,600	800	800	160	640

5. Strategies for dealing with potential non-response bias:

During the initial contact for the on-site survey, the researcher will ask each visitor three questions taken from the survey. The following questions will serve as the non-response bias check for this collection:

1. How many days in the last month (30 days) have you visited WOTR?

2. Prior to your visit, were you aware that WOTR is managed by the National Park Service (NPS)?  yes  no  not sure

3. What is your gender? (select one)  male  female

All responses will be recorded on a log for every survey contacted. Results of the non-response bias check will be described in a report and any implications for park planning and management will be discussed. These same three questions will be used to follow up with online refusals as well.

6. Description of any pre-testing and peer review of the methods and/or instrument:

The questionnaire format and variations of many of the questions have been used in NPS instruments previously approved by OMB (e.g., Monocacy National Battlefield). The questions are from the currently approved NPS Pool of Known Questions (1024-0221 exp. 5/31/2023). Any variations of the questions have been reviewed by WOTR managers and faculty at Old Dominion University and Kansas State University and approved by the NPS Information Collections Clearance Officer. The questionnaire was tested on six members of the general public for to estimate respondent burden and clarity of questions.

BURDEN ESTIMATES:

On-site Survey:

Overall, we plan to approach 800 individuals at WOTR during the sampling period. We anticipate that 50% (n=400) of those contacted will agree to participate and complete the on-site survey. The initial contact time (1 minute) will be used to explain the purpose of the survey and provide instruction or answer questions about the survey. Based upon the pretest we estimate that an average of 10 additional minutes will be required to complete and return the survey (400 respondents x 11 minutes = 73 hours).

Of all the visitors refusing to accept the invitation (n=400) we will ask if they would be willing to answer the 3 questions that will serve as the non-response bias check for this collection. We expect that 20% (n=80) of the on-site refusals will agree to answer the non-response bias questions which will require an additional minute, including the initial contact, the burden for the non-response check is estimated to be 3 hours (80 respondents x 2 minutes = 3 hours).

The respondent burden for the on-site survey is estimated to be 75 hours. This includes the initial contact, instructions, and the time it takes to complete the questionnaire and non-response survey.

Online Survey:

For this segment of the study, we plan to email 800 past performance attendees online during the sampling period. We anticipate that 50% (n=400) of those contacted will agree to participate and complete the online survey. The initial contact time (1 minute) will be used to explain the purpose of the survey in the email. Based upon the pretest, we estimate that an average of 10 additional minutes will be required to complete and return the online survey (400 respondents x 11 minutes = 73 hours).

Of all the past performance attendees refusing to complete the online survey (n=400) we will send an additional email asking if they would be willing to answer the 3 questions that will serve as the non-response bias check for this collection. We expect that 20% (n=80) of the initial refusals will agree to answer the non-response bias questions which will add additional minute, including the initial contact the burden for the non-response check is estimated to be 5 hours (80 respondents x 2 minutes = 3 hours).

The overall respondent burden for the WOTR Visitor Use Management and Planning Survey is estimated to be 152 hours. This includes the initial contact, instructions, and the time it takes to complete the questionnaire and non-response survey for both phases of the study.

Table 4: Burden Estimates

	Completed Responses	Completion Time * (minutes)	Burden Hours (rounded up)
Questionnaire
Onsite Survey	400	11	73 hours
Online Survey	400	11	73 hours
Subtotal	800		146 hours
Non-response survey
Onsite	80	2	3 hours
Online	80	2	3 hours
Subtotal	160		6 hours
Total burden requested under this ICR:			152 hours

* Initial contact time of one minute is added to the time to complete the surveys.

REPORTING PLAN:

The study results for WOTR will be presented in internal agency reports for NPS managers within the network. Response frequencies will be tabulated, and measures of central tendency computed (e.g., mean, median, mode, as appropriate). The reports will be archived with the NPS Social Science Program for inclusion in the NPS Social Science Studies Collection as required by the NPS Programmatic Approval process. Hard copies will be available upon request.

NOTICES

Privacy Act Statement

General: This information is provided pursuant to Public Law 93-579 (Privacy Act of 1974), December 21, 1984, for individuals completing this form.

Authority: National Park Service Research mandate (54 USC 100702)

Purpose and Uses: This information will be used by The NPS Information Collections Coordinator to ensure appropriate documentation of information collections conducted in areas managed by or that are sponsored by the National Park Service.

Effects of Nondisclosure: Providing information is mandatory to submit Information Collection Requests to Programmatic Review Process.

Paperwork Reduction Act Statement

We are collecting this information subject to the Paperwork Reduction Act (44 U.S.C. 3501) and is authorized by the National Park Service Research mandate (54 USC 100702). This information will be used by The NPS Information Collections Coordinator to ensure appropriate documentation of information collections conducted in areas managed by or that are sponsored by the National Park Service. All parts of the form must be completed in order for your request to be considered. We may not conduct or sponsor and you are not required to respond to, this or any other Federal agency-sponsored information collection unless it displays a currently valid OMB control number. OMB has reviewed and approved The National Park Service Programmatic Review Process and assigned OMB Control Number 1024-0224.

Estimated Burden Statement

Public Reporting burden for this form is estimated to average 12 minutes per collection, including the time it takes for reviewing instructions, gathering information and completing and reviewing the form. This time does not include the editorial time required to finalize the submission. Comments regarding this burden estimate or any aspect of this form should be sent to the Information Collection Clearance Coordinator, National Park Service, 1201 Oakridge Dr., Fort Collins, CO 80525.