Attachment 6

Survey to Evaluate Recreational Benefits of Nutrient
Reductions in Coastal New England Waters
Pretest Results (OMB Control #2080-0084)
July 9, 2018 OMB discussion

Office of Research and Development
National Health & Environmental Effects Research Lab, Atlantic Ecology Division, Narragansett, RI.

Survey Summary
• EPA’s Office of Research and Development
is conducting a revealed preference survey
to estimate use values for recreation, and
how those values are affected by water
quality
• The survey also explores people’s
perceptions of water quality
• The survey is a mixed-mode internet and
mail survey of randomly-selected
households in New England counties within
100 miles of Cape Cod

Sampled Counties

Pretest administration
summary
• Invitation letters mailed to 370 randomly
selected individuals in our sample area on
May 15, 2018
• Survey invitations did not include
monetary or other incentive
• Individuals were given a web address
and individual PIN to log in; letter also
contained a QR code that could be
scanned to directly access the survey
• Reminder letter mailed on May 22, 2018
• Second reminder letter with paper survey
mailed on June 5, 2018
• Data collection cutoff June 25, 2018

MAY 2018
SUN
6
13
20
27

MON
7
14
21
28

TUE
1
8
15
22
29

WED
2
9
16
23
30

THU
3
10
17
24
31

FRI
4
11
18
25

SAT
5
12
19
26

JUNE 2018
SUN
3
10
17
24

MON
4
11
18
25

TUE
5
12
19
26

WED
6
13
20
27

THU
7
14
21
28

FRI
1
8
15
22
29

SAT
2
9
16
23
30

Response summary
Rcvd. after
cutoff
Date

5/22/2018

5/29/2018

6/5/2018

6/12/2018

6/19/2018

6/26/2018

7/9/18

Number of Completed Surveys (WEB)

11

23

30

33

34

36

36

Number of Partial Surveys (WEB)

4

11

12

11

12

12

12

9

13

17

43

49

53

Number of Completed Surveys (PAPER)

TOTAL Completed Surveys (WEB & PAPER) as of 6/25/18
% web

11
100%

23
100%

30
100%

33
100%

% paper

79.1%

73.5%

67.9%

20.9%

26.5%

32.1%

Average Length of Survey (min)

21.6

16.5

18.2

17.8

17.3

17.7

Shortest Length of Survey (min)

5.2

2.4

2.4

2.4

2.1

2.1

Longest Length of Survey (min)

52.7

52.7

59.5

59.5

59.5

59.5

Average Length of Survey (min) (with 3 surveys >50min.
deleted)

15

Response rates
total sample mailed

370

undeliverable

61

partial responses

12

completed surveys (as of July 6)

53

partial plus completed

65

Response rates: completed/(total mailed - undeliverable)
completed surveys

17.2%

partial completes (online only)

3.9%

completed plus partial

21.0%
(Updated July 9, 2018)

Pre-test Sample

Demographics
Summary Statistics:
Compared to U.S. Census
Bureau for our sample area

Male
White
Hispanic
Age
Median
18-34
35-49
50-64
65+
Income
<20k
20-59k
60-99k
100-200k
>200k
Education
High School/GED
Bachelors
Graduate Degree

Population
(in our sample area)

60%
95%
0%

49%
81%
10%

61.5 yrs.
2%
24%
35%
39%

41.1 yrs.
30%
25%
26%
19%

0%
32%
27%
32%
8%

14%
28%
22%
26%
9%

17%
28%
47%

26%
23%
15%

Participation
Rates:
Compared to NOAA’s
Ocean Recreation
Survey for New
England Coastal
Counties

Activity
Activity on the shore
Birding/wildlife viewing
Fishing
Hunting
Jetskiing
Kayaking/canoeing/rowing
Kiteboarding/windsurfing
Motorboating
Paddleboarding
Sailing
Scuba diving
Shellfishing
Skimboarding
Snorkeling
Spearfishing
Surfing/boogie boarding
Swimming/body surfing
Tubing/waterskiing
Wading
Other
Non-participants
Any activity

N
30
18
10
1
0
10
0
7
1
4
2
6
0
3
0
4
18
0
17
2
16
33

% Participate
NOAA % Participate
88.2
52.9
30.3
11.2
3.0
0.0
30.3
0.0
21.2
3.0
12.1
6.1
17.6
5.4
0.0
9.1
0.0
12.1
52.9
0.0
50.0
6.1
32.7
67.3
57.8

Days per year:
Compared to NOAA’s
Ocean Recreation Survey
for New England Coastal
Counties

Days per year of saltwater recreation in New England
from pretest sample
N
32

Mean
38.7

Std. Dev.
7.7

Min
1

Max
192

NOAA Ocean Recreation Expenditure Survey
New England coastal counties

Residents

Nonresidents

All

Avg. number of days per year

25.3

19.5

24.2

Mapping page in
web survey:

able to accurately
locate places where
people went

Origins and
destinations of
respondents
(includes single and
multi-day trips)

Origin
Destination

Sample is not geographically skewed
Geographic Distribution (Home to Coast)
60
50

Percet of Sample

• Chart shows closest distance
to coast for all people in
sampled population (blue)
and pretest respondents
(orange).
• Illustrates the makeup of our
sample in terms of the
distance from their home to
the coast.

40
30

Expected

20

Sample

10
0

Miles from Coast

Water Quality Ratings by Distance to Destination
10

9
8

Water Quality

General trend is that
longer distances are
travelled for better water
quality

7
6
5
4
3
2
1
0
0

50

100

Miles

150

200

250

Places with WORST water quality
Place

WQ
Rating Comment

HarborWalk, Boston, MA

1

smell, visual appearance

Revere Beach

1

smell

Sabin Point, Riverside, RI

1

Knowing there is a sewage treatment plant up-stream and overspill into the bay..

Oakland Beach, Warwick, RI

1

The bad odor that exists coming from the water. This beach is also mentioned i..

560 Menauhant Rd, East Falmouth, MA

3

the pond is filling in with sand & water flow in & out is not adequate

Red River Beach, Harwich, MA

3

Eelgrass is gone. Use to be clear water. Now it is a vegetable soup when the..

Misquamicut, Westerly, RI

4

lots of algae

227 Thames St, Groton, CT

4

industrial plants, EB, Sub Base

East Matunuck State Beach, South Kingstown, RI

4

Red Tide

46 Bay Ave, Warwick, RI

4

There is always trash on the beach and a high percentage of seaweed and algal ..

50 Triton Way, Mashpee, MA

5

there was a lot of brown gloppy algae(?) in the water ,,, everywhere!

1014 E Rodney French Blvd, New Bedford, MA

5

The amount of trash

Boston Harbor, Boston, MA

5

oily, trash in the water

2-12 Carroll St, Chelsea, MA

5

Trash, hearsay

India Point Park, Providence, RI

5

small, urban environment, noise

920 Ocean Blvd, Hampton, NH

6

Lots of seaweed and trash

Places with BEST water quality
Place

WQ
Rating Comment

Crane Beach, Ipswich, MA

10

Beautiful beach; well cared for

Refuge Rd, Newbury, MA

10

I've never seen any trash and it always smells fresh and clean

S Shore Rd, Little Compton, RI

10

Water is clear. No seaweed, sea lice, etc. Sand is clean.

Niantic, East Lyme, CT

9

clear

Watch Hill, Westerly, RI

9

it's clear, almost never any trash and periodic stripers seen

Deep River, CT

9

clarity, lack of odor

Craigville Beach, Centerville, MA

9

It was a very nice clean beach and marsh area

Miacomet Rd, Nantucket, MA

9

no trash, no oil, no smell, wildlife in the water

596 Sound Dr, Mt Desert, ME

9

Well maintained

Salisbury Beach State Reservation, Salisbury, MA

9

Assume because of island location. Seclusion

Boardwalk Rd, Sandwich, MA

9

Clear, no litter, lots of wildlife

Ogunquit Beach, Ogunquit, ME

9

It just seems very clean...nice clear water, very little trash around.

Bar Island Trail, Sorrento, ME

9

No rotten smell or murky water. Tide pools had periwinkles.

469 E Beach Rd, Charlestown, RI

9

The water color appears to look clear and fresh.

130 Old County Rd, Rockport, MA

8

Very clear water. Healthy diversity of flora and fauna.

Long Sands Rd, York, ME

8

clean

Open-ended
Beach closure
response
Work
zip code/
town

Race

Q 5.14

Q 5.13

Q 5.12

Q 5.11

Q 5.10

Q 5.9

Q 5.8

Q 5.7

Farthest you
would travel

Q 5.6

Q 5.5

Q 5.4

Q 5.3

Q 5.2

Q 5.1

Q 3.10

Worst and Best WQ
place & ratings

Q 3.9

50

Q 3.8

Lodging cost

Q 3.7

Q 3.6

Q 3.5

Q 3.4

Q 3.3

30

Q 3.2

40

Q 3.1

Q 2.10 B

Q 2.9 B

60

Q 2.7 B

Q 2.6 B

Q 2.4 B

Q 2.20 A & 2.30 B

Q 2.19 A & 2.29 B

Q 2.11 A & 2.23 B

Q 2.10 A & 2.22 B

Q 2.9 A & 2.21 B

Q 2.8 A & 2.20 B

Q 2.7 A & 2.19 B

Q 2.5 A & 2.17 B

Q 2.4 A & 2.16 B

Q 2.2 A & 2.2 B

Q 1.2

% MISSING

Item non-response rates

100

90

80

70

Demographics

Home zip code

20

10

0

Income

Summary
• Overall, pretest survey worked well
• Responses made sense for all questions, indicating successful wording
• 4 people confused “best/worst” place for water quality – will address this with added emphasis in
full survey

• Able to easily identify where people went for both paper and web versions
• Low item non-response – primarily for open-ended questions (which are not needed for
analysis), race and income, and for some of the other optional questions
• Open-ended comments indicate that answers are well-considered by respondents
• Respondents included more recreation participants than anticipated, resulting in higher
participant response than expected

• Response rate for main survey should be higher than for pretest
• Pretest conducted before the start of the recreation season
• Main survey should occur in August

Proposed minor changes for full sample
See Attachment 5 for details of revisions
• Minor proposed survey edits
• Increase emphasis on “worst” and “best” water quality perception questions

• Administration:
• Change addresses from “Name” to “[State] Household”
• Add text to reminder letters telling people that, if they have started the online
survey but did not complete it and wish to complete it online, they can log in
and be returned to the same point where they left off.
• Add text to letter with paper survey telling people that, if they have already
answered the survey online, they do not need to return the paper survey.

Full Survey Schedule
• Goal is to implement the full survey by the end of the summer season.
• Estimated timing:
• Printing:
• Issue request for quotes through GPO July 13-20
• Contract with printer by July 27 – August 3
• Deliver of first letters by August 20-27

• Mail first letters between August 21-28, 2018
• Reminder letter mailed one week later
• Paper survey mailed 2 weeks after reminder, September 4-11, 2018