Comparison of Teacher Post-PD vs. Nonresponse Questionnaire Results

ATTACHMENT 3 Comparison of Teacher Post-PD vs. Nonresponse Questionnaire Results.pdf

NOAA Bay Watershed Education and Training (B-WET) Program National Evaluation System

Comparison of Teacher Post-PD vs. Nonresponse Questionnaire Results

OMB: 0648-0658

Document [pdf]
Download: pdf | pdf
Comparison of Teacher Post-PD vs. Nonresponse Questionnaire Results
This document compares responses from teachers who responded to the post-PD questionnaire with the
responses from teachers who responded to a follow-up non-response post-PD questionnaire. Chi square
tests were conducted when the response choices were nominal (e.g., yes/no or categorical) and
independent t-tests were conducted when response choices were ordinal (e.g., 1-5 point Likert-type) or
interval (e.g., rating from A+ to F). P values are reported to indicate if initial (PD) and non-respondent
(NR) teachers’ responses were statistically significantly different (p<.05). Post hoc tests were completed
when chi square tests showed statistical significant differences to determine where the differences
occurred (Bonferroni method to compare column proportions).
Notes:
▪ The numbers in parentheses immediately following the response choices, such as (55), (1), (0), are the
values assigned to each response.
▪ Respondents who did not participate in MWEE PD, were not teachers, or did not teach in a public or
private school were excluded from these analyses [SPSS selection syntax PDQ6 ~= 55 & PDMQ3 = 1
& (PDMQ5rev = 1 | PDMQ5rev=2)]
PDQ6 How long ago did you complete a NOAA B-WET-funded professional development focused
on watersheds (ocean, coastal, riverine, estuarine, Great Lakes) (also known as a Meaningful
Watershed Education Experience professional development or MWEE PD)?
▪ I did not complete a MWEE PD (55) → Exit from survey, these respondents are not included in these
analyses
▪ Less than 1 week ago (1)
▪ 1-2 weeks ago (2)
▪ 3-4 weeks ago (3)
▪ 5-8 weeks ago (4)
▪ 9-12 weeks ago (5)
▪ More than 12 weeks ago (6)

Value
Pearson Chi-Square

62.66
3

d
f
5

p
.00
0

Crosstab
Group
PDQ6

1
2
3
4
5
6

Count
% within Group
Count
% within Group
Count
% within Group
Count
% within Group
Count
% within Group
Count

NR
1a
1%
1a
1%
4a
3%
30a
20%
39a
27%
72a

Total
PD
26b
5%
30b
6%
98b
19%
145a
28%
65b
13%
146b

27
4%
31
5%
102
16%
175
27%
104
16%
218
Page 1 of 7

% within Group
33%
49%
29%
Total
Count
147
510
657
% within Group
100%
100%
100%
Each subscript letter denotes a subset of Group categories whose column proportions do not differ
significantly from each other at the .05 level.

PDMQ3
Are you currently a PreK-12 teacher or educator?
▪ No (0) → Exit from survey, not included in these analyses
▪ Yes (1)
No analysis.
PDMQ5rev
In what setting do you teach primarily? (select one)
▪ Public school (1)
▪ Private school (2)
▪ Non-formal education (e.g., environmental centers, zoos, museums, interpretive programs at local or
state level parks, youth organizations, summer camps, after school programs) (3) → Exit from
survey, these respondents are not included in these analyses
▪ Home-school (4) → Exit from survey, these respondents are not included in these analyses
▪ Other (88) → Exit from survey, these respondents are not included in these analyses
Chi-Square Tests

Pearson ChiSquare

Valu
e
.363

d
f
1

p
.54
7

PDGMQ1 In which region did you teach this past year? (check one)
▪ California (1)
▪ Chesapeake Bay watershed (Maryland, Virginia, Delaware, West Virginia, Pennsylvania, New York,
and the District of Columbia) (2)
▪ Great Lakes (Ohio, Michigan, Indiana, Illinois, Minnesota, Wisconsin, New York, and Pennsylvania)
(3)
▪ Gulf of Mexico (Texas, Louisiana, Mississippi, Alabama, and Florida) (4)
▪ Hawaii (5)
▪ New England (Maine, New Hampshire, Vermont, Massachusetts, Connecticut, and Rhode Island)
(6)
▪ Pacific Northwest (Oregon and Washington) (7)
Chi-Square Tests
Pearson Chi-Square

Value
17.925

df
6

p
.006

PDGMQ1 * Group Crosstabulation
Group
PDGMQ1

1

Count
% within Group

NR
3a
2%

Total
PD
32b
7%

35
6%
Page 2 of 7

2

Count
74a
198b
272
% within Group
43%
51%
41%
3
Count
12a
26a
38
% within Group
8%
5%
6%
4
Count
5a
51b
56
% within Group
9%
3%
11%
5
Count
23a
89a
112
% within Group
16%
18%
18%
6
Count
11a
48a
59
% within Group
8%
10%
9%
7
Count
18a
39a
57
% within Group
12%
8%
9%
Total
Count
146
483
629
% within Group
100%
100%
100%
Each subscript letter denotes a subset of Group categories whose column proportions do not differ
significantly from each other at the .05 level.

PDQ10rev
In which grade level(s) do you teach primarily? (select one)
▪ PreK (1)
▪ Elementary (2)
▪ Middle (3)
▪ High (4)
▪ Other (88)
Chi-Square Tests

Pearson ChiSquare

Valu
e
2.638

d
f
4

p
.62
0

PDGQ2rev
What subject(s) do you teach primarily? (select one)
▪ Science (1)
▪ Technology (8)
▪ Engineering (9)
▪ Math (2)
▪ English Language Arts (3)
▪ Social studies (4)
▪ Music (10)
▪ Fine arts (5)
▪ Multiple disciplines, including science (6)
▪ Multiple disciplines, not including science (7)
▪ Other (please describe) (88) ________________________________________________

Chi-Square Tests
Pearson ChiSquare

Value
11.81
5

df
1
0

p
.29
8
Page 3 of 7

PDQ50 How many years have you been an educator? (select one)
▪ 0 to 5 years (1)
▪ 6 to 10 years (2)
▪ 11 to 20 years (3)
▪ More than 20 years (4)
Chi-Square Tests
Valu d
p
e
f
Pearson Chi4.922 3 .17
Square
8

PDQ19
What was your PRIMARY reason for participating in the MWEE professional
development? (check one)
▪ To obtain information and resources for teaching (1)
▪ Personal interest in the topic of the professional development (2)
▪ To obtain continuing education, recertification, or graduate credit (3)
▪ I was required to attend (4)
▪ I was asked to attend (5)
▪ Other, please describe: (88) ________________________________________________

Chi-Square Tests

Pearson ChiSquare

Valu
e
4.196

d
f
5

p
.52
2

PDGQ4
Which type(s) of MWEE professional development did you participate in or
receive? (please select yes or no for each type)

One day workshops (usually less than 8 hours) (PDGQ4_1)
Teacher institute (usually on consecutive days that cumulatively consist of 40 hours
of more) (PDGQ4_2)
Multi-day workshops (events that last at least 6 hours, but are less than 40 hours,
e.g., a three-day workshop on a specific topic or a series of five Saturday sessions)
(PDGQ4_3)
A college-level course (PDGQ4_4)
Professional development provider training (training for individuals who provide
teacher professional development) (PDGQ4_5)
Individual teacher coaching and support (e.g., curriculum planning, shared teaching,
demonstrations and/or other forms of in-school or in-field support (PDGQ4_6)
On-line professional development support (e.g., courses, webinars, discussion
forums) (PDGQ4_7)

Pearson ChiSquare
Value df p
3.048 1 .081
.000
1 .996
.424

1

.515

.468
.622

1
1

.494
.430

.404

1

.525

1.124

1

.289

Page 4 of 7

PDGQ23rev About how many hours of MWEE professional development and/or support did you
receive over the past 12 months?
▪ 1-10 hours (9) (note the order)
▪ 11-20 hours (4)
▪ 21-40 hours (5)
▪ 41-60 hours (6)
▪ More than 60 hours (10)

Chi-Square Tests
Pearson Chi-Square

Value
11.067

df
4

p
0.026

Crosstab
Group
Total
NR
PD
PDGQ23rev
9
Count
38a
100a
138
% within Group
27%
21%
23%
4
Count
34a
76b
110
% within Group
18%
24%
16%
5
Count
33a
164b
197
% within Group
32%
23%
35%
6
Count
23a
90a
113
% within Group
16%
19%
19%
10
Count
15a
37a
52
% within Group
11%
8%
9%
Total
Count
143
467
610
% within Group
100%
100%
100%
Each subscript letter denotes a subset of Group categories whose column proportions do not differ
significantly from each other at the .05 level.

PDQ37
Overall, what grade would you give your MWEE professional development
experience? (slide the scale between F and A+)

1 (1) 2 (2) 3 (3) 4 (4) 5 (5) 6 (6) 7 (7)
13 (13)

8 (8) 9 (9) 10 (10)

11 (11) 12 (12)

Page 5 of 7

PDQ3
7

Grou
p

N

Mea
n

Std.
Deviation

Std. Error
Mean

NR
PD

78
29
6

11.17
11.48

1.671
1.834

.186
.107

ttest
(p)
.176

PDGQ84
For each statement, select one response for BEFORE and one response for AFTER
the MWEE professional development.
BEFORE the MWEE professional
AFTER the MWEE professional
development, how confident were you in development, how confident are you in
your ability to: (#1)
your ability to: (#2)
Not at 2 3 4 5 6 Extrem Not at 2 3 4 5 6 Extrem
all
(2 (3 (4 (5 (6 ely
all
(2 (3 (4 (5 (6 ely
confid )
)
)
)
)
confide confid )
)
)
)
)
confide
ent 1
nt 7 (7) ent 1
nt 7 (7)
(1)
(1)
Teach my
students about
local
watersheds (ocea
n, coastal,
riverine,
estuarine, Great
Lakes) (PDGQ
84_1)
Incorporate
MWEEs into my
curriculum
(PDGQ84_2)

PDGQ84#1_PDGQ84_
1

Grou
p
NR
PD

PDGQ84#2_PDGQ84_
1

NR
PD

PDGQ84#1_PDGQ84_
2

NR
PD

PDGQ84#2_PDGQ84_
2

NR
PD

N
14
2
43
8
13
6
43
8
14
1
43
8
13
4
43

Mea
n
3.83

Std.
Deviation
1.726

Std. Error
Mean
.143

4.12

1.767

.084

5.90

1.030

.087

6.18

1.000

.047

3.16

1.667

.138

3.34

1.779

.084

5.52

1.210

.103

5.92

1.155

.055

t-test
(p)
.087

Difference in
means

.003

0.28

.290

.001

0.40

Page 6 of 7

7

PDGQ84_int Select one response for each statement.
During the next school year, I intend to:
Strongly
2
3
4
5
6
disagree 1 (1) (2) (3) (4) (5) (6)
Teach my students about local watersheds
(ocean, coastal, riverine, estuarine, Great
Lakes) (1)
Incorporate MWEEs into my curriculum
(2)
Grou
p

N

Mea
n

Std.
Deviation

Std. Error
Mean

NR

13
3
44
3
13
1
44
2

5.86

1.298

.111

6.20

1.226

.058

5.63

1.313

.113

5.96

1.276

.060

PDGQ84_int#1_
1

PD
PDGQ84_int#1_
2

NR
PD

Strongly
agree7 (7)

ttest
(p)
.005

Difference in
means

.012

0.33

0.34

Summary of Results

How long ago PD
PreK-12 Teacher or educator
Setting
Region
Grade level
Subject
Years teaching
Reason for PD
Types of PD (7 types)
Hours of PD
Rating of PD
Confidence teaching watersheds – before
Confidence teaching watersheds - after
Confidence using MWEEs – before
Confidence using MWEEs – after
Intention to teach watersheds
Intention to use MWEEs

NR
(n)

PD
(n)

147
147
147
146
141
147
147
146
100-122
143
78
142
136
141
134
133
131

510
510
510
483
476
484
482
482
361-409
467
296
438
438
438
437
443
442

Statistical
significant
difference
yes
NA
no
yes
no
no
no
no
no
yes
no
no
no
yes
yes
yes
yes

Meaningful
difference
no
NA
no
no
no
no
no
no
no
yes
no
no
no
no
no
no
no

Page 7 of 7


File Typeapplication/pdf
AuthorBronwen rice
File Modified2018-10-03
File Created2018-10-03

© 2024 OMB.report | Privacy Policy