Survey Items Mapped to Sources and Research Questions

Appendix B: Survey Items Mapped to Sources and Research Questions

Recipient Survey
Key to Sources
Acronym
NPSAS04

Source*
National Postsecondary Student Aid Study. 2004 Survey

BPS:04/09

Beginning Postsecondary Students, 2009 Follow-up Survey

NSSE 2011

National Survey of Student Engagement, 2011. Center for Postsecondary Research National Survey of Student
Engagement at Indiana University
New item written for the Evaluation of the S-STEM Program

New

*The recipient survey includes items drawn from national surveys, some of which are preserved in their original wording. Items that have been modified from
national surveys are noted.

Mapping of Survey Items to
Source
The item number listed in the exhibit below corresponds to the recipient survey, the source lists the national survey the item was drawn from (see previous
exhibit for complete source information), and the source variable name provides the name of the variable for the item in its original source.
Section A: Enrollment History
Item No.
A1

Source
New

Source Variable Name

A2

BPS:04/09

MBCREN00

A3

BPS:04/09

MBETYP00

A4

NPSAS04

N4DOB

A5

NPSAS04

N4FSTMM, N4FSTYY

A6

BPS:04/09

MBDEG01

A7

BPS:04/09

MBRSN00

A8

BPS:04/09

MBDAT00

A9

BPS:04/09

MBERN00

A10

BPS:04/09

MBERN200

A11

BPS:04/09

MBDGMY00

A12

BPS:04/09

MBPLAN00

A13

BPS:04/09

MBMNL00

Sources for Items in Recipient Survey

2

Section A: Enrollment History
Item No.
A14

Source
BPS:04/09

Source Variable Name
MBENR00

A15

BPS:04/09

MBEARNED

A16

BPS:04/09

MBSCHOLA

A17

BPS:04/09

MBSCH01, MBSCH02, MBSCH03

A17a

BPS:04/09

A18

BPS:04/09

A19

BPS:04/09

MBSCH01
MBCREN01, adapted: “By currently enrolled we mean enrolled as of Reference_Date_02” was not
included in the BPS:04/09 survey.
MBETYP01

A20

BPS:04/09

MBDEG01

A21

BPS:04/09

MBDAT01

A22

BPS:04/09

MCDBLMAJ

A23

BPS:04/09

MCMAJ01, adapted

A24

BPS:04/09

MBERN01

A25

BPS:04/09

MBERN201

A26

BPS:04/09

MBDGMY01

A27

BPS:04/09

MBPLAN01. Dates have been modified from original (BPS:04/09 referred to the 2009-10 school year)

A28

BPS:04/09

MBMNL01

A29

BPS:04/09

MBENR01

A30

New

A31

New

A32

New

A33

New

A34

BPS:04/09

MBDAT00

A35

BPS:04/09

MCDEGMAJ

A36

BPS:04/09

MCDBLMAJ

A37

BPS:04/09

MCMAJ1

A38

BPS:04/09

MCMAJ2

A39

New

A40

New

Sources for Items in Recipient Survey

3

Section A: Enrollment History
Item No.
A41

Source
BPS:04/09

A42

BPS:04/09

MBCRGR01

A43

BPS:04/09

MBDGGR01

A44

BPS:04/09

MBERGR01

A45

New

A46

BPS:04/09

A47

New

A48

New

Source Variable Name
MBENGRD

MBMRGR01. Note that the item in the BPS:04/09 survey includes an additional response option,
“Yes, will be enrolled in an additional degree/certificate program before July, 2009.” This option was
omitted here: the relevant date for survey respondents in this study is REFERENCE_DATE_02,
namely the date prior to onset of survey fielding. This response option will be nonsensical (e.g., if the
survey is fielded in April, 2013 setting REFERENCE_DATE_02 to April 1, 2013, then the response
option would read “Yes, will be enrolled in an additional degree/certificate program before April 1,
2013.” For respondents completing a survey after 4/1/2013, this option does not make sense.

Section B: Characteristics of
Enrollment at S-STEM Institution
Item No.
Introduction to
Section B
B1

Source

Source Variable Name

BPS:04/09

ENROLLMENT CHARACTERISTICS, INTRO

BPS:04/09

MCDEGMAJ

B2

BPS:04/09

MCDBLMAJ

B2a

BPS:04/09

MCCLSTC, MCCLTY

B3

BPS:04/09

MCMAJ1

B4

BPS:04/09

MCMAJ2

B5

BPS:04/09

MCNUMJOB

B6

BPS:04/09

MCRELMAJ, MCRELCRS

B7

New

B8

BPS:04/09

MCHOURS

B9

BPS:04/09

MCWRKRSN

B10

BPS:04/09

MCUGLN

Sources for Items in Recipient Survey

4

Section B: Characteristics of
Enrollment at S-STEM Institution
Item No.
B11

Source
BPS:04/09

B12

New

B13

New

B14

New

B15

New

B16a

New

B16b

NPSAS04

N4CLSTYA-N4CLSTYL, N4CLTYX

B17

NPSAS04

Item adapted from N4DBLMAJ

B18

NPSAS04

Item adapted from N4MAJ1A

B19

NPSAS04

Item adapted from N4MAJ2A

B20

NPSAS04

Item adapted from N4MAJ2A

B21

New

B22

New

B23

New

B24

New

B25a

NSSE 2011

Item 7; item adapted for students not currently enrolled.

B25b

NSSE 2011

Item 7; item adapted for students not currently enrolled.

B25c

NSSE 2011

Item 7; item adapted for students not currently enrolled.

B25d

NSSE 2011

Item 7; item adapted for students not currently enrolled.

B25e

NSSE 2011

Item 7; item adapted for students not currently enrolled.

B25f

NSSE 2011

Item 7; item adapted for students not currently enrolled.

B26a

New

B26b

New

B26c

New

B26d

New

B26f

New

B27a

NSSE 2011

Sources for Items in Recipient Survey

Source Variable Name
MCUGLAM
Note to reviewers: B13 was not included in BPS:04/09. There was no information on response
options available in the BPS:04/09 specifications or Methodology Report. We have added this
categorical item in case recall burden for B12 is too high.]

Item 9

5

Section B: Characteristics of
Enrollment at S-STEM Institution
Item No.
B27b

Source
NSSE 2011

Source Variable Name
Item 9

B27c

NSSE 2011

Item 9

B27d

NSSE 2011

Item 9

B28a

NSSE 2011

Item 1

B28b

NSSE 2011

Item 1

B28c

NSSE 2011

Item 1

B28d

NSSE 2011

Item 1

B28e

NSSE 2011

Item 1

B28f

NSSE 2011

Item 1

B28g

NSSE 2011

Item 1

B28h

NSSE 2011

Item 1

B28i

NSSE 2011

Item 1

B29a

NSSE 2011

Experimental Item 1

B29b

NSSE 2011

Experimental Item 1

B29c

NSSE 2011

Experimental Item 1

B29d

NSSE 2011

Experimental Item 1

B29e

NSSE 2011

Experimental Item 1

B29f

NSSE 2011

Experimental Item 1

B29g

NSSE 2011

Experimental Item 1

B29h

NSSE 2011

Experimental Item 1

B29i

NSSE 2011

Experimental Item 1

B29j

NSSE 2011

Experimental Item 1

B29k

NSSE 2011

Experimental Item 1

B29l

NSSE 2011

Experimental Item 1

B29m

NSSE 2011

Experimental Item 1

B29n

NSSE 2011

Experimental Item 1

B29o

NSSE 2011

Experimental Item 1

B30

NSSE 2011

Item 19

Sources for Items in Recipient Survey

6

Section C: First Year at S-STEM
Institution (for S-STEM degree)
Item No.
C1

Source
NPSAS04

Source Variable Name
N4GPATYP

C2

NPSAS04

Item adapted from N4GPA

C3

NPSAS04

Item adapted from N4GPAEST

C4

NPSAS04

Item adapted from N4LT30

C5

NPSAS04

N4MARR

C6

NPSAS04

Item adapted from N4DEP

C7

NPSAS04

N4DEP2

C8

NPSAS04

Item adapted from N4DAGE1

C9

NPSAS04

Item adapted from N4PARNC

C10

NPSAS04

Item adapted from N4INCSP

C11

NPSAS04

Item adapted from N4RCVAID

C12

NPSAS04

Item adapted from N4FEDLN

C13

NPSAS04

Item adapted from N4PELL

C14

NPSAS04

Item adapted from N4STAID

C15

NPSAS04

Item adapted from N4OTAID

C16

NPSAS04

Item adapted from N4PRVLN

C17

NPSAS04

Item adapted from N4SCHJOB

C18

NPSAS04

Item adapted from N4INCOM

C19

NPSAS04

N4COLLCRM

C20

NPSAS04

N4AP

C21

NPSAS04

N4ENSOPH

C22

NPSAS04

N4ACTSAT

C23

New

C23a

New

C23b

New

C24

NPSAS04

C24a

New

Sources for Items in Recipient Survey

SATMATH; note that in the NPSAS study, SAT/ACT scores were abstracted from student
transcripts provided by participating institutions; this item was not presented on survey

7

Section C: First Year at S-STEM
Institution (for S-STEM degree)
Item No.

Source

Source Variable Name
SATREAD; note that in the NPSAS study, SAT/ACT scores were abstracted from student transcripts
provided by participating institutions; this item was not presented on survey

C25

NPSAS04

C25a

New

C26

NPSAS04

C26a

New

C27a

NPSAS04

N4DISSEN; item adapted to refer to first year of enrollment at S-STEM_IHE

C27b

NPSAS04

N4DISMOB; item adapted to refer to first year of enrollment at S-STEM_IHE

C27c

NPSAS04

N4DISOTH; item adapted to refer to first year of enrollment at S-STEM_IHE

ACTSCORE; note that in the NPSAS study, SAT/ACT scores were abstracted from student
transcripts provided by participating institutions; this item was not presented on survey

Section D: Employment History
Item No.
D1

Source
BPS:04/09

Source Variable Name
MDINTRO; MDJSTAT

D2

BPS:04/09

MD0CC1

D3

BPS:04/09

MDHOURS

D4

BPS:04/09

MDEARN

D5

BPS:04/09

MDFIRSTJ

Section E: Background
Item No.
E1

Source
NPSAS04

Source Variable Name
N4EXPVR

E2

NPSAS04

N4GENDR

E3

NPSAS04

N4HISP (adapted)

E4

NPSAS04

N4RAC1

E5

NPSAS04

N4DADED

E6

NPSAS04

N4MOMED

E7

NPSAS04

N4LANG

All Items in the Principal Investigator Survey are new.

Sources for Items in Recipient Survey

8

Major RQ#
1

Detailed RQ#
How do individual awardees implement their S-STEM projects?
What are promising practices in key areas (e.g. recruitment, academic support, retention) of and/or lessons learned from highly effective
1a
and successful S-STEM projects?

2

What are the educational and career outcomes of the S-STEM scholarship recipients? How do outcomes of S-STEM recipients compare to an
appropriate comparison group or national trends?
2a

3

4

What is the effect of the S-STEM program scholarships on recipients?
To what extent do S-STEM scholarship recipients transfer to a four-year program as compared to an appropriate comparison or national
2b
trends?
To what extent do S-STEM scholarship recipients join the STEM workforce after graduation as compared to an appropriate comparison
2c
or national trends?
To what extent do S-STEM scholarship recipients apply for and attend a STEM graduate program as compared to an appropriate
2d
comparison group or national trends?
How effectively does the program meet the needs of academically talented financially needy STEM students as compared to other need2e
based opportunities and/or mechanisms?
Are there student or programmatic outcomes associated with receipt of an S-STEM award?
What is the effect of the S-STEM program on student outcomes (e.g. recruitment, retention) in STEM at institutions that have received
3a
an award compared to an appropriate comparison or national trends?
3b
What is the added value of the S-STEM program on institutions that receive awards?
What is the added value of the S-STEM program on student support and educational opportunities for recipients in institutions receiving
3c
S-STEM program funding?
What are the added value of the S-STEM program on STEM programs, STEM departments, and/or IHEs that have received S-STEM
3d
funding?
What is the relationship between specific project features or practices and student outcomes? Are there promising practices or lessons learned
about implementation of S-STEM projects?
4a
Are there any unintended positive and negative consequences/outcomes that can inform project and program management and design?

Research Questions

4b

To what extent can outcomes be attributed to components supported by the S-STEM program?

4c

Are there other NSF-funded education-oriented projects at the institution?

4d

What is the relationship among these NSF-funded education-oriented efforts at the institution?

9

RECIPIENT SURVEY: MAPPING ITEMS TO RESEARCH QUESTIONS
Key: Admin = this item is used to route the respondent appropriately through the survey.

Control = data from this item will be used for a control variable in analyses.

Outcome = data from this item will constitute an outcome of interest

Descriptive = data from this item will be summarized statistically to describe the S-STEM
program or its participants

Relational = data from this item will be used as a predictor or dependent variable in
correlational analyses of the relationships between program and individual recipient
characteristics and outcomes
Major RQ
Detailed RQ

1
1a

2a

2b

2
2c

2d

Research Questions
3
2e 3a 3b 3c

4
3d

4a

Item
Section A: Enrollment History: S-STEM DEG at S-STEM IHE, other
undergrad, other post-baccalaureate schools attended
A1
Confirms enrollment at S-STEM_IHE
A2
Currently enrolled at S-STEM_IHE
A3
Enrolled in degree/certificate program, or just taking classes?
A4
Date of birth
A5
Date first enrolled at S-STEM_IHE
A6
If not S-STEM_DEG, what degree?
A7
Reasons for enrolling at S-STEM_IHE to take classes
A8
Months enrolled at S-STEM_IHE
A9
Was S-STEM_DEG at S-STEM_IHE earned
A10
Enrolled at S-STEM_IHE for any (other) undergrad degrees?
A11
Date S-STEM_DEG at S-STEM_IHE earned
A12
Plans to enroll at S-STEM_IHE in 2013-2014
A13
Reason for leaving S-STEM_IHE without earning S-STEM_DEG
Enrollment at OtherIHE (undergrad) since first enrolled at SA14
STEM_IHE
A15
Ever enrolled for (or earned) Bachelor's degree
A16
[list of undergrad IHEs so far. No response needed]

Recipient Survey: Map to Research Questions

4b

4c

4d
Use in Analysis

1
1
1

1

1
1
1
1

1

1
1
1

Admin
Outcome, Admin
Outcome, Admin
Control, Admin
Outcome
Admin
Descriptive, Admin
Outcome
Outcome
Admin
Outcome
Admin
Descriptive
Outcome,
Descriptive
Outcome, Admin

10

Major RQ
Detailed RQ

1
1
a

2
2
a

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

4
4
a

Item

4c

4
d
Use in Analysis

A17

Name of any other UndgrdIHE since first enrolled at S-STEM_IHE
[Begin other UndgrdIHE school loop with iteration=1]

A17a

ErrorCheck: If ever enrolled for BS degree, get name of Bachelor's IHE
where enrolled (if not S-STEM_IHE)

A18

Currently enrolled at UndgrdIHE_1? (if i=2, at UndgrdIHE_2?)

A20
A21

Enrolled in degree program or just taking classes (i=1, UndgrdIHE_1;
i=2, UndgrdIHE_2)
Degree expected at UndgrdIHE_1 (or UndgrdIHE_2)
What months enrolled at UndgrdIHE_1 (or UndgrdIHE_2)

A22

Declared a major at UndgrdIHE_1 (or UndgrdIHE_2)?

A23

A19

4
b

1

Outcome, Descriptive
Admin
1

Outcome, Admin

1

Admin
1
1

Outcome
Outcome

1

1

Outcome

What major?

1

1

Outcome

A24

Earned degree from UndgrdIHE_1 or UndgrdIHE_2?

1

1

Outcome

A25
A26

Enrolled at UndgrdIHE_1 for any other undergrad degrees?
Date UGDEG_1 earned (or Date UGDEG_2 earned)
Plans to enroll at UndgrdIHE_1 in 2013-2014?
Plans to enroll at UndgrdIHE_2 in 2013-14?
Reason for leaving UndgrdIHE_1 without UGDEG_1
Reason for leaving UndgrdIHE_2 without UGDEG_2

1

Admin
Outcome

A27
A28

Admin
1

1

A29

Enrollment at any other UndrgrdIHE not yet listed since first enrolled at
S-STEM_IHE? [end of school loop; next iteration is i=2]

1

A30

Ever earned a Bachelor’s degree between REF_DATE_01 and
REF_DATE_02?

1

A31

Currently enrolled in Bachelor’s degree program?

A32

Name of school enrolled in for Bachelor’s degree (set as UndgrdIHE_3)

A33

Earned (or earning) a 4-year or a 5-year Bachelor’s degree from
UndgrdIHE_3?

Recipient Survey: Map to Research Questions

1

Descriptive
Outcome, Admin
Outcome

1

Outcome, Admin
Admin, Descriptive

1

Outcome

11

Major RQ
Detailed RQ

1
1
a

2
2
a

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

Item

4
4
a

4
b

4c

4
d
Use in Analysis

A34

What months enrolled at UndgrdIHE_3?

A35

Double major at UndgrdIHE_3? [if no longer enrolled]

1

Outcome

A36

Declared a major at UndgrdIHE_3? [if currently enrolled]

1

Outcome

A37

Primary major at UndgrdIHE_3?

1

Outcome

A38

Secondary major at UndgrdIHE_3?

1

Outcome

A39

Month and year Bachelor’s degree awarded from UndgrdIHE_3

1

Outcome

A40

Month and year expect to earn Bachelor’s degree from UndgrdIHE_3

1

Outcome

A41
A42
A43
A44
A45
A46
A47
A48

Enrolled in any post-baccalaureate degree program since date of
Bachelor's degree? [begin graddegree loop, i=1, max=2]
Currently enrolled in a GradDEG program?
What GradDEG are/were you pursuing
GradDEG earned?
Major field of GradDEG
Enrolled for any other post-bac degrees other than GradDEG_1
[end graddegree loop]
Expect to enroll in any GradDEG program in 2013-14?
If A47=yes, In what field do you expect to pursue GradDEG?

Recipient Survey: Map to Research Questions

1

Outcome

1

Outcome

1
1
1
1

Outcome, Admin
Outcome
Outcome
Outcome

1

Admin

1
1

Outcome
Outcome

12

Major RQ
Detailed RQ

1
1
a

2
2
a

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

4
4
a

Item

B10
B11
B12

4c

4
d
Use in Analysis

Section B: Characteristics of Enrollment at S-STEM IHE for S-STEM degree
Did you have/Do you have a double major at S-STEM_IHE (for SB1
STEM_DEG)?
B2
Have you declared a major at S-STEM_IHE? (for S-STEM_DEG)
B2a
What subject areas were you taking classes in at S-STEM_IHE?
B3
What is your (primary) major?
B4
What is your secondary major (if appl: only for those with double major)?
How many jobs do you have [did you have when last enrolled] for SB5
STEM_DEG at S-STEM_IHE?
Is/was job [where you worked the most hours] related to academic
B6
major/coursework?
B7
Is/was job any of the following (research assistant, peer tutor, etc.)
How many hours per week do/did you work [in main job] while at SB8
STEM_IHE for S-STEM_DEG
B9

4
b

What is/was main reason for working while at S-STEM_IHE for SSTEM_DEG
Did you have any educational loans while at S-STEM_IHE for SSTEM_DEG
How much did/have you borrowed in student loans for entire
undergraduate education?
[if B11=don't recall]: What range below best approximates amount you
borrowed in student loans?

Recipient Survey: Map to Research Questions

1

1

Outcome, Admin

1
1

1
1

1

1

Outcome, Admin
Descriptive, Admin
Outcome
Outcome

1

1

Descriptive, Relational

1

1

Descriptive

1

1

Descriptive

1

1

Descriptive, Relational

1

Descriptive

1

Descriptive, Relational

1

Descriptive, Relational

1

Descriptive, Relational

13

Major RQ
Detailed RQ

1
1
a

2
2
a

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

4
4
a

4
b

Item
B13

4c

4
d
Use in Analysis

Did you receive an S-STEM scholarship while at S-STEM_IHE for SSTEM_DEG? [note: recipient may not recall, may not know the term "SSTEM."]

if B13=yes, respondent sees Items B14-B23/B24; else skips to B25
B14
Date first received S-STEM scholarship funding
B15
Months during which you had S-STEM funding
During the months you received S-STEM scholarship funding, was your
B16a
major [major from Item B3]?
[if just taking classes]: During the months you received S-STEM
B16b
scholarship funding what areas have you been taking classes in?
During the months you’ve received S-STEM scholarship funding have
B17
you declared a double major?
[if B16a=no]: During the months you’ve received S-STEM scholarship
B18
funding what was your [primary] major?
[if applicable]:During the months you’ve received S-STEM scholarship
B19
funding was your secondary major [major from Item B4]?
[if applicable]: During the months you’ve received S-STEM scholarship
B20
funding what was your secondary major?
[if S-STEM_DEG earned:] Did S-STEM scholarship help you finish SB21
STEM_DEG?
[if B21=yes]: How did S-STEM scholarship help you finish SB22
STEM_DEG? Check all list.
[if B21=no]: Why didn't S-STEM scholarship help you finish SB23
STEM_DEG? Check all list.
Did you have any S-STEM scholarship funding when you [transferred to
B24
another undergrad IHE]?
Only respondents Currently Enrolled at S-STEM_IHE for S-STEM_DEG
receive Items B25 to B30.
B25
While at S-STEM IHE, which of the following did you do/have you done:
Practicum, internship, field experience, co-op experience, or clinical
B25a
assignment
B25b
Community service or volunteer work
B25c
Participated in a learning community
B25d
Worked on a research project with a faculty member

Recipient Survey: Map to Research Questions

1

Descriptive, Relational,
Admin

1
1

Descriptive, Relational
Descriptive, Relational

1

Descriptive, Control

1

Descriptive, Control

1

Admin, Descriptive,
Control

1

Descriptive, Control

1

Descriptive, Control

1

Descriptive, Control

1

Descriptive, Relational

1
1

1
1

1

Descriptive, Relational

1

Descriptive, Relational
Descriptive

1

Descriptive

1

Descriptive

1
1
1

Descriptive
Descriptive
Descriptive

14

Major RQ
Detailed RQ
Item
B25e
B25f
B26a
B26b
B26c
B26d
B26f
B27
B27a
B27b
B27c
B27d
B28
B28a
B28b
B28c
B28d
B28e
B28f
B28g
B28h
B28i

Independent study or self-designed major
Capstone course, senior project or thesis
Were any of these experiences (practicum, internship, …) related to your
major?
Was this community service or volunteer work related to your major?
Was this participation in a learning community related to your major?
What this research project related to your major?
Was this capstone course, senior project or thesis, related to your
major?
About how many hours in a typical 7-day week do you spend: [question
stem only]
…preparing for class
…participating in co-curricular activities
…providing care for dependents
…commuting to class
During the current school year how often have you: [question stem only]
Come to class without completing …assignments
Worked with other students on projects during class
Worked with classmates outside of class to prepare assignments
Tutored other students
Participated in a community-based project as part of a course
Talked about career plans with a faculty member or advisor
Discussed ideas from your readings or classes with faculty members
Received prompt written or oral feedback from faculty on your work
Worked harder than you thought you could to meet an instructor’s standards

B29

During the current school year, to what extent has your academic
advisor: [question stem only]

B29a
B29b
B29c
B29d
B29e
B29f

Responded when you contact them
Made themselves available
Asked you to make an appointment
Listened closely to your concerns and questions
Provided you with accurate information about academic requirements
Helped you understand school academic policies

Recipient Survey: Map to Research Questions

1
1
a

2
2
a

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

4
4
a

4
b

4c

4
d

1
1

Use in Analysis
Descriptive
Descriptive

1

Descriptive

1
1
1

Descriptive
Descriptive
Descriptive

1

Descriptive

1
1
1
1

Descriptive
Descriptive
Descriptive
Descriptive

1
1
1
1
1
1
1
1
1

Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive

1
1
1
1
1
1

Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive

15

Major RQ
Detailed RQ
Item
B29g
B29h
B29i
B29j
B29k
B29l
B29m
B29n
B29o
B30

Kept you informed of support options such as tutoring
Kept you informed of important deadlines
Provided accurate information about courses
Assisted you with academic difficulties
Assisted you with the credit transfer process
Showed you where to get information on educational options
Talked with you about career interests/plans for after graduation
Showed interest in your plans for the future
Offered you support to meet your career goals
What is your classification in college? (freshman, sophomore, etc.)

Section C: First Year at S-STEM Institution
C1
Is your GPA on a 4.0 scale?
C2
What was GPA at end of 1st year?
C3
[If C1 ne Yes]: Which [category] best describes GPA at end of 1st year
C4
[if A4=missing]: Categorize your age at start of 1st year: <24, 25-29, ≥30
C5
Marital status at end of 1st year
During 1st year did you have any children you were supporting
C6
financially
C7
[if C6=yes]: How many children?
C8
[if C6=yes]: Ages of children
C9
[if age <30]: What was parents' income at end of 1st year?
[if married]: In first full calendar year of first year of enrollment, what was
C10
spouse's income?
C11
During 1st year, any financial aid?
C12
During 1st year, federal Stafford student loan?
C13
During 1st year, Pell grant?
C14
During 1st year, any scholarships/grants from your school or state?
C15
During 1st year, any of the following other financial aid?
C16
During 1st year, any commercial or private loan (TERI, Excel, Access)?
C17
During 1st year, any work study or assistantship?

Recipient Survey: Map to Research Questions

1
1
a

2
2
a

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

4
4
a

4
b

4c

4
d
Use in Analysis
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Descriptive
Control

1
1
1
1
1
1
1
1
1

1
1

1
1

1
1

Admin
Matching
Matching
Control
Control
Control
Control
Control
Control
Control

1
1
1
1
1
1
1

1
1
1
1
1
1
1

1
1
1
1
1
1
1

Matching
Matching
Matching
Matching
Matching
Matching
Matching

16

Major RQ
Detailed RQ

1
1
a

2
2
a

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

Item
C18
C19
C20
C21
C22
C23
C23a
C23b
C24
C24a
C25
C25a
C26
C26a
C27a
C27b
C27c

4
4
a

4
b

4c

4
d
Use in Analysis

In first full calendar year of first year of enrollment, what was your
income
Did you earn college credit for any college courses taken in high school?
Any AP [advanced placement] credits accepted by S-STEM IHE?
[if C20=yes]: Enough credits to enter S-STEM IHE as a sophomore?
Did you take SAT or ACT?
When did you most recently take SAT/ACT prior to date of entry to S-STEM
IHE?
[if C23 date is after date enrolled at S-STEM IHE]: Did you take
SAT/ACT before enrolling at S-STEM IHE for S-STEM degree?
[if C23a=yes]: When did you take SAT/ACT before enrolling at S-STEM
IHE for S-STEM degree?
SAT Math score
As best as you can recall, what range did your SAT Math score fall into?
SAT Reading score
As best as you can recall, what range did your SAT Reading score fall
into?
ACT composite score
As best as you can recall, what range did your ACT score fall into?
During 1st year, any sensory disability (sight, hearing)?
During 1st year, and mobility disability?
During 1st year, any other physical, mental, emotional, learning
condition of 6 months or longer?
[NO RESPONSE, NO ITEM: INTERNAL ROUTING ITEM ONLY]

Section D: Employment History
[only for respondents not currently enrolled at any IHE]
INTRO: The next section asks about your current employment. Are you
D1
currently employed?
D2
[if D1=yes]: What is your job title and job duties?
D3
How many hours per week do you work on average?
D4
How much do you earn (select per year, per month, per week, per hour)
Is this job the first you've had since you were last enrolled at [most
D5
recent undergraduate IHE]?

Recipient Survey: Map to Research Questions

Control
1
1
1
1

1
1
1
1

1
1
1
1

Matching
Matching
Matching
Matching
Matching
Admin
Admin

1
1
1

1
1
1

1
1
1

Matching
Matching
Matching

1

1

1

Matching

1
1

1
1

1
1

Matching
Matching
Control
Control
Control
Admin

1

Outcome

1
1
1

Outcome
Outcome
Outcome

1

Outcome

17

Major RQ
Detailed RQ

1
1
a

2
2
a

Item
Section E: Your Background
[all respondents]
E1
What is the highest level of education you expect to complete?
E2
Gender
E3
Ethnicity (Hispanic/Latino)
E4
Race
E5
Father's highest level of education completed
E6
Mother's highest level of education completed
Was English the language most spoken at home when you were
E7
growing up?

Recipient Survey: Map to Research Questions

2
b

2c

Research Questions
3
2 2 3 3
3c 3d
d e a b

4
4
a

4
b

4c

4
d
Use in Analysis

1

Outcome
Control
Control
Control
Control
Control
Control

18

PI SURVEY: MAPPING ITEMS TO RESEARCH QUESTIONS
Research Questions
Item

Major RQ

1

Detailed RQ

1a

2
2a

2b

2c

3
2d

2e

3a

3b

4
3c

3d

4a

4b

4c

4d

Module A: Verification
A1
Our records indicate that you are [First, Last Name]: correct?

Use in Analysis
Admin

A2

Are you a current or former Principal Investigator (PI) of a National
Science Foundation Scholarships in Science, Technology,
Engineering and Mathematics (S-STEM) award?

Admin

A3

What type of system is your institution's academic calendar
(semester, quarter, trimester)?

Admin

Module B: Your S-STEM Award
B1

Do scholarship recipients know S-STEM by a different name?

Admin

B1a

Local, Institutional name for S-STEM

Admin

B2a (i)

Is local S-STEM programming/activities funded solely by S-STEM
award? If no, list additional funding sources

1

1

Descriptive,
Relational

B2a(ii)

What proportion of S-STEM programming is funded by each source
(including S-STEM award)

1

1

Descriptive,
Relational

B3a

Was this S-STEM award to your institution only or others as well?

1

Descriptive

B3b

[If B3a=2+ institutions]: List co-awardee IHEs and co-PIs
a. How many faculty at your IHE serve as PI or co-PI?
b. How many faculty serve a role on S-STEM award?
Which of the following NSF awards does your IHE have [has your
IHE had since 2001]

1

Descriptive

B4
B5
B6
B6a
B7

1

1

Does your IHE have funding from any non-NSF sources to support
recruitment/retention of undergraduates in STEM?
[if B6=yes]: List name of each grant and funding organization
Did your IHE use S-STEM award to help obtain other external
funding?

PI Survey: Map to Research Questions

1

Descriptive
1

Descriptive

1

Descriptive

1

Descriptive
Descriptive

19

Research Questions
Item

Major RQ

1

Detailed RQ

1a

2
2a

2b

2c

3
2d

2e

3a

3b

4
3c

3d

4a

4b

4c

4d

Use in Analysis

Module C: Recruitment and Selection of S-STEM scholarship recipients
C1

How do you recruit or identify potential scholarship recipients?

1

C1a

How successful have your recruitment efforts been?

1

C1b
C2a

C2b
C3
C4
C5
C5a
C6
C7
C8
C9

[if C1a =less than expected]: What are reasons for recruitment
difficulty?
Which of the following criteria do you use to identify or select
scholarship recipients? (High school coursework, high school GPA,
undergraduate coursework, cumulative undergraduate GPA, STEM
undergraduate coursework GPA, standardized test scores)
Which of the following criteria do you use to identify or select
scholarship recipients? (Letters of recommendation, personal
statements, employment or internship experiences, candidate
interviews, informal faculty recommendation, other)
Students in what academic majors are eligible at your IHE for an SSTEM scholarship?
Does your IHE give priority for scholarship to any of the following
types of students?
Do prospective scholars complete a formal application for S-STEM
scholarship?
[if C5=yes]: what % of applicants typically receive an S-STEM
scholarship?
[if C5=no]: what % of eligible students receive an S-STEM
scholarship?
When does a typical student begin participation in your IHE's SSTEM program?
How many first-ever S-STEM scholarships do you award per year?
[categorical range]
For how many academic terms (e.g. semesters) does a typical
student receive S-STEM scholarship funding?

C11

How much scholarship funding does a typical recipient receive per
academic term?
What is the maximum scholarship amount per recipient?

C12

What is required of scholars to continue receiving S-STEM funding?

C10

PI Survey: Map to Research Questions

1
1

Descriptive
Descriptive,
Relational
Descriptive

1

Descriptive,
Relational

1

Descriptive,
Relational

1

Descriptive

1

Descriptive
Admin

1
1
1
1
1

Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational

1

Descriptive,
Relational
Admin

1

Descriptive

1

20

Research Questions
Major RQ

1

Item
C13

Detailed RQ
Have any students turned down an S-STEM scholarship?

1a

C13a

[if C13=yes]: For which of the following reasons (or other)?

2
2a

2b

2c

3
2d

2e

3a

3b

4
3c

3d

4a
1

4b

4c

4d

Use in Analysis
Admin
Descriptive

Module D: Non-financial support of scholarship recipients
D1
D1a
D2
D2a
D3
D3a
D3b

D4

Do recipients have a designated S-STEM faculty advisor (other than
regular academic advisor)?
[if D1=yes]: How often are recipients encouraged to meet with SSTEM advisor?
Does your S-STEM program cluster students for co-enrollment in
one or more common courses?
[if D2=yes]: For which courses are students clustered together?
Does your S-STEM program offer recipients peer
mentoring/tutoring?
[if D3=yes]: Is peer mentoring/tutoring one-on-one, small group, or
large group?
[if D3=yes]: How often are recipients encouraged to meet with peer
mentor/tutor?
Are any of the following academic/professional development
opportunities provided to scholarship recipients? If so, is
participation strongly encouraged or voluntary?
a. lectures, colloquia, seminars
b. Student chapters of professional associations
c. Hands-on research opportunities
d. Learning communities/study groups
e. Internships
f. Attendance at professional conferences
g. Other (specify)

PI Survey: Map to Research Questions

1

1

1

1

1

1

1

1

1

1

1

1

1

1

1

1

Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational
Descriptive,
Relational

Descriptive,
Relational

21

Research Questions
Item

D5

D6

Major RQ

1

Detailed RQ
Are any of the following support services offered to scholarship
recipients? If so, is participation strongly encouraged or voluntary?
a. Courses/seminars to aid in college transition
b. Learning support center for math/science
c. Learning support center for writing
d. Support that targets students from under-represented groups
e. [2-year IHEs only]: Support for prospective transfers to a 4-year
IHE
f. [4-year IHEs only]: Support for incoming transfer from a 2-year
IHE
g. Advising for application to graduate school
h. Career counseling
i. Other
At your institution, does coordination exist between the S-STEM
project and the other NSF- or non-NSF-funded campus initiatives to
recruit and retain students in STEM occur at your institution? Check
all that exist
a. Some of the same faculty (and staff) are involved in the oversight
and administration of S-STEM are also involved in other STEM
initiatives on campus;
b. S-STEM scholarship recipients are encouraged to participate in
activities sponsored or supported by these other initiatives
c. S-STEM scholars can receive additional financial support from
these other initiatives
d. S-STEM scholars have access to resources, equipment that are
partially or fully funded by these other initiatives
e. S-STEM scholarship recipients have educational opportunities
that might not exist without these other initiatives
f. S-STEM scholarship recipients have access to support services
that might not exist without these other initiatives
g. Other coordination

1a

2
2a

2b

2c

3
2d

2e

3a

1

3b

4
3c

3d

4a

4b

4c

4d

Use in Analysis

Descriptive,
Relational

1

1

1

Descriptive,
Relational

Module E: Scholarship Recipient Outcomes
E1
E1a

What percent of current and former recipients are majoring in a
STEM field?
[if E1=don’t know]: Does your S-STEM program collect data on:
percent of current S-STEM recipients majoring in a STEM field;
percent of former S-STEM recipients majoring in STEM field?

PI Survey: Map to Research Questions

1(a)

1

Descriptive

22

Research Questions
Item
E2
E2a
E3
E3a
E4

Major RQ

1

Detailed RQ
What percent of current and former recipients have graduated with
STEM degree?
[If E2=don’t know]: Does your S-STEM program collect data on:
percent on current S-STEM recipients graduating with STEM
degree; percent of former recipients graduating with STEM degree?
[2yr IHEs only]: What percent of recipients have transferred to BAdegree program?
[If E3=don’t know]: Does your S-STEM program collect data on the
per cent of S-STEM recipients that transfer to a BA program?

1a

What percent of recipients have pursued graduate study in STEM?

2
2a

2b

2c

3
2d

2e

3a

3b

4
3c

3d

4a

4b

4c

4d

Use in Analysis

1(a)

1

Descriptive

1(a)

1

Descriptive

1(a)

1

Descriptive

[If E4=don’t know]: Does your S-STEM program collect data on the
percent of S-STEM recipients that pursue STEM grad study?
What percent of recipients are currently working in STEM
E5
1(a)
1
Descriptive
occupations?
[If E5= don’t know]: Does your S-STEM program collect data on the
E5a
percent of recipients that work in STEM occupations?
Please tell us anything else about your S-STEM award and program
F1
1
1
Descriptive
that we should know. [open-ended]
(a) These survey items (E1a-E2e) do not allow any attribution of causal effect of S-STEM on institutional outcomes, but rather allow description of aggregate S-STEM
recipient outcomes at the PI's institution (outcomes which could have occurred in the absence of S-STEM award).
E4a

PI Survey: Map to Research Questions

23