Undergraduate Participant Survey

Program Evaluation of the Partnership for International Research and Education (PIRE) Program

Appendix E_UndergradSurvey_July2014

Undergraduate Participant Survey

OMB: 3145-0236

Document [docx]
Download: docx | pdf

Appendix E. Undergraduate Participant Survey


Guidelines for Reviewers

Note, because of the complicated skip patterns that will be programmed, the reviewer version of the survey, by necessity, requires that there be embedded among the questions notes documenting skip patterns, alternate wording of questions, and information about which respondents will receive a particular question. These programming notes appear in a small, blue, sans-serif font. Some questions also contain placeholders for text that varies depending on existing information (e.g., the start and end dates of a grant period) or a respondent’s answer to an earlier item. These placeholders appear as [BROWN CAPITALIZED TEXT] inside brackets.


The online survey will automatically incorporate skip patterns and present the appropriate text for placeholders and question wording to the respondent. Also note that boldface type is used for emphasis, while an asterisk (*) indicates that a roll-over definition is available to online respondents (see Glossary, below). Surveys will employ a variety of response structures and will be programmed to use radio buttons, checkboxes, text boxes, and drop down boxes. Examples of each are shown below.


Radio Buttons – Allow only one answer to a question. Click circle to select option. To change answer, click another button.

Are you currently employed?

Yes

No

Checkboxes – Allow multiple answers to a question. Click a box to select a response. Click a checked box to remove the choice.

Which of the following degrees you have completed? Check all that apply.

☐ Doctoral degree

☒ Master’s degree

☐ Post-baccalaureate certificate

☒ Bachelor's degree


Text boxes – Allows respondent to write answer to question within a box. The number inside brackets (i.e., the “2500” in [textbox, 2500]) indicates how many characters the respondent can enter into the textbox.

What is your job title and what do you do in your job? [textbox, 2500]

     


Drop down – Allows respondent to select one answer from a list of specified list of options. Respondents click on box, and then scroll to select option.

In what month and year did you complete your graduate degree?

Month: [Drop box]

Year: [Drop box]

Glossary


Foreign: When referring to individuals, ”foreign” means people who are based primarily in institutions or locations outside the U.S., regardless of their citizenship or country of origin. (In other words, “foreign” could refer to a U.S.-citizen who is primarily based at an institution outside the U.S.) When referring to places, “foreign” means countries or locations outside the 50 United States or the District of Columbia.



Institution: Typically refers to a university, college or other higher educational entity but may include a museum, private or governmental research institute, laboratory, foundation, non-profit or for-profit business, or other organization.


Placeholders


SURVEY_DATE / NOVEMBER 15, 2015: The first day that the survey is fielded will serve as a common reference date across respondents. November 15, 2014 is currently filled as a hypothetical survey fielding date. After OMB approval, this date will be replaced with the actual field date of the survey.


PIRE _PROJECT_NAME: The title of the PI’s or co-PI’s project funded by PIRE or the comparison program.

ABBREVIATED_PROJECT_NAME: Because project titles are often long, a shortened name will be introduced and substituted for the full title in survey questions.


AWARD_START_DATE: Date when the PIRE award period began, according to NSF records.


AWARD_END_DATE: Date when the PIRE award period ended (if applicable), according to NSF records. If a project is still active, the SURVEY_DATE will be used as the most recent reference date for questions.


PARTICIPATION_START_DATE: Collected during the survey, the date the respondent reports first engaging in project activities. Not all co-PIs, postdocs, graduate students or undergraduates begin their participation on the date when the award officially commences.


PARTICIPATION_END_DATE: Collected during the survey, the date the respondent reports last engaging in project activities. Not all co-PIs, postdocs, graduate students or undergraduates continue participating on the project until its official end date.


URL TO AWARD ABSTRACT: Hypertext link to the award abstract posted on nsf.gov


HIGHEST_DEGREE: Collected during the survey, the highest post-secondary degree the respondent has completed.


BA_INSTITUTION: Collected during the survey, the institution where respondent was enrolled for bachelor’s degree when she/he participated in the PIRE project.


BA_DEGREE_INSTITUTION: Collected during the survey, the institution where respondent completed bachelor’s degree if degree was not received from “[BA_INSTITUTION].”


BA_END_DATE: Collected during the survey, the date when those not currently enrolled as an undergraduate who did not complete bachelor’s degree were last enrolled for bachelor’s degree.


BA_START_DATE: Collected during the survey, the date when respondent first enrolled for bachelor’s degree during the time he/she participated in the PIRE project.

Survey of Undergraduate Participants in the National Science Foundation’s Partnerships in International Research and Education (PIRE) program


This survey is about your participation in research, educational activities or international travel funded by the National Science Foundation’s (NSF’s) Partnerships for International Research and Education (PIRE) while you were an undergraduate. The researcher who received funding from NSF for the [PIRE_PROJECT_NAME] was required to identify people who did research, took part in educational activities, traveled to another country, or were affiliated in other ways with the project: you were listed as a participant. You can read about the project here: <URL TO AWARD ABSTRACT>, but this summary may or may not describe the project activities in which you participated. Even if you do not recognize the project, it is likely that you participated in an activity supported by this project.


None of the questions are of a sensitive nature, but you are free to skip any question you prefer not to answer. Researchers at Abt Associates (abtassociates.com) are conducting this survey as part of a study sponsored by the NSF.


Participation is voluntary. We will not reveal to NSF whether or not you participate in the survey. We will protect your privacy to the extent permissible by law by separating the responses you provide from your name, contact information and other personally identifiable information. Your survey results will be summarized along with the responses of others in aggregate statistical form only. We will give NSF data from survey respondents only after we have removed personally identifiable information about you.


Questions? See the Frequently Asked Questions page <FAQs>; or contact the study director, Carter Epstein of Abt Associates Inc. (toll-free: 1-800-XXX-XXX; email: [email protected]) or contact John Tsapogas at NSF, ([email protected]). For questions about participating in this research study, contact Abt’s Institutional Review Board (XXX-XXX-XXXX; email: [email protected]). This study’s IRB approval number is #XXXX.


OMB Clearance Number: xxxx-xxxx

Expiration Date: xx/xx/xxxx

Estimates of Burden for the Collection of Information.
According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this collection is xxxx-xxxx. The time required to complete this information collection is estimated to average 25 minutes per response, including the time to review instructions, search existing data resources, gather the data needed, and complete and review the information collected.


[CONTINUE]

MODULE A: VERIFYING INFORMATION ABOUT YOU



To confirm that we’ve reached the right person, we’d like to begin with a few questions about you.


A1. Is your name [First Name, Middle Name/Initial, Last Name]?


Yes, this is correct.

No, my name has changed or my name is misspelled above. My name is: [textbox, 75]

No, I’m not the person named above.


If A1= yes, go to A2.

If A1= my name has changed or my name is misspelled above, go to A2.

If A1= no, I’m not the person named above, go to Exit Screen and Flag for follow-up.




A2. When you first participated in the [PIRE/COMPARISON_PROJECT_NAME] project, where were you enrolled as an undergraduate?


At [BA_INSTITUTION]

At a different institution within the U.S.: Please enter the institution’s name, city, and state.

School name: [textbox, 100]. City: [textbox, 75]. State: [dropdown menu]

At a different institution outside the U.S.: Please enter the institution’s name, city, and country:

School name: [textbox, 100]. City: [textbox, 75]. Country: [textbox, 100]

I was never enrolled as an undergraduate.

I did not participate in this project as an undergraduate student.

Other, specify: [textbox 300]


If A2=1ST option, go to A3.

If A2 = 2nd option, let [BA_INSTITUTION= institution name entered] and go to A3.

If A2=3rd option, let [BA_INSTITUTION= institution name entered] and go to A3.

If A2=no, I was never …an undergraduate, go to Exit Screen and Flag for follow-up.

If A2=no, I did not participate in this project, go to Exit Screen and Flag for follow-up

If A2=other, specify, go to Exit Screen and Flag for follow-up




A3. As of [NOVEMBER 15, 2014], are you currently enrolled for your bachelor’s degree?


(If you are currently enrolled for a degree other than your bachelor’s degree, please answer “No.” You will tell us about other degrees later in the survey.)


Yes, currently enrolled for bachelor’s degree at [BA_INSTITUTION]

Currently enrolled for my bachelor’s degree at a different institution: Enter the full name of this school: [textbox, 300]

No, I am not currently enrolled for a bachelor’s degree


If A3= currently …at a different institution, let [OTHER_INSTITUTION] =entry in textbox. OR If A3=currently …at a different institution and the textbox=missing, let [OTHER_ INSTITUTION] = “unknown institution”.

If A3=no, not currently enrolled, go to A4





A4. Did you complete your program of study and receive your bachelor’s degree prior to [SURVEY DATE]? 


Yes, from [BA_INSTITUTION]

Yes, from another school. Enter the full name of this school: [textbox, 150]

No



If A4=yes, go to A5.

If A4=yes, from another school, let BA_DEGREE_INSTITUTION=entry in textbox. Go to A5 (when was BA awarded?).

If A4=no, go to A6 (when did you first attend BA_INSTITUTION?)



A5 is shown only if respondent received BA degree (A4=yes, from either BA_INSTITUTION or another school).

A5. In what month and year did you receive your bachelor’s degree? If you know the year but not the month, please enter the year. If you know the month but not the year, please enter the month.


Month: <dropdown from January through December>

Year: <dropdown from 1999 to 2013>



Let BA_DEGREE_DATE=A5_Month, A5_Year. Go to Item A6 (when did you first attend BA_INSTITUTION?).





A5a is shown only if respondent is not currently enrolled and did not receive BA degree (A4=no).

A5a. In what month and year were you last enrolled for your bachelor’s degree? If you know the year but not the month, please enter the year. If you know the month but not the year, please enter the month.


Month: <dropdown from January through December>

Year: <dropdown from 1999 to 2013>



Let BA_END_DATE=A5a_Month, A5a_Year. Go to Item A6 (when did you first attend BA_INSTITUTION?).




A6. In what month and year did you first attend [BA_INSTITUTION] for your bachelor’s degree?


Month: <dropdown from January to December>

Year: <dropdown from 1990 to 2015>



  • Let BA_START_DATE=A6_MONTH, A6_YEAR.

  • If respondent did NOT receive BA degree (A4=no) AND A6_Month not missing, go to Module B.

  • If respondent did receive BA degree (A4=yes, from either BA_INSTITUTION or another school) AND A6_Month not missing, go to A7.

  • IF A6_MONTH=missing, go to A6a.





A6a. Did you first attend [BA_INSTITUTION] for your bachelor’s degree before or after July 1st of [YEAR FROM A6]:


Before July 1st, [YEAR FROM A6]

After July 1st, [YEAR FROM A6]



If respondent did NOT receive BA degree (A4=no), go to Module B.

If respondent received BA degree (A4=yes, from either BA_INSTITUTION or another school), go to A7.




A7 is shown only if respondent received BA (A4=yes).

A7. When you received your bachelor’s degree, what was your primary major or field of study?


<select one>

Agricultural sciences

Psychology, Clinical

Biological sciences

Psychology, OTHER

Computer sciences

Social science, OTHER

Earth, atmospheric and ocean sciences

Business/Management

Engineering (aeronautical/aerospace, chemical, civil, electrical, mechanical, materials/metallurgical, other)

Medical or health sciences (e.g., audiology, dentistry, medicine, nursing, veterinary science, other medical)

Mathematics

Professional fields, OTHER (law, parks & recreation)

Physical sciences: Astronomy, Chemistry or Physics

Religion, Theology

Physical sciences, OTHER

English/Literature

Education: Mathematics or science

Foreign languages/literature

Education, OTHER

Humanities, other (e.g., fine/performing arts, philosophy)

Economics


Political science


Sociology







Go to Module B.





MODULE B: UNDERGRADUATE RESEARCH AND EDUCATIONAL EXPERIENCES



The next several questions ask about research, education or other activities in which you may have participated while working on your bachelor’s degree. When we ask about the [PROJECT_NAME] project, we will refer to this project as the [ABBREVIATED_PROJECT_NAME].


[CONTINUE]




If currently enrolled for BA (A3=yes, at BA_INSTITUTION OR A3=yes, elsewhere): have you ever

If not currently enrolled for BA (A3=no): did you ever

B1. While pursuing your bachelor’s degree, [have you ever traveled/did you ever travel] outside the U.S. for any of the following?



While pursuing my bachelor’s degree, I traveled outside the U.S. to:

Yes

No

A

Help conduct an original research project*

B

Take classes at an educational institution or participate in a study abroad program

C

Participate in an internship

D

Attend a professional conference


Rollover definition:

By “original” research, we mean an inquiry or investigation that was intended to make an original intellectual or creative contribution to knowledge. (You should answer yes even if the research project was not complete when you stopped participating in it.)


If all rows=no, go to Exit Screen.

If any row=yes, go to B2 (were any activities related to PIRE?).



If currently enrolled for BA (A3=yes, at BA_INSTITUTION OR A3=yes, elsewhere): Have any… in which you have participated… been related

If not currently enrolled for BA (A3=no): Were any… in which you participated… related

B2. [Have any/Were any] of these activities outside the U.S. [been related/related] to the [ABBREVIATED_PROJECT_NAME] project?



This activity was related to the project:

Was this activity outside the U.S. related to the project?

Yes

No

Not sure

Show this row if B1_RowA=yes:

Research project

Show this row if B1_RowB=yes:

Classes or a study abroad program

Show this row if B1_RowC=yes:

Internship

Show this row if B1_RowD=yes:

Professional conference



If all rows=no, go to Exit Screen.

If any rows=not sure, display “An Important Note about the Next Questions”.

If all rows=yes, go to B3 (skip “An Important Note”).

If any rows=yes AND no other rows=not sure, go to B3.



Note is shown only if respondent is not sure that any activities abroad are/were related to PIRE (any rows in B2=not sure).

An Important Note about the Next Questions

The next several questions ask about activities associated with the project, “[PROJECT_NAME]”. In these questions, we will refer to this project as the “[ABBREVIATED_PROJECT_NAME]” project.

Please answer the next set of questions even if you are not sure if activities you participated in were associated with the project named above. You were listed as a participant in one of this project’s activities by the Principal Investigator. It is likely that your activities outside the U.S. were related to this project. You may review the description of this project here <AWARD ABSTRACT>.


[CONTINUE to B3]






B3. The [ABBREVIATED_PROJECT_NAME] project officially began in [AWARD_START_DATE]. When did you first participate in activities associated with this award? If you are unsure of the month, please enter your best approximation. Please enter the month and year.


Month: <dropdown from January to December>

Year: <dropdown from AWARD_YEAR to 2015>


Let PARTICIPATION_START_DATE = “Month, Year” entered.

if date entered ([PARTICIPATION_START_DATE]) is earlier than [AWARD_START_DATE], display the following note: 

  Note:  You participated in activities for this project prior to its official starting date ([AWARD_START_DATE]). We recognize that activities related to a project may begin before the project’s official start date.   However, please read survey items carefully because some items may ask you to exclude activities that occurred before the project’s official start date of [AWARD_START_DATE].


If PIRE award is still active, go to B4 (still participating in PIRE?)

If PIRE award is not active, go to B5 (did you participate in PIRE in month of award end?)



B4 is shown only if PIRE award is still active.

B4. As of [NOVEMBER 15, 2014], have you completed your participation in the PIRE project?


If you will be engaging in research or educational activities that are part of this project in the future, please answer “No, I am still participating – or I will be participating in the future—in this project.”


  • Yes, I have completed my participation in this project.

  • No, I am still participating – or I will be participating in the future—in this project.


If B4=yes, go to B6 (to get PARTICIPATION_END_DATE).

If B4=no, let PARTICIPATION_END_DATE= NOVEMBER 15, 2014. Go to B7 (duration of PIRE participation?).

If B4=missing, let PARTICIPATION_END_DATE= NOVEMBER 15, 2014 (i.e., respondent classified as active PIRE participant). Go to B7 (duration of PIRE participation?).





B5 is shown only if PIRE award is no longer active.

B5. The official award period for the PIRE project, [ABBREVIATED_PROJECT_NAME], ended in [AWARD_END_DATE]. Were you still participating in this project in the month that the award period ended?


Yes

No



If B5=yes, let PARTICIPATION_END_DATE=AWARD_END_DATE. Go to B7.

If B5=no, go to B6 (to get PARTICIPATION_END_DATE).

If B5=miss, go to B6 (to get PARTICIPATION_END_DATE).


B5b is shown only if PIRE/COMPARISON award is not active AND IF B5=YES.

B5b.

We recognize that you may have conducted research or engaged in educational activities associated with the [ABBREVIATED_PROJECT_NAME] project after its official end date ([AWARD_END_DATE]), but please read survey items carefully because some items ask you to distinguish between activities that occurred before and activities that occurred after the official end date of [AWARD_END_DATE].


Go to B7.



B6 is shown only if PIRE participation has ended (B4=yes) OR no, was not participating in PIRE in month of award end (B5=no).

B6. When did you last participate in research or educational activities associated with the PIRE project? Please enter the month and year. If you are unsure, please enter your best approximation.


Month: <dropdown from January to December>

Year: <dropdown from AWARD_START_YEAR to 2014>



Let PARTICIPATION_END_DATE=B6_MONTH, B6_YEAR




For items B7-B18:

The first phrase in brackets (i.e., before the “/” mark) is used if PIRE participation has NOT ended;

The second phrase in brackets (after the “/” mark) is used if PIRE participation has ended (B4=yes) OR the PIRE award period is no longer active.


If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2.


VERSION 1:

B7. Between [PARTICIPATION_START_DATE] and [PARTICIPATION_END_DATE], how many weeks, months or years [have you been/were you] participating in research or educational activities associated with the project: [ABBREVIATED_PROJECT_NAME]? If you are unsure, please enter your best approximation.


If PIRE/COMPARISON award not active AND respondent was still contributing to the project in the final month of the award period (see Item B5), display the following warning:

We recognize that you may have conducted research (or engaged in educational activities) related to the project after [AWARD_END_DATE], but please do not include those months in your total.


VERSION 2:

B7. Between [AWARD_START_DATE] (the official start date of the project) and [PARTICIPATION_END_DATE], how many weeks, months (or years) [have you been/were you] conducting research associated with the project: [ABBREVIATED_PROJECT_NAME]? If you are unsure, please enter your best approximation.


Display the following warning:

We recognize that you may have conducted research (or engaged in educational activities) related to the project before [AWARD_START_DATE]} {(If PIRE/COMPARISON award not active AND respondent was still contributing to the project in the final month of the award period (see Item A9)}: or after [AWARD_END_DATE]}, but please do not include those months in your total.



Number of weeks/months/years: <weeks> < months> < years>





B8. Where outside the U.S. [have you traveled/did you travel] for activities related to the [ABBREVIATED_PROJECT_NAME] project? Do not include brief stops due to travel layovers or delays or stays lasting less than 24 hours. You may indicate up to five different countries.


[if not currently enrolled (Item A3):

Please exclude any trips for which you departed the U.S. after you were enrolled as an undergraduate.]

[if currently enrolled (Item A3):

Please exclude a trip for which you departed the U.S. after [NOVEMBER 15, 2014]


1st country

Select the first letter of the country to see a list

[Populated with drop-down list of countries. See APPENDIX H.2]

A

B

C

D

E

F

G

H

I-J

K

L

M

N

O

P

Q-R

S

T

U-V

W-Z











2nd country

A

B

C

D

E

F

G

H

I-J

K

L

M

N

O

P

Q-R

S

T

U-V

W-Z











3rd country

A

B

C

D

E

F

G

H

I-J

K

L

M

N

O

P

Q-R

S

T

U-V

W-Z











4th country

A

B

C

D

E

F

G

H

I-J

K

L

M

N

O

P

Q-R

S

T

U-V

W-Z











5th country

A

B

C

D

E

F

G

H

I-J

K

L

M

N

O

P

Q-R

S

T

U-V

W-Z








Note is shown only if respondent is unsure that any activities abroad are related to PIRE (any rows in B2=not sure).

An Important Note about the Next Questions

The next several questions are designed to gather information about research and educational activities associated with the project, “[ABBREVIATED_PROJECT_NAME]”.


Please answer the next set of questions even if you are not sure if research and activities you participated in were associated with the project named above. You were listed as a participant in one of this project’s activities by the Principal Investigator. Please focus on your participation in activities that occurred while you were pursuing your bachelor’s degree at [BA_INSTITUTION] [if A3=2: (or at [OTHER_INSTITUTION]). You may review the description of this project here <AWARD ABSTRACT>.


[CONTINUE]





B10 is shown only if respondent took classes abroad or did study abroad program for PIRE (B2_RowB=yes OR B2_RowB=not sure).

B10. What types of coursework did you take while outside the U.S. or what did your study abroad program include? Check all that apply.


Courses, seminars, lectures, or other education in my primary major or field of study

Courses, seminars, lectures, or other education in fields other than my primary major field of study

Foreign language classes or education

Classes or other education about the history, geography, and culture of the country/region

Other – specify [textbox, 300]



If respondent did PIRE internship abroad (B2_RowC=yes OR B2_RowC=not sure), go to B11 (internship setting and type or work?)

If respondent did NOT do PIRE internship abroad (B2_RowC=no) AND did PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure), go to B12 (while abroad, did you interact with foreign researchers…?)

If respondent did NOT do PIRE internship (B2_RowC=no) AND did NOT do PIRE research (B2_RowA=no), go to B13a (how many times have you traveled outside the U.S.?)



B11 is shown only if respondent participated in PIRE internship abroad (B2_RowC=yes OR B2_RowC=not sure).

B11. Which of the following describes your internship setting and the type of work involved? Check all that apply.


Setting:

Elementary or secondary school

Medical or health care institution

College, university, or other institution of higher education

Government agency or non-governmental organization (excluding any belonging to one of the above categories)

Industry or business (excluding any belonging to one of the above categories)

Another setting, please specify: [textbox, 300]



Type of work:

Research or research & development (R&D)

Policy-related work

Teaching, training, or mentoring others

Providing help or services to others

Another type of work, please specify: [textbox, 300]



If respondent did PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure), go to B12 (while abroad, did you interact with foreign researchers…?)

If respondent did NOT do PIRE research abroad (B2_RowA=no), go to B13a (how many times have you traveled outside the U.S.?)




B12 is shown only if respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure).

B12. While conducting research outside the U.S., were you interacting directly with someone based primarily at an institution or location outside the U.S.? Select Yes or No in each row.



I was interacting directly with

Yes

No

Faculty, senior- or postdoctoral-level researchers or graduate students based outside the U.S.

Undergraduate students based outside the U.S.









B13a. While pursuing your bachelor’s degree, how many times [have you traveled/did you travel] outside the U.S. for activities related to the [ABBREVIATED_PROJECT_NAME] project?


if currently enrolled as undergraduate (see item A3), display note:

Please exclude a trip for which you departed the U.S. after [NOVEMBER 15, 2014]


If not currently enrolled as undergraduate (item A3) and completed or did not complete degree (items A4, A5), display note:

Please exclude any trip for which you departed the U.S. after [BA_DEGREE_DATE/BA_END_DATE]


  • Once

  • More than once: Please enter the total number of trips: __



If B13a=once, go to B13c.

If B13a=more than once, go to B13b.



B13b is shown only if respondent traveled outside the U.S. for PIRE project activities more than once (B13a=more than once).

B13b. Thinking about these [NUMBER OF TRIPS FROM B13a] trips outside the U.S., how many consecutive days, weeks or months were you outside the U.S. on average, and on the single longest such trip?


On average, a trip outside the U.S. for activities related to the [ABBREVIATED_PROJECT_NAME] project lasted how many consecutive days/weeks/months?

__

<select days, weeks or months>

Single longest trip outside the U.S. for [activities related to the [ABBREVIATED_PROJECT_NAME] project lasted how many consecutive days/weeks/months?

__

<select days, weeks or months>





B13c is shown only if respondent traveled outside the U.S. for PIRE project activities once (B13a=once).

B13c. How many consecutive days, weeks or months were you outside the U.S. for activities related to the [ABBREVIATED_PROJECT_NAME] project?


How many consecutive days/weeks/months did this trip outside the U.S. for activities related to the [ABBREVIATED_PROJECT_NAME] project last?



<select days, weeks or months>







B14. When you were abroad for activities related to the [ABBREVIATED_PROJECT_NAME] project, were you with other U.S.-based* students or faculty?


While abroad for this project, I was with:


Yes

No

Other U.S.-based undergraduates

U.S.-based graduate students

U.S.-based faculty or postdoctoral researchers


Rollover definition:

U.S.-based individuals are people based primarily at an institution or location within the 50 United States or the District of Columbia.


If respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure), go to B15.

If respondent did not conduct PIRE research abroad (B2_RowA=no), go to Module D.




B15 is shown only if respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure).

B15. Who was your primary mentor for the research in which you participated as part of the [ABBREVIATED_PROJECT_NAME] project?


A U.S.-based faculty member (or other senior-level researcher, such as a postdoc)

A U.S.-based graduate student

A faculty member or senior-level researcher based primarily outside the U.S.

A graduate student based primarily outside the U.S.

Other (please describe your mentor: [textbox, 500]

I did not have a mentor for this research


If respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure), go to B16;

If respondent did not conduct PIRE research abroad (B2_RowA=no), go to B18 (continue to participate in PIRE in U.S.?).






B16 is shown only if respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure).

B16. Please respond to the following statements about your experience participating in research that was part of the [ABBREVIATED_PROJECT_NAME] project:



Strongly disagree

Disagree

Agree

Strongly agree

My mentor helped me acquire the methods or techniques I needed for the research

My mentor showed sincere interest in my learning








B17 is shown only if respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure).

B17. For each of the following statements please indicate whether you strongly agree, agree, disagree or strongly disagree. Mark one answer in each row.


First phrase in brackets for A3=currently enrolled; second phrase for A3=not currently enrolled

Strongly disagree

Disagree

Agree

Strongly agree

Not applicable

Regulatory, bureaucratic or administrative procedures in a foreign country [have hindered/hindered] the progress of the research*

Different cultural perspectives [have improved/improved] the quality of the research

Language differences [have hindered/hindered] the progress of the research

Items marked with an * are reverse-scored.







B18 is shown only if respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure).

B18. [Have you experienced/Did you experience] any of the following challenges during your participation in the [ABBREVIATED_PROJECT_NAME] project?


Not enough information or guidance to prepare for the foreign component of the research

Delays pursuing/completing my bachelor’s degree

Unexpected financial burdens

Not enough opportunity to contribute to the research

Not enough supervision or mentoring

Too much supervision

My contributions to the research were not always appreciated or respected

Bias from foreign members of the research team based on my nationality, gender, race, ethnicity, religion, disability or sexual orientation

Other – specify [textbox, 300]

None of the above






MODULE C: COLLABORATIONS


C1 is shown only if respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure).

If PIRE participation has NOT ended (B4=no): have you collaborated

If PIRE participation has ended (B4=yes OR award not active): were you collaborating

C1. While pursuing your bachelor’s degree and conducting research associated with the [ABBREVIATED_PROJECT_NAME] project, [have you collaborated/were you collaborating] with any of the following? Select Yes or No in each row.


Row


Yes

No

A

Faculty, senior- or postdoctoral-level researchers or graduate students based primarily at an institution outside the U.S.?

B

Undergraduate students based primarily at an institution outside the U.S.?


If C1_Row(A)=yes OR C1_Row(B)=yes, AND PIRE participation has ended (B4=yes OR award not active), go to C2a.

If C1_Row(A)=yes OR C1_Row(B)=yes, AND PIRE participation has not ended (B4=no), go to Module D.

If C1_Row(A)=no AND C1_Row(B)=no, go to Module D.



C2a is shown only if PIRE participation has ended (B4=yes OR award not active).

C2a. Between [PARTICIPATION_END_DATE] and [NOVEMBER 15, 2014], have you collaborated on research with any foreign* member of the [ABBREVIATED_PROJECT_NAME] project team? Please answer Yes or No for each row.


Rollover definition:

By “foreign” member of the project team, we mean someone based primarily at an institution or location outside the U.S.



Since my participation in the project ended, I have collaborated with:

Yes

No

A

One or more project members who were —and are still**based primarily outside the U.S.

B

One or more project members who were based primarily outside the U.S.—but who are now ** based primarily in the U.S.

C

One or more project members who were based primarily in the U.S. --but who are now *** based primarily outside the U.S.


** If you do not know where a project member is currently based: check YES if this project member was based primarily outside the U.S. at the time you collaborated with him or her.

*** If have collaborated with a project member while that person was based primarily outside the U.S., check YES, even if you know (or think) that this person used to be based within the U.S.

If C2a_RowA=no AND C2a_RowB=no and C2a_RowC=no, go to C2d (collaborated with non-PIRE foreign partners?)

If any row = Yes, go to C2c.


C2b is shown only if PIRE participation has ended (B4=yes OR award not active) AND respondent collaborated with current or former foreign partners (C2a_RowA=yes OR C2a_RowB=yes OR C2a_RowC=yes).

C2b. When was the most recent time you have collaborated with a member of the [ABBREVIATED_PROJECT_NAME] project team?



Row

Most recent collaboration with. . .

Within the past 6 months

6 months to less than 1 year ago

1 year to less than 2 years ago

2 years to less than 4

years ago

4 or more years ago

A

Display row A if C2a_Row(A) =yes:

One or more project members who were —and are still—based primarily outside the U.S.

B

Display row B if C2a_Row(B)=yes:

One or more project members who were based primarily outside the U.S.—but who are now based primarily in the U.S.

C

Display row c if C2a_Row(C)=yes:

One or more project members who were based primarily in the U.S. --but who are now based primarily outside the U.S.







C2b is shown only if PIRE participation has ended (B4=yes) OR award not active--AND respondent collaborated with current or former foreign researchers (C2a_RowA=yes or C2a_RowB=yes or C2a_RowC=yes).

C2c. Which of the following describe your collaborations with someone from the [ABBREVIATED_PROJECT_NAME] project team who was—or who is now—based primarily outside the U.S. (that is, with a foreign* partner)? Check all that apply.


 I have traveled outside the U.S. to work with one or more foreign partners

 I have met with one or more foreign partners at conferences outside the U.S.

 I have enrolled as a student at an institution outside the U.S.

 I have (or have had) a job or position at an institution outside the U.S.

 A foreign partner has (or had) enrolled as a student at an institution in the U.S.

 A foreign partner has (or has had) a job at an institution in the U.S.

 A former U.S.-based partner has (or has had) a position at an institution outside the U.S.

 I have planned one or more research projects with a foreign partner

 I have conducted one or more research projects with a foreign partner

 I have discussed developments in our research field(s) with a foreign partner

 I have shared data or other resources with a foreign partner

 None of the above


Rollover definition:

By “foreign” partner, we mean someone who was, or who is now, based primarily at an institution or location outside the U.S. regardless of this person’s citizenship or country of origin.





C2d. Between [PARTICIPATION_END_DATE] and [NOVEMBER 15, 2014], have you collaborated with any foreign* partners (i.e., a person based primarily at an institution outside the U.S.) who were not affiliated with the [ABBREVIATED_PROJECT_NAME] project? Check one only.


 Yes

 No


Rollover definition:

By “foreign” partner, we mean someone who was, or who is now, based primarily at an institution or location outside the U.S. regardless of this person’s citizenship or country of origin.

If C2d=yes, go to C2e (How many foreign partners …?)

If C2d=no AND collaborated with foreign PIRE/COMPARISON partners (C2a_RowA=yes OR C2a_RowB=yes or C2a_RowC=yes), go to C2e (how many foreign …?).

If C2d=no AND did NOT collaborate with foreign PIRE/COMPARISON partners (C2a_RowA =no AND C2a_RowB=no AND C2a_RowC=no), go to Module D.







C2e. Between [PARTICIPATION_END_DATE] and [NOVEMBER 15, 2014], how many foreign partners have you collaborated with?


  • 1

  • 2

  • 3

  • 4 or more


Rollover definition:

By “foreign” partner, we mean someone who was, or who is now, based primarily at an institution or location outside the U.S. regardless of this person’s citizenship or country of origin.





C2f. Please think about the one foreign partner—that is, someone based primarily at an institution outside the U.S.—with whom you have collaborated the longest.


(i) As of SURVEY_DATE, how long have you been collaborating with this person? You may enter months, years, or any combination:

Years: <0 years to 30 or more years> and Months: <1 month to 11 months>


(ii) Is this person currently based primarily at an institution:

  • Outside the U.S.

  • Within the U.S.


(iii) As of SURVEY_DATE, how long [has this person been/was this person] based primarily at an institution outside the U.S.? If you are unsure please select your best guess.

Years: <0 years to 30 or more years> and Months: <1 month to 11 months>




MODULE D: RESULTS OF YOUR PIRE PROJECT EXPERIENCES


If PIRE participation has NOT ended (B4=no): have you

If PIRE participation has ended (B4=yes OR award not active): were you

D1. [Have you been/Were you listed] as a co-author on any publication as the result of your participation in the PIRE project? Check all that apply.


I have been listed as a co-author on a publication

I will be listed as a co-author on an paper that is in preparation, under review for possible publication or in press (accepted for publication but has not yet appeared)

None of the above



If D1=none, go to D2b (to how many PIRE works have you contributed?)



D2a is shown only if respondent has or will be listed as co-author on PIRE publication (D1=yes OR D1=I will be).

D2a. On how many publications resulting from the PIRE project are you listed (or will you be listed) as a co-author?



Total number

How many of these include a foreign* co-author?

Don’t know if there are foreign* co-authors

Publications



Papers in preparation, under review or in press




Roll-over definition:

By foreign co-author, we mean someone based primarily at an institution or location outside the U.S.







If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2


Version 1:

D2b. Between [PARTICIPATION_START_DATE] and [NOVEMBER 15, 2014], how many of the following works related to the [ABBREVIATED_PROJECT_NAME] project have you contributed to as an author or co-author, inventor or co-inventor, developer or co-developer? Make your best approximation if you do not know the exact number.


Version 2:

D2b. Between [AWARD_START_DATE] and [NOVEMBER 15, 2014], how many of the following works related to the [ABBREVIATED_PROJECT_NAME] project have you contributed to as an author or co-author, inventor or co-inventor, developer or co-developer? Make your best approximation if you do not know the exact number.


None

Total

How many of these include a foreign* co-author, co-inventor, co-developer?

Don’t know how many had foreign contributor

Conference abstracts, posters or presentations (including any published in conference proceedings)


Patents, registered or pending, provisional or non-provisional



Other products that have been disseminated to the scholarly community or public (e.g., educational material, software application, dataset, database)




Roll-over definition:

By foreign co-author, co-inventor, or co-developer, we mean someone based primarily at an institution or location outside the U.S.






If PIRE participation has NOT ended (B4=no): have you

If PIRE participation has ended (B4=yes OR award not active): did you

D3. What role [have you played/did you play] in preparing publications, conference presentations, patent applications, or other works that will be shared with the scholarly community? Check all that apply.


Designing the research

Collecting data

Preparing samples or specimens

Synthesizing or fabricating materials

Conducting computer or mathematical simulations

Analyzing data

Manufacturing or building a prototype or model

Testing a prototype

Writing part of a manuscript or report on the research

Editing drafts of manuscript written by others

Other (please specify: [textbox, 1,000]

None of the above





D4 is shown only if respondent conducted PIRE research abroad (B2_RowA=yes OR B2_RowA=not sure).

In this section of the survey, we ask you to consider a variety of possible benefits you may have gained from your PIRE research experience.


D4. Please indicate how much your PIRE research experience may have benefited you for each area of learning below.



No benefit

Small benefit

Moderate benefit

Large benefit

Very large benefit

Not applicable

Clarification of a career path

Tolerance for obstacles faced in the research process

Understanding of how scientists work on real problems

Self-confidence in my field of study






D5 is shown only if traveled abroad for PIRE (B2_AnyRow=yes).

D5. Would you recommend or not recommend to other undergraduates that they participate in international research or educational activities?


 Strongly recommend

 Recommend

 Recommend with reservations

 Not recommend








D5a. Why would you [strongly recommend/recommend/recommend but with reservations/not recommend] that other undergraduates participate in international research or educational activities?


Textbox 3500










D5b. What aspects of your participation as an undergraduate in the PIRE project have been most beneficial? What aspects have been (or were) the most challenging?


Textbox 3500








MODULE E IS SHOWN ONLY TO RESPONDENTS WHO HAVE COMPLETED BACHELOR’S DEGREE (A4=YES).

MODULE E: EDUCATIONAL AND CAREER OUTCOMES


E1 is shown only if respondent received BA (A4=yes).

POST-BACCALAUREATES ONLY RECEIVE ITEMS E1- E13 (A4=received bachelor’s degree)


E1. As of [NOVEMBER 15, 2014], what is the highest degree you have completed? Mark one response.


Bachelor’s degree

Post-baccalaureate certificate (e.g., teaching certificate)

Master’s degree

Doctoral degree (PhD, EdD)

Professional degree (chiropractic, dentistry, law, medicine, optometry, osteopathic medicine, pharmacy, podiatry, ministry or divinity, or veterinary medicine)



Let HIGHEST_DEGREE=response to E1.

If E1=Master’s OR E5=Doctoral OR E5=Professional, go to E2a.

If E1=Bachelor’s or post-baccalaureate certificate, go to E3 (currently enrolled in grad degree program?)




E2a. Where did you complete your [HIGHEST_DEGREE]?


In the United States

Outside of the United States






E2b. In what month and year did you receive your [HIGHEST_DEGREE]? If you completed more than one [HIGHEST_DEGREE], please enter the year that you received your most recent [HIGHEST_DEGREE].


Month: <dropdown from January to December>

Year: <dropdown from AWARD_YEAR to 2015>







E2c. In what field was your [HIGHEST_DEGREE]?


<select one>

Agricultural sciences

Psychology, Clinical

Biological sciences

Psychology, OTHER

Computer sciences

Social science, OTHER

Earth, atmospheric and ocean sciences

Business/Management

Engineering (aeronautical/aerospace, chemical, civil, electrical, mechanical, materials/metallurgical, other)

Medical or health sciences (e.g., audiology, dentistry, medicine, nursing, veterinary science, other medical)

Mathematics

Professional fields, OTHER (law, parks & recreation)

Physical sciences: Astronomy, Chemistry or Physics

Religion, Theology

Physical sciences, OTHER

English/Literature

Education: Mathematics or science

Foreign languages/literature

Education, OTHER

Humanities, other (e.g., fine/performing arts, philosophy)

Economics


Political science


Sociology





If HIGHEST_DEGREE=PhD/EdD (E1=Doctoral Degree), go E2d. If HIGHEST_DEGREE is not a doctoral degree, skip to E3.



E2d is shown only if respondent’s HIGHEST_DEGREE = PhD (E2a=Doctoral degree)

E2d. After completing your [HIGHEST_DEGREE], did you ever hold any postdoctoral appointments?


Yes

No


If E2d=No, skip to E3.  If E2d=yes, go to E2e.



E2e is shown only if respondent has held a postdoctoral appointment (E2d=Yes)

E2e. Have you ever held any postdoctoral appointments outside the U.S.?


Yes

No


Go to E3.






E3. As of [NOVEMBER 15, 2014], are you currently enrolled in a graduate degree program?


Yes

No


If E3=yes, go to E4a.

If E3=no AND highest degree completed is BA (E1=bachelor’s), go to E5 (CURRENT PLANS?).

If E3=no AND highest degree completed is greater than BA (E1=Master’s OR E1=Doctoral OR E1=Professional), go to Module F



E4a is shown only if respondent currently enrolled in grad school (E3=yes).

E4a. What degree do you expect to earn?


Post-baccalaureate certificate (e.g., teaching certificate)

Master's degree (includes MBA, M.Ed., etc.)

Doctoral degree (PhD, EdD, etc.)

Professional degree (only includes: chiropractic, dentistry, law, medicine, optometry, osteopathic medicine, pharmacy, podiatry, ministry or divinity, or veterinary medicine)







E4b. Where is your graduate school located?


In the United States

Outside of the United States









E4c. In what graduate field is your degree program?


<select one>

Agricultural sciences

Psychology, Clinical

Biological sciences

Psychology, OTHER

Computer sciences

Social science, OTHER

Earth, atmospheric and ocean sciences

Business/Management

Engineering (aeronautical/aerospace, chemical, civil, electrical, mechanical, materials/metallurgical, other)

Medical or health sciences (e.g., audiology, dentistry, medicine, nursing, veterinary science, other medical)

Mathematics

Professional fields, OTHER (law, parks & recreation)

Physical sciences: Astronomy, Chemistry or Physics

Religion, Theology

Physical sciences, OTHER

English/Literature

Education: Mathematics or science

Foreign languages/literature

Education, OTHER

Humanities, other (e.g., fine/performing arts, philosophy)

Economics


Political science


Sociology





Go to Module G.




E5. Which of the following best describes your plans for any education beyond your bachelor’s degree:


  • I do not intend to pursue a graduate degree or certificate


I intend to pursue: (select one)

  • A master’s or doctoral degree in engineering, computer science, math or the natural (biological or physical) sciences

  • A master’s or doctoral degree in the social sciences

  • A master’s or doctoral degree in a field other than engineering, computer science, math, the natural or social sciences

  • A business degree (MBA)

  • A medical degree (MD)

  • A joint medical and doctoral degree (MD/PhD)

  • Another health-related or professional counseling degree (e.g., nursing, Psy.D., social work)

  • A law degree

  • A teaching certificate or master’s degree related to a field in which I teach/will teach

  • None of the above, a different graduate degree or certificate


If currently enrolled in grad school (E3=yes), go to Module G (Demographics).

If not currently enrolled in grad school (E3=no), go to Module F (Employment).





MODULE F IS ONLY SHOWN TO RESPONDENTS WHO ARE NOT CURRENTLY ENROLLED FOR A BACHELOR’S (A3=no) OR GRADUATE DEGREE (E3=no).


MODULE F: EMPLOYMENT



F1. Were you working for pay or profit, during the week of [NOVEMBER 15, 2014]? Work includes being self-employed, on a postdoctoral appointment, or on any type of paid or unpaid leave, including vacation.

1= Yes

0= No



If F1=yes, go to F2.

If F1=no, go to Module G (Demographics).





F2. Did your duties on this job require the technical expertise of a bachelor’s degree or higher in:


Yes

No

Engineering, computer science, math or the natural sciences

The social sciences

Some other field (e.g. health, business, or education)






MODULE G: DEMOGRAPHICS



G1. Did you ever attend elementary or secondary school outside of the United States? (if you ever attended elementary or secondary school in Puerto Rico, American Samoa, Guam, Micronesia, the Marshall Islands, the Northern Mariana Islands, Palau, or the Virgin Islands, please answer YES)


Yes

No






G2. When you were growing up, was English the language you spoke most often at home?


Yes

No






G3. What is your gender?


  • Male

  • Female






G4. What is your ethnicity? Check one only.


Hispanic or Latino

Not Hispanic or Latino







G5. What is your race? Check one or more.


  • American Indian or Alaska native

  • Asian

  • Black or African American

  • Native Hawaiian or other Pacific Islander

  • White






G6. Were you born in the United States?


Yes

No


If G6=yes, go to G8 (usual degree of difficulty with seeing, hearing, walking, lifting?)

If G6=no, go to G7




G7. Are you a U.S. citizen?


U.S. citizen

Permanent resident (“green card”)

Student visa or exchange visitor visa (F1 or F2, J1 or J2 visa)

Other temporary visa (e.g., H-1B, K, L, O or other visa)


Go to G8 (usual degree of difficulty with seeing, hearing, walking, lifting?)




The next question is designed to help us better understand the career paths of individuals with different physical disabilities.


G8. What is the USUAL degree of difficulty you have with: Mark one answer for each item.



None

Slight

Moderate

Severe

Unable to do

1

SEEING words or letters in ordinary newsprint (with glasses/contact lenses, if you usually wear them)

1

2

3

4

5

2

HEARING what is normally said in conversation with another person (with hearing aid, if you usually wear one)

1

2

3

4

5

3

WALKING without human or mechanical assistance or using stairs

1

2

3

4

5

4

LIFTING or carrying something as heavy as 10 pounds, such as a bag of groceries

1

2

3

4

5



If all 4 rows in G8 are marked “None,” go to Thank You screen. Otherwise go to G8a.



G8 and G8a will appear on the same page of the online survey.

G8a. What is the earliest age at which you first began experiencing any difficulties in any of these areas?


Since birth; or Enter age in years: |








CONCLUSION


Thank you! Your responses are very important to the National Science Foundation in understanding the research and career outcomes of NSF program participants. We appreciate the time you have taken to complete the survey.


The survey is now complete. You may close your internet browser or click Exit. <EXIT >


If you would like to send NSF any comments about the survey please contact:

Suzanne Plimpton at NSF (splimpto@nsf.gov) and include the OMB Control No. = xxxx-xxxx






EXIT SCREEN

If we have identified the wrong respondent or have erroneous information, display this screen and FLAG this respondent for Abt follow-up (weekly basis)


Please accept our apology.

The information you supplied suggests that you are not eligible to participate in this study or that we have reached you in error. We regret any inconvenience to you. If you have any questions about this study or you would like to make a comment, please contact one of the following individuals and include the OMB Control No. = xxxx-xxxx:

  • Dr. Carter Epstein, Study Director at Abt Associates: 1-800-XXX-XXXX or [email protected]

  • John Tsapogas, PIRE Program Evaluation Officer at the National Science Foundation: [email protected]

  • Suzanne Plimpton at NSF (splimpto@nsf.gov)


May we have permission to contact you by email in order to clarify your responses here? Answering “yes” does not obligate you to answer any questions.

 1=Yes, you may contact me. My preferred email address is: [textbox 150]

  • 0=No, please do not contact me to clarify.


Thank you very much.






Appendix E: Undergraduate Survey 2

File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
AuthorMaureen Sarna
File Modified0000-00-00
File Created2021-01-27

© 2024 OMB.report | Privacy Policy