Results from the Survey of Earned Doctorates Cognitive Interviews

ATTACHMENT 9.3

Results From the Survey of Earned
Doctorates Cognitive Interviews
December 16, 2008
Prepared by: Cindy Simko and Mireya Dominguez, National Opinion
Research Center

December 2008

Contents
Executive Summary ........................................................................................................................ 3
Background and Purpose ................................................................................................................ 3
Staffing............................................................................................................................................ 4
Recruiting and Sample Selection .................................................................................................... 5
Cognitive Interview Protocol .......................................................................................................... 7
Incentive Payments ....................................................................................................................... 11
Interviewer Training ..................................................................................................................... 11
Office of Management and Budget (OMB) and NORC‟s Internal Review Board (IRB) ............ 12
Interview Administration .............................................................................................................. 13
Analysis and Conclusions ............................................................................................................. 16

Appendices
Appendix 1: Cognitive Interview Protocol
Appendix 2: Respondent Concent Form
Appendix 3: Verbatim Notes
Appendix 4: Letters
Appendix 5: 2009 SED Survey
Appendix 6: 2010 SED Survey
Appendix 7: Respondent Screener

Executive Summary
In preparation for the 2010 Survey of Earned Doctorates (SED) questionnaire, NORC conducted
twenty cognitive interviews for the National Science Foundation. As part of the ongoing goal to
improve and refine the survey form, the NSF COTR, in conjunction with NORC, compiled a
short list of items to be tested. Those items were:

Review of current respondent consent language on the front cover of the survey
Interpretation of the term “interdisciplinary” in question A2
Wording and response categories related to the post graduation salary items
Wording for the time-to-degree questions
Reactions to the scannable form, in particular, the presence of bar codes. We used the
2009 version of the form, altering the document slightly in order to “mock up” the bar
codes such that they could be tested properly. (In its pure form, the 2009 version is not
scan-ready, and therefore does not contain bar codes).
Overall the results of the cognitive interviews yielded useful information about the items,
ultimately leading to suggestions for a few adjustments to the 2010 form prior to printing. The
major areas to be tested did not result in changes; however, additional issues came to light during
the interviews with respect to another survey item. Specifically, at Question A7, where
respondents indicated that they thought they needed to provide the exact amount in the boxes
regardless of what they owed (not just $70, 000+), NORC‟s recommendation is to shift the box
to the left so it starts directly under the final response option. The remainder of the results and
discussion can be found in the Analysis and Conclusions sections of the report.
Background and Purpose
The Survey of Earned Doctorates (SED) has been conducted annually since 1957 on behalf of
the National Science Foundation (NSF) along with the National Institutes for Health (NIH), U.S.
Department of Education, US Department of Agriculture (USDA), National Endowment for the
Humanities (NEH), and National Aeronautics and Space Administration (NASA). The survey is
conducted by NORC, and collects data on the number and characteristics of all individuals
receiving research doctoral degrees from all accredited U.S. institutions. The results of this
annual survey are used to assess characteristics and trends in doctorate education and degrees.
In preparation for the 2010 SED questionnaire, NORC conducted a series of cognitive interviews
to provide information for the 2010 survey design. The cognitive interviews were conducted in
October of 2008 at NORC‟s offices in Chicago. The schedule for this task was set such that all
recommendations could be implemented in accordance with the OMB submission deadlines. All
interviews were completed by mid-October 2008.
For authorization of this task, the NSF COTR worked closely with NORC to submit a
supplementary OMB clearance package detailing the cognitive testing task and addressing the
importance of this work in providing input for the 2010 survey. The first iteration of the 2010-

Page 3 of 165

2012 OMB clearance package was submitted to the COTR on October 1, 2008. The final report
and recommendations descriibed in this report will supplement that clearance package.
NORC‟s goal was to complete a total of 20 cognitive interviews with recent doctoral graduates,
all of whom had completed the 2008 SED form. Graduates holding interdisciplinary degrees
were purposely over-represented within the sample. The interview protocol addressed the entire
SED survey questionnaire, although certain pre-determined items were targeted for additional
probing.
Issues of particular interest to this cognitive research included:
Review of current respondent consent language on the front cover of the survey
Interpretation of the term “interdisciplinary” in question A2
Wording and response categories related to the post graduation salary items
Wording for the time-to-degree questions
Reactions to the scannable form, in particular, the presence of bar codes. We used the
2009 version of the form, altering the document slightly in order to “mock up” the bar
codes such that they could be tested properly. (In its pure form, the 2009 version is not
scan-ready, and therefore does not contain bar codes).
NORC used the 2008 SED data responses to draw the sample of potential respondents who had
graduated from Chicago area universities and/or had indicated on their 2008 SED form that they
planned to reside in the Chicagoland area post-graduation. Once the sample was drawn, NORC
began the locating and recruitment process. Recruitment involved using contact information
collected from the completed SED survey, with additional locating as needed. NORC recruited
the sample via email; it was not necessary to employ follow-up techniques such as mail and
telephone contacting. Potential respondents were asked to complete a screener survey to assist in
the selection process and, if selected, were offered a $75 incentive to participate in the
interviews. The incentive was offered in order to complete the interviews within a shorter time
span than was originally planned, as incentives are known to improve interview attendance and
reduce the need to find replacement interviewees.
Staffing
The Cognitive Interview team from NORC was composed of dedicated and experienced staff at
all levels. The team members are as follows:
Mary Hess, SED Project Director. Hess provided project oversight on the Cognitive
Interviews and served as consult during all aspects of the project.
Cindy Simko, SED Cognitive Interview Task Leader. Simko served as Task Leader and
worked closely with the NSF to draft the cognitive interview protocol and the procedures
for administration. Simko has nearly nine years of survey project management experience
and has led several cognitive testing tasks, including those for the SED and Survey of
Doctorate Recipients. She was supported by two Survey Specialists.
Lisa Lee, Senior Survey Methodologist. Lee has served as lead methodologist for NORC
Page 4 of 165

projects which have focused on methods for improving the accuracy of reporting,
development of memory aids and diaries, and assessment of response errors. She has
extensive experience in cognitive testing, questionnaire design, and survey data analysis.
For this task, Lee contributed her knowledge and expertise to the protocol draft prior to its
submission for NSF approval.
Mireya Dominguez, Survey Specialist. Dominguez has over ten years of experience at
NORC in the Central Office and as Assistant Production Manager in the Production Center.
Her experience with systems and relational databases and her knowledge of survey
research was critical to the success of this task. Her role as support to Simko included
generating e-mails files, monitoring response rates, liaising with potential respondents,
screening and scheduling respondents for interviews, conducting interviewer training,
conducting cognitive interviews and transcribing interview notes.
Lino Jimenez Jr., Survey Specialist. Jimenez was hired in June 2008 for the SED project.
Though new to NORC, he has experience in project management, questionnaire
development, and content and statistical analysis through his graduate school studies and
internship. His support role to Simko included testing video equipment, ensuring that all
necessary materials for respondent sessions were acquired and/or printed, conducting
interviewer training sessions, conducting cognitive interviews, processing respondent
payments, coordinating video transfer to DVD format and transcribing interview notes.
Additional Support Staff: Additional SED management and regular staff assisted this
project by conducting mock interviews for training, conducting actual interviews and
transcribing interview notes.
Recruiting and Sample Selection
Per NSF and Dr. Don Dillman‟s specifications, it was decided that all cognitive interview
participants would have already completed an SED survey form within the last survey cycle.
Therefore, NORC drew a sample of potential interview participants from respondents to the 2008
SED who had graduated from Chicago area universities and/or indicated on their SED form that
they planned to reside in the Chicago area post-graduation.
Because schools considered to be in the Chicago area are not easily determined by the institution
city item on the SED, and because the SED does not ask for the specific city of planned postgraduation location (rather, it asks for the state in which the respondent will reside), the sample
was defined to include schools and current addresses within 20 miles of NORC‟s downtown
Chicago location at 55 East Monroe Street. This yielded a total of 578 potential sample
members for the cognitive interviews. The sample was then divided into the following groups:
1) respondents that went to school and currently live in Chicago area post-graduation, 2)
respondents that did NOT go to school in Chicago area but planned to live or work in Chicago
area post-graduation, and 3) respondents that went to school in Illinois and lived 20 to 50 miles
from the Chicago area.
Once the final sample selection was complete, NORC focused on recruiting respondents to
participate. In order to ensure a representative sample, ten criteria were established for selecting
respondents. Furthermore, as survey respondents‟ interpretation of the term “interdisciplinary”
in question A2 was of central concern, one criterion focused on recruiting respondents who had

Page 5 of 165

indicated that their dissertation research was interdisciplinary. The remaining criteria and goals
for each respondent characteristic are listed in Table 1 below.
Table 1: Criteria Cells Goal
Criteria
Non-Whites

Goal
15

Female

10

Male

10

Foreign

5

Over 50 yrs. Old

5

Social Sciences

5

Biology/Chemistry

5

Engineering

5

Health Sciences

5

Interdisciplinary

10

NORC recruited respondents for the cognitive interviews in two email waves. The first email
wave (Batch 1) focused on respondents that went to school and planned to live post-graduation
in the Chicago area. Batch 1 consisted of 127 potential respondents. The second email wave
(Batch 2) focused on the characteristic goals of the sample that were not being met after one
week of recruiting. Batch 2 consisted of 292 potential respondents. In total, 419 respondents
were contacted to participate in the research. Details of the mailing batches can be found in
Table 2 below.

Table 2: Email Wave Breakdown
Email
Email
Wave
Sent
Respondents
Batch 1

Batch 2

9/19/08

9/26/08

127

292

Sample Group
Respondents that went to school and
currently live in Chicago area postgraduation
Respondents that did NOT go to school in
Chicago area but planned to live or work in
Chicago area post-graduation

Page 6 of 165

Focus
All
 Male
 Interdisciplinary
 50 or older
 Non-White

From the email efforts received, 43 interested respondents indicated they could come to one of
NORC‟s Chicago offices for an interview. During the first week of recruitment NORC
concentrated on filling as many characteristic fields as possible. This was completed by
emailing or calling those interested that possessed one or more of the required criteria. By the
end of the first week eight interviews had been scheduled and confirmed. During the following
week, NORC concentrated on contacting interested respondents that met one or more of the
following criteria: Males, Interdisciplinary, 50 years or older and non-whites. All 20 interviews
were scheduled by October 2, 2008. Once all of the interviews were scheduled, all other
interested respondents were contacted and asked to participate as alternates. As alternates they
provided dates and times of availability and, if their participation was needed, NORC would call
them at least one day before the desired interview time. A total of six alternates were on
standby. Only one cancellation occurred and NORC was able to get an alternate scheduled
immediately. See Table 3 for breakdown of final respondent characteristics.

X X
X X

X

X X X

X X
X

10

9

X X X 10

11

5

4

5

3

5

8

5

4

5

2

5

2

5

10

X
X X

X X

X X

X X

X

X
X

X
X

X

Engineering

X

X X

Health Sciences
Interdisciplinary

11

X
X

Over 50 yrs. Old

15

X X

X

X X

Social Sciences

X

Respondent 18
Respondent 19
Respondent 20

Respondent 11
Respondent 12
Respondent 13
Respondent 14
Respondent 15
Respondent 16
Respondent 17

X X X X X
X

X

Bio/Chemistry

X X

Actual

Foreign

X

Goal

X X X X

Female
Male

Respondent 4
Respondent 5
Respondent 6
Respondent 7
Respondent 8
Respondent 9
Respondent 10

Criteria
Non-Whites

Respondent 1
Respondent 2
Respondent 3

Table 3: Breakdown of Final Respondent Characteristics

X X

X

X X X X X X

X

Overall the recruiting efforts were successful in that a representative sample of respondents was
obtained that closely matched the goals established at the beginning of the project.
Cognitive Interview Protocol
The cognitive testing protocol was created by NORC in conjunction with NSF. NORC Senior
Methodologist Lisa Lee contributed her knowledge and expertise to the protocol draft prior to
submission for NSF approval. The protocol itself consisted of four major sections:

Page 7 of 165

Overview and introductory script
Listing of all SED survey items (text)
Follow up probes for key areas of study
Closing section
NORC reviewed the selected areas on which NSF wished to concentrate. Question item probes
and interview language were scripted in a manner that would facilitate a high level of
consistency across the 20 interviews. Lee channeled most of her efforts toward reviewing and
revising the probes to ensure the capture of meaningful data during the interview. The following
table illustrates the areas of concentration for the interviews and the justification for that
selection:

Page 8 of 165

Table 4: Areas of Concentration

Page 9 of 165

Item/Area for Cognitive Testing
Reactions to changes in the 2010 questionnaire,
which include layout changes (e.g. eliminating
the „flip out‟ page with the taxonomy of the
fields of study, changing the location of the
NSF/SRS letter to the graduates). SRS also
wants to test the reactions to the scannable
format of the questionnaire, in particular the
presence of bar codes. A mock-up version of the
2010 version of the form will be used.
Review of current respondent consent language
on the front cover of the survey

Interpretation of the term “interdisciplinary” in
question A2

Justification
The 2010 version of the survey is currently in the
final redesign phase and it is important to test
respondents‟ reactions to the questionnaire changes.

SRS wants to investigate how respondents perceive
the pledge of confidentiality in the front of the
questionnaire – particularly looking at whether the
respondents focus on the pledge when they start
responding, and whether they go back to it later on
or not – and also wants to explore respondents‟
reactions and feelings about the current pledge
when they do read it.
Interdisciplinary degrees have become more
prominent over the last few years and SRS wants to
explore respondents‟ understanding of the term
when completing the survey.

Understanding of the term “tuition remission” in
question A4

This question was slightly redesigned in recent
years by adding the word “waiver” in parenthesis.
The purpose was to further clarify the word
“remission.” The goal of including this term for
cognitive testing is to be sure that the respondents
are considering the acceptable types of remission,
meaning they understand what is and what is not
considered “tuition remission.”

Wording and response categories related to the
post-graduation salary items in questions B8 and
B9

The salary questions were cognitively tested in
2005, prior to their addition to the survey. While
the testing of this item resulted in useful
information and confirmed respondents‟
interpretation of the language, it will be helpful to
follow up on its use within the survey and affirm its
functionality and design.

Wording for the time-to-degree answers in
question A8, as well as responses to questions
A11 through A13.

The time-to-degree questions A8 and A11 through
A13 are multi-item in design. Because of the
importance of the combination of these questions to
calculate time-to-degree, it will be helpful to
confirm the layout, design, and interpretation of
these items.

Page 10 of 165

At the time the protocol, probes and scripts were being developed, NORC also generated drafts
of the consent forms and advance e-mail letters. Each respondent, as per both OMB and NORC
IRB requirement, had to sign a consent form prior to beginning the interview.
NORC received final sign off for the protocol by the COTR in August 2008, and NSF then
submitted it to OMB (See OMB and IRB section). Upon OMB approval, NORC acquired
Internal Review Board (IRB) approval and began scheduling interviews with the respondents,
with the goal of completing all testing by October 15, 2008. Interviews occurred during the day
or in the evening, based on respondent convenience, and lasted no longer than 90 minutes each.
All interviews were videotaped for documentation purposes and to assist in accuracy and notetaking. See Interview Administration section for details about these procedures.
Incentive Payments
Respondents who were selected as participants were offered a $75 incentive for their
participation in the interviews.
There are several reasons for offering this incentive. The amount was the same as was offered in
2005 when the SED conducted interviews, and it was important to ensure that we are able to
recruit participants who clearly graduated and were most likely in the workforce, presumably
with a higher salary. Additionally, due to the shortened timeline, it was necessary to ensure
participation.
Interviewer Training
To alleviate possible interviewer fatigue, a total of seven SED staff members (interviewers)
assisted in conducting the cognitive interviews: a task leader, two primary interviewers and four
supplementary interviewers. The particular interviewers were chosen because they had sufficient
knowledge of this type of research and of the SED study itself. All interviewers participated in a
multi-step training process.
NORC implemented a briefing and training session to define the expectations for the interviews
and to establish a protocol for training the interviewers. Because multiple SED team members
would be conducting interviews, it was critical that each performed mock interviews to ensure
that all were accurately prepared.
Simko led the briefing and provided the requirements for each team member. Key staff
(Dominguez and Jimenez) were considered primary interviewers and played lead roles in
recruiting and overall task management. The key requirements for conducting a cognitive
interview were:
Reviewing approved past NORC interview sessions, briefings and videos

Page 11 of 165

Understanding the elements of the interview, the role of each staff person in the
interview room, and the differences between this interaction and administering a
survey
The importance of detailed note-taking as a non-interviewer participant
Learning techniques to enhance the interview, such as language to use that keeps
the respondent talking, on track, and providing appropriate feedback without
leading him/her
Coping with „difficult‟ interviews or respondents who are less inclined to engage
Aspects of the video camera and the „checklist‟ for everything an interviewer will
need for each session (respondent background sheet, envelope with all the
necessary materials, etc).
Conducting mock interviews with the team to confirm preparedness
Participating in at least two interview observations prior to conducting his/her
own
Post-interview debriefings
Each interviewer conducted at least one actual interviews, with Simko conducting the first two as
the lead, and a combination of Simko, Jimenez, and Dominguez conducting the remainder. No
more than three researchers were in the room during an interview in order to avoid respondent
discomfort. The primary person conducted the interview, the second person worked the camera
and took notes, and the third also took notes and served as a “back-up” to the camera operator.
When interviewers who were not part of the main team were rotated in to participate in or
conduct an interview, either Simko, Dominguez, or Jimenez would not participate.

Office of Management and Budget (OMB) and NORC’s Internal Review Board (IRB)
NSF took the lead in compiling the submission to the Office of Management and Budget (OMB).
NORC supplied the NSF COTR with the final draft of the cognitive interview protocol and
consent language along with the proposed approach and timeline for data collection. Approval
was granted in August of 2008 to begin conducting this research.
Once OMB approval was granted and final documents were given sign-off, NORC submitted the
necessary paperwork to its Internal Review Board (IRB). NORC‟s IRB has the corporate
responsibility for monitoring survey procedures to ensure the confidentiality of persons and
establishments participating in a study. Before any survey may begin, a formal protocol must be
submitted to address human subject protections that include all survey materials and instruments.
The IRB meets monthly to review new protocols and substantive amendments to existing
protocols, to conduct the annual or continuing review of existing studies, and to consider
“adverse events” or incidents associated with a particular study. The proper documentation for
the SED Cognitive Interview Protocol was submitted to the IRB in September of 2008 and
promptly approved.
Page 12 of 165

Interview Administration
NORC conducted a total of 20 interviews between October 1st and October 16th. The interviews
took place in NORC‟s Hyde Park and downtown loop locations. Interviews were conducted
Monday through Friday during the day and evening and each session lasted between 30 to 90
minutes. To prevent interviewer fatigue and to allow ample time to administer the interviews,
NORC planned to schedule no more than two interviews per day. It was sometimes necessary to
revise this planned schedule in order to accommodate respondents‟ own scheduling needs.
When this occurred, interviewers and note-takers alternated roles and interviews were scheduled
in 2½ hour blocks to allow time between interviews. To assist with note transcribing, all
interviews were video taped. This ensured accuracy of information collection and also allowed
for additional data reviews as per NSF preference. To minimize respondent anxiety only two to
three interviewing staff were allowed in each session. Each session consisted of a lead
interviewer, camera operator/note taker and a third spot was reserved for a trainer or trainee to
observe.
Schedule and Preparation Activities
NORC originally expected this work to be completed in the spring/summer of 2008. The original
schedule for this work was adjusted according to the following:

Benchmark
OMB Approval
IRB Approval
Recruiting Begins
Sample Selection Begins
Cognitive Interviews
Summary of Interview Data
and Recommendation
(Internal)
Summary of Interview Data
and Recommendation (To
NSF)
Draft 1 of Methodology
Report due to NSF
Final Report Due to NSF

Date
August 2008
September 2008
September 19, 2008
September 23, 2008
October 1-October 16, 2008
October 31, 2008

November 2008

November 14, 2008
November 26, 2008

The main preparation activities were related to the development of the materials (protocol,
recruitment letters, etc) along with the sample file generation. The original sample files were
drawn in May of 2008, however a secondary set, which included additional eligible respondents,
were redrawn in September of 2008. Review of these files was a critical step in creating a
meaningful and representative sample of interview respondents.

Page 13 of 165

Additional preparation activities included creating the telephone and interview scripts that were
to be used contacting respondents and during the interview process. The screener/background
information form and tables summarizing the respondent characteristics were critical for
ensuring that goals were met relating to sample characteristics.
Respondent Contacting
Using letters drafted by NORC and NSF, respondents were contacted via email (See Appendix
4). The letter stated the purpose, benefits of participation, timeframe, and scheduling
information. The email was sent from the SED project mailbox ([email protected]) on behalf
of Cynthia Simko, Senior Survey Director. The respondents were asked to express interest
through email or the SED toll free line. Each potential respondent was sent only one invitation
to participate. Invitations were sent out on September 19, 2008, to 172 respondents and on
September 26, 2008, to 292 respondents. NORC received many inquiries in response to the
invitation but only 43 individuals indicated they could complete the interview at one our Chicago
offices. Most respondents contacted NORC via email rather than the toll-free number; fewer
than five calls were received on the SED toll-free line with inquiries about the cognitive
interviews. Each email NORC received was followed-up by a response email or call if a phone
number was provided. The follow-up emails and calls were tailored to address each of the
respondent‟s questions or concerns. If the respondent was interested in participating s/he was
asked to provide a phone number in order to confirm their background information and schedule
them into an interview. If the respondent provided a date and time through email they were
emailed a background sheet (Appendix 7) asking to provide background information and their
mailing address. Once all this information was confirmed the respondent was emailed a
confirmation e-mail with their interview time and directions.
Administration
Interview administration began on October 1, 2008. Each interview session was divided into
three parts: consent form completion, contact information confirmation, and the administration
of the Cognitive Interview Protocol.
Before the interview began and the camera was turned on to start recording, the respondent was
informed of their rights as a research participant. They were provided with an Informed Consent
form to read and sign prior to beginning the interview. Both the respondent and the interviewer
were required to sign the document. At this time the respondent was also asked to confirm
his/her mailing address and informed that his/her incentive for participation would be mailed by
the end of the month. It was important that all this was done prior to taping in order to preserve
the respondent‟s anonymity.
Next, the camera was turned on and the lead interviewer began the session by giving the
respondent an overview of the session and the expectations of him/her as a respondent. S/he was
introduced to the concept of thinking aloud and asked to participate in a think aloud exercise.
The interviewer closely followed the protocol script as this process continued in order to ensure
uniform administration across all interviews.

Page 14 of 165

The respondent, as per the protocol, was given an envelope of materials that contained what s/he
would expect to see if mailed the SED form. It included: a letter, the SED 2009 questionnaire, a
business reply envelope, a SED Purpose and Use brochure. The respondent was then asked to
give his/her overall impression of the envelope and its contents.
Once s/he was finished giving his/her overall impression, s/he was then asked to complete the
SED 2009 questionnaire. The interviewer instructed the respondent to complete the
questionnaire as s/he would at home, but think aloud, describing how s/he was coming to an
answer. That is, the respondent was asked to verbalize the initial thoughts and reactions to each
question as s/he was completing the questionnaire. During this section of the session, the lead
interviewer would probe to clarify a response or non-verbal reaction/body language given off to
a question. If the respondent did not make any verbal comments, the lead interviewer prompted
him/her to think aloud.
Once the respondent completed the questionnaire, the lead interviewer followed-up on key
sections with a series of scripted probes. The specific items/issues that were probed (as
described in the Cognitive Interview Protocol section) included:
Consent Language
Question A2 – Interdisciplinary
Question A4 – Remission
Question A8 – Time to Degree
Question B8 – Salary Response Categories
Finally, the respondent was asked to review and provide reactions to a new questionnaire format
(2010 SED form). The respondent was informed that all questions were exactly the same and
s/he only needed to supply feedback on the layout of the survey form. Each respondent was
asked to give an initial reaction without referencing the previous questionnaire. This was
followed by an exercise that requested input by comparing the questionnaires page by page, and
then followed by a series of probes on the changes made to the 2010 questionnaire.

Page 15 of 165

Data Review and Documentation
An important part of the cognitive interview process was the thorough review of the notes from
each interview. At the end of each session, the three key members of the interview team would
submit their notes to be transcribed, pulled together into one document, and organized by item
and respondent ID. A full master document of all comments made by respondents was then
compiled for later review once all interviews had been completed.
Once the detailed notes were transcribed and organized by question item and respondent ID,
NORC began the detailed review process. Major themes, particularly those associated with the
key research areas, were summarized in an easy to read table. Additional areas that came to light
during the interviews were also highlighted for possible examination at a later time.
Once all of this information was compiled into a summary document, SED PD Hess, APD
Latter, and Webber met with Simko to discuss the major themes and prepare for
recommendations and next steps.
Analysis and Conclusions
The following section describes the areas that were tested, along with the major themes based on
review and analysis of the respondents‟ feedback and responses to the probes. Additional issues
not related to the key areas tested are also included. These issues were documented because they
appeared with enough regularity to warrant an acknowledgement and, perhaps, future cognitive
testing.
Major findings
The following table details the tested items/areas along with the summary of reactions. NORC
has also provided additional information in the “NORC Recommendations column” that reports
the justification for actions taken or not taken, along with historic data pertinent to any potential
change. Kristy Webber has supplied information for items that have been examined in past SED
cycles. Additionally, several issues studied warrant further discussion with the NSF COTR,
researchers, and NORC staff prior to making changes to the 2010 form. In some instances these
items may be candidates for future cognitive research.
Table 5: Summary of Findings and Recommendations
Item/Area for Cognitive
Testing
Reactions to changes in
the 2010 questionnaire,
which include layout
changes (e.g. eliminating
the „flip out‟ page with
the taxonomy of the
fields of study, changing
the location of the

Overall Theme/Respondent Reaction(s)
Overall respondents seemed to prefer the 2010
version. They appeared to like the new layout,
as well as the coloring. However, while they
didn‟t like the 2009 version‟s „flip-out‟ page,
they didn‟t like the location of the 2010
version. Their preference was that the 2010
version stay as is, however move the field of
study list to the end (although not as a flip-out

Page 16 of 165

NORC Recommendation
No change. Due to printing
requirements, the FOS list must be the
center-most pages of the questionnaire.

Item/Area for Cognitive
Testing
NSF/SRS letter to the
graduates). SRS also
wants to test the
reactions to the
scannable format of the
questionnaire, in
particular the presence
of bar codes. A mock-up
version of the 2010
version of the form will
be used.
Review of current
respondent consent
language on the front
cover of the survey

Interpretation of the term
“interdisciplinary” in
question A2

Understanding of the
term “tuition remission”
in question A4

Wording and response
categories related to the
post-graduation salary
items in questions B8
and B9

Overall Theme/Respondent Reaction(s)

NORC Recommendation

page). The new version had less additional
question response space on the back which
respondents preferred (Overall, respondents
felt that ANY additional questions on the back
made them feel that they weren‟t finished with
the survey). When asked about the scanning
marks, etc., no one stated they were concerned
about confidentiality.

Nearly all respondents did not read any of the
consent language prior to beginning the
survey. When probed further after they
completed the form, most felt the two
paragraphs were important but probably
would not be read very often. They felt that it
was a lot of necessary “legal jargon.”
Regarding the Social Security Number (SSN),
in reference to it being voluntary, respondents
indicated that they would like to see this stated
next to the question (C15).

NORC suggests maintaining the current
consent language, as it offers a clear
description and legalese necessary
information regarding the Social
Security Number. However, NORC
thinks a further discussion is needed
prior to including the voluntary
reference at C15. Because of the critical
nature of the SSN information for
deduplification and identification,
reiterating that this is voluntary could
result in a lower response rate for this
item.

Respondents to this question in some cases
seemed to think we were asking about their
RESEARCH rather than their DEGREE (or
vice versa). Those who had interdisciplinary
degrees seemed to have more difficulty in
determining which was their primary field of
study (vs. secondary) at question A2 because
they felt both were equally primary. Some
respondents who knew they were not going to
be able to find their correct FOS would look
up the field that best described it and then
write that as the description. This could
become problematic for emerging fields.

No recommendation at this time.

Respondents for the most part weren‟t able to
come up with a good rephrasing of this
question and/or another term for the word
“remission.” They felt that “waiver” best
described and in some cases defined it for
them.

This item doesn‟t appear to need any
edits, as respondents felt that the word
“waiver” assisted in defining the term
“remission.”

Nearly all respondents did not realize that they
could provide their salary via ranges rather
than exact amounts. They would supply the
information and then realize they could have
just selected a response. Didn‟t seem to have
any concerns about providing this info though.
People who were working part-time had a
hard time providing this information because
it was not reflective of what someone with

No change. The salary experiment
conducted during the 2008 round found
that respondents who were presented
with both options (fill-in and ranges)
responded at a higher rate than those
printed with either option on its own.

Page 17 of 165

Item/Area for Cognitive
Testing

Overall Theme/Respondent Reaction(s)

NORC Recommendation

their degree could make. All thought that
annually was the best way, perhaps hourly for
part-timers. One respondent had two part time
jobs and felt only giving info on the one
would seem inadequate.
Wording for the time-todegree answers in
question A8, as well as
responses to questions
A11 through A13.

Additional Item/Issue:
Question B (entire
series)
Question A5

Question A7

Question A9

Questions C3, B10, C3,
A6

Instructions

The major comment at this section was that
respondents felt it was redundant with the
items they completed on the front cover and
the field of study they provided in A2.
People who completed their MA/MS as part
of the doctorate degree had a hard time
referencing when they started and received
their MA/MS. This question was also
difficult for respondents who completed their
degrees at multiple schools and/or started and
stopped for periods of time. For example,
some were uncomfortable stating when they
began a degree because it would appear that
they took an extremely long time to complete
since they could not provide the info that they
had stopped and started. At A12, for those that
were completing coursework and dissertation
concurrently, they had a difficult time
breaking up the time for each phase.

No change. The data collected on the
front cover that is also asked in A8
(institution name and graduate date) is
used for administrative purposes and
should be maintained. Removing these
two options from A8 would disturb the
order and symmetry of that question.

Some respondents (approximately more than
half) answered B5 when they were not
supposed to – they didn‟t follow the skip
pattern.

No recommendation at this time.

Some respondents were stumped as to what
this meant. Some thought it meant „how‟ they
paid for school, while others thought it
referred to how they supported themselves in
school. Also, approximately half of the people
marked “yes” for those responses that applied
but left the rest blank instead of marking “no”
where appropriate.

This item may be worthy of further
discussion and future cognitive testing in
upcoming SED cycles.

People thought that they should be providing
the exact amount in the boxes regardless of
what they owed (not just $70, 000+).

Shift the specify box to the left so it
starts directly under the final response
option.

Respondents had a problem understanding
what “post-secondary” degrees were. Some
thought they meant anything after a bachelors
or masters.

No recommendation at this time.

Because all the boxes don‟t line up with the
other response categories (for “mark an „x‟”),
respondents would often miss that “mark an
x” option.

No change. The “mark an „x‟” option
has been moved to several different
locations for these questions throughout
the past several rounds, to no discernable
difference.

Because the instructions in the 2009 version

This item does not appear to be critical

Page 18 of 165

Item/Area for Cognitive
Testing

Question B10

Overall Theme/Respondent Reaction(s)

NORC Recommendation

are on the second page, people do not know to
print or whether to use pen or pencil or either.

and NORC does not have suggestions at
this time.

Respondents had a problem understanding
what “professional services to individuals”
meant. They related to professional services
but not necessarily to the “to individuals”
portion.

No recommendation at this time.

Page 19 of 165

SED 2008 Cognitive Interview Instructions
During this interview, I am going to ask you to complete a questionnaire and answer
some follow up questions. As you complete the questionnaire, I would like you to try to
think aloud and verbally share your thoughts and reactions; please try not to censor your
thoughts. Please feel free to share all of your opinions and questions about what you are
seeing. One of the things I am most interested in is how you are deciding which answer
to select. I am going to take notes and will try to respond to your questions when we are
finished. When you complete survey, I may ask you to go back to certain items that I
would like more information about.
Before we begin, I’d like to go through an exercise to help familiarize you with what I
mean by “think aloud”. [PAUSE] Try to visualize the place where you live. Now, think
about how many windows there are in that place. [PAUSE] As you count up the
windows, tell me what you are seeing and thinking about.
[AFTER PARTICPANT RESPONDS]
That’s an example of what I would like you to try and do as you read through the survey.
Do you have any questions before we begin?
[HAND PARTICIPANT THE ENVELOPE]
In this envelope you will find a questionnaire and a pencil. The letter and brochure will
provide some background information on the survey. I would like you to take out the
questionnaire. Beginning with the first page, please complete the questionnaire using the
pencil provided. Please remember to tell me what you are thinking about as you respond
to each question. Please feel free to share all comments with me.

[BEGIN COGNITIVE INTERVIEW AND PROBES]

Page 20 of 165

Protocol – Survey Items and Probes
[INTERVIEWER: NOTE THAT PROBES BEGIN ON PAGE 6 OF THIS DOCUMENT]

Cover Page:
i.
ii.
iii.

Name, institution, graduation information
Confidentiality/Consent Statement
Bar codes/scanning layout

Instructions:
Part A – Education:
A1. What is the title of your dissertation?
A2. Please write the name of the primary field of your dissertation research.
A3. Please name the department of the university that supervised your doctoral studies.
A4. If you received full or partial tuition remission (waiver) for your doctoral studies,
was it…
A5. Which of the following were sources of financial support during graduate school?
A6. Which TWO sources listed at A5 provided the most support?
A7.When you receive your doctoral degree, how much money will you owe that is
directly related to you undergraduate and graduate education?
A8.a. Have you received a degree of this type?
A8.b. Month/year degree granted
A8.c. Month/year that you started your degree
A8.d. Primary field of study
A8.e. Field number from list on p.7
A8.f. Institution name
A8.g. Branch or city
A8.h. State or province
A8.i. Country
A9. Excluding those above, have you attained any additional postsecondary degrees?
A10. Was a master’s degree a prerequisite for admission to your doctoral program?
A11. In what month and year did you first enter graduate in any program or capacity?
A12. How many years were you (a) taking courses…, (b) working on your
dissertation…?
A13. Was there any time from the year you entered your doctoral program and the award
of your doctorate that you were not working on your degree…?
A14. Did you earn college credit from a community or two year college?
A15. Are you earning or have you earned an MD or a DDS?

Page 21 of 165

Part B- Post-graduation Plans:
B1.In what country or state do you intend to live after graduation?
B2. Do you intend to take a “postdoc” position?
B3. What is the status of your postgraduate plans?
B4. What best describes your postgraduate plans?
B5. What will be the main source of financial support for your “postdoc”or further
training within the next year?
B6. What type of principal employer will you be working for in the next year?
B7. Please name the organization and geographic location where you will work or study.
B8. What will be your basic annual salary for this principal job?
B9. How many months does this salary cover?
B10. What will be your primary and secondary work activities?

Part C- Background Information:
C1. Are you [male/female]
C2. What is your marital status?
C3. Not including yourself or your spouse/partner, how many dependents do you have?
C4. What is the highest educational attainment of your mother and father?
C5. What is your place of birth?
C6. What is your date of birth?
C7. What is your citizenship status?
C8. Of which country are you a citizen?
C9. In what state or country was the high school/secondary school
C10. Are you a person with a disability?
C11. Which of the following categories describes your disability?
C12. Are you Hispanic or Latino?
C13. Which of the following best describes your Hispanic origin or descent?
C14. What is your racial background?
C15. Please fill in the last 4 digits of your social security number.
C16. In case we need to clarify some of the information you have provided, please list an
email address and telephone number where you can be reached.
C17. Please provide your address and the name and address of a person who is likely….
Back page:
Additions to Questions [A2 and A9]
Comments about the survey
Bar Codes and Survey Design

Page 22 of 165

PROBES
ii. Probes - Consent language:
[If respondent doesn’t appear to read the consent language]. I would like you to take
a moment to locate the bottom two paragraphs on the front cover of the survey.
1. Did you read these two paragraphs before you started responding to the survey?
Why/Why not?
If not--[Give respondent time to read]
2. Using your own words, can you please summarize what the first paragraph is
saying?
3. What was your initial reaction to these paragraphs when you read them for the
first time?
4. Do you feel that the wording of the first paragraph explains fully the way in
which the information you provide will be used?
5. Do you feel that the information you provide will be secure and remain
confidential?
6. Do you have any concerns about providing the last 4 digits of your social security
number?

A2 Probes - Interdisciplinary:
I would like to ask you a couple of questions about question A2.
1. Please describe your thought process as you answered this question.
2. Using your own words, could you please tell me the definition of
“interdisciplinary?”
3. Do you think the term interdisciplinary will be clear to graduating doctoral
students?
4. Was your dissertation research interdisciplinary? [If ‘YES’, continue]
5. Do you feel this question is worded such that it can easily accommodate
respondents whose dissertations research was interdisciplinary?
6. What are your thoughts on the instructions in italics? Did you notice them? Are
they clear?

Page 23 of 165

A4. Probes - Remission:
1. Please take a look at this question and rephrase it using your own words.
2. What is your understanding of the word “remission”?
3. Is there another synonym that you can think of that may be more clear and has the
same meaning as “remission?”
4. As you were answering this question, what were your thoughts on what would be
considered a “tuition remission”?

A8. Probes - Time to Degree:
Please look at the series of questions at A8.
1. What were your initial thoughts and impressions as you completed this question?
2. What are your thoughts of the layout for this question? Do you have any
suggestions?
3. Please tell me your thought process as you answered question item A8c. How
comfortable did you feel recollecting the month and year that you started each
degree?
4.

Further down the page at question A11, please tell me your thought process as
you answered this question. [INTERVIEWER: Ask the same probe for
questions A12 and A13].

Page 24 of 165

B8 Probes - Salary response categories:
I would like to ask you a couple of follow up questions regarding question B8.
1. How do you feel about providing your salary information? How comfortable are
you about sharing it?
2. This question offers two ways to report your salary. When answering this
question, did you provide the exact salary amount, or select a range? Why?
3. Do you feel there is a more convenient way to report salary information? [Probe
more if needed: Hourly? Weekly? Bi-monthly? Monthly? Etc.?]
4. Think back to when you were filling out the SED questionnaire at the time of
your graduation. Do you recall whether you were negotiating offers at that time?
[If YES]: Since you were negotiating between different offers, how do
you think you would have answered this question?
5. What do you think the question is referring to when it says “basic annual salary?”
[Try to get an idea of what they may have included when they thought about
their total – are they including just salary or other parts of their package?]
6. In thinking about the salary you had in mind when you answered this question,
where were you drawing your information from? [Try to get an idea of what the
source of the knowledge is. Is it a contract, verbal agreement, something they
saw online or talked about with friends, a guess?]

Page 25 of 165

Survey Layout Probes - Reactions to Scannable Form and New Design:
Now I would like to ask you about the layout of the questionnaire.
1. Overall, what was your initial impression regarding the layout?
2. [Ask respondent to look at both designs of the form] Comparing both forms
page by page, please tell us your thoughts as you flip through each.
3. [If needed] How do you feel about the newer design for the “flip out” page of
degree types? Which do you feel is more convenient?
4. When you were completing the survey, did you notice the bar code and the
scanning marks?
a. [If R noticed the marks] What do you think the markings are for?
Did you have any thoughts about these markings while completing the
survey?
b. [If R did not notice the marks] Now that you are aware of the markings,
What do you think the markings are for? Do you have any thoughts about
the survey because of these markings?
5. What is your overall understanding of the scanning process?
6. [If R mentions any concern about confidentiality in relation to scanning] Do you
feel data are more or less confidential and secure if they are scanned into a
database?

Page 26 of 165

STATEMENT OF INFORMED CONSENT
Survey of Earned Doctorates – Cognitive Interviews

The National Opinion Research Center (NORC) is conducting a series of cognitive
interviews for the Survey of Earned Doctorates (SED) on behalf of the National Science
Foundation and its sponsors, the National Institutes of Health, the U.S. Department of
Education, the National Endowment for the Humanities, the U.S. Department of
Agriculture, and the National Aeronautics and Space Administration. The procedures and
content of this research have been approved by the U.S. Office of Management and
Budget. By participating in this study, you are assisting us in the revision of our primary
research instrument for the 2010 academic year. Please read the statements below
carefully.

CONFIDENTIALITY
This information is solicited under the authority of the National Science Foundation Act
of 1950, as amended. All information collected will be confidential and used only for the
purpose of evaluating the SED survey questionnaire. Your identifying information will
be removed from any results or reports of data. We want to assure you that anything you
tell us or any information that you give us will not be attributed to you individually. The
information will only be shared with the research team. We consider the information you
choose to share with us personal and confidential. You have the right to refuse to answer
any question, and to refuse to participate. However, we expect the outcome of this survey
to benefit you in that the results will be used to improve the quality of the data that NSF
reports about doctorate recipients.
PROCEDURES
NORC will interview you at its Chicago facilities. You will be asked to complete a
videotaped think aloud session, where you will complete the paper-and-pencil
questionnaire, and then answer follow up questions about your thought processes and
experiences during this exercise. The interview will take no more than 90 minutes of your
time and is completely voluntary.
We would like to audio/video tape this interview. Audio/videotape recording is used to
allow the researcher(s) to record and analyze data at a level of accuracy and detail that is
otherwise unattainable. Audio/videotape recording the session will allow us to focus on
the interview, rather than on taking notes, which enhances the productivity of the session.
If at any time during our interview you should feel uncomfortable, you are under no
obligation to stay, and are entirely free to leave.

Page 27 of 165

RISKS AND BENEFITS
This survey will take no more than 90 minutes of your time. You are free to refrain from
answering any one of the questions, and you may stop the interview at any time. Failure
to provide some or all of the requested information will not in any way adversely affect
you.
As a token of our appreciation, upon completion of the entire interview, you will be paid
$75.00 in the form of a personal check to be mailed to an address which you provide. If
you have questions about your rights as a study participant, you may call Kathleen Parks,
the NORC IRB Administrator, toll free, at 866-309-0542.

_________________________________
Interviewer

____________________
Date

PARTICIPANT STATEMENT
I understand that this session will be videotaped and that it is completely confidential. I
have had an opportunity to ask questions about my rights as a participant before I signed
this form. I also understand that any further questions I have about this study or about my
rights will be answered by the interviewer named above.

_________________________________
Participant

Page 28 of 165

____________________
Date

Appendix 3 – Verbatim Notes
Overall Impressions of Letter and Cover Page
Start from the beginning here. The letter. It obviously congratulates you on completing your doctorate. A pat
on the back. At first glance it looks like this is survey for people who earn doctorates So basically that is so
you will be completing on the information about your doctorate. As I read on here the results are used by the
government. So obviously this is tied to some sort of government grant. Which they are trying to find
information on people who have doctorates. And how they achieve that goal. The website is clear here in
terms of using the survey and the pin number and password so you can get online to complete the survey.
Which I appreciated instead of filling in the paper and pen. It says here it is convenient and that is true.
Instead of writing in and sending it later. Everything here is self explanatory. It says that you are tied to the
University of Chicago and everyone is familiar with that understand that the University of Chicago does a lot of
research. This is going to be useful in using the information.
The following piece has information about the purpose and use of the survey. It obviously states what it is
going to be used for it describes a variety of publication here It is also discusses who this info is used for and
are the questions being used for. So this information in this brochure is helpful in being able to understand
who it is targeted for and who should be able to use once it is finally completed going to use it. I also like the
fact that it list all the different organizations tied to this. So you understand that this is not just a company
trying to get your information. So it is tied into familiar to national organizations for research.

R1

The first time I received it was in my graduate school package and I set it aside to complete whenever I get to
it. Then I looked and previewed that information and saw the questions that [were being asked].
CINDY SIMKO: Is there anything else then before you start completing the survey?

Reaction to Letter

That‟s about it except for the fact like I said, when I first got it I did not have time and I did not want to look at
and it was tied to a package that I thought was for something else. I don‟t remember being this letter being in
the package. If this package was in here with the letter talking about the website, I might have spent more
time looking at it. I would have jumped to the website.
Important to include university upfront so you can identify the people. Obviously their names are there so you
can identify what institution they came from and then that definitely their degree so that you put all the Ed Doc
and PHD and you can have that up front. And the date is obviously important in case some one gets this
survey and they received their degree 3 year ago

Cover Page - i
Cover Page - ii N/A
Cover Page - iii
Instructions

Page 29 of 165

In general don‟t like surveys but I was thinking it is for my PHD which I am very proud of so I guess I have to

R2

Reaction to Letter take it.
Cover Page - i Degree granted date is 12/07 even though my actual graduation was 05/08.
Cover Page - ii
Cover Page - iii
Instructions On front page before beginning questionnaire, asked if he should use pencil or pen.
R opens questionnaire packet. Reads cover letter. R says, “I would think this is a waste of paper, because
this can be found online.”
R continues to read cover letter.

R3

R reads purpose and use brochure. R says, “I still feel like with all the information about the survey, I still feel

Reaction to Letter they don‟t tell you how the data will be used.” “Like they‟re going to use it for planning. Planning for what?”
Cover Page - i
Cover Page - ii Did not read
Cover Page - iii
Instructions
I would read letter and preview summary report and contents of envelop. I would flip though the questionnaire
before I answer it.
Seems like a lot of stuff. I saw the brochure but I did not read it. Seems extra. I would keep the letter and

R4

Reaction to Letter questionnaire and place on the table and get to it when I have time. I would rather complete it online.
Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions Before beginning Page 2 of questionnaire - Spaces for everything - Looks pretty easy to answer

Reaction to Letter

R5
Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions

The respondent begins by reading the letter and comments that it is straight forward. He also notes that he
likes the choice of doing the survey online or on paper. In addition he comments that it is good to know
recipients of the data, referring to the various government agency logos, and says that he recognizes them.
Also he says that the congratulatory statement is nice as well as the history of the survey. He then puts aside
the letter and quickly looks over brochure. He explains, “I usually breeze through brochures.”
He begins to fill in the box, remarking that it “feels like standardized test” and that it is “pretty self-explanatory.”
In addition he says that “It is good to have ID info on front.” He neglects to read the bottom paragraphs before
opening the survey.

Page 30 of 165

Reaction to Letter

R6

Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions

Nice to know they are trying to assess graduate programs somewhat by doing a survey after people finish their
degrees. It‟s great that the details are all here in terms of links and pin s and passwords. I would have liked it
better if it was emailed to me so I could have accessed it whenever and not worry about loosing this piece of
paper. Online would have been a lot better.
I am dreading it. It does look like a census form. It does not look too hard to do. I would have like to have
essay type things. There is a comment section.
I am wondering if what all the different agencies are.

Letter:
Language is clear, the letter is fine, the only question is whether I want to take the time to do it.
Brochure:

R7

The print is not easy for me to read, and I think other older respondents will also have trouble. I would just

Reaction to Letter skim this probably
Cover Page - i
Cover Page - ii Font is too small.
Cover Page - iii
Instructions
R – Reads cover letter.
This looks kind of long to read. Usually when you get a letter that is soliciting your participation, and that isn‟t
required, the fewer amount of words that are used to give somebody an initial idea of what it is you want from
them would be more useful than seeing a page with a lot of writing. It can turn somebody off right away, or
when they‟re going through the mail, they might think, “I‟ll get to this later.”

R8

It‟s nice to know that you can go online to complete the questionnaire. For a lot of people it would be pretty
convenient.
I do have a comment on aesthetic value. Everything is kind of blending-in in terms of color. If you could use
different colors so that the text could stand out it would be easier to look at the design. Just at initial glance, it
looks like there‟s a lot crammed. It looks like useful information. But it looks like there‟s a lot to read through.
I don‟t really have any major comments or reactions to the cover page, it seems like this is the first bit of
information to be filled up. It‟s helpful that this area is a different color and stands out.

Reaction to Letter It‟s nice that the font is big. It looks easy to navigate.

Page 31 of 165

R begins writing information.
Interviewer – “Any more thoughts on the cover page.” I was a little bit confused by cross reference, but it goes
on to say birth name or former name if legally changed. Of date degree granted, this title or indication is really
far off to the right. It would be easy to see this big open space and think that there‟s nothing else to fill out.
Like I said before, I like that the heading in this section is in capital letters and in really large font.

Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions
Taking items out of envelope: “I am very thorough about this; sometimes people leave things in there. I
always look at the back, I am always really careful to try and read everything; it looks legitimate. I try to read
everything carefully; I always look at the backs of letters. I like surveys I think they‟re fun to fill out.”

R9

Looking at brochure: “This whole idea is interesting, it‟s amazing how many people and organizations use
this.”

Reaction to Letter Flips through entire questionnaire to see “how long it is.”
Cover Page - i “This is straightforward; I assume the second line is for maiden name.”
Cover Page - ii
Cover Page - iii
Instructions

Page 32 of 165

So, if I got this in the mail, I‟d wonder if it were some kind of advertising for some educational program for U of
C. I have not heard of NORC, it doesn‟t tell me what it is. It also has an address of 1N State Street so it
makes me think that it‟s not really U of C. So it would make me think that this was some sort of advertising.
I‟d see that it was a survey. I would take note of this [brochure].
R reads cover letter.
X – If we could focus on your thoughts and reactions.
Seems worthwhile and legitimate. This is being conducted by the NSF so it seems like a legitimate purpose.
So it‟s not just some sort of marketing. It‟s something I would do if it didn‟t seem too long. The purpose of the
survey would be something I would be interested in participating in.
I‟m not sure if I would look at [purpose and use] too much because the cover letter told me what was in it.
R reviews survey. Says it looks like pretty straight forward. If she thought it would take more time, she would
do it online. But it looks like it might not seem too hard to complete. Just looking at it, it looks like it would take
15 minutes. Again I would probably start on paper. If there was too much writing involved, I‟d complete it
online.

R10

Reaction to Letter R begins to fill survey.

Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions

Reaction to Letter

R11
Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions

So, birth name, I actually had a former name that was legally changed. My master‟s degree was in this other
name, so I‟d write it down. Interviewer asks the question of respondent‟s name cross referenced name. The
front cover. No, sometimes I wonder, “why do you want to know that?” If I couldn‟t think of reason of why you
would want to know that. But I thought maybe they‟re going to check into my other degrees. My degree I got
was under this name. In general for things like this, as I said before, this whole thing seems legitimate. When
I get surveys in the mail, I think “do they need this information.” That‟s why there was a little bit of hesitation.

After reading the letter, he voiced that he was curious how this information helps students. “I try to see the long
term benefits of research even if they don‟t benefit the subject other than the check that they will be getting.”
He does not read confidentiality statement. Initially upon opening the survey he says, “There are a lot of
questions.” He wonders how long it will take him.
Initially he wondered how long it would take him to get through the survey. He thought it looked like it would
take a long time. “It wasn‟t frustration, it was just like „it‟s probably going to take me a little while to get through
this‟.”

Page 33 of 165

R12

Reaction to Letter
Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions

The interviewee reads the letter. He comments that he understands the information is used in the private and
public sectors. He believes that the information will assist universities in finding the strengths and weaknesses
in graduate schooling. “I guess it is for diversity ladders as well,” he hypothesizes.
He skips reading the brochure.
He flips through the survey, in which he recognizes questions that he assumed would be asked based on what
he read in the letter. He also comments that it looks like typical demographic information.
He did not read the confidentiality statement on the cover page.

x- So what are your thoughts as you‟re going through the letter?
R- I see that the letter is from NORC, and this is an organization that I recognize. And the NSF and other
federal agencies are mentioned. So this strikes me as a thing that has credibility and is important.
So, it‟s not asking much of me, and I would like to offer my responses because it seems the purpose is a good
one.
R opens and looks at questionnaire.
So it looks like it‟s just asking for routine information about my PhD program that I completed.

R13

What is being asked is straight forward. And I have the sense I can give fairly accurate responses.
x- Whenever you‟re ready, if you can start the survey.

Reaction to Letter
Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions
Letter:
I hadn‟t even known that something like this was going on for 50 years. If I would have read this letter I would
have just proceeded.

R14
Reaction to Letter
Cover Page - i
Cover Page - ii

Brochure:
It‟s good that the government is doing something like this in order to improve the doctorate degrees granted in
the country.

Page 34 of 165

Cover Page - iii
Instructions

R15

Reaction to Letter

Looks like its something I am supposed to return. It looks like a survey, I have written surveys before and I
would check it out to see if I think it is a well designed survey and I think it is. It‟s very clear. I wonder, “what is
the survey of earned doctorates” and I would read this [letter] to find out what this is what it is about and who
sent it to me. NSF that is reputable and five other agencies. Sound like it‟s a survey that has some weight
and importance. I am always skeptical about filling things out. I would most likely do it online. Sounds
something typical of the University of Chicago to be involved in. I know about NORC. I would look over
pamphlet quickly …repetitive. Impressive list of organizations that are involved in the survey. Important
organizations will be interpreting that data they get. I am from Washington DC and I know organizations quite
well.
This is all information that I presume they have about me. It‟s annoying to have to fill it out. Online would be a

Cover Page - i lot quicker.
Cover Page - ii
Cover Page - iii
Instructions
First thing I‟d do is open it and get an idea of what‟s in here. Then I‟d probably read the letter because if I
didn‟t fill this out earlier, I would have no idea what this was. And I‟d go through there.

R16

Reaction to Letter I would, in all honesty, would through that aside [referring to the purpose and use brochure].
Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions

Reaction to Letter

R17

Letter: I would know being a graduate student at the University of Chicago that is a survey because it‟s from
NORC. I would open immediately and look at the contents. I would skim the letter quickly and set it aside until
I had time to fill it out because it would take a while. Your surveys tend to be large.
I would have to admit that would be little annoyed at first because surveys are a pain in the butt but as a
researcher I know the importance of survey so out of sense of duty and obligation I would fill it out.
I like that it has plenty of room for my very long name. I don‟t have any idea what cross reference is. I know

Cover Page - i that is applies to most schools not just the U of C but U of C does not have branches so that is kind of weird.
Cover Page - ii
Cover Page - iii
Instructions Reads Instructions

Page 35 of 165

R18

Reaction to Letter

The respondent comments that he had to complete the survey for graduation and admits that he probably
would not have completed it otherwise. After reading the letter he says that he would likely choose to complete
the survey online rather than on paper. He skips reading the brochure and picks up the survey. He expresses
concern about providing his personal information on the front page and feels that the survey would be better if
it were anonymous.

Cover Page - i He doesn‟t remember the date of graduation. “I‟m going to say June of last year.”
Cover Page - ii
Cover Page - iii
Instructions
Letter: Big envelope probably important. Usually when a letter is attached, I start skimming letter and then go
through whatever attachments are there and then go back to the letter. From here since It‟s asking to go on
the web, I could probably go on the web and do the survey there.

R19

R20

Reaction to Letter Brochure: Gives some information about the survey and the department.
Cover Page - i Simple. Fill in the blank.
Cover Page - ii
Cover Page - iii
Instructions

Reaction to Letter
Cover Page - i
Cover Page - ii
Cover Page - iii
Instructions

Look at introductory pamphlet here: about what the survey is for …education history, source of support, plans
after graduation. Doctorate records file, which lives where? 1920 to present - that is while. Purposes are
policy and statistics. Various agencies that use that. Congress comes up again.

Page 36 of 165

Part A- Education

A1

A2

R1

A3
A4
A5
A6
A7

A8-a

R1: A lot of people have these long titles so they don‟t have enough information here to fill that out X
CS: Enough space you mean to fill it out?
R1: Yeah
R1: So for that reason the online situation would work better.
CS: Because of the spacing issue?
R1: Umm Hmm
R1: That is redundant…to me it is. I have already listed field above and now I have to page 7 and find the field. I
found that when I went to page 7 to find the field under education, If I remember correctly I am searching for
technology and I think I ended up saying other because I am still doing done the list…here we it says education
instructional media design but that does not necessary mean
R1: This is Education Technology Research and Assessment and I can‟t fill that in.
CS: Is that for spacing
R1: Yes
CS: If you were to choose would put that in the technology field or education to start?
R1: It‟s a combined department…Its hard to put in the description area for primary field. Educational technology or
Instructional technology should be a title under education.
N/A
R1: Mainly had fellowship, no loans, personal savings
That is easy…Personal saving is primary and fellowship secondary
R1: That is easy…how much you owe…none…I hope not.
R1: So you are asking her if I have received my doctoral, master‟s and bachelor‟s…I hope so if I received my
doctorate.
CS: Do you think that is something that we can… [erase?]
R1: You can X those because if you have a doctorate this is for doctorates research doctoral degrees they obviously
have these degrees or should be obvious. So I would say just ask these question for doctoral degree. Have you
received a degree of this type, would only make sense if this person is only a month or two away from receiving
degree. Which is what happened when I got the package….The X is already checked Yes and I may not gone to fill
out the rest of the information. Then it says here month and year granted and I will fill that out because it is
important. Started Degree…that is important
CS: How are you getting to that answer?
R1: Well I am going down the line here…I left the rest of that information blank unless you want me to answer for
masters. I‟ll check yes. Again, I think this redundant to answer this information. What is used useful to determine for
masters and bachelors so people can see if I got to this point in 2008 how long did it take?
CS: So when you were responding to when you started your degree how did you get to this answer?
R1: I remember years. People may not remember exactly right off the bat. As far as when I started my degree some
people maybe embarrassed to say gee I started my degree 20 years ago but I remember exactly when I started.
CS: And when did you start?
R1: In January 1999

Page 37 of 165

A8-b
A8-c
I just answered that at A2.
CS: You were looking at your field of study for bachelors and masters, is that what you were looking up?
R1: Yup
CS: And that you felt was easier to look for?
R1: Yeah for communication cause there is only a few listed here. I feel like education is going to go forever.

A8-d
A8-e Here we go again. I am going to put 810 because that is the closest one that matched.

A8-f
A8-g
A8-h
A8-i
A9

R1: That was on the first page. Except for the master‟s and bachelors this information is critical. As far as asking it
again for the Doctorate, I don‟t think it should be asked. The only thing that should be asked is when you received
your doctorate.
CS: So you feel that the school name/institution for bachelor‟s and master is important but not for the doctorate.

So really this area on A8 should be used for Bachelor‟s and Master‟s education.
CS: So do you feel that the spacing is alright on this question?
R1: Yes
Yes – This is great question to ask because some people emphasize that some people have you from your masters

A10 to your doctorate degree straight across.
Okay and I have a master‟s degree than there is something that tells me that its graduate level work so if I indicated

A11 here in A8 when I started that the question in A11 is redundant. Cause again I am filling in the same information.
This is important because doctoral degrees are different levels and take so long to do…so if I think back...six years.
CS: So how are coming to that answer?
R1: Thinking from when I started in program which was 1999 and what year I started writing dissertation in 2005

A12 which would be 6 years.
R1: This question is good because it asks you if you took a break and I answered no.
CS: Okay you did not have a break?
R1: No

A13
A14 That is good to know whether or not you did that anytime in your bachelors or master.
Nope…That is good to know because your doctorate degree might be in MD sort of like a doctorate and not

R2

A15 specializing in a practice…its teaching or something.
A1

Page 38 of 165

Name of field is financial mathematics and now I need to find code on page 8. Its applied mathematics even though I
got my degree from math department but it‟s a research in finance area but I am still going to pick code in math. My
second field is in finance.

A2
A3
A4 Full remission …I did not pay any money

This question makes assumption that you need support. What do they mean by support? I worked full time and they
did not pay for school. I am going to put other – working full time X not exactly because school was paid for and I
don‟t earn income in graduate school X income better than financial support…what is your source of income?

A5
A6 Again same situation
A7
A8-a
A8-b
A8-c
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i
A9
A10
A11
A12
A13
A14
A15

R3

My undergrad was from China and I paid almost nothing because this is how it was before in get it in 1993. If you are
a good student from high school, college paid for. I have 3 masters and PHD
I am trying to understand this question
I have two master‟s degrees I am trying to refresh my mind X…December 2007, I got my masters degree
I started January 2007.

There are provinces in China
Is that masters? X I would say its masters, higher than that.
Yes, I did in China 1993
1 year taking courses. 6 or more…it was a long time
Yes, I was working full time and relocated to Seattle for a year. I'll just say one year.

R says, “I don‟t know the title of my dissertation. I would probably open up and check it. R fills questionnaire. “I was

A1 so when I had to produce a title.” R took R‟s advisor‟s recommendation for a title and R agreed.

Page 39 of 165

R says, “There is no list on page 7.” R reads question, “using list on page 7, choose the code that best describes the
primary field of your dissertation research. R looks at FOS list and R did not find ecology saying, “I studied ecology
and it‟s not on here. “ R continues, “I guess I‟ll put environmental science. But, environmental science is not the
same as ecology at all. . You should have it.”
x- So what did you write in the fill in box? R “Ecology. And the number that goes with environmental science.”
“Environmental science can be anything like environmental engineering. It‟s not the same.”
R writes

A2 “Ecology is a big field”
A3
R says, “I guess it was full tuition remission. Even though I got - the university guarantees us, it was a stipend plus

A4 no tuition, so you never even - there was never even an option to pay tuition.
“So financial support means, um stipend, or does it mean my research grant?”
x- it‟s whatever it means to you.

A5 Well alright I guess I‟ll put scholarship, and grant, and teaching assistantship.

A6

A7
A8-a
A8-b

A8-c

Fellowship and Scholarship gave me the most money. Grants gave me the second most money, but the distinction is
that in ecology fellowship and scholarship is for your stipend, and grants are usually for your research. So, I got a lot
of money from grants. I got more money from fellowships and scholarships. But they were not paying for the same
things. The grants went all to my research.
“So the graduate program here, we got paid the whole time. And so I only took out a loan to buy a computer.”
And I had a scholarship in college, too.
X – What about your undergrad. “No I had a scholarship to undergrad as well. I think I borrowed 5000 dollars, but I
paid it back before I started grad school. I just didn‟t eat a lot.”
So the master‟s degree in my program is just given after you defended your proposal, your research proposal, and so
you kind of uh, you fill out a card and get your degree in the mail. It was not a big thing. So it‟s always hard to
remember when I got it. I figured that out when I started and counted two years forward.
R - “I had to try to remember the year I started. It‟s been a long time.”
X – “So how did you come to that?
Undergrad is a little harder to remember. But x- Why is that?
Because it was longer ago. I also don‟t remember the month; I think it started in August. But it‟s easy to remember
when I graduated because I graduated in 2000.

Page 40 of 165

I always think these things that make you fill out the same information like three times are really irritating.
X – What do you mean by that?
Irritating? I already filled this out once and presumably it will be already entered in computer. So all you have to do is
push a button, so there‟s no reason for me to have to fill it out again.
X – You‟re talking about your doctoral degree?
Yes, I‟m on A8.
X – And you said you filled this out already in questionnaire.
Yea I did. Isn‟t this already in here? Oh, I filled it out in the sheet you gave me. Oh no, I filled it out on the front, date

A8-d degree granted, and all that stuff.

A8-e

So the master‟s degree in my program is just given after you defended your proposal, your research proposal, and so
you kind of uh, you fill out a card and get your degree in the mail. It was not a big thing. So it‟s always hard to
remember when I got it. I figured that out when I started and counted two years forward.
Undergrad is a little harder to remember. But x- why is that?
Because it was longer ago. I also don‟t remember the month; I think it started in August. But it‟s easy to remember
when I graduated because I graduated in 2000.
And I didn‟t read it and put Michigan state when I should have put my primary field of study.
So I just drew arrows, so you guys can just.
X – Do you find the layout difficult to follow?

A8-f No I just wasn‟t paying attention. It‟s usually with these things that I do it as fast as I can.
A8-g
A8-h
A8-i
A9
A10
X - How did you come to your graduate school start?

A11 I just read it from up here.

Page 41 of 165

A12 And I clearly remember how many years it took me because I just finished. It was six.
A13
A14
A15
A1 It‟s a little short
A2
A3
A4
A5
A6

I don‟t see mine where I expect it to be. No social work under social science. Does not describe my field. So picked
Social Science other- 699
Department of Social Work.
Tuition waiver. That question could be phrased different...how did you pay for it?
Pretty Clear
Enter the letter. I don‟t understand this. Oh the letters on top.
Seems pretty clear. X Not clear if I should put the exact amount. Not supposed to put exact amount. X Probably

A7 leave it blank.
A8-a

R4

R5

A8-b
A8-c
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i
A9
A10
A11
A12
A13
A14
A15

Trying to figure out which number the month is and year. Trying to get it right. Its not hard math would kind of just
have to figure it out.

Have to go back to this list.

To answer this question, I would just have to look back up.
Kind of counting. 6 years and 2 years.

“I don‟t really remember the exactly title of my dissertation, so I am just going to write down the title of my book that

A1 became of my dissertation.”

Page 42 of 165

A2
A3

“I did it in political science, but the nature of my research was in the international studies. My degree is in political
science, so I am trying to decide whether I should put down international studies, but I decided against that because I
don‟t think that there is a number for international studies. There is on for international relations, but not international
studies.” He also saw a code for international affairs but said that it cannot substitute international studies because its
specific connotation is different than international studies.
“I am thinking rather hard about this because it talks about partial tuition remission and I got tuition remission, but
once I got to the dissertation stage that sort of runs out because they only fund for three years, you know? So I don‟t
know whether to put down full tuition remission or calculate the number of years. I am going to choose number three
to be on the safe side.”

A4
A5
A6
A7 “I would say about 20-30 for my undergraduate and I would say 40-50 for my graduate education.”
A8-a
A8-b “I guess I am kind of annoyed about redundant questions, but that is just my personal thing.”
A8-c
A8-d He didn‟t remember the code, so he had to turn to the flip out to look it up. It was the same code as earlier.

He had difficulty remembering the dates of his degrees and made a mistake in the master‟s field, which he later

A8-e scratched out and corrected.
A8-f
A8-g
A8-h
A8-i
A9
A10
A11
A12
A13
A14
A15

“Masters are not required when you enter the PhD program, though I am thinking you do eventually get a masters
conferred, but I will say no.”
“2002-08, so, 6 years. Oops, courses 4 years, dissertation 2 years.”
“Not really”
“Yes”
“No”
I will try to remember. This would be better online because you can save draft and not have to complete it all in one

R6

A1 sitting. This is weird; I am not used to writing this out.
A2 No list on page 7 it should just say use list on pages 8 and 9.

Page 43 of 165

My program is interdisciplinary. My funding came from Evanston Hospital. I usually put down the hospital but that is

A3 not part of the school. I will put down interdisciplinary committee.
A4 Reminds me of how lucky we are.
A5 Stipend was from research assistantship. Had personal savings but never had to use to pay for grad school.
A6
A7
A8-a
A8-b
A8-c
A8-d
A8-e
A8-f
A8-g

Research assistantship…next would be…research assistantship was part of grant. Not sure what to put. Put
research assistantship and then grant.
Grad school was totally free and so was my undergrad.
Doctoral degree already filled out.

I felt like I answered that already and then I realized it was on the front page.
At least they don‟t assume for your undergrad that it was in the U.S.
This survey is going to people that got their doctorate in the US but they do not discriminate against in terms of where
you got your baccalaureate.

A8-h
A8-i If it was online it would have been easier to sub-divide data instead having to manually enter statements.
A9
A10 No it was not. People always seem surprised when I tell them I don‟t have a master‟s.

A11

R7

A12
A13
A14
A15
A1
A2
A3

When I applied for grad school in the US I actually started a Master‟s program in the Philippines. Then when I got
accepted in the US I took an honorable leave of absence. It asks me if I entered graduate school in any program in
any university but it doesn‟t let me but it doesn‟t ask me to fill out any information about that. Because in my case I
started it but I did not finish it but there is not way for me to include that information. There is not way for them to
know I started in the Philippines. A9 could have been something like that but was assuming I finished.
It would be nice if it said required for research. We started actual dissertation research in 2nd year but it‟s not after
course work and exams for me.
No, I was full time.
No but I get this question a lot.
Can‟t remember the entire thing. Would have it in front of me if I was completing this at home.
So far this is straightforward.
Assuming by department we mean sociology. This seems redundant since my degree was in Sociology.

Page 44 of 165

A4
A5
A6
A7
A8-a
A8-b

I‟m not sure if her Teaching Assistantship or Research Assistant ship applied. I don‟t think it means to include that.
This is just simple recall.
I‟m glad to not owe anything.
I‟m reading this question a few times to make sure I‟m doing it right.
I don‟t need to really think about this, it‟s simple recall.
I‟m not sure what to put for my PhD start date. My PhD and MA were through the same program, so should I use the
same start date?

A8-c BA – I have to think for a second. It was a while ago.
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i
A9
I‟m not sure how to answer this. I guess yes, cause you can‟t get a PhD without earning an MA first. (NOTE –

A10 Respondent checked yes, but based on her comments and A8, this was answered incorrectly).
I took some classes after my BA, but I don‟t think they were part of a graduate program and wouldn‟t count. (NOTE:

A11 Respondent skipped question entirely).

A12

a) I‟m assuming this is only referring to classes for my PhD program. (NOTE – R had to cross out her original answer
after reading part B, but then wrote in the same answer as originally)
b) It was a long time
I did apply for a leave of absence, but can‟t recall exactly how much time I took off. I see it says to round up though.

R8

A13 It was definitely more than one year, so I‟ll put two.
A14
A15
A1 Respondent writes.

Page 45 of 165

It‟s nice that this field is also in white. I think it helps me know that there‟s something that needs to go in this space,
instead of reading a lot of small text or font.
Interviewer: Could you talk about your thought process as well?
I don‟t really have any other thoughts. This looks very similar to other standardized forms where you have to pick a
major in a large list. It‟s pretty easy to pick a list with the large headings. It‟s pretty easy to find my field.
The italicized font can be a little bit, it‟s not that I can‟t read it; I feel that it‟s less easy to read than just the regular

A2 font.
A3
Interviewer: Can you say something about your thought process?
I had tuition remission for...let‟s see, seven of the 8 semesters. So I was trying to figure out where this fell in between

A4 the choices.
I think the choices are pretty good for financial support. I don‟t really see anything missing on potential support as it
applies to me.

A5

I was about to move on to the next question, but I realize that I‟m supposed to put „no‟ on the ones that didn‟t apply to
me. If I was doing this quickly I may have missed this. I can go through a survey quickly, so, a lot of the small print
may not get read.
In question A6 it would be helpful to say, which two sources in question A5 or the previous question, because I don‟t
know what A5 is just by looking at the question. It requires me to think, “A5 is the previous question.”
So, what happens if there are multiple sources that are the primary source? Do you put multiple letters or is it only
one letter. I‟ll just pick one, even though I think that a couple of them were equally primary.
Interviewer: You‟re referring to A7?
A6. So, I feel like I should just pick one of my two primary, so teaching and research were the primary sources of
support. Although I feel like I should just pick one. As secondary, loans and family savings, so, I‟ll just pick loans.

A6

In A6, there‟s this bottom box, mark x if no secondary source, I think I was about to skip that because it was in italics.
I wasn‟t going to pay attention to it because I thought it was further explanation of the question. Also, the box isn‟t
immediately below the other two boxes. Visually, it‟s kind of confusing. It would be clearer, „If no secondary source,
then mark x.‟

A7

A7 is pretty clear. There‟s a box at the bottom, which I‟m assuming is to indicate the actual amount, but I‟m not
positive. So I will just put a dollar figure in here that I assume is what‟s supposed to be in here for graduate school
and undergraduate.

Page 46 of 165

This page does not look as clear cut as the previous page. There are just a lot of boxes.
R reads the question.
Ok so, this column (most recent masters degree) it‟s assuming that somebody might have multiple master‟s degrees.
The „most recent‟ part made me pause for a second.
This is pretty clear in terms of the format that you have to input this information.
R reads the question. I‟m thinking is that the field number I used in the previous page, and I think it is.
Um. So far filling out the rest of this chart is straight forward after I figured out what was wanted.
I think part of the confusion is having the columns laid out the way they are. I‟m not sure if these were laid out

A8-a horizontally would make them easier to understand.
A8-b
A8-c
It would be nice if there were an option to check a box that was same as above instead of filling out the same
information, if it applied.
Interviewer – You‟re talking about 8D?
Yes. A8d through i.

A8-d R – Answers questions.
It says field number from list on page 7, but the list isn‟t on page 7. It‟s on pages 8 and 9.
Interviewer: Do you have an opinion on that?
I understand that the list is two pages long. I understand that there has to be this cover page. I don‟t know why this
list isn‟t in the same form as the rest of the questionnaire. Again, everything is the same shade of color so I‟m not
reading that it says please open to see the field of study. It would be clear if it didn‟t have this design and it said
„please open this page‟ in a darker font. It doesn‟t take that much effort, but it seems kind of superfluous to have that
extra step.

A8-e So again, actually finding the fields is really easy [on the field of study list]. The information is organized really well.
The space for writing your institution name is a little cramped. It would be nice if it were a bit longer. The space for

A8-f city and state are fine.
A8-g
A8-h
A8-i

Page 47 of 165

Just at initial glance, the bold face words of A9 – A13, there‟s a lot of text crammed in this area.
I guess this arrow is okay. I don‟t remember seeing stuff like this on other forms. Usually, they say that right next to
the yes. This is not that confusing.
x- How are you coming to these answers? Based on other forms. What comes to mind is a tax form. You kind of
have to pay attention to the arrows.
The actual questions, referring to question A9 and beyond are pretty easy. Visually, there‟s a lot of text within this

A9 small space.
A10
A11
It‟s nice in the question they are differentiating that there are different phases in your graduate course work phase,
exam, defending. It‟s helpful that they‟re specifying so you know the right amount of time you‟re supposed to put in
the field.

A12
A13
A14
A15
A1 “It was long, had to stop and think.”

“I have to find the field,” seemed to find fold out easily, and took a few moments to find 230 Nursing, “It took a little bit
but I found it, it wasn‟t bad.”

R9

A2
A3
A4
A5
A6
A7
A8-a
A8-b

A8-c
A8-d

“Wasn‟t interdisciplinary but a person on my dissertation committee was, he was an immunologist.”
“That‟s the school of nursing at Loyola.”
“I did get money for teacher assistantship, 1/3 to 2/3.”
“Assistantship, fellowship, grant, no loans, personal savings.”
“D first and personal loans second, I
“I am glad to say none.”
“Question is a little confusing, three of them, ok; I had to read it over a couple times before I got it.”
“This goes back to ancient history. August 2008 that‟s easy.”
“I‟m racking my brain all the way back thinking about this. It took a long time to get my doctorate because my mother
and my husband‟s mother were sick I had to take a leave of absence for a year….Loyola…DePaul…I didn‟t have my
BSN when I went to get my master‟s so I had to take some extra classes as part of my master‟s so…September
1990.” Think of when she graduated high school.

Page 48 of 165

“Hard to find biology, oh its health sciences, looking in wrong column, hard to go through numbers, I have a problem
with one of my eyes though. It‟s logical but took a little while to find the number. I suppose you can‟t do it
alphabetically then because people would pick different numbers or the wrong numbers. I don‟t think you could do it
any better.”

A8-e
A8-f
A8-g
A8-h “Everything is in Illinois, Chicago.”
A8-i
A9 No, that‟s easy.
A10 “No, though I did have one.”
A11
A12
A13
A14
A15

“I‟m not sure if it means doctorate only, or masters and doctorate. I guess I will go with doctorate only. Started in
1994, took a leave of absence.”
“I have eye problems, did I read it right? Twelve years to finish, took one year leave of absence.”
“Yes, one year.”
“Yes, I have gone to a community college and took a couple courses.”
“No.”
R says, I think I‟m going to run out of room. [When filling in dissertation]. So I ran out of room. I guess a lot of

A1 people would run out of room. So I wrote outside the space.
A2 Page 7, it‟s actually on page 8 and 9. Nursing science is on here, so 230.
A3
Full or partial tuition remission. So I assume this means through the university that I got the degree. That doesn‟t

A4 mean reimbursement from my employer, but I did not get remission from the university where I got my degree.
A5

R10
A6
A7
A8-a

A8-b

The primary source. I don‟t know, probably from my employer reimbursement, and then secondarily from my personal
earnings. When I‟m filling this out, I‟m thinking I hope this isn‟t an l or j, so I‟ll make this a capital „L.‟ So if I put a
small „l‟ like it‟s listed above, it looks like an I.

Interviewer asks a question on A8b. I think that a lot of people may not remember, well. I don‟t think that‟s true. I
remember very well the start and finish of when I started college. I think some other people might just guess. If I had
to ask my husband, he would have to look it up. Or he would just guess. As far as the month, I don‟t know if I started
in Aug or Sep, but I would probably put Sep. The degrees were granted in May, I would guess. I know the doctoral
degree was granted in July. I guess that‟s one question, does it matter what month the degrees were granted for
things like bachelor‟s degrees. I would guess that people might guess.

Page 49 of 165

A8-c
Field number is the same here, 230. Institution name, which I‟ve already put. I might wonder why you‟re asking me
to write it again, when I‟ve written it already. It‟s kind of a long name.
One thing I would think is that they wouldn‟t have social studies education. Oh, they have social science education.

A8-d It‟s the same thing, so 885.
A8-e
Interviewer asks a question on A8F. You mentioned, why you had to write this again. I wonder if this can be left off

A8-f on the front, since you wouldn‟t have to write it down twice. It would just be a minor annoyance.
A8-g
A8-h
A8-i

A9
A10
A11

And I would probably think for a few minutes what post secondary means, and I would think that means after my
bachelor‟s degree. Interviewer asks a question on A9. It‟s just my own lack of knowledge of what‟s meant by
postsecondary. Maybe it‟d be good to put (after graduation from high school).

I guess that would mean years spent on my course work, and the time that I spent on my prelim exams and the
proposal. The proposal is really working on my dissertation. 3 years of my course work. I would probably be
uncertain whether my proposal would be an exam. It‟s not really an exam, its part of my dissertation. I think I would
decide it wasn‟t an exam. So I would count this as part of my course work.
On 12B. This is a little confusing. It‟s confusing because this could be taken that this phrase in parentheses could be
describing what exams are. It might be clearer to say after dissertation and course work and exams, so that it
references the dissertation, and not a descriptor of exams.

A12
A13
A14
A15

So I put two. There‟s some gray in this question for me. I know from other people who have dissertations in other
areas is that there is a preliminary exam called an exam, then there‟s a prospectus or proposal and it‟s unclear
whether you would call that your [dissertation].

He thinks that he may not have enough room to write it. He says that every time he writes the title he remembers how

A1 long it is and wishes that he simplified it.

R11
When turning to the flip out, he looks confused, and then says “oh” when he understands that he has to flip out the

A2 page. “The codes are actually on page 8, but it says refer to page 7.” He comments that there are a lot of categories.

Page 50 of 165

A3 He comments that “for the most part the questions are very straight forward.”
“I am not sure what the goal is as far as if they look at it and sees that there is a problem. I am not sure what is going

A4 to happen with this survey. Hopes it would benefit future students.

A5

He has a strong reaction to the question because he says that he took out too many loans, which he regrets doing.
He wouldn‟t have done so knowing what he knows now. Later when prompted to provide further explanation he says
“If I could do it over, I would work more, take a lighted course load. It probably would take me another year, but it
would have cut down on the loans that I have hovering over me.

A6 He does not regret the work that he did because he got a lot of practical experience. He says “it was a good thing.”
He reads the question and says “a lot.” He thinks about how much he owes and says “It hurts me to write this number
down.”
• He comments that he is not sure why the government needs that information. He surmises, “Unless to say we have
a problem. This would be one of the benefits of this survey.”

A7
A8-a
A8-b He verbal reacts to this question, saying “I get annoyed when have to answer the same questions.”

Similarly he comments, “Lots of redundancy in these questions. Odds are your dissertation is going to be your

A8-c primary field of study. So it is very redundant.”
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i
A9 He answers “no”, but comments that he is in the process of getting an additional postsecondary degree.
A10 He verbally responds “No, and I am glad it wasn‟t. It‟s just another way to make money off of students.”
A11

A12
A13
A14

“I have an issue with A12B because some students, well…maybe not, well, they are actually fortunate enough to
work on their dissertation around the time they are taking courses. The question is worded as if you can only work on
you dissertation after the course are done with.”

He asks why they didn‟t ask about other postsecondary degrees such as JD or MBA. He questions why it is so

A15 specific to these two degrees when there are a great proportion of people who earn other postsecondary degrees.
Page 51 of 165

A1 “See if I can remember…,”
When looking for the field codes, he follows the directions and turns to page seven, which he looks at confusingly. He

A2 then realizes that he has to open the page to find the codes.
This didn‟t require much thought. He said that he just recognized the categories he chose as he read them. He did

A3 not fill in any marks in the “no” column.
A4
A5
A6

R12

A7
A8-a
A8-b
A8-c
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i

He thinks aloud, “Oh, it‟s broken into two categories. I was trying to think of a combination of aid that I got. It‟s all
loans for me. All this I check off is in the form of loans.”
Later he says that he works in the Dean‟s office at Northwestern and “one of the big things is money. The cost of
tuition is very high. One of the things that schools have to try to do is to eliminate loans for students. A large
percentage of students have to take out loans. [Schools] have to restructure things.”

About this question he says, “I thought this question was repetitive because it already asked me that at the top.” He

A9 says that post secondary is anything after BA and suggests that something like “training” may be more applicable.
A10
A11
A12
A13
A14
A15
A1

R13

Primary field is political science and government. My dissertation was somewhat interdisciplinary because it had a lot

A2 of philosophy in it. So, I‟ll look for that.

Page 52 of 165

A3 R Answers question. Political science.
A4 More than 2/3s tuition remission.
A5

A6
A7

A8-a
A8-b
A8-c

A8-d
A8-e
A8-f
A8-g
A8-h
A8-i
A9
A10

Fellowship and teaching assistantship.
X – What‟s your thought process as you‟re going through these items?
These are - I‟m happy to give this information. It strikes me as information as important to know for doctoral
education. Its information that‟s easy to give that I‟m happy to give.
X – What about those two items?
R – Fellowship and teaching assistantship? They were clearly my main sources of support in my program.

X – What are you thinking as you‟re moving through this item?
R – I‟ve got to look at it again; I stumbled on it. I have to see what exactly it‟s asking.
I see, so some folks have more than one master‟s degree, more than one bachelor‟s degree.
@ 12:10 I have not received a degree of this type. I happened to have done work on a master‟s degree but I failed to
complete it.

I‟m not sure what I would have put for the primary field of study when I did the survey. It was an interdisciplinary
program. So, looking on here now, „Humanities general‟ would probably be the best description. I‟m not sure if that‟s
what I supplied.

That would have been in September of 1994. So from that response, the person reading the survey would know that

A11 I started a graduate degree of some kind and did not complete it.

Page 53 of 165

A12
A13
A14
A15

I would say that on question A12, my program was pretty long; it took me pretty long to finish. It took me 8 ½ years.
It asks me the division where does course work stop and where does dissertation begin. I‟m not really sure the
answer. I put down five years of course work, and I think that‟s right. I worked on my dissertation for 3 and ½ years.
So I rounded up to 4, because it says round to whole years. I think this information is accurate, but in order to make
sure that I‟m exactly right, I would have to go back and look at my records.

I am trying to think if my dissertation is performance or project report. It is a project report. I worked on project for 6

A1 years.
It says here to use list on page 7 and I didn‟t read this (instruction in logo), at first I read this one (instruction on
bottom right corner). Since I studied cancer immunology the closest one is 158-cancer biology which is found under
life sciences. Then go back and see because my course was interdisciplinary. There wasn't more than two fields, so
I am just going to finish up this question.

A2
A3
A4 I received full tuition remission so I checked last box.

R14

A5
A6
A7
A8-a
A8-b
A8-c
A8-d

The main funding source for my project was the grant, teaching assistantship, personal savings, personal earnings as
well and family savings and for the rest I am going to say no.
Primary was teaching assistantship. Secondary was grant.
I don‟t owe any money. I am going to check none for both undergrad and grad.
I have received master‟s degree as well as a bachelor‟s.
Reminded me I made a mistake on the first page.

Since I already listed the field number on page 2, I am just going to refer and get the same code for the doctoral

A8-e degree.
A8-f
A8-g I am just going to give city where I studied.
A8-h
A8-i
I received one additional post secondary degree. Master‟s in immunology and the field number is 151 which is what I

A9 put in second page.
A10 Masters degree was not a prerequisite.

Page 54 of 165

A11

A12
A13
A14
A15
A1

A2

6 years – is how long I took to prepare for doctoral degree.
Post course work that was 4 years.
There wasn‟t a time.
I did not earn college credit.
It‟s pretty long it will take me a little while to get through. I hope someone will be able to read my writing.
I have to look at long list to find the code that describes my primary dissertation research. It fits in European history.
It‟s in Russian History. It was interdisciplinary but I don‟t see category but don't see any category that I can match up
with.
So when I see they ask the name of the department, I wonder, should that be same as primary field of dissertation

A3 research?
A4
A5 Looks like a good thorough listing of all sources of financial support.
A6
Now I have a difficult answer to make. I owe a lot but it has nothing to do with undergrad and grad school. It‟s

R15

A7 because of medical school.
A8-a I have to fill out all these dates; I hope I can remember without having to refer to any reference.
A8-b
A8-c
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i

Referring to Doctorate…Asking again? I wish there was a way I can say the same institution, so I don‟t have to write
it down. If I did this online, I would hope there are pull-down menus for the universities.
Referring to Doctorate…already wrote down.
Referring to Doctorate…already wrote down.
Referring to Doctorate…already wrote down.
Referring to Doctorate…already wrote down.

I have an MD where would I put it? I am torn, not sure what to put for this to be accurate. (referring to field of study).

A9 I am just going to put other fields. Though I could probably find it I don't want to spend too much time looking for it.
A10
A11
A12 I presume this is not referring to A9. A12B is complicated I did a lot of work in residency.
Page 55 of 165

There was no year when I was not working on it at all but were there years when I was primarily not working on it -

A13 Yes. And I will say 3 years when I was a resident.
A14
A15
A1 I have to remember the title of my dissertation.
I‟m looking at this and it says primary field of my research. I‟m just going to put polymer science. I‟m not sure if it‟s
supposed to be related to my major or not. But I‟ll just put that, because that‟s what it was.

A2
A3
A4
A5

Alright, so, I‟m going to say that it‟s chemical engineering now. So I‟ll go ahead and put a little slash. So if cheme is
the primary, then polymer science will be the secondary. Let‟s see what we have for that. [R reads field of study list].
Polymer chemistry is close enough.

Interviewer –Could you say your thoughts on how you‟re answering?

R16

I was just going through the funding. Just fellowship funding. I was looking to see what might apply. There‟s other
thing in there like teaching assistantship, but that wasn‟t the actual source of the funding. And primary source, I was
just trying to remember how much I had – I had no debt owed for undergrad and just 8thousand for grad school. And
So now I‟m going through degrees earned.

A6
A7
A8-a No Master‟s Degree.
A8-b December of last year.
A8-c
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i
A9
A10
A11

August of 2003, although I started grad school earlier, because I was in a master‟s program and moved directly into
the PhD.
We‟ll say is Chemical Engineering.
I‟m impressed you guys have paper science and technology in there.

No additional postsecondary degrees.
Was not required.
Again it was August, 2001.

Page 56 of 165

Well that‟d be a lot. Let‟s see, I had two years. Then, my school merged with Georgia tech. So, I had to start
classes again. So, 2, we‟ll say 5 of the years I was taking classes. And working on dissertation that was probably 4
years of actual work towards the topic.

A12
A13
A14 No.
A15 No.

A1

I don‟t have the memorized. I really don‟t remember my dissertation titles beyond the main title. The subtitle is a
problem.
I need more space. I think the Social Science and humanities titles tend to run kind of long.
That‟s a problem. My field is interdisciplinary so it does have a primary field. So I guess I will just go with my
department. I was annoyed by that question when I did this for real too. This is something that struck me when I did
the original. Human Development here falls under psychology. But in the University of Chicago it is not psychology it
is its own department. It is more closely related to anthropology. It‟s not family studies either. Lumping human
development and family studies might be a problem.
Human development is interdisciplinary. This doesn‟t all me to actually unpack the fields. It‟s not like I received a
secondary degree. But my research is in anthropology and language specialization. In the past I have put linguistic
anthropology because that is the closest fit. Linguistic Anthropology is not a choice.

R17

A2
A3
A4
A5 Loans – yes because education cost more than it should
A6
A7
A8-a Which type? Oh ok you are already marking yes for the PHD.
A8-b
A8-c
A8-d

The human development is still an issue 613 does not represent what it is. I don‟t know codes and names are

A8-e necessary. It seems kind of redundant.
A8-f
A8-g
A8-h
A8-i
A9
Page 57 of 165

A10
A11
I was forgiven a much of my course for the PHD because of the master‟s but the master‟s was not a prerequisite so I
don‟t know if I should include the master‟s or not. Had I not done the master‟s it would have taken me 4 years to do
the course work. Having taking the master‟s it took me 3 years. I will put down three.

A12
A13
A14 No but my dad wanted me to go there instead of college.
A15

A1

“I actually did the survey with my dissertation in front of me. If I were doing this at home, I would find the file on my
computer and look up the title. Here I am going to guess the title.” He also cites his poor handwriting as another
reason why he would choose to do the survey online.

A2

“I am confused as to what my primary field is. I don‟t know official fields.” He then flips to the codes and jokes that
“you need a PhD just to figure out how to open page seven.” His field is not included in the list. “I don‟t see a virology
section. I‟ll put molecular biology.”

A3

“I can‟t remember the exact department because the departments in life sciences aren‟t specific to one field and are
called various things.” He also says that there is not a way to note interdisciplinary studies. Another problem he has is
that he went to two different graduate schools, and is unsure how to express that through the survey. He decides to
fill out the survey with the second school in mind.
“I went to two different grad schools.” He assumed that this question was asking about the school where he earned

R18

A4 his degree and not the school where he began his degree.
A5
A6
A7 He provides a guess because he feels that he falls in between two categories. “It‟s nothing specific.”
The respondent fills out the question vertically and guesses on the dates he began and earned his doctorate degree.
Again, he attributes his difficulty to provide a confident answer to the fact that he transferred schools. He also
verbalized that this question was redundant with A2.

A8-a
A8-b
A8-c “This is so lengthy and I transferred, so it is really hard to answer this.”

A8-d “With bachelor‟s degrees they aren‟t that specific.” Again he did not find the precise field that he was looking for.
A8-e
Since he already filled out this information in question on the first page he supposed that this section would be

A8-f automatically filled in on the online form.
A8-g
A8-h

Page 58 of 165

A8-i
A9 “I actually don‟t know what postsecondary means.” He previously thought that it was anything after high school.
A10
A11 “I am trying to figure out what you are trying to get out of me. I like that you underlined „any.‟”
a. “It‟s unclear whether it is any university or the university where we received our degree from. I‟ll assume any
university.”
b. “Four years”

A12
A13 “There was a year that I did take off. I liked that you asked that question.”
A14 “No”

“The organization of this page is weird. The questions are horizontal and not below each other as they were on the

A15 previous page.”
A1 Let‟s see if I remember my actual title.
I was about to write chemical engineering but then I thought it was area of research it might be referring to. But since

R19

A2 there is a table I will look it up and see. I am pretty sure it is chemical engineering.
A3
A4
A5
A6
A7 Way too much! Do they want me to write it in? (referring to blank space for over 70,000)
A8-a No Masters, just Bachelors.
A8-b
A8-c
A8-d
A8-e
A8-f
A8-g
A8-h
A8-i
A9
A10
A11

Page 59 of 165

I am just that thinking-wondering. I took courses that were not necessarily needed for my degree later on. I took the
core courses pretty much within the first year or two and I am just thinking if I need to consider all those also. So I
am just going to include those directly related to getting my degree.
It‟s a bit complicated. I left school after about 5 years and started working so I was not actually on campus for the
last part of writing. Last year I spent while working and writing and I am just wondering if I should include that year
too. I would include that year. Six totals years from start to finish.

A12
A13
A14
A15
A1 If I were filling this out for real I would have it in front of me.

The question is, "what's it going to be under. I guess I will put Spanish. That question strikes me as a little bit odd
because I am a linguist that happens to have gotten my degree from the Spanish department. Putting Spanish
assumes that I know something about literature. Secondary in linguistics. I am a bit between several fields. Spanish
goes first on my degree

A2
A3
A4
A5 Sources of Financial support - Does that mean I was married and my wife worked?

R20

A6 Fellowship and teaching - a. c - I am not sure of the order. But it does not look like it matters for the question.
A7
A8-a
A8-b
A8-c
A8-d For Bachelors: I'll just note double major here.
A8-e
A8-f
A8-g
A8-h
A8-i
A9 The Master‟s on the way probably counts.
A10
A11

Page 60 of 165

A12
A13
A14
A15

Page 61 of 165

Part B- Post-graduation Plans
Maybe that is good for people who plan to leave in state or who plan to leave it in near future.
CS: Do you have any reservations about answering that question?
R1:That should be something like in the next five years do you plan to live or intend to live in state other than where you reside.
CS: So you think a 5 year interval?
R1: 3 to 5 because some may not have that job they wanted after graduation.

B1
B2 That‟s a good one.

Signed Contract – That is me. Ideally that is on going

B3

The other questions [options] are good one to have
…negotiating
…seeking position

B4 I am sticking down to employment because that would be the obvious after post doc.
B5 SHOULD HAVE SKIPPED THIS QUESTION
B6 Usually 4 year …I checked that one.

R1

B7

Well that may not be available but in this case I have a current position so I will put that down.
CS: Can you talk a little more about that?
R1: …Maybe that is not available for me yet at this point when I am filling out the survey before graduation…
CS: So what you may be responding to the previous questions is what your intentions are what you hopes are but the reality may
be not there yet
R1: Right
Who knows…if in fact they apply for a position? I can write expected at 40 or 50 but I cannot guarantee that is what is going to be.
CS: So at the time of your survey did you know?
R1: Yep because I had a position but if I was someone that was working on my degree and signing a contract for the following
academic year…I wouldn‟t know.
R1: If you prefer not to report an exact amount, please indicate into which range you expect your salary to fall…now that should be

B8 the question.
That is debatable. Some institutions will give you 9 month contract over 12 months and others may only pay for 9 months and you
have to figure out the rest. Most people in this situation will probably put 9 months.

B9

R2

B10
B1

R1: Research and development is my secondary and Teaching is my primary.
CS: Is this question clear?
R1: Yes

Page 62 of 165

B2
B3
B4 Employment just employment.
B5
B6
B7
B8
B9

(Was supposed to skip this question) I have no plan for post doc. It gives no choice what will be. I didn‟t think about it.
Private sector…I have been working
I have been working for ITG derivatives.
157000
He skipped this question and then came back. 12 months.
Professional services to individuals? Just professional services. Why to individuals? I don‟t have secondary…Would like to have

B10 one…possibly teach
I‟m going to be in IL for the next year after I graduated because I‟m waiting for my husband to finish. But I‟m only doing part time
teaching for the university. And having a kid. And then I do intend to take a post doc position but not until the next academic year.
So when I start reading the next question B3, um a lot of these are a pain because they don‟t take in to account people who are
taking time off before they go to postdoc.
For example, I have sponsor to do a post doc with, I know who I‟m going to do a post doc with, but they don‟t have funding right
now. So, two is kind of applicable because I do have a commitment with one sponsor, but I don‟t have any money, and so that‟s
going to fall through if I don‟t have money. And negotiating with one or more specific organizations, I mean it‟s not an organization
when you turn in a grant application.
And so, um, I am seeking a position but I do have specific prospects because I know which grants I‟m applying to. That one
doesn‟t really apply. I‟m not going back for more school.

R3

So I guess, in the next year I‟m going to have to say, uh; I guess other. Or going to say teaching because it‟s only in the next year
you‟re asking.

B1
B2
B3
B4
B5
B6
B7
B8
B9

College or university, oh no that‟s for training, I‟m not doing training.
So I guess I‟ll be working for a 4 year college.
University of Chicago
I‟m only doing two quarters of teaching. And each quarter will be paying 9000. So I will be making, not much. So, around 18,000.
6

Page 63 of 165

Primary teaching, secondary, well I‟m not getting paid to do anything else. I will hopefully be doing some writing up papers on my

B10 own. But I‟m not getting paid.
B1 Not Sure…I will put the one where I live in now. Might move, I have been applying to different jobs.
B2
I am doing both working at a job and looking for another. So I don‟t know where to go. It doesn‟t really capture what I am doing. I

R4

B3 am doing more than one.
B4
B5
B6 I have two jobs. I would answer two items not just one.
B7 Well this is asking what is coming up but I put what I am doing
B8
B9
B10
B1
B2
B3
B4
B5

R5

I have two jobs. I would have preferred not to put exact amount but asks for range after I had already put exact amount.
Not sure what professional services to individuals means. I work for non-profit.
“Illinois”
“Contract, no wait. (Reads options over) I am thinking when is next year?‟” He assumes that next year is 2009.
“Employment.”
“U.S. 4-year University.” (Reads over other options after choosing). “I do some consulting for the state department, but that‟s not

B6 technically employment…so no.”
B7 Fills out country in the state box: DePaul University.
B8 “I feel better about the estimation of the ranges rather than indicating the exact amount, but that is neither here or there.”
B9
B10 “Research and development, teaching is also primary.”
B1 Not by choice, my husband lives in Indiana.
I was continuing dissertation in lab. It just asks for a post-doc or not post doc. It‟s very cut and dry. Funny there is no teaching

B2 option.

R6
B3 At the time right after graduating I was in negotiations. I got a job offer but was unable to take it because of Visa issues.
B4 Started to answer but realized she should skip question. SHE IS ASKED TO COMPLETE SECTION B ANYWAY.

Page 64 of 165

B5 Why would employment and other employment be two different squares?
B6 That‟s one good thing about being able to write whatever you want.
B7
B8 Maybe they should include a space for bonuses.
B9
The kind of work I do is not quite research. We provide communication services to pharmaceutical companies. It‟s not the same

B10 as services to individuals. I will just put other. It‟s funny to think about how to describe the work that I do.
B1
B2

B3

R7

None of these really explain what I did. I did take an adjunct position, and spent the rest of my time preparing for a set of
community presentations of my thesis. I‟ll chose “other” here and write out what I did. (NOTE – The R missed the skip pattern,
continued to B4).
This seems very similar to B3. Employment seems the most accurate. (NOTE – The R missed the skip pattern for this question,
continued to B5).

B4
B5 This does not apply to me, I‟ll just skip it.
B6
B7
B8
B9
Teaching. At first I thought I wanted to do research or turn my thesis into a book, but now I don‟t want to do that. I‟ll leave

B10 secondary blank because nothing else applies.
B1

B2

For question 2. If you were offered a position, you have to sift through these positions. So choice number two, I guess that would
fall in question 2, but if you have a full time teaching position. I guess that would be other work. Question two seems like a post
doc, where „other work‟ seems vague and ambiguous.

R8
I almost forgot that I was supposed to go to B4. If I were to have to have checked options 3 -7, I may or may not have

B3 remembered to skip to question C1, just because the [skip indicator] is off to the margin, and I might have gone straight to B4.
B4
B5
B6 B6. Because I taught at a two year college. It‟s pretty clear.

Page 65 of 165

B7
B8
B9

B10

I‟m choosing teaching for question B10 because that‟s what most of my time was spent doing. For the secondary activity, I‟m
going to go with research and development. But I do have other secondary activities like committee work. But if I check one, I‟m
not sure if I‟m to offer other information. So, I‟ll leave that out.

B1 “Ok, what‟s part B?” “While my husband has a business in Chicago so I am stuck here so it‟s the U.S.”
B2 “Not really, so no.”
B3 “Well I was working part time at Loyola, not pre-doctoral.” Went through whole list before selecting second option.
“Option 6, that‟s working out great for me.”

R9

B4
B5
B6
B7
B8
B9
B10
B1
B2

“Since I‟m not doing a Postdoc it probably won‟t work so I‟ll select “unknown.”
*Did not follow skip pattern.
“Loyola, 4-year University.” Went through list after seeing before selecting.
“Loyola so Illinois that‟s easy.”
“I‟m just going to guess.” Wrote in no hesitation.
“Nine months because summer is off.”
“Basically I am doing teaching, no secondary so [marks box].”

Going back to B3, if I didn‟t know what exactly what I was doing. So, maybe I was going to stay on my job, or maybe I was going
to seek a new position, but it says I can only mark one. So if that was the case, I guess I would mark other, and put, „don‟t know.‟
So for me it‟s not an issue, but people might not know what to do with that.

R10

Like B4, there‟s not much room to put for uncertainty, also for B6, and B7, and also for B8. I can imagine, somebody, if I was

B3 employed right now, but only for 8 months, that might be something you‟d be interesting in knowing.
B4
B5
I read down through education and realized they were in buckets, so it‟s not in education, and not in government. Private sector

B6 and non for profit.
B7

Page 66 of 165

B8
B9

I don‟t know if I feel funny putting down my salary. To me it seems like a reasonable question given the objectives of the survey.
So it makes sense. I feel like everything has been easy to answer because I‟m not making changes right now. I can see how
somebody was in the midst of making some changes, like going to a new job, or if they were not sure what they would be doing.

Actually, I could probably, research and development is a good description of my primary work. And management and
administration is a pretty good description of my secondary work.
Interviewer – How are you coming to those decisions?

B10

B1
B2
B3

R11
B4
B5
B6

What I really do mostly is research and writing. Development, I hope research and development doesn‟t mean scientific research
in a lab. But when I read the option, and had to describe it, that‟s what I would say. If I had to describe as a secondary work, it‟s
process improvement work. So it‟s working to create new processes in health care. So, is that administration, it kind of us. It‟s
working with people in the hospital to institute new processes, and systems. So I would call that administration. I do some
teaching, but not as much as the other two. When I think about administration, it‟s probably not a good description, but its close
enough.
He responds to this question by saying New York, his hometown or Minnesota, where he went to undergrad. “This is a loaded
question for me.” He wants to move, but his wife wants to stay in Chicago. He comments that the answer to this question really
depends on the respondent‟s stage of life. “This is the question with most uncertainty. It depends on where you are in life and if
you like where you are.”
When later asked about his response to this question he explains, “I went off on a stream of consciousness. I didn‟t even realize
that I wrote both NY and MN.

He explains, “Some postdocs aren‟t listed as postdocs, they are listed as employment. Mine kind of falls in the middle of those two.
It is probably better to refer to it as a postdoc because I am working for licensing hours.”
Upon prompting he further elaborates, “Some places may not classify something as a postdoc, but it does fulfill the requirements of
a postdoc. They don‟t have specific language in the contract about it, but it is a postdoc.”

B7 He says “This is odd because I actually here filling this out, so obviously Chicago.”
I am getting paid pretty well considering it‟s just a postdoc. I am pretty happy about that. In fact that was one of the deciding factors

B8 why I stayed with this postdoc is the salary, plus the licensing, and the flexibility.
B9

Page 67 of 165

R12

B10
B1
B2
B3
B4
B5
B6
B7
B8
B9
B10

His primary is clinical, which he does 60% of the time, and his secondary is research, which he does 40% of the time. He set up
this specific arrangement.
“Here for now at least.”

“So, I‟ll do the range.”He crosses out his first answer and makes a correction.
10 months
“Teaching,” he says. “I have a joint appointment as an advisor.”
Well at the time when I completed the survey, I probably would have said Michigan because I don‟t think I had yet made plans to

B1 move to Chicago, I‟m not sure. I have a feeling this may not have arrived in my mailbox in Chicago.
I wouldn‟t have had grounds to answer this. Because I would like to have one. This is a tough question for me to answer.
Because when I came out I hadn‟t yet secured my next step in academia. It would have been easier if the question said „are you
seeking a postdoc‟ that would have been a clear yes.

R13

R14

B2 Do you intend to take a post doc position? I guess I could go with yes.
B3 Seeking position but have no specific prospects.

B4
B5
B6
B7
B8
B9
B10
B1
B2
B3

I stumbled a little bit on B4 on just the way the question was presented. Because the other on number 5, there‟s a space there
before answer choice 6. But I would go with 6, because I‟m teaching as an adjunct.

Of range – I don‟t mind supplying the amount.

I will be continuing in current postdoc.
I made commitment - post doc in next year.

Page 68 of 165

B4 Post-doc fellowship is what I am checking.
B5 To fund the project that is from grant and my own saving. So I am going to say Other – grant which is stipend and savings.
B6 Not part of government/private sectors, so I will leave those blank.
B7
B8 My salary is 37,000. It is only after I put my exact salary did I see the next line. If I read the next line, I would have put #3.
B9
B10 Research and development. I don‟t have secondary.
B1
B2 Glad [postdoc] is defined because I wasn‟t sure. Yes postdoc in medicine,
B3
These choices here don't describe really what I am doing. It's Clinical fellowship which isn't a choice here.…it‟s a coin toss

R15

B4 between postdoc fellowship and clinical residency. Not sure what to put here.
B5
B6
B7
B8
B9
B10
I plan to live in the US. Looking at this, after graduation, that probably changed a bunch of times from the start time of school

B1 towards the end. We‟ll put to states because it was CA or IL due to jobs.
B2 Did not intend to take a postdoc, but thought about it.

R16

B3
B4
B5
B6
B7
B8
B9

We‟ll it says seeking position and have no specific prospects, but that‟s not true. So I‟m going to say other. Start work at
predetermined job.
Employment.
Industry or business, because that‟s where I‟m working
Industry or business, for profit.
Nalco. IL.
I don‟t care about specifying an amount, but we‟ll check the box anyway.

Page 69 of 165

Research and Development. And to be honest, secondary would be Research and Development so we‟ll check X for no

B10 secondary work.
B1 I plan to live in Illinois until I get a job.
B2 Yes if it comes first.

B3

At the time that I had made a contract with a post doc and also seeking…there is no room for…so an option that would be even
though I have a post doc, I need space to say that I am also seeking a position. So to say that I am seeking a position but I have
no specific prospects, doesn‟t quite fit the situation. In this case “Other” – Seeking academic position while employed.

B4

I would put within the next year after the question its sort of strange in the middle. Post-doc, research associate ship and adjunct
teaching. That is a pretty common strategy after graduate school. So adjunct teaching or part-time teaching or lectureships may
want to be included.

R17
B5 We are in the lovely position right now as graduates having to cobble together 4 or 5 jobs to make ends meet.
My employment is currently divided in three ways so it hard to say that I have a principle employer. So I guess I will take the post

B6 doc because that is the institutionally recognized principle employer.
B7
You might want to mark B8 as optional because it comes across as fill in this amount here. And once you fill it in then I have an

B8 option to be less specific. Again it does not allow me to represent my full salary across three positions.
B9
B10 Again choosing primary and secondary in my case is a little hard because it‟s divided in three ways.
B1 “There is no box for „not sure‟ if you are unsure where your next job would be.”

R18

B2 “It is hard to answer this question. I did not intend to take a postdoc position, but would if I had to.” He checked yes for his answer.
B3
B4
B5
B6
B7
B8
B9

Page 70 of 165

B10
B1
B2
B3
B4 I knew I had a job before I was done. ENTERED OTHER: JOB OFFER ACCEPTED-WORKING FULL TIME

R19

R20

Employment
I was a little confused seeing the post-doc before the training. I thought all employment would be listed under there and not broken
up.

B5
B6
B7
B8
B9
B10
B1
B2
B3
B4
B5
B6 4 year college is the best match
B7
B8
B9

B10 Just research. I am trying to teach if I get the opportunity but no concrete plans nor is it required.

Page 71 of 165

Part C - Background Information
C1
C2 This good question
This is important to designate whether a person in a doctoral program was married, single...what their status was according to
matching up when you look at the information of how long it takes to do this. My children are 20 something years old now do I put
them down here? I think there needs to be a follow-up question. How many children do you have and were any of them
dependents while you were getting your degree. It comes down to whether you had dependents while you were in the graduate
program. Put it as how many dependent do you have now, and then have follow-up questions were any dependents while you
were in the program.
It‟s also important in relation to female vs. male because the female has to stop and have the baby.
CS: Why is that?

R1

C3
C4
C5
C6
C7
C8
C9

C10
C11
C12
C13
C14
C15

R1: Because the she has to stop and give birth
This is good to know where I have been
It‟s good to know age to see how old recipients are.
That is important because those that receive a doctorate may not be able to get a visa.
This is good so you can map where they came from.
This a good question because there are many levels of disabilities and this will enable you to know how it affects them attaining
their doctorate degree. Someone with a disability may have more time to do research vs. someone who has a more physical job
and is not able to spend as much time on research. It will also affect if they can teach. If there field is a hands on a disability may
not allow you to teach on a post doc program
It‟s good to know their level of disability
Important to know
Makes sense
Not sure if this is relevant
R1: This is relevant to me because I provided it
CS: X
R1: I prefer email
CS: Any concern providing street address or phone
R1: No

C16
C17 R1: This helpful for someone who is 23 and leaving home.
Page 72 of 165

R2

R3

C1
C2
C3
C4
C5
C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16
C17
C1
C2
C3
C4
C5
C6
C7
C8
C9
C10

CS: X
R1: I am a grown man. I would list my wife but if I move she comes with me. Should say list a friend or relative.
CS: Would you have any reservations giving that information
R1: Myself no…others maybe
That was easy
I don‟t have any
Both Bachelors
China
Non- US Citizen
China
China

No
Asian

My wife, of course she lives in same place as me

Father and mother both have master‟s degrees

Physical orthopedic disability. My spine is fused; I had scoliosis as a child.
X – What are your thoughts on this question?
They just want to know if you have a disability. It‟s never gotten me anything good, but I do have a disability. I don‟t get any benefit

C11 from it. It also doesn‟t really impair me that badly. But technically, I do have a disability, so I say yes.
C12 Yes
C13 Mexican or Chicana.

Page 73 of 165

Yes.

C14 They never have an option for mixed either, because I am half Mexican, half Irish/German/American Caucasian mix.
C15
Sometimes I don‟t give my email for these things. I fill it out and I feel like that should be good enough. And I give them my phone
number though because I‟m expecting them not to call. But I don‟t want spam. But I‟ll fill it out this time, since they clearly already
have it „cause the probably sent this to me by email anyway.
And whenever they ask for a daytime or cell phone, I only give them my home phone number because I don‟t want them to be
calling me at work. And I‟ll eventually get it if it goes to my home.
This I also feel is stupid – putting down my address again – because if this came though the mail, they already have my address.

R4

C16 But I play along anyway.
C17
C1
C2
C3
C4
C5
C6
C7 Trying to get it right because it tells me to skip down.
C8
C9
C10
C11
C12
C13
I would have to pick other. My ethnicity is not here. There is nothing for biracial or bicultural. Forces me to pick and I am not

C14 comfortable. I would be more comfortable if I could write it in.

R5

C15
C16
C17
C1
C2
C3
C4
C5

Wondering why you need SS. Wouldn‟t want to put them in because banks and companies ask for this information as security
questions.
Email fine.
Wondering why you would need this. Would probably fill out but does not think it‟s important.

“Farwaniyah in Kuwait. Though not K.U. National, but it‟s not asking that.”

Page 74 of 165

C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16

“It doesn‟t ask about dual citizenship. Doesn‟t it count? I am not going to answer that [question].”
“Illinois, it‟s not asking for the city.”
“No”
“No”
“Technically I am considered by the US census as white.”
“I am wondering what this is for.” He responds anyway.
He writes quickly. “Since you are asking me to tell you what I think, I am afraid that my writing is not legible, but that is neither her
or there.”
“I guess my girlfriend.”

C17 “None of this will particularly identify me right”?
C1
C2
C3 That is all they ask you is credentials. No questions about length in time in program; support from program.
C4
C5
C6
C7 Sadly I am not a US citizen and that is what is giving me trouble.
C8
C9
If I had a disability it does not give the option to talk about how it affected grad school. All you know is someone with a disability

R6

C10 graduated or not but you have no understanding why or how that affected.
C11 All multiple choice no length or detail.
C12
C13
I considered myself Asian and then when I got here I am apparently I am a Pacific Islander. In the Philippines they don‟t ask race.

C14 They ask religion but not race.
C15
C16 Good thing I have a non-university address because I don‟t have access to it.

R7

C17
C1
C2

They ask they name and address of another person. It does not end with just your information. They want to have options on how
to reach in case the contact information I gave wasn‟t current. Please provide your address and your name. I answered it wrong, I
put the person who likely to know where I can be reached in my address box. They ask for the mailing address of the person who
is likely to k now where before but email…faster.
Not everyone fits into these categories. Maybe the survey should explore opportunities for additional options here.

Page 75 of 165

C3
C4
C5
C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16
C17
C1
C2

This is all very matter of fact.

Not an official disability, no.

This whole section is very clear. It‟s all just basic recall
I can‟t think of an address offhand. I don‟t have any real family, so I‟m going to leave this blank.
For part C, this seems like standard survey data.
Again for C3, the checkbox is kind of off to the left. Visually, it‟s something I might have skipped over. It would be nice if it were

C3 aligned and the [responses] matched the other options.
C4 C4, C5, C6 seem straight forward.
C5
C6
Again, I feel like these arrows and the information in the margins are as easy to follow if the skip patterns were directly below the

R8

R9

C7 questions.
C8
C9
C10
C11
C12
C13
C14 C14 and C15 are pretty straight forward.
C15
C16
C17
C1
C2
C3

For question C16. It‟s not clear whether that‟s required. I generally hesitate to give out my email address because of spam. I‟m
thinking whether or not I want to include this. I may choose to leave this off.
“Easy one.”
“Married, one.”
“None, that‟s easy.”

Page 76 of 165

C4
C5
C6
C7
C8
C9
C10
C11
C12
C13

“Mother got through high school and my father has a master‟s.”
“Illinois.”
No hesitation… “March 30, 1950.”
“Getting long…that‟s easy since birth.”
“Everything has been in Illinois.”
“No, unless you count my eye but I will get it fixed, so no.”
“No.”
“White”…later in interview… “I have no problem giving out my race but I know others who have a real problem with these

C14 categories, if they have multiple backgrounds.”
C15 No hesitation… “we got that.”
No hesitation… “I am going to print it neatly so you can read it. I put my home phone down. I have a cell phone but it‟s usually not

C16 on so I put down my home phone.”
“Easy. I‟ve been there for years. I will put down my next door neighbor who is usually around, we are good friends. I can‟t recall
her address…got it.”

C17 …flipping through, closing survey…”Oh that does it…oh I should read the back we‟re not done yet.”
C1
If I were separated or divorced, I might want to know why you want to know that.

R10

C2 Comments. I don‟t think I‟d put anything down.
C3
C4
C5
C6
C7
C8
C9 Actually I see that secondary is high school.
C10
C11
C12
C13
C14
C15
For a daytime or cell, my daytime is my work number. I‟m reluctant to give my work number because I don‟t like taking personal

C16 calls at work, but I‟ll put it down. I don‟t think you‟ll be bugging me.
C17 I don‟t know if I‟d fill that out or not. For two reasons: I don‟t anticipate I‟d be unreachable for any reason. And the person I put
Page 77 of 165

down would be my husband. And if I were to move, he‟d move with me.

C1
C2
C3
Both graduated high school. He elaborates, “I feel pretty lucky because that is as far as they got and I am working on my second

R11

R12

C4 postdoc. I feel pretty blessed in that regard.”
C5 “I actually love answering this question”, he says. He misses New York and this makes him feel still connected to the city.
C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16
C17
C1
C2
C3
C4
C5
C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16
C17

I put my cell number because it is the best way to reach me. “Sometimes I don‟t answer my office phone.” He wonders whether
someone is going to spell his name wrong because it is an unusual spelling.
He puts down his wife. Then he flips open the code page as if to check for more questions.

He leaves it blank because he says that it is not applicable. “It doesn‟t fit.”
“That‟s a hard one. Hispanic is not a race. I leave that blank, although most Latinos pick white. I don‟t know if that is appropriate.”

Page 78 of 165

R13

C1
C2
C3
C4
C5
C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16
Now it‟s asking an address of another person, I won‟t complete that because I don‟t have my address book with me. I would

C17 probably say my parents in Pittsburg.
C1
C2

C3 My mother lives with me but she has her own personal savings. So she does not depend on me for financial support.

R14

I am not sure of their educational background; I am just going to say some college. I know what they studied, I just don't know

C4 what.
C5
C6
C7
C8
C9
C10

Page 79 of 165

R15

C11
C12
C13
C14
C15
C16
C17 I live with my mom. Mom is aware of my whereabouts
C1
C2
C3
C4
C5
C6
C7
C8
C9 Here‟s a tricky one. Not in a state – Washington DC
C10
C11
C12
C13
C14 I always like its weird when they ask this question. But I guess is a good idea.
C15 Wondering why the last 4-digits of my social security number, but feel secure giving.
C16 Don‟t mind giving email but prefer not to give my phone number.

R16

C17 They have my address but I will give it again. Don‟t want them to bother someone else.
C1
C2
C3 That would be 0. Oh wait, „mark x if none.‟ It would help if I looked at all the answers before I filled it in.

Page 80 of 165

C4 R Answers. Father - 2 bachelor‟s degrees. Mother has 1 bachelor‟s degree.
C5
C6
C7
C8
C9

Well it depends what you consider [disability]. I have a dog for diabetes. But I don‟t know. I‟ll put yes, because technically I am,

C10 but I don‟t know, that‟s everybody else‟s.
C11 Other, diabetes.
C12 No.
C13 Oh it skipped [laughs]. Helps if I follow the directions, again. It‟s been a long day.
C14 White.
C15 R provides.
C16

I‟m going to put my Dad, because my wife is going to be in the same place I am.

C17 There‟s that. Now I‟m going to see how many things where it said, skip.
C1
C2
C3 Might be important to move „None‟ to the top of the list since everything is in numerical order.

R17

C4 My dad has a veterinary degree a professional degree but not listed…
C5
C6
C7
C8

Page 81 of 165

C9 This is strangely worded question. I don‟t know if there is a better way to say that.
C10
You may want to indent C11 in under C10. Actually all dependent questions might be indented in because it looks like it‟s just the

C11 next in sequence.
C12
C13
C14

Why on earth do you like to know the last 4-digits of my social security number? That is information you like to keep private in this

C15 day and age when people are robbing them

C16 Email address sure, I don‟t know about telephone numbers. I don‟t necessarily want to be called. It might be better to say and or.

Why do you need to know where I know somebody else? Feels a little nosey. I can understand providing that kind of information
as an emergency contact as an employee but survey seems odd. And it might make people especially immigrants nervous about
the real purpose about the survey. I am at the same address as my husband so if we both move you can‟t find us. And that is who
I would put down here unless you want me to put my mother and father.

R18

C17
C1 “This is easy enough.”
C2
C3
C4
C5

“I am wary of giving my date of birth. I would probably make up a date by changing the month and day of birth, I would put the real

C6 year. I don‟t see how this is pertinent to the study.”
C7
C8
Page 82 of 165

C9 “I really don‟t know the distinction between high school and secondary.”

C10 The respondent laughs and comments “that is a loaded question.” On the survey he indicates that he is not disabled.
C11
C12
C13

C14 “I always hate that question” he responds because he thinks that Asian and Indian should be distinct from each other.
C15 “I don‟t mind giving that.”
“I‟ll give you my email address and day number and my right address because this is something that I have to fill out for my grad

C16 school.”

He didn‟t see the reason for this question, but he provided his wife‟s name, but no other information because, he asked, “Why

C17 would I need for you to reach me?”
C1
C2
C3

Mother she‟s got community college degree and a nursing degree but there is no nursing. I thought it would have been a

R19

C4 professional degree but did not seem appropriate. No sure what else would like to see.
C5
C6
C7
C8
C9
C10
C11
C12
C13
Page 83 of 165

I was looking for other or fill in. I thought there would be one there but there wasn‟t. Sometimes there is usually else there.

C14 Depending on my mood I put in other and fill it in. I am Haitian American. Usually I put black.
C15
C16
C17
C1
C2
C3
Bachelors – Mother

R20

C4 DDS – father…Doesn‟t matter anyway.
C5
C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16
C17 I'll just put my wife. Address is the same.

Page 84 of 165

Back Page
So that is page 6. Where is page 7? 8 Field of Study and 9 Field of study. Ok 10. Oh that‟s

Additions to Questions [A2 and A9] continued from the other page.

R1
Comments about the Survey
Bar Codes and Survey Design

R2

R1: Good to add comments about answers or response to questions.
CS: Did you make any comments?
R1: Not at all…not at that time…I had these thoughts when I couldn‟t answer questions but I never
indicated it in the comments.

Additions to Questions [A2 and A9] Where does this question come from…Oh for more degrees
Comments about the Survey
Bar Codes and Survey Design
No that‟s it. I don‟t have any questions
x-did you have any thoughts on the back page.
I didn‟t read the thing. Well, I read the first line of it, and it‟s clearly the same kind of
congratulations I already read. And just glancing at it you can tell it‟s the same thing I already
read, of why I‟m doing it. And I already scan these kinds of things in the beginning, the initial letter
to see if it‟s worth doing. And I already decided that it was worth doing. So I‟m not going to bother
to read this again for it to tell me again that this was worth doing. I don‟t think anything needed to
be added further.

R3

R4

R5

Additions to Questions [A2 and A9]
Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9] I might miss this page
Comments about the Survey
Bar Codes and Survey Design

Additions to Questions [A2 and A9]
Comments about the Survey
Bar Codes and Survey Design

The respondent didn‟t see the questions at first. Then says “Oh wait, I have no idea where this
came out of. Usually, if you weren‟t here, what I would do is just ignore it. [Seeing] „office use only'
makes me feel better about that.”

Page 85 of 165

Additions to Questions [A2 and A9]

What is this? This kind of threw me off. I thought I was done. A brief reminder of what this
section is referring to would minimize confusion. Why couldn‟t they have just put it beside the
question? Just for logical flow.
I would have appreciated having question that addressed other dimensions of grad school.
Including factors affecting duration of study (which is an area of concern especially for humanities
who apparently have longer average times than the sciences), and what influenced post-gradation
career plans (try to understand what made you decide to take a post doc instead of taking position
in industry) in order to improve the…of PHD programs to help the US be more competitive in the
global economy.

R6

Comments about the Survey
Bar Codes and Survey Design

I entered grad school wanting to be a professor but somewhere along the way that is not what
happened I feel sad about that in one sense and I am hoping efforts are made to try to understand
that and to try to keep people as interested in the sciences as much as possible. Even though I
understand the need to have scientists I cannot make myself follow a research career going
through what I have gone through. Questions like those I think would help develop/improve
graduate programs in the future to increase the number people who stay and do research.
What is this for? Do I need to answer this? (After going back to A2 & A9). This doesn‟t apply to

R7

Additions to Questions [A2 and A9] me. It should have some sort of instructions explaining this is for additional questions.
Comments about the Survey
Bar Codes and Survey Design
Respondent reads back cover.
It‟ a little bit confusing. If the end of the survey is on the bottom of page 6, it would help if it said,
“this is the end of the survey.”

R8

Respondent talking about bottom box on page 6.
I‟m not reading this [ending paragraph], because it looks like something I could ignore. I turn to

Additions to Questions [A2 and A9] the back and it takes awhile to figure out that this is supplemental information to other questions.
Comments about the Survey
Bar Codes and Survey Design

R9

Flipping back to A2 and A9, rereading them, “let me just look here to see if I have it right. No, no

Additions to Questions [A2 and A9] more.”

Page 86 of 165

“This is fun to fill out; I love surveys. I think this information is helpful for various education policy
makers and organizations. There is a shortage in nursing, I wonder if this information can help. I
want to ask my peers regarding their experiences at Loyola, what they found frustrating. Some
experiences were frustrating and my peers agree it takes a long time to get a doctorate degree. I
hope my handwriting is clear. I think the questions were really good; they make me think.”

R10

Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9]
Comments about the Survey Comments. I don‟t think I‟d put anything down.
Bar Codes and Survey Design
Additions to Questions [A2 and A9]

He says “I think that I am finished with this. I mean it just…At least here is the additions section
and I am assuming there isn‟t anything to fill out. I don‟t have any additional information because I
gave them all my information. And comments…well they are all recorded.”

R11

R12

Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9]
Comments about the Survey “I guess I am done with this.”
Bar Codes and Survey Design
Additions to Questions [A2 and A9]

R13

R- Reads the item. R says, I think it‟s asking me to complete the question for A2 here on the back
of the survey. Sort of an abbreviated version of the question. R reads A9. R reads A2.
No, I‟m sorry I made an error. It‟s if there are more than two fields and space is given on the back.
I don‟t think I would have made any comments. The questions seem straight forward. I don‟t think
there‟s any need for any comments.
X – Points out that R missed the front cover.

R14

R15

Comments about the Survey R fills the front cover.
Bar Codes and Survey Design
Additions to Questions [A2 and A9]
Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9] What‟s on the back?
Comments about the Survey No specific. Glad I finished it. Feel that I am contributing to society.
Bar Codes and Survey Design

Page 87 of 165

Additions to Questions [A2 and A9] Alright. There‟s those, now I‟ll fill out the back.
Nothing really stands out. It‟s a survey. So we‟ll just say, „no comments.‟
Interviewer – you indicated that you missed some skips in the questionnaire. Can you give us any
suggestions to make those skips more easily to follow?
I don‟t know. Me missing is probably more that I‟m tired than anything else. You maybe can put
arrows, and I think there were some. Those I know I saw. Yeah, the arrows off to the side that
says, go to, and skip to.

R16

Interviewer – would bolding help? Having them closer to the answer.
The only thing in my particular case is if there was an arrow that went directly to the question. But
you can‟t really do that. So, I read the question and saw that that really didn‟t apply so I went back
and looked.

Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9] What is this? All the field stuff should be together.

R17
Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9]

R18

R19
R20

Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9]
Comments about the Survey
Bar Codes and Survey Design
Additions to Questions [A2 and A9]
Comments about the Survey
Bar Codes and Survey Design

The way HD Human Development is currently categorized really doesn‟t represent what Human
Development is at least not at the University of Chicago. And since we invented the field, I think
that carries some weight.

“I probably wouldn‟t take the time because filling out the survey was enough of my time. If this was
shared with my particular program than I would comment on that, but given that it is general, I
wouldn‟t give you any more information.”

Page 88 of 165

Probes - Consent Language
Did you read? Why or Why Not?:

R1

Summary of Paragraph:
Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:
Did you read? Why or Why Not?:

R2

Summary of Paragraph:
Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:
Did you read? Why or Why Not?:

No – Based on the information from this document [brochure] helped me to understand the
purpose and use. Normally a person should read this. I recall it from the website. I see all the
logos and think this must be legitimate survey.
State Act of 1950 which I am not really familiar with that act. all information will be treated as
confidential...here is something we do for our research it is same info our graduate school
makes us sign off on Last 4-digits of SS number solicited under the NSF act of 1950. I don't
know why but it‟s if they ask for it will be kept confidential, used for quality control and will not
personally identify you. Information given will not adversely affect you.
Anyone familiar with this research should be familiar especially doctoral recipients.
Yes
There is no security in written version. I don‟t know where it would end up.
If this information was taken and then entered in secure database. Being online hopefully in
secure database. Mailing this back, who knows will this end up.
Felt internet that was more secure than paper
No I didn‟t. It‟s general information or whatever. I read the letter and I already decided to take
the survey. I basically don‟t like legal language. I am just lazy.
General, confidential, information according to law. The purpose is only for study research,
analyze data. Your information and well as your number will be confidential. So basically you
are protected.
Yes, I am just being labeled
I would think so.
Yes
No its okay. Other places require last 4-digits.
No
The part where it‟s telling you that it will take 19 minutes and if you have comments regarding
the time estimates, it would take more than 19 minutes so clearly I‟m not going to contact
anybody.

R3

It‟s the same information here that was on the initial cover letter. Pretty much everything I got
out of here.

Summary of Paragraph:

Sure, that they‟re going to gather and keep this information confidential. And it‟s going to be
used for studies, I‟m still not clear on what, but it will be used by a bunch of organizations that
actually do decent research, so it‟s fine by me.

Page 89 of 165

Initial Reaction:

Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:
Did you read? Why or Why Not?:

R4

Summary of Paragraph:
Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:

R5
Did you read? Why or Why Not?:
Summary of Paragraph:

They‟re boring.
No. They say preparing scientific reports or articles; but saying you‟re doing anything scientific
is a real cop out to say what you‟re doing with it. Considering the type of information they
asked. They just want to know what doctorates do after they graduate and what their plans
are. I assume some of these things that they‟re going to be used for are figuring out why
women drop out of the sciences, which I think is worthwhile. I don‟t know what else they could
do with it.
x- What would you like to see instead of this?
I don‟t know some of this stuff has been here. It‟s telling you legally that they‟re going to keep
it confidential.
x- You said that it doesn‟t really explain – what would you have liked to have been explained.
Instead of this pamphlet. Instead of saying the organizations that do it, say some of the
studies that resulted. They do have some of these books here. So, “American women surpass
men in doctoral studies,” that‟s interesting.
x- So statistics?
Yeah. The thing with statistics, like in the past we found that so many people graduated and
are planning on doing this, that would be kind of cool. Then you could see how you fit in to it,
instead of having a list of organizations which are already in the cover.
Yeah. Or I wouldn‟t have filled it out.
Not really, they probably have it anyway because it got me through the university. I might not
have put it down if they wanted the whole thing.
No, just the first couple of lines since I read the letter.
This information comes from grant source. All treated confidential. Just like other research
efforts. Will be used by a lot of different people. Social security number voluntary. This would
have been put next to question.
Basically this is an informed consent.
Yeah it tells you where it‟s doing
I feel pretty comfortable. Did not want to give Social Security number. This should be
highlighted of emphasized.
Never been asked for a survey. Very generic wouldn‟t tell you how the far the information will
go.
“I never read these.” “Usually what I would do is not read. It‟s kind of like the thing that I just
signed. I‟ll read it now because I feel pressured because there are people around.” Upon
reading it the respondent comments, “Maybe this is not the same information. I would have
assumed that it was the same information, but maybe it‟s not.” After reading he says, “Well I
guess that would have answered my question [about being personally identified], but I would
have still probably called you because I would have not read it.”
“I am not really good at summary, so basically I look at key points: NSF, confidential, SSN
doesn‟t really matter, federal evaluation, and the time thing, I don‟t really know if its 19 min…”

Page 90 of 165

Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:
Did you read? Why or Why Not?:

R6

R8

“Yeah. I do.”
“Yes, that‟s just a fear of government I have because I don‟t trust the government. I still
provided it because this authoritative survey told me to so I obliged.”
No. It‟s not a big deal.

Summary of Paragraph:

Your privacy will not be at risk in anyway and everything will be considered confidential. And
you will not be identified by your name.

Initial Reaction:
Explains fully how data will be used:

Sounded like standard disclaimer. Even though you asked me to read it, I still did not read it.
It‟s fine print. Maybe if it was bulleted instead of sentence form.
I think so.

Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:
Did you read? Why or Why Not?:

R7

“They eased any fear that I have being identified with the survey. Not really with the survey, I
don‟t like being identified period.”
“Yes it does provide how it will be used. No it does not do it fully.”

Summary of Paragraph:
Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:

The only personal...You did not ask for my complete SS which was good and my birth date. If
I moved out of this address or I did not respond to email or the person I put... I feel like it
doesn‟t completely link me.
No, I like it that it‟s just the last 4 digits.
No, I didn‟t bother. (After reading)
Things will be kept confidential; my information will be used by a couple of organizations to
collect data. There‟s no risk to me, its standard stuff.
It seems very clear. I have no idea if it really took 19 minutes.
Yes
Yes
No, I‟m putting my trust in you. Maybe if my identity was stolen I would feel differently.

Did you read? Why or Why Not?:

No. There‟s a lot of information. It doesn‟t look like there‟s a lot of disclaimer information. The
font color that‟s used is the same as the cover, so it blends in and doesn‟t stand out.

Summary of Paragraph:

That this information is confidential. It‟s voluntary. And whatever information you disclose will
not be shared with other parties.

Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:

Pretty standard. Nothing really stood out as out of the ordinary. It‟s obviously reassuring that
the info I‟m providing will be kept confidential. Met my expectation.
No.
Yes.
No.

Page 91 of 165

R9

Did you read? Why or Why Not?:

“I probably read half of it and stopped. I‟ve read so many things like it that I think I probably
know what it says. I saw „confidential‟ and immediately assumed I knew what it meant and
could blow the rest of it off.”

Summary of Paragraph:

“It will be confidential, the information won‟t be shared with other people, it‟s for educational
purposes. There is someone you can contact with questions and comments.”

Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:

Did you read? Why or Why Not?:

Summary of Paragraph:

“I kind of thought they are the standard fare, it‟s good to have it in there. If it wasn‟t there I
would be concerned. I have done research and would expect this to be there. I‟ve never had
a problem with this kind of thing in the past.”
“I think it does, I don‟t know what the Act of 1950 is. I see a lot of this it seems familiar. For
others it might be confusing but it doesn‟t concern me much.
“Yes I do.”
“Very little, I put it on the internet when I have to. I‟ve never had a problem with identity theft
and I feel in this situation its fine and I‟m generally okay with giving it out.”
No.
They just look like legal. Some of it‟s in all caps telling of confidentiality. Then there‟s this
legal stuff about the NSF act of 1950.
Information collected to be used by own institution, and some other agencies who look at what
people do after they get their doctorate degrees. The information would be completely
confidential. The last for digits of the social security number would be used as an identifier
that I‟ve completed the form.
Standard confidentiality. The only thing that was new information was that it‟s used for
research and statistical purposes by your institution. I didn‟t get from this letter that it would be
used by my institution. It says the information is used by government and academic
institutions, but it doesn‟t say specifically that it will be used by my institution.

R10

Initial Reaction:

And then it says that I don‟t have to answer some of the items if I don‟t want to. And that it
should take about 19 minutes.
Well, for one thing. I don‟t know what the NSF act of 1950. It sounds upstanding and
trustworthy. I assume that what it means is that this is information that is being collected for
scientific study for the careers and work done of people who get doctorate degrees.

Explains fully how data will be used:
Will data be secure and remain
confidential:

I just get the general sense, is that this is a general confidentiality statement.
Yes

Page 92 of 165

No

Concerns providing last 4-digits of SS:

Did you read? Why or Why Not?:

R11

Summary of Paragraph:
Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:
Did you read? Why or Why Not?:

R12

Summary of Paragraph:
Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:

Did you read? Why or Why Not?:

R13

By the way, one thing that makes [the survey] seem legitimate is that it‟s affiliated with the
University of Chicago.
He did not read the paragraphs because, he says, “I don‟t usually read fine print, which is odd
because I am also training to be a lawyer. Seriously, I read the signed consent form, so I got
my information there.”
He summarizes, “The responses are confidential, and the last four digits of your social security
number are for identification purpose only so that the results can be tied to the person filling
out the survey. Since I‟ve done research I know that it says that.”
“I mean I trust that their statements are genuine. I believe that it is true.”
“Yes”
“Yes”
“No, I think that this comes from my bias in doing research. I really do believe confidentiality
has a place and people really do adhere to it.”
No, he did not read the paragraphs preceding the survey. He figured that NORC was a
legitimate source and he was familiar with the survey because he knew others who took it.
“It is just basically letting you know that the information will be confidential and it can be shared
with public and private institutions, government agency and universities, for statistical
purposes.”
“I would say that I have no reaction. It is standard for surveys.”
“Yeah, I think it is pretty clear. The word „confidential‟ is in there I don‟t know how many times.”
“I hope so,” he responds. When asked to answer with a definitive „yes‟ or „no‟ he says, “yeah.”
“No. that‟s pretty standard, especially when dealing with the government.”
No. I read where it says in caps that all information will be treated as confidential. All of these
things seem to be sufficient and reassuring. Again, this is an organization that I recognize.
And I didn‟t hesitate to supply the information.

Summary of Paragraph:

Sure. It‟s saying that the information that I provide will not be disclosed. And that it‟s being
used for research purposes. And that the last four digits of my social security number will not
be exploited, and that this is needed to make sure that the person who completed the survey
is the person who earned the degree. And as a reader of this, this seems plausible.

Initial Reaction:

My reaction to them was favorable. And that these paragraphs confirmed the initial opinion I
had of the whole mailing that I received, which was favorable. Based on NORC‟s reputation.

Explains fully how data will be used:

Well, I don‟t have grounds for answering that because I don‟t understand, 100%, how this will
be used. I‟m not doing the research, so I don‟t really know. But I have a general sense of how
it‟s going to be used. And the general sense is that it‟s going to be used for research

Page 93 of 165

purposes.

Will data be secure and remain
confidential:

Concerns providing last 4-digits of SS:

Did you read? Why or Why Not?:

Summary of Paragraph:

R14

Initial Reaction:
Explains fully how data will be used:

Will data be secure and remain
confidential:

Concerns providing last 4-digits of SS:

R15

Well, I think that it‟s highly probable that the information will remain secure and confidential.
No. Because, again, I‟m not an expert on ways of which people‟s personal information can be
used or exploited, but it‟s my guess that the last four digits are not sufficient to any nefarious
purposes
No because presumed it would be the same as what was written in the cover letter. I just read
the first line and what caught my attention is that everything I provide would be confidential.
So I did not see the need to read the rest of it. Which is why I asked for copy of signed
document.
It's saying everything that I provided in this survey will be kept confidential. And the last 4digits, which I already put in, I realized if I had read this I would have not put it in. Because it
says here it is voluntary but it will be kept confidential so I am not too worried about it. I wish I
had read that at first and not responded to those questions.
The fact that it‟s going to be kept confidential doesn‟t worry me to much it doesn't worry too
much about giving my personal information. I appreciate the fact that it will be kept
confidential.
Yes
Which is the reason again I asked you for a copy of that document (consent statement) so that
in case something happens I have that letter with me signed by both of us. Just based on that
sheet of paper that I signed - everything will be kept confidential.
I do. X No, because even if I had not signed that sheet of paper I would not have read these
two paragraphs. X I am having second thoughts now that I gave my social security. If it‟s
okay, I would like to cross it out.

Did you read? Why or Why Not?:

I did not. I felt like it was going to be boiler plate statement and I glanced over the one on the
little pamphlet.

Summary of Paragraph:
Initial Reaction:

The survey materials are confidential and won‟t be shared. Last 4 digits to verify my identity to
for quality control purposes.
This is a boiler plate that is required for human subject‟s research.

Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:

No, I don't think this paragraph along says anything about how it will be used. In fact this
paragraph says almost nothing.
Yes, I believe it will. I know that this information could get it. I takes a lot of effort to
information confidential
I don't

Page 94 of 165

Did you read? Why or Why Not?:

Summary of Paragraph:
Initial Reaction:

R16
Explains fully how data will be used:
Will data be secure and remain
confidential:

Concerns providing last 4-digits of SS:
Did you read? Why or Why Not?:
Summary of Paragraph:

R17

Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain

No. I wasn‟t too worried about it after reading the letter. I just assumed it was right. In this
case, I didn‟t worry about it.
It‟s saying that the point of doing this is for research to look at responses and to help out the
institution that I came from. What else was in there? That was one thing, and that I don‟t
really remember the rest of them. A survey to gain information was the way I looked at it.
Nothing much and I wasn‟t surprised. Its stuff I had assumed. Nothing really stood out.
I‟d say, no. Indirectly, yes. It says the information will be used by these people. If I knew that
this was going to eat away at me, I‟d be looking at specific details. But obviously, you can‟t put
that in there. For me to say that I understand how it‟s going to be used. That‟s what I‟d be
thinking more at an in depth level. But it does give an overview. So technically it does
answer, yes.
I‟m not worried about it. It didn‟t bother me before. It‟s nice not having to put the full social
security number.
I generally wouldn‟t do it. But in this case, it didn‟t bother me. I supposed of the first
paragraph, that was the only thing that stood out, was that you don‟t have to provide the
[social security number].
Nope Its small print and legalistic-Even as an educated person with a degree I am not familiar
with all these acts and amendments that are referenced.
You guys are abiding with this body of legislation. And that a whole slew of people will have
access of these data but this data will be confidential.
I don‟t know what the statement “National Science Foundation Act of 1950, as amended”
means. That‟s a heck of list of people who might use this data. So the SS number is
voluntary. You might mention that in the body of the survey as well. Everything about this
survey looks mandatory.
That might be made more incorrigible in a number of ways. In designing my own my
confidentiality and participant rights documentation for the IRB, I tend to avoid laundry list of
people who can use the data. I‟ll have a form that says these are the participants in this
research and then when I get down to participant rights and responsibilities, I say the people
listed at the beginning of this are those that will have access to the data. And these data will
be kept strictly confidential using whatever you use. We never mention that NSF act of
1950...I have no idea what the amendment is. I have not idea why it would ask for part of my
SS number. If a survey were being directed toward immigrant it would make them very
uncomfortable, makes more financially conservative people than I am very uncomfortable as
well makes me uncomfortable. Putting in fine sort of legalize print at the bottom. As
consumers were used to skipping the fine legalize print because it doesn‟t seem relevant to
our lives. So making it seem more about me and less about the NSF act might be useful. I
would re- word the word failure.
If I study it hard yes.
I hope so.

Page 95 of 165

confidential:

Concerns providing last 4-digits of SS:

I hope so because it‟s hard to recreate the SS from the last four digits. But we are encouraged
daily by the media, financial advisors by our parents and loved ones to not five our SS number
if we don‟t have to. Especially with the current climate of increased aptitude in identity theft.
Giving our SS on a qualitative survey seems kind of strange. Even as researcher I don‟t know
what kind of purpose that would serve.

Did you read? Why or Why Not?:

“No.” “I didn‟t think about it. I trusted the survey because it was given to other graduates and it
was mandatory by the university. If it is something that I have to do, then it wouldn‟t matter
about fine print.”

Summary of Paragraph:

“Now I wish that I had read it because I would have left my date of birth blank. I probably
wouldn‟t have given my social security number either. The time estimate was correct.”
“It says who originated the survey and where it is going to go.” He believes that it is “going in a
pile in a government office” mostly because of the NSF act from 1950 that was cited in the
paragraph. “It makes me wonder if anyone is going to read them.”
“That they are pretty standard. I thought „Oh great. Another government survey that won‟t be
followed up on.”
What would convince you that this survey is followed up on?

R18

Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:

“Like when you do a survey in a magazine, then the report comes out. If they mailed
something to me or if someone from the university followed up on it. If there was a tangible
report. It would be good to know the information on the fields. This has potential to help me
out.”
“No, not fully. As a researcher I see it as very vague. It doesn‟t really explain the purpose.”
“Yes.”
“No, but I did have concerns about my birth date.”
Why did you have concerns about providing your date of birth?

Concerns providing last 4-digits of SS:

R19
Did you read? Why or Why Not?:

“Because that is the complete answer. If you have the last four digits of someone‟s social
security number, there is still six other numbers to figure out.”
No I didn‟t. I thought it was basic information about the survey or about the organization and I
guess I just assumed that I knew it all and it wasn‟t that important. I also just assumed it was
regular legal information or copyright information.

Page 96 of 165

Summary of Paragraph:

Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:

Concerns providing last 4-digits of SS:

Did you read? Why or Why Not?:

R20

Summary of Paragraph:
Initial Reaction:
Explains fully how data will be used:
Will data be secure and remain
confidential:
Concerns providing last 4-digits of SS:

The information will be kept confidential. It‟s used for research purposes. They make sure they
have your correct information by using social security numbers and you have the right to not
answer a question that you would not like to answer.
I kind of felt it was pretty basic. What I would expect to be on a survey when you are providing
information. You have option to not answer anything and also since it‟s a survey it's
understood that you would tell you what the survey is used for. Nothing came out of it that was
unexpected.
Yes, I understand what the researcher and statistical purposes is but it‟s still a bit vague as to
what type of research is still being done with the information.
I think so. Just the fact that it‟s a government agency I feel like it probably would be.
I sort of hesitated but usually it‟s pretty common to provide that. I wasn‟t that big of a deal. I
hesitated more so…Do I really need to fill this out now? I guess going through the motions of
it. Otherwise it‟s not a problem.
I did not today. Although I read this [brochure] and I kind of assumed it was that. I don't
remember seeing this last year. Probably having skimmed through this, I skipped the fine
print.
Who funds it...the NSF. What the data will be used for. It also explains about things like
collecting the last 4 of your social. The basis how they have the authority to ask for that
information. Also explains that the responses voluntary. The usual informed consent,
protections, disclaimers.
Standard, nothing new here. If I have been reading it ahead of time. Social - interesting
So coming from social sciences myself…Yeah it‟s in my language sort of speak. If I were
coming from different field like engineering, I don‟t know.
Yes
Using that last 4 seems to be a wide spread way of not disclosing the whole one but still
retaining some identifiable information. It seems pretty standard.

Page 97 of 165

A2 Probes - Interdisciplinary
Thought Process: Indicated this question was redundant

R1

R2

Definition of Interdisciplinary:
Clear Term:
Research Interdisciplinary?:
Accommodates interdisciplinary
dissertations?:
Instructions in italics:
Thought Process:
Definition of Interdisciplinary:
Clear Term:
Research Interdisciplinary?:
Accommodates interdisciplinary
dissertations?:

If you are working in communication, like myself, and doing a dissertation in education
and the subject matter crosses over. That to me is interdisciplinary
Yes
No
I would say it could
He references the italicized instruction is question A5 not A2. He felt those instructions
were clear.
Skipped
Two area research fields…crossing areas of two fields.
I think so
Yes - applied math and finance
I think so
To be honest, I kind of tired. I did not notice that. May have thought of other related

Instructions in italics: fields. It‟s fine.
I wrote down ecology because that‟s the name of the field of my research, even though
my degree is going to be in evolutionary biology. But I studied ecology. Then I went and
looked for the code, and they didn‟t have ecology, which is always irritating. And then I
picked the one I thought was closest, which was environmental sciences. Which is not
ecology, but there wasn‟t anything on here that was close to ecology.

R3

Thought Process:

Definition of Interdisciplinary:

I guess the other thing I was thinking about was plant sciences other. But I studied
community ecology, so it‟s not even. So it would be plant sciences other and animal
sciences other.
The study that takes, or overlaps in two different fields. Mine doesn‟t, it‟s just ecology.
There are some people; using paleontological data use that to study ecology. That
would be interdisciplinary between ecology and paleontology and or evolutionary biology
and paleontology.
[laughs]. If it‟s not, they shouldn‟t get a PhD. Interdisciplinary is totally a buzzword right

Clear Term: now. So everybody should know what it means.
No. It was ecology, with some conservation aspects, but I guess conservation falls

Research Interdisciplinary?: under ecology.
Page 98 of 165

Accommodates interdisciplinary
dissertations?:
Instructions in italics:

R4

Thought Process:
Definition of Interdisciplinary:
Clear Term:
Research Interdisciplinary?:
Accommodates interdisciplinary
dissertations?:
Instructions in italics:

I was thinking how they would have it listed. I was annoyed that it wasn‟t there.
I did not know how to code.
Collaboration between different fields
I think so.
No

“I was sort of. I did not know how to answer it because I have several primary fields. And
I don‟t feel like US foreign policy alone captures it. There is not enough room, so you
have to be as brief as possible. Although if you give PhD students more space, they
would write a book in it.”

R5

Thought Process:
Definition of Interdisciplinary: "A field that traverses a multiplicity of disciplines."
Clear Term: “Yes, it‟s almost like ingrained in their heads from day one.”
Research Interdisciplinary?: “Absolutely.”

“No. I think that at the point that you ask for primary field, there is something that always

Accommodates interdisciplinary takes precedents. Interdisciplinary assumes that all disciplines are created equal and
dissertations?: treated equally. Any time you ask about a primary field that dissolves that.”

Instructions in italics:

Thought Process:

R6

“I didn‟t even notice them. Now that I look at them they are clear. I think they should be at
the top may be better since people read from top to bottom it wouldn‟t shut down the
possibility of interdisciplinary when you ask about the primary field of study because
once I fill that out I feel that it is safe to move on.”
It says using the list on page 7 so I look and expect to see a list on page 7 and there is
no list. There is a paragraph that says field of study list is on page 8 and 9. I felt a more
way would be to say go to page 8 and 9. I don‟t understand what this page is for…it‟s
just an additional step extra step
It‟s when a mix of pre-established fields that are currently available. Interdisciplinary

Definition of Interdisciplinary: uses resources or expertise from two or more established fields.
Clear Term: I think so.
Research Interdisciplinary?: My program is interdisciplinary but my research degree was not.
Accommodates interdisciplinary
dissertations?:

Page 99 of 165

Instructions in italics:
Not much thought process. I knew it was sociology. When I went to the code list I only
had to search for a moment before finding the Social Sciences and figured Sociology
would be in there.

R7

Thought Process:
Definition of Interdisciplinary: Several fields together, drawing from various disciplines.
Clear Term: Anyone who has a PhD will know what it means.

Research Interdisciplinary?: No. I used research from different fields, but my department was not interdisciplinary.
Accommodates interdisciplinary
dissertations?: Yes
Instructions in italics: I probably did, but I wasn‟t really paying attention since it didn‟t apply to me.

Thought Process:

R8

R9

R10

Definition of Interdisciplinary:
Clear Term:
Research Interdisciplinary?:
Accommodates interdisciplinary
dissertations?:
Instructions in italics:
Thought Process:
Definition of Interdisciplinary:
Clear Term:

Pretty straight forward. Field is definitely the right word used in this situation. Other
people may use area. Or field of study. The second part of A2, I know you‟re supposed
to go to the list. But the list not being on page 7 is another thing. I don‟t see anything
confusing or strange about the third part. I didn‟t really read the italicized bit because
that I thought was associated with the interdisciplinary part.
Using multiple fields or having your research span multiple fields. Sociology or
anthropology or sociology or history.
Yes. I think so.
No.

“Since it‟s a nursing program I did nursing and most of my research in nursing.”
“Fusing different disciplines i.e. immunology and nursing working together.”
“Yes, everyone should be very familiar.”

Research Interdisciplinary?: “No, though my committee was, one man was an immunologist and I worked in his lab.”
Accommodates interdisciplinary
dissertations?:
Instructions in italics:

Thought Process:

Just that my degree is in nursing science and, that‟s it. And especially when I went to
the list of codes, and nursing science was on there, that‟s certainly the most appropriate
code.
If my research had been done with someone from another department. Research done

Definition of Interdisciplinary: in conjunction with another department.
Page 100 of 165

Clear Term: Yes. There might be some people, there might be some gray, but to me it„s clear].
No. Some of my subjects were. I was taking this to mean did I collaborate with

Research Interdisciplinary?: someone else in doing the research itself.
Accommodates interdisciplinary
dissertations?: Yes. I think so.
Instructions in italics:
He did not have much of a thought process because he thought that it was a very

Thought Process: straight forward question.

R11

Definition of Interdisciplinary:

“People from various disciplines. People coming from different perspectives and
practices. Some programs will offer advanced degrees in areas where you are studying
things in various different fields. For example, people in sociology might be looking at
things with systemic factors. Actually, now that I think about it, I cannot think of too many
programs that adhere to that. They try to keep [degrees] very specific.”
“I think in practice people know what it means, but when it comes to dissertations, not so
much. I think most students might be coming from programs where their dissertations are
very focused in a specific area rather than it being something that focuses on different
aspects of different fields.”

Clear Term:
Research Interdisciplinary?: “No”
Accommodates interdisciplinary
dissertations?:
Instructions in italics:

“Obviously political science is a general field within there is four categories: American

Thought Process: politics, theory, methods, government interaction. I fall in American politics.”
“You actually borrow from other studies or methods different research approaches to
conduct one study. You go outside of your field. So to history, anthropology, sociology. It
is basically an intersection with different fields appropriate to the study.”

R12

Definition of Interdisciplinary:
Clear Term: “Yeah”

“Yes it was to some extent, but it wasn‟t fully interdisciplinary, which is why I didn‟t fill in a
second field. I would not consider one or the other primary or secondary. Political
science is interdisciplinary by default. I didn‟t have to separate from those different
fields.”

Research Interdisciplinary?:
Accommodates interdisciplinary “No because it just gave me one option. If you are going to do something like that you
dissertations?: should give three fields.”
Instructions in italics: “Yeah, they were clear. Pretty straight forward. They were right there on the box”
Page 101 of 165

Thought Process:

R13

Definition of Interdisciplinary:
Clear Term:
Research Interdisciplinary?:
Accommodates interdisciplinary
dissertations?:

Instructions in italics:

R14

Thought Process:
Definition of Interdisciplinary:
Clear Term:
Research Interdisciplinary?:
Accommodates interdisciplinary
dissertations?:
Instructions in italics:

Thought Process:

R15

Definition of Interdisciplinary:
Clear Term:
Research Interdisciplinary?:
Accommodates interdisciplinary
dissertations?:
Instructions in italics:

In my case, the first field I would have looked for was political philosophy. I studied
philosophy in a political science department. But political philosophy didn‟t appear, and I
understand there are good reasons for this. And so I looked right away for political
science. Then when I saw the opportunity to supply a second field, I was confident I was
able to classify my research accurately.
It‟s research that cuts across disciplinary boundaries. Its research that cuts across
classes in to which other research normally falls.
Yes
Yes
Yes
I did not notice them the first time I looked at it. And I didn‟t take note of it until I
completed the survey.
x- Looking at them now, do you think they‟re clear?
R – Yes.
Very straight forward. My subject was cancer immunology. I did not have to think twice
about it.
I would think it is combining more than two subjects.
I think so, yeah.
Yes
Yes
I noticed them and they were clear.
When I think of primary field…I thought that academic institutions can be split up into
many types units…You can describe it in many different ways such as Russian History,
History of Medicine etc.
Work that crosses the usually accepted boundaries that define different fields of
investigation. Such as public health and history.
Yes, I do.
Yes
The problem with phrasing of the question…People can interpret this in different ways
Very clear

Page 102 of 165

Thought Process:

The field of study for my dissertation research, I was thinking the exact branch of science
it related to. Not even branch, but what specific area of my major that it was related to.
And since it‟s a broad area that encompasses many things, I didn‟t think Chemical
Engineering right off the bat. I did stuff on the confirmation of absorbed polymers. So
polymer science, right off the bat.
I would say involves different fields of study. I started as a graduate of paper science
and engineering. That essentially was moved away and I was combined in to the
chemical engineering program where it was initially interdisciplinary where I was working
towards a paper science degree in chem. E. Switched that over to chem E. That‟s an
example of interdisciplinary more than a description.

R16

Definition of Interdisciplinary: Something that branches out in to multiple areas.
Clear Term: I would hope so. Watch – my definition isn‟t right [laughs].
Yes. It was the effect of site blocking in absorbed polymers. IT was originally – you can
use that for paper making, retention applications, which is what the original focus was.
Then we moved along to other areas, like water treatment. Then we moved on to other
areas.

Research Interdisciplinary?:
Accommodates interdisciplinary I think so. The way I looked at it was, list two different areas where you research fits in
dissertations?: to.
I honestly didn‟t notice them. I was going through it rather quickly. I looked at it and

Instructions in italics: thought, alright, two fields. But I could sit here for a long time putting in sub branches.

Thought Process:

R17

Comparative Human Development as an interdisciplinary field at least here at the
University of Chicago I am forced to choose that It‟s under psychology but I am not a
psychologist. And I don‟t really have a way of representing that I am not a psychologist
on this form. Also seeing it sort of smashed together with family studies is also a
misrepresentation of Human Development as I understand it. I don‟t do family studies, I
am not a psychologist. I do ethnographic studies of language acquisition in special
language circumstances
Engaging in research that reaches across disciplinary boundaries, draws

Definition of Interdisciplinary: methodologically and theoretically from a range of relevant areas.
Clear Term: Yes
Research Interdisciplinary?: Yes
If by interdisciplinary you mean a dual degree, Yes. But if you mean a program like

Accommodates interdisciplinary human development, No. This seems like is more for dual degrees than it is about a field
dissertations?: that is in of its self interdisciplinary.
Instructions in italics: I noticed them. When I needed them I paid attention to them.

Page 103 of 165

Thought Process:

Definition of Interdisciplinary:

“My field was very specific. It is not available at all schools. I was concerned that this
would mess up the statistics. Leaving the code would have been enough because the
name and code doesn‟t match. My research was interdisciplinary. So do you want my
department or my actual field of study?”
“More than one general area of study. Biology is itself interdisciplinary. It uses different
techniques and its methods cross fields. It is a meaningless word, made up by some
MBA.”
“No because it is reinforced by the different areas of biology in the field codes. Any

R18

Clear Term: degree in biology is talking about techniques, theories, etc.”
“I wrote yes when I answered this question. But no, if I had to be precise. I just wrote the

Research Interdisciplinary?: main discipline, but you need four or five codes to say yes.”

Accommodates interdisciplinary
dissertations?:

“No but I understand this [survey] is general for all PhDs. It would be different for other
fields like humanities, life sciences, physical sciences. It would be any easy in life
sciences because there are many fields. The research itself? The techniques used?
What exactly are you talking about?”
“I did notice them and I thought that they were clear. I didn‟t properly fill out A6 because I

Instructions in italics: only checked the „yes‟ boxes. I didn‟t fill out A5; I don‟t know how that happened.”

R19

Thought Process:

The first thing I thought of primary field, I thought membrane separations. I did not think
chemical engineering. Chances are they have not broken down the different research
areas that far so it‟s probably chemical engineering. When it indicated a list, I knew I
didn‟t have to guess and I can go find out specifically what they wanted. (If you did not
have a list what would you put down as your…) I probably would have put membrane
separations in A2 and chemical engineering in A3. (What would membrane separations
fall under?) It would fall under chemical engineering.
(Has trouble coming up with concise definition, starts by giving examples but finally
decides on definition) It covers different major areas of study that are somewhat related
but usually are very different.

Definition of Interdisciplinary:
Clear Term: Yeah.
Research Interdisciplinary?: No.
Accommodates interdisciplinary
dissertations?:
Instructions in italics:

R20
Thought Process:

If the question were worded, "What field does your dissertation research belong?" I may
have been more overwhelmingly likely to say linguistics. Phrased the way it is it makes
me think where did you come from? What does it say on degree?

Page 104 of 165

Theoretical/methodological approaches come from a variety of sources that are not
traditionally house under the same rubric. It has to do with three parts of your work;
research questions, methods and theoretical.

Definition of Interdisciplinary:
Clear Term: I think so at least in my field.
Research Interdisciplinary?: Yes

Accommodates interdisciplinary Probably…I was in a bit of unique situation because the particular department I was the
dissertations?: linguists are very cross disciplinary. Linguists distributed among different departments.
Yeah…it did not occur to me to include applied linguist the first time through. I looked for

Instructions in italics: at the end but there was no field listed for me to add. Would have added it field listed.

Page 105 of 165

A4 Probes - Remission
R1

R2

Rephrase question:
Understanding of Word Remission:
Synonym:
Considered tuition remission:
Rephrase question:
Understanding of Word Remission:
Synonym:
Considered tuition remission:
Rephrase question:

R3
Understanding of Word Remission:
Synonym:
Considered tuition remission:

R4

There is no way to rephrase it because it is straight forward
Whether I got some money to go to school
Financial support
Exactly what it is… institution is gunna pay for you to go to school
I would say the same thing
I am more familiar with waiver.
I don‟t use remission
I guess I didn‟t notice. My guess it should be waiver. I think it would be clear for a
graduate student. X Don‟t need to pay tuition.
Did somebody else pay for your tuition?
That it was taken back. So you were charged it and you didn‟t have to pay it. I
had a hard time answering because I was never in a position to pay tuition. So it
never really was remission, I just never had to pay it. In most biological sciences,
graduate schools - you may have to work for your stipend, but you never have to
pay tuition. Medical school does, but in biological sciences you never have to, at
least the ones I applied for.
You can just ask, how much of the tuition you paid for, then you‟d have to
restructure the answers.
Either you had been charged and someone paid for it, or there was potential that
you had to pay for it, and then weren‟t charged it.

Rephrase question:
Understanding of Word Remission:
Synonym:
Considered tuition remission:
Rephrase question:
Understanding of Word Remission:
Synonym:

How was your doctoral education funded? Please list the sources that contributed
to doctorate education.
Payback…The question could have been asked more simply?
Reimbursement. Payment…I don‟t know.
Anything that paid for my education.
“How were you doctoral studies paid for?”
“Reduction or waiver.”
“Reduction.”

Considered tuition remission:

“Literally, someone paying for your studies. Tuition remission has a negative
connotation to me because everyone gives you tuition remission. It‟s like what else
is there? So it‟s like, yeah, whatever. Tuition remission assumes that you are
taking classes. What about when you get out in your dissertation stage?”

R5

Page 106 of 165

R6

R7

Rephrase question:
Understanding of Word Remission:
Synonym:
Considered tuition remission:

Rephrase question:
Understanding of Word Remission:
Synonym:

Considered tuition remission:

R8

Rephrase question:
Understanding of Word Remission:
Synonym:
Considered tuition remission:

Rephrase question:

R9

Understanding of Word Remission:
Synonym:
Considered tuition remission:

R10
Rephrase question:
Understanding of Word Remission:

It‟s grammatically incorrect…at least the first answer. I would put the “No” answer
last. Its fine the way it is. Why a third? How did they come up with this? It‟s weird
to me.
You didn‟t have to pay for it and not reimbursed.
Financial Support. It‟s specific for tuition.
Just tuition…none of the other cost of school.
This seems to apply to students who came in through a program that waived
tuition, not to waivers like the ones I got on my own. I would add “not including
fellowships or assistantships” and whatever else. I‟m not sure what it means by
“waiver.”
It‟s like a waiver. But I‟m not really sure what it means here.
Either being a TA or part of a program where you come in day one with a waiver.
Or if you get a package/scholarship when you first come in. Or if someone
received a waiver for financial need.
How much of your tuition was covered by full or partial tuition remission? Or, what
part of your doctoral studies was covered by tuition waiver?
That you‟re taking away the cost. Or you are sort of removing the expense.
Waiver is good. If you received funding. I know scholarship isn‟t the only type of
funding. I think funding is all encompassing.
Fellowship, assistantship, some type of scholarship. I was not thinking a loan.
“It‟s confusing; well I guess you could call it that. I did some work/study….How
much of your tuition did you have waived or forgiven, that‟s not a good word, by
doing work...Or What fraction? I understand what it means but it‟s hard to
rephrase.”
“When you don‟t have to do something. It‟s subtracted or forgiven. Waived is
easier to understand in this context.”
“Forgiveness, probably a lot of people would understand since they have problems
with student loans.”
“Tuition you would ordinarily pay but you don‟t have to for some reason, like work,
kind of like a gift.”
I‟m more familiar with tuition waiver, and you have waiver there in parentheses. So
the only thing I thought was that you don‟t mean reimbursement, and saw that the
next item had reimbursement. Even if you didn‟t have waiver there, I would have
figured it out. But it‟s good there. Because I think most people are familiar with
waiver. But you could put reduction.

Page 107 of 165

Synonym:

Considered tuition remission:

R11

Rephrase question:
Understanding of Word Remission:
Synonym:
Considered tuition remission:
Rephrase question:
Understanding of Word Remission:

R12
Synonym:

R13

R14

Considered tuition remission:
Rephrase question:
Understanding of Word Remission:
Synonym:

Other than waiver, reduction?
My husband has TAs and they don‟t have to pay any tuition at all. If I were a TA, I
wouldn‟t have to pay any tuition, but if I go to the next question, I would see that
this was a source of support. I would guess that being a TA I would mark yes.
And then I would mark down here that I would have received tuition remission.
“The amount of money that you actually pay. Pretty much forgiven. The school
doesn‟t charge you for it.”
“School doesn‟t charge you for it.”
He answers, “Not really. I just see it as a reduced amount of tuition that you don‟t
have to pay.”
“Did you receive full or partial tuition for your doctoral studies? The categories are
fine.”
“Kind of „receive‟ or „discount‟.”
“No, I would not even use the word. I have not even seen that word used with
tuition. Usually you would say „did you receive full tuition or not? But it is not
confusing when I look at it.”
“I didn‟t think. I just knew what you were asking. I ignored the wording, so it didn‟t
affect my answer.”
How much support were you offered?
Someone pays your tuition bill for you.
No, I like remission.

Considered tuition remission:

Basically one of two things, a fellowship or an assistantship. An assistantship can
be divided into classes, teaching assistantships, research assistantships.
Basically, they can be a fellowship or assistantship.

Rephrase question:
Understanding of Word Remission:
Synonym:

I received full tuition remission so I did not have to pay for the courses I studied
while in program. I would ask, "Did you receive full or partial tuition remission?" If
not, how much of it was covered.
Payment covered
I have only used remission. Covered

Considered tuition remission:
Rephrase question:

R15
Understanding of Word Remission:

I would say scholarship, teaching assistantship, research assistantship or any
other kind of assistance provided by university or funding agency.
What fraction of your full tuition were you not responsible for?
Something that is sent back. Waiver is clearer term in this context. Student would
not be responsible for tuition. Students would be familiar with either of these
terms.

Page 108 of 165

Synonym:

Considered tuition remission:
Rephrase question:

R16

Understanding of Word Remission:
Synonym:
Considered tuition remission:

R17

R18

Rephrase question:
Understanding of Word Remission:
Synonym:

Thought about it actually as technically as tuition. That is the cost as the university
as money that goes directly to the university for your studies. I did not include in
that living expenses travel or personal.
„Did I have to pay for graduate school‟ is the way I looked at it.
Not a very good understanding, but I‟m going to say that we are given something
to apply towards it or excused from it.
Probably um. For what percentage of my tuition I was responsible for paying. But
I would avoid it altogether.
Scholarship is what came to mind.
I don‟t know that I can.
If you received financial help for doctoral studies that took the form of…
Reduction or elimination of…
Aid

Considered tuition remission:

Grants or fellowships. Any money that was given to me on behalf of the institution.
It might also include work study but that is border line. Tuition aid…is a package of
fellowship and teacher assistantships and work study.

Rephrase question:
Understanding of Word Remission:
Synonym:

“The only thing that I would change is the word „remission.‟ I would say scholarship
or tuition scholarship.”
“It means „not paying.‟ How much you don‟t have to pay.”
“Did you receive a full or partial scholarship?”

Considered tuition remission:
Rephrase question:

Understanding of Word Remission:

R19

Assistance. It‟s hard to generalize more than.

Synonym:

Considered tuition remission:

“How much is not coming out of my pocket. It is not specific. Life science is
different than humanities.”
If your tuition was paid for how much of it was paid? If not… How much of your
tuition was paid for by the department or paid for by someone.
I guess my initial understanding if you are reimbursed for your tuition or either
reimbursed or given some type of stipend towards your tuition. Reduction in your
tuition.
If you received full or partial tuition reimbursement? Or If you received full or partial
tuition reduction?
I thought of what the full tuition was and how much I actually paid and considering
how much of a difference that was and it was fairly large. The regular tuition was
based on how many credits you took but we were just giving a flat rate of 25
dollars. If your graduate research assistant your rate was 25 dollars for the
semester.

Page 109 of 165

Rephrase question:

R20

Understanding of Word Remission:
Synonym:
Considered tuition remission:

Did you receive any portion or how much tuition remission did you receive for your
doctoral studies?
Waiver is more familiar to me. I didn‟t have to pay tuition. The university grants
me a waiver.
Other than waiver I am not sure. Waiver would do it.
My thoughts were more what did I have? Could what I had be called tuition
remission? But since we call it waiver I was able to answer the question.

Page 110 of 165

A8 Probes - Time to Degree
It‟s already checked for doc because you are talking about your recent doctorate. But then again

Probe: Initial Thoughts and the information becomes redundant in terms of have your received a Master's and Bachelors.
Reactions: The question should be, “when did you receive your masters or your bachelors…”.
Thoughts on Layout and
Suggestions: It is straight forward but a little bit small for those who write too large

R1

Thought process – A8c: Anyone trying to get an academic position should have the in their head for their CV.
A11 – It's redundant because you just entered that in A8 already indicated that.
A12 – If someone can remember when they started their program they should be able to figure
out how many years it took.
A13 – Straight forward to ask you if you took any time off and how many years but it may be a

Thought process – A11-A13: process of months instead.
Probe: Initial Thoughts and
Reactions: It was clear.
Thoughts on Layout and
Suggestions: No. quite good. I like it.

R2

Thought process – A8c:

It was not easy for me because it was a mixture because I was half finished. The lines were not
clear between Masters and doctorate and I would work for 3 months and went to school for 3
months.
A11 – I thought it was easy
A12 – My course belonged to masters and doctorate. It‟s not easy because mixture of work and
grad course work
A13 – I was working full time. Gave a rough number. Not an easy question for me easy for full

Thought process – A11-A13: time PHD student to answer.

Page 111 of 165

The first one was that I was annoyed that I had to fill out the doctoral information again because I
filled it out in front and you have it, at least some of it, because you contacted me.
But I filled it out anyway.
The master‟s degree one – that one takes me a little while to figure out when I had my masters
because we got it as part of our program, it wasn‟t an end goal. So it wasn‟t something terribly
worth remembering. I did not fill out f though I in the masters, I wrote same and drew an arrow.
For the last one, for baccalaureate, it took me a little while when I started college. I was thinking
where I went to college instead of primary field of study.
I did not go back to look at the list of field number, because I remember ecology wasn‟t on there.
My degree in undergrad was in environmental biology and not ecology, and that‟s pretty close to
environmental science. Even though it implies that I did more biology than engineering.
X – Is that what you would have put if you hadn‟t filled it out already, if this was your first time?

Probe: Initial Thoughts and
Reactions: R – Nods head yes.

R3
Thoughts on Layout and
Suggestions:

I don‟t know actually. Most of the time when you are ask for the years, you ask the university,
and then the field of study. That was part of why I put Michigan State for this one I went to the
University of Chicago for both– I put down the dates and thought, “oh I went to Michigan state
[For undergrad] I had gone to the university of Chicago for the next two. And so I put this down
and then I realized I had done it in the wrong order.
Well, I had already figured out that it was 2002. I filled out another couple of surveys recently
about when I started, so I just remembered when I started for the doctoral degree. And then for
the master‟s degree I put the same. Then I was wondering whether I should put 2004 for the
master‟s degree, but I decided not to change it.
X – Why was that?
R – I entered a PhD program in 2002 and got a master‟s degree on the way. But I didn‟t enter a
master‟s program then a PhD program, so I left it 2002. You could split hairs and say that I really
wasn‟t working on my PhD portion until after I had my master‟s, but I don‟t really think that‟s true.
I remembered what year I graduated college easily, then I had to count backwards to figure out

Thought process – A8c: when I started.

Page 112 of 165

A11. I thought that was silly because I just answered the same thing, but I just copied it from
above.
A12. I had to read it twice.
X- Why is that?
Because it‟s long. I just wanted to make sure I was going to answer what you were asking. If
you had asked how many years I was in the PhD program, I would have written 6. I guess the
second part that was clear, the first part I had to read twice. A12a.
A13. Um, that one made me laugh, the answer was no.
x- Why?
R – It was a long haul [laughs]. I know there are some programs that you can get work in the
summer. Not me, not in the biological sciences usually. So we get paid year round and are
expected to work year round, so I did.

R4

Thought process – A11-A13:
Probe: Initial Thoughts and
Reactions: I wish I had my resume. It was annoying to think back.
Thoughts on Layout and
Suggestions: You‟re asking for a lot to write in. This is probably the best way.
Thought process – A8c: Not that comfortable. I guessed for my undergrad and masters.

Thought process – A11-A13:

R5

Probe: Initial Thoughts and
Reactions:

A11- Seems like first question. Same as first started master‟s degree.
A12- Had to read carefully – I think I answered it wrong
A13- Applies to other people. Not sure, it‟s asking whether students were a way from school.
Assumed students took leave.
“I hate questions that ask you about specific dates. I feel anxiety, not really, but anger and
imprisonment. I can barely remember what happened yesterday. Not to criticize, but if you are
the type that doesn‟t like surveys this could be daunting. After I did it though, it wasn‟t really hard.
As far as interdisciplinary, I assume that there is no number for interdisciplinary fields. I mean
yeah, I would look at A8 kind of confused if I answered interdisciplinary for A2.”
“I think that it gets at the information that you are seeking. I was sort of taken back by USA being

Thoughts on Layout and filled in. And curious why BA and MA are included. I figured that it was because it was a federal
Suggestions: study.”
“On a scale of 1-10, with ten being the most comfortable and 1 the least comfortable, I was about

Thought process – A8c: a 7. I was fairly comfortable.”

Page 113 of 165

A11. “[It] sort of brought me in a panic because I was like 'oh my God, I started grad school in
1999, after that it is not that hard.”
A12. “I dislike questions that ask something with two choices. It‟s almost like A12 should be A13
and A13 should be A14 because those questions were like „eh, what am I looking at here?‟ and
then I have to focus. I really had no idea what this was saying. It is too cluttered; it should be
separated into different questions to make it more readable. I had to read it twice because I was
confused. Courses are usually separate from dissertation stage. Again, it would make sense as
two separate questions.”

Thought process – A11-A13:
Probe: Initial Thoughts and
Reactions:
Thoughts on Layout and
Suggestions:
Thought process – A8c:

R6

A13. “I think it‟s pretty straight forward.”
Country prefilled for doctorate but no other degrees. It allows for degrees you could have gotten
somewhere else.
It‟s fine.
I was sad to think it was that long ago.
A11 – I did enter master‟s program in the Philippines but did not finish. It‟s kind of hanging.
A12 – for our program it‟s not clear cut. It should say how many years taking courses that are
required. Some take courses while doing their dissertation.

Thought process – A11-A13: A13 – I guess maybe this addresses break.
Probe: Initial Thoughts and
Reactions: It wasn‟t automatically clear, I had to review the format a few times to tell exactly what to do.
Maybe add a visual change between the columns for PhD, MA, and BA. Stagger them so the

R7

Thoughts on Layout and PhD is on the top, then starts slightly below, etc. Equal columns made feel like I had to choose
Suggestions: one.

Thought process – A8c:

I wasn‟t sure how to enter my PhD & MA start date because it was a combined program. I know
when I started the program and wrote that, but then I saw the MA line and I wasn‟t sure. I didn‟t
know if the PhD start date should be from the time I finished my MA. But I took classes towards
for my PhD before I finished my MA. I ended up just using the same date for both.

Page 114 of 165

A11 – (R left it blank). The wording made me think it was asking about classes other than what I
did at Loyola, since I already had the information in A8. I would include something like
“(including the institution where you received your MA/PhD)”
A12 – The question is fine; it was just a matter of me remembering how much time I took off.

Thought process – A11-A13: A13 – This was worded clearly.

Probe: Initial Thoughts and
Reactions:

Initially it looked like a very multifaceted question and I needed to figure out how they are
organizing all the information in one question. It seemed like a large chunk of information. I just
needed to look at the column headings and figure out how they were being divided. Once I
started filling it out it was pretty straight forward.
It would be interesting to see the rows and the columns inverted. I‟m not sure if that would look
better.

Thoughts on Layout and Having less information in the column headings would be easier. The [other wording] requires
Suggestions: the person to take more time to figure out what‟s being asked for.

R8

It took a little bit of figuring out. It wasn‟t confusing; it was just going back in time and

Thought process – A8c: remembering the dates.

A11 - I know what it‟s asking, but because it‟s asking any program of any university it‟s asking
the person to think more broadly. It requires the person to step back and think about it. But the
wording isn‟t confusing.
A12 - I think it was a lot of sifting through the words, but it is useful that they are looking for
information on a very specific part on your academic career. Information like…course work and
exams, whether you want that to be included or not.
A13 - That was pretty straight forward. If the not taking course work or working on dissertation –

Thought process – A11-A13: it‟s helpful that you‟re clarifying what you mean by this.

R9

“I thought this was pretty straightforward, had to rack my brain for past dates, I was referring to
the one above, had to read it twice. Field of study was easy though I had to look them up, but
there‟s probably no easier way. The two lines at the top were initially confusing and I had to read
them twice, then I looked below and it was easy.”

Probe: Initial Thoughts and
Reactions:
Thoughts on Layout and
Suggestions: “Actually not….very logical…once I got started it was pretty straightforward.”

Page 115 of 165

“It was ok, just took a bit because I‟m not the youngest graduate and I had to consider the leave

Thought process – A8c: of absence.”

Thought process – A11-A13:

A11 – “Some schools consider a master‟s and a doctorate as graduate but some consider only
the doctorate as graduate. I decided it was just the doctorate. I took a year off and I started in
1994.”
A12-“I thought it took forever (the doctorate degree), question isn‟t hard. First I started to mix up
A and B.
A13-“Straightforward except I had to consider my year off.”
Wondering why you‟re asking. Because the whole response is of degrees received. And the first

Probe: Initial Thoughts and question you ask is whether or not you received it. To ask again why you received it is
Reactions: redundant. Again the dates, some people might guess. Everything else seems fine.
Thoughts on Layout and
Suggestions: It‟s easy to follow.
That was fine. It‟s a number that I know. Like I said, some people might guess. I certainly know

Thought process – A8c: and didn‟t have any hesitation.

A11 - I did a program after I graduated college, but it was not at a university. It was a paralegal
program. What you‟re asking here, is of any program in any university. If you‟re looking just for
university work, it was not a university, it was a training institute. So I decided it was not what
you were interested in. I did take a couple of graduate level classes in Loyola before I started my
master‟s program. So this isn‟t correct. The question‟s a little vague. I wasn‟t in graduate
school, I just took some classes. So if you want to get at that, then you can ask did you take any
graduate classes. Or do any graduate work, because I wasn‟t in graduate school. I was just
taking classes. I kind of want to know why you want to know that.

R10

Thought process – A11-A13:

A12 – I had to read it a couple of times to see what you were getting at. Then there‟ the question
of what the proposal is. And for some people, there is no suggestion in how to round.
A13 – No. and I know for a lot of people there is, and you have „round to whole years.‟ Again,
maybe say „round up‟ to whole years.
He replies, “I think I remember answering this question more than once [referring to the first time

R11

Probe: Initial Thoughts and he filled out the SED]. The number and the primary field of study I definitely felt it was redundant.
Reactions: I could see its [importance] if you earned your MA before, but it is redundant.”
Thoughts on Layout and
Suggestions: “I thought that the layout was fine. It seems relatively clear.”
“It‟s relatively simple because I finished in the time they expected me to finish, five years. I

Thought process – A8c: enrolled in Florida one year after 9/11, so that‟s how I remember I started in 2001.”

Page 116 of 165

Thought process – A11-A13:

A11. “Simple because it was the same as A8C.” He questions why A11 is pertinent. Suggests
asking A11 or A13, it would be just fine answering one or the other.
A12. “This was easy because I finished in expected time, five years. I had the luxury of working
on my dissertation as I was taking classes. So actually the time when I was working on my
dissertation was a little more than one year. Depending on what they are trying to get at, whether
it was how long it did take you to finish your dissertation, the data might be a little bit misleading.”
A13. No thought process.
“The doctoral degree was relevant, straight forward, and recent. I had to think back a bit about
my bachelor‟s degree. My program didn‟t require a master‟s degree, so I didn‟t fill that in. Some
do, so I see why that is in there. Maybe this is to find out how long from getting your BA. But
once you get your doctorate your BA becomes irrelevant.”

Probe: Initial Thoughts and
Reactions:
Thoughts on Layout and “For bachelors you should ask for the major instead of the field of study. That threw me off a bit.
Suggestions: The layout is fine.”

R12

“I had to think back a little bit too when I actually started. One was a quarter and one was a

Thought process – A8c: semester.”

Thought process – A11-A13:

R13

Probe: Initial Thoughts and
Reactions:
Thoughts on Layout and
Suggestions:
Thought process – A8c:

A11. “What I thought you are asking is to determine how long it takes to complete the degree and
determine a timeline for certain graduate programs. That‟s important to people actually looking to
get into grad programs. The questions below speak to that.
A12.Again, it‟s what I laid out before. Its more specifics about the time line.
A13. The same as above. I think that it is also relevant to A4. And tied to question A5, A6, and
A7. They are all just extensions of each other.
I did stumble for a second just on how the answers were supposed to be presented. It‟s
presented here vertically. I think the basic question is, do I want to lay this out vertically or
horizontally. It‟s a question of what it looks like to the eye.
No. I really don‟t. I confess I stumbled on it. I don‟t have any suggestions for improvement.
Easy. Easy.

Page 117 of 165

A11. That was a little hazier for me because it‟s going back a ways in time. A11 refers to me to
a master‟s degree that I didn‟t complete. So it‟s a little harder for me to remember when I started
working on it. If I had completed, it would have given me a marker to count back of when I first
started.
A12. This was – I wasn‟t 100% confident in supplying my answer. If I had been doing this at
home, I would have taken more time.

Thought process – A11-A13:
Probe: Initial Thoughts and
Reactions:
Thoughts on Layout and
Suggestions:

A13. That‟s a clear no. I was just working on my degree the whole time.
I expected this to come up at one point in survey. I was not surprised. Asking me everything
about my education background.
I think it‟s pretty clear.
I just remembered correctly when I started the degree, the most recent BA and MA. I was also

R14

Thought process – A8c: wondering why they need to know which month.

Thought process – A11-A13:

R15

Probe: Initial Thoughts and
Reactions:
Thoughts on Layout and
Suggestions:
Thought process – A8c:

Thought process – A11-A13:

A11 – The same as my answer to the previous question you asked…I could not recall the month
I started. I remind one I made a mistake put date for finish instead of started.
A12-I know how long it took me to finish the doctoral degree because it was very recent. It did
not take me too long
A13 – Understandable there are several students that take time off. Not a surprise but I had not
taken break.
I am going to have to remember all of these dates. Reassured myself I could do it in my head. I
know I keep my CV up to date and that is one reason I have this stuff in my head.
Counter intuitive…putting starting point second…date granted first. But it was very clear. Felt I
was repeating what I had already written down on front.
I knew exactly when it was.
A11-I knew it exactly when it was.
A12- A – was very clear
B – Was a little trickier because people would wonder as I did, how many years should I put
down for working on my dissertation. I was wondering if it should be years full time or from start
to end.
A13-Clarified A12B A12B could have said, “How many years did you dedicate...”

Page 118 of 165

I was just looking through it. The first thing I thought was is there a certain order that I should be
going through this. Because initially I was thinking bachelor‟s degree listed there, so I thought
that‟s where I‟m going to start. When I was looking at it I was kind of thrown that the doctoral was
listed there first, but that makes sense, too. It‟s not that it doesn‟t make sense, it‟s just in the
reverse order that I was thinking.

Probe: Initial Thoughts and
Reactions:
Thoughts on Layout and
Suggestions: No, I think. It was fine. I knew what I was supposed to do. So it was just a matter of filling it in.

R16

Thought process – A8c:

It wasn‟t too much of a problem, but I think that. I don‟t know if I filled that out earlier somewhere
else. Maybe I did on one of the forms -if I filled it out earlier today, it was fresh in my mind. It
wasn‟t hard to come up with.
A11 – There really wasn‟t much. I knew I started on the same year as I graduated undergrad, so
I went though and thought what month that it started. Undergrad started in quarters. That was
the only thing.
A12 – That one, since courses were interspersed throughout, I was trying to think how to go
about answering that. So I took a stab at it. A rough estimate, based on how it worked. The
same for the opposite side the not thesis work. Again, it was mixed together so much. I didn‟t
really worry about it so much.

Thought process – A11-A13:

A13 – Well, it. I entered my doctoral program –I didn‟t think much of it. When I entered my
doctoral program I didn‟t stop and do anything else. In graduate school I stopped and got work
experience. But it wasn‟t during the doctoral program.
I was confused at first, sorting out staring with question A. Sorting out the boxes at the top.

Probe: Initial Thoughts and Somehow the boxes at the top do not catch your attention until you read question A and the box
Reactions: is already checked.
Thoughts on Layout and
Suggestions:

R17

I would have to think that for a while. I feel like…perhaps not already checking that first box
might clear things up for me. Or question A might read…”indicate if you have received and of the
degrees in the top row”
Cost some cognitive effort to think back that far but it wasn‟t uncomfortable. There are not dates

Thought process – A8c: I carry around with me.

Thought process – A11-A13:

A11 – No particular thought process. I know when I started my first MA
A12 – I was trying to figure out if I should put in 3 or 4 years. I did my MA at the U of C in the
social sciences. When I got into my PHD program which has an MA built into it…not only could I
not earn not another MA but they forgave much of the course work that I had done. Technically
speaking the number of years to complete my exams and degree work was three years from the
time I entered the PHD program. Had not been in MAPS first it would have been first year. The
question should include MA work accepted to complete doctoral degree.
A13- Straight forward.

Page 119 of 165

“I already gave you this information, so it seems like a waste of time. Again, maybe online this

Probe: Initial Thoughts and would have been pre-filled based on my previous answers. Otherwise, it is pretty straight
Reactions: forward.”
Thoughts on Layout and
Suggestions: “Usually this is in rows, not columns. It didn‟t make any difference. The layout didn‟t matter.”
“The BA was easy to remember, but the MA was more difficult because of my transfer and I took

R18

Thought process – A8c: a year off.”

A11. “I was happy that you asked because I started grad school elsewhere. I didn‟t want to skew
the data.”

Thought process – A11-A13:

A12 & A13. “Again, I was happy that you asked because it would help to identify that I did not
take the standard course. I liked that you asked about taking years off. I had to make sure that
my math was right because I wasn‟t sure that it was correct. If it were online there should be a
control for this and mark if the math seems incorrect.”
I took a look to see what categories were in each column and recognized the PHD was the first

Probe: Initial Thoughts and one because it was already marked. And then I know for my program it was straight to the PHD
Reactions: program. I glanced over Master‟s and moved on to the next one.
I initially would have thought that it would go left to right; Bachelor‟s Master‟s PHD but

R19

Thoughts on Layout and considering that this is a survey for those getting a doctoral degree it sort of makes sense. At
Suggestions: first glance I expected bachelor‟s degree to be in first column.
Thought process – A8c: Pretty comfortable because every year was usually August when we started.

Thought process – A11-A13:

R20

A11 – At first I thought they already asked me this question and this is referring to school that
you finished your degree. I understood why this was asked again. Since I only went to grad
school once. It was pretty easy it was the same answer as above.
A12 – I was trying to think what years would count towards courses from my doctorate degree.
Thinking about it made sense. Only count the courses towards my doctorate degree and not my
certificate. Part B was a little more complicated because technically I wasn‟t on campus and
wasn‟t writing for a good part of the year. I was working and couldn‟t write.
A13 – I said pretty much yes. Although technically I was supposed to be writing I was more
working than writing.

Probe: Initial Thoughts and Format took me a couple of seconds to figure how the table was constructed. The format is a bit
Reactions: odd. Not sure how it could be done. For each degree received please answer the question.
Thoughts on Layout and
Suggestions: Format is a bit odd, not sure how else I would

Page 120 of 165

Thought process – A8c:

Thought process – A11-A13:

It didn‟t take too much thought. I connected it to events in my live. Bachelor‟s is a salient date.
For undergrad that was straight forward so that was easy to remember. Walked for all three
graduations so remembering the month connects with that.

A11-attended summer institute but not as official grad student but I received credit for my
graduate studies. So I briefly considered putting that down.
A12-I had to guess, I took a few courses after I finished. I did not count those here but they way
the question is worded it did not actually exclude that. But I just counted my official course work.
That was a little shaky because everything ran together. The way my exams were structured in
my program...it was not lock yourself and room and take exams.
A13-Straight forward…I did spend some of the summers doing other work

Page 121 of 165

B8 Probes - Salary Response Categories
Personally no, [I had no concerns]. If I started off in teaching, I am probably
aware of what the salary ranges are. THE RESPONDENT KEEPS
REFERRING TO EXPECTATIONS BUT NOT ACTUAL SALARY

Providing/Comfortable-Salary:
Exact Amount vs. Range: CS: You indicated that you prefer salary ranges is that correct?
More Convenient Way: No just yearly because it‟s probably a yearly salary anyway.

R1

R2

CS: You indicated that at the time you were completing the survey, you already

Negotiating Offers?: knew. So there was no negotiation at that time.
Answered question different?:
Basic Annual Salary:
Salary Information:
Providing/Comfortable-Salary:
Exact Amount vs. Range:
More Convenient Way:
Negotiating Offers?:
Answered question different?:
Basic Annual Salary:
Salary Information:
Providing/Comfortable-Salary:

Exact Amount vs. Range:
More Convenient Way:

R3

R1: Yes

Anyone that consults outside of teaching or does some extra curricular activity
or has the skill level to get additional income would be extra. Does not include
additional income.
I had a contract
Yes
Ok for me to give exact. I don‟t care the range would been the same
For part-time work that would be better
Don‟t remember
Basic salary that‟s all, not including bonus. Before tax
SKIPPED
I don‟t care.
I provided the exact amount because I knew it. Even though I put a squiggle in
front of it – so around 18 thousand. I filled that out then I looked at the next part
“if you prefer to not report the exact amount” but I already had, so I didn‟t fill out
that.
Oh that would have been annoying, no. That would have taken more time to
figure out.
I was not. Well, it depends on when I filled this out. We found out, my husband
is doing a fellowship at Stanford. And we found that out at the end of April. So if
I filled this out ahead of time, I would not have known where I was going. I still
wasn‟t negotiating offers. Because I was going to be working out here.

Negotiating Offers?:
Answered question different?:
Basic Annual Salary: It was asking how much I‟ll be making the next year. I was assuming just salary.
Salary Information: From them telling me. Verbal agreement.

Page 122 of 165

R4

Providing/Comfortable-Salary:
Exact Amount vs. Range:
More Convenient Way:
Negotiating Offers?:
Answered question different?:

I would rather check box. This was tricky. Asks you for amount and then give
you option to check box.
Chose the range for privacy
Think couple be an option. This is fine.
Yes
My current salary and job.
Basic total number for the year. I would have included bonuses. I taught

Basic Annual Salary: through the summer, I would have included that.
Salary Information: From my current job. I knew what I was making. X verbal agreement.

Providing/Comfortable-Salary:

R5

“I don‟t like it. I have lots of employment and don‟t feel comfortable talking about
my variety of sources of income. But, no, then I read principle and I think „oh, it‟s
just my principle job.‟ If you answer a high salary, it‟s like „oh my God, you are
making so much money‟ and if you answer a low salary, then its like „oh my
God, who are you working for? You are a PhD for God‟s sake. You should be
working for like $120 thousand dollars a year‟ but that‟s another story. I
answered it because I wanted to be honest on the survey. It feels like I am lying
because I didn‟t list them all, omission of truth.”
“I answered exact amount because it really is an issue of what came first and I
was like „all right, let‟s get this over with.‟ I added $12 to give a more rounded
number. If offered the other choice, I would have picked [the range]. I don‟t know
what it is talking about with expect because it is in the future tense, so it is what
you expect in the future. Maybe I should have chosen a hundred and ten.”

Exact Amount vs. Range:
More Convenient Way: “Reporting annually is best.”
Negotiating Offers?: “Yes.”
Answered question different?: “I would have answered by giving the highest offer.”

“I guess don‟t include any benefits, frills, travel budget, no summer teaching, and
wait, it says literally don‟t include bonuses are extra benefits like no healthcare.
Wait, 401K is included.”

Basic Annual Salary:
Salary Information: “My contract, literally visualized it.”

Makes me grateful that I have an offer but makes me think of other offers that

Providing/Comfortable-Salary: were retracted.
Exact Amount vs. Range: It‟s not personal and it‟s more accurate this way.

R6

This question assumes you have a fixed income but does not have room for

More Convenient Way: non-fixed. Put an option per hour.
I would have skipped this question. X I probably would but DK be nice to have a

Negotiating Offers?: box to explain.
Page 123 of 165

Answered question different?:
It‟s spelled out no bonuses. Your compensation for the year but I would include

Basic Annual Salary: bonuses.
Salary Information: Job offer letter
Providing/Comfortable-Salary: I had no problem. I was fine with it.
I saw the exact amount first, so that it was I chose. Though I don‟t know if I

R7

Exact Amount vs. Range: would even fit a category, my salary is so low.
More Convenient Way: This doesn‟t really apply to me. Annually was appropriate.
Negotiating Offers?: Yes, I was not negotiating.
Answered question different?:

Basic Annual Salary:

If I had a more normal job I wouldn‟t include benefits or anything like that. Just
the gross income before taxes. If I was being paid for multiple classes, I would
calculate my annual salary multiplying the amount per class times the number of
classes.
I saw it in the e-mail posting for that position. I asked if it was negotiable and

Salary Information: was told no.

Providing/Comfortable-Salary:

Exact Amount vs. Range:

R8

I don‟t really have a problem with that. If I feel like that it‟s confidential and it
provides information with research. And I‟m not associated with the person on
the receiving end, I don‟t have a problem.
I don‟t know I guess I was focused on the first part of it. And then I get to the
[range] part. I guess when I initially was reading B8; it would be helpful if it
came first, so that I knew that I had a choice.
Yes, if people were paid hourly/weekly/monthly. I didn‟t think about that

More Convenient Way: because it didn‟t apply to me.
Negotiating Offers?: No.
Answered question different?:
Basic Annual Salary:
Salary Information:
“It doesn‟t bother me at all. I‟m fine with it. I thought of the number of courses

Providing/Comfortable-Salary: I‟m taking.”

R9

I did both, I probably should scratch this out…I estimated my exact salary but
I‟m more comfortable that the range is right because I guessed my exact
amount.”

Exact Amount vs. Range:
More Convenient Way: Maybe both monthly and annually because jobs pay differently.”
Negotiating Offers?: “No.”

Page 124 of 165

Answered question different?:
Basic Annual Salary: “I think it means what you expect to make next year.”
Salary Information: “Basically I taught before so I‟m estimating from past verbal agreement.”

Providing/Comfortable-Salary:

R10

I think a lot of people are reluctant to give salary information. I guess I have a
sense of security of filling this out. Maybe there‟s a little bit of hesitation. I don‟t
know why, maybe it‟s „is this information you really need.‟ But it‟s
understandable to ask.
Exact amount because it was first. If, I would have checked a box otherwise. If
you had the check boxes first, and the blank, I probably would have just checked
the box.

Exact Amount vs. Range:
More Convenient Way: No.
Negotiating Offers?: No other negotiations.
Answered question different?:

For me it‟s easy because I know what my annual salary is. This is just the way I
think of my income. So if someone‟s working on a project, they only have a
certain amount of income for the project, they might have difficulty answering
this question.

Basic Annual Salary:
Salary Information: Just what I know from my salary. In writing, I got it in a letter, I think.

Providing/Comfortable-Salary:

R11

“It doesn‟t bother me at all because of how I classify my job. When I think about
a postdoc, I think I probably make more than other postdocs. Although it‟s not
near what I hope to make”
“To be honest, I saw the box and just filled it in. I‟m impulsive. But also because
I am comfortable with my salary. If I was uncomfortable with my salary, I would
have probably looked for a follow-up to see if I could get around it. But I didn‟t
have a problem disclosing it. Also because this is for research and I don‟t have a
problem disclosing information that I would otherwise be uncomfortable with. I
am an advocate of research.”

Exact Amount vs. Range:
More Convenient Way: “No”
Negotiating Offers?: “No”
Answered question different?:

“How much money you‟ll make the following year depending on what stage you
are at? If you haven‟t started your postdoc yet, then put down what they told you
will make the following year. And if you have, then put down what you are
making.”

Basic Annual Salary:
Salary Information: “Contract”

Page 125 of 165

“I don‟t mind giving a range. It is important for people to know how they should

Providing/Comfortable-Salary: expect to make. I didn‟t have any issues with that.”

Exact Amount vs. Range:

R12

“I gave a range because I think it can be deceptive to give an exact amount. The
salary of a professor will vary by school, what you are teaching, what kind of
projects you are working on, the kind of research that you did, whether you do
grant writings or anything, and this is how you do it normally. When you apply for
jobs they always give you a range.”
“No, annual is fine. My guess is that most people choose [the range] like I did.

More Convenient Way: You can eliminate the specific.”
Negotiating Offers?: “No, you submitted the survey when I was already done with all that.”
Answered question different?:
“Just what you make. Just what your university or your institution gives you
gives you because you can always make extra money through getting a grant or
speaking engagements or anything like that. Benefits are built into the salary.”

Basic Annual Salary:
Salary Information: “My contract”
Providing/Comfortable-Salary: I‟m comfortable sharing it. I‟d be more comfortable sharing it if it were higher.

I provided the exact amount because I saw there were two spaces. The first
thing I saw was that there was a space for the exact amount. Then as my eye
went down the page, I saw the space for a range. I thought I‟d answer that to.
My reason was that I wanted to do a thorough job in answering the question.

R13

Exact Amount vs. Range:
More Convenient Way: No.
Negotiating Offers?: I was not negotiating offers.
Answered question different?:
Basic Annual Salary:
Salary Information:

It does not bother me because this is the standard stipend amount for most
postdoc in the country. I would have preferred range.

R14

Providing/Comfortable-Salary:
Exact Amount vs. Range:
More Convenient Way:
Negotiating Offers?:

R15

Answered question different?:
Basic Annual Salary: The question is clear.
Salary Information: I have my offer letter which gives me exact amount.
Providing/Comfortable-Salary: I feel comfortable sharing it. It‟s known to the federal government.

So then my exact salary or stipend is not known to person reading.
This is the most convenient way.
I do not remember.
I was only considering postdoc opportunities. It was not going to go above 39 or
40.

Page 126 of 165

Exact Amount vs. Range:
More Convenient Way:
Negotiating Offers?:
Answered question different?:
Basic Annual Salary:
Salary Information:

Providing/Comfortable-Salary:

It‟s just quicker.
Most people think of salary as annual
No
It‟s very clear. Salary that would be in your contract with main employer.
Number I carry in my head from contract.
I could care less about sharing. I think it‟s good. I know that when I was
graduating I was thinking, how I tell that this is a good salary or not. It‟d be nice if
it was easier to find that. My wife is going through the same thing right now.
How do you describe what a PhD? In material science engineering, or whatever,
should make. I don‟t have a problem in providing that. But I don‟t really worry
about what others make relative to me. At work I don‟t mind letting others know
how much I make. I know where not supposed to talk about that. But I don‟t
mind.
I did both. Because the exact salary sticks in my head, and the range was
there.
Interviewer – which one would you have preferred?

R16

I like the exact from the idea, that somehow information was to make it‟s way
out, it‟d be nice to know what it is, granted if it was different offers from different
companies, the range would be easier, because the range would encompass
both of them.

Exact Amount vs. Range:
More Convenient Way: No. The exact amount is the best way to do it.
Negotiating Offers?: Nope, it was already done.
Answered question different?:

It would be the salary not including bonuses, or payback for sick days not used,
and any of those pluses. I assume that it would be the minimum amount of
money that I was going to make for the year.

Basic Annual Salary:
Salary Information: From my offer letter.

It doesn‟t bother me so much it an anonymous number. I think most people will

Providing/Comfortable-Salary: probably round which is what I did.
So rather than putting the exact number vs. the range I would opt for the range.

R17

Exact Amount vs. Range: People are probably already rounding might as well put range.
More Convenient Way: No
Negotiating Offers?: No
Answered question different?:

Page 127 of 165

Basic Annual Salary: My gross income before taxes.
Salary Information: The combination of positions I cobbled together.
“I would be comfortable sharing it, but I didn‟t fill it in because it was not

Providing/Comfortable-Salary: applicable. I would appreciate having access to the information.”

R18

R19

Exact Amount vs. Range:
More Convenient Way:
Negotiating Offers?:
Answered question different?:
Basic Annual Salary:
Salary Information:
Providing/Comfortable-Salary:
Exact Amount vs. Range:
More Convenient Way:
Negotiating Offers?:
Answered question different?:
Basic Annual Salary:
Salary Information:

“I would have selected a range because it is social convention not to talk
numbers.”
“Annual salary is appropriate for my field.”
“No.”
“Annual salary for my field. It is well defined and not confusing.”
“That depends on where I was in my job search. I would use friends.”
I was pretty comfortable. I read through it quickly I did not even the bottom to
not to report exact amount. I did not have any problems.
Probably the Range, I wouldn‟t have to remember exact amount.
I think most people if they are salaried remember yearly.
I don‟t believe I was.
Salary pre-tax. Your gross salary.
From the offer letter.
I am on a grant. It is public knowledge. Had I noticed checkbox before filling
amount, I might have used the check boxes instead. I don't worry too much
about that here on a document like this.

R20

Providing/Comfortable-Salary:
Exact Amount vs. Range: Exact numbers feel closer to home but it wouldn‟t have sent me running.
More Convenient Way: Not on a grant like mine.
Negotiating Offers?:
Answered question different?:
Basic Annual Salary:
Salary Information:

I may not have known I was coming here (University of Chicago). But I think I
probably did. I was really confident I would be in an NIH grant.
In a training grant like mine there is not much negotiation
This is my primary job what am I getting paid for it.
I new what my training grant/post docs make

Page 128 of 165

Survey Layout Probes - Reactions to Scannable Form and New Design
I can tell this version is condensed – print is smaller…previous version larger and clearer. Though it is

Overall Impression: the same amount of questions and same type of questions though it appears to be more.

R1

R2

Form Comparison:
Flip Out Page:
Notice Barcodes?:
Yes:
No:
Scanning process:
Confidentiality:
Overall Impression:
Form Comparison:
Flip Out Page:
Notice Barcodes?:
Yes:
No:
Scanning process:
Confidentiality:

R3
Overall Impression:

2nd page on the new version appears to be better layout and clearer.
3rd page on new version, I feel more comfortable because it has less questions and easier to navigate.
Seems to have same information condensed on less on page.
Majors list appears to be the same.
No preference. Appears each page has less info.
No
No thoughts on them. Should be deleted. Seems like it was in a protégé form.
I am currently trying to do that. You may have too many pages.
I would much rather do this online.
A2 a bit different. A2 has an additional field. 09 was more concise. 09 is more put together and ‟10
expanded. I don‟t have a strong preference.
No strong preference I am easy going
No strong preference
No
I don't know. Would not affect completion of survey.
Easiest way would be PDF writer. X Yeah of heard of it before but like I said PDF writer would be easier.
Safer because no human intervention.
I like the color better. It seems mostly the same. Oh there‟s less questions per page. It looks the same,
but it‟s not though. I bet a whole lot of people would get to page four and they‟d think they‟re done
because of this gap here. Seems similar.

Page 129 of 165

Form Comparison:

So I like the color better. So they give you more options to be interdisciplinary. Seems pretty much the
same though. The instructions part in the brown one are a lot bigger, but I still didn‟t read them. It‟s
smaller in the green one, but I still wouldn‟t have read them. Maybe they‟re acknowledging that nobody‟s
reading them.
I like A9 better. A lot of the information they ask, like A12a can be calculated by the way you filled it out.
So the one question that‟s going to throw the thing when I do it is B2. Do you intend to take a post doc
position yes. But it doesn‟t say within the next year. So I would say yes there and then everything else I
answered would say I was not taking a post doc because I‟m teaching here ,because everything says
would be within the next year. So when you get that you‟ll have a thing pop up that says these answers
do not match.
For the post grad plans, asking just the next year I think. If what you‟re trying to get out of the survey is
what people are planning on doing with their careers, then asking the next year, is just not going to give
you that information. At least it‟s definitely not for me. I totally intend to stay in science. But when this is
analyzed it‟s going to look like I‟m dropping out and teaching. So I‟ll be the Latin women, disabled person
who drops out of science and adds to the stats, but I‟m not going to. [laughs].
Still don‟t have ecology. Ecology is a big field, you should include.
x- Where are you looking for ecology?
R – In the life sciences, and agricultural sciences, I glanced at the other one. Oh look I totally didn‟t see
that it‟s under biomedical sciences „cause I would not have looked there. I didn‟t look there. Is it in this
one too? And it‟s totally there. Maybe I looked when I filled it out online.
And then on the next thing, um. It looks the same.
So I skipped B5 because I will not be doing a post doc or further training within the next year since I‟m
teaching so, I didn‟t say that one.
x- Do you find the skips difficult to follow?
R - No. I just felt like I should fill it out because it was there and it didn‟t say not to, but none of those
applied to me. So I‟m thinking I hope it doesn‟t screw things up.
These are all the same. All the background information is on the same page. Maybe that will help
people.
Yea, that‟s it.
I still wouldn‟t have read that thing, in the back. And I still would not have answered anything further.
I don‟t think either is difficult. This being right in the middle, might stop people from finishing the survey
though. It doesn‟t say anywhere on here to continue the survey, to keep going.
If I was procrastinating, which I probably was, I probably would have continued through flipping through

Flip Out Page: and found the rest of the questions.
Notice Barcodes?: No. I noticed it on the back though, on page 11.

Page 130 of 165

I assume the bar code is to assign the confidentiality number.
X – Do you have any thoughts about the survey because of the markings?

Yes: No. It probably makes it easier to enter the information.
No:
I assume the scanning marks are because you‟re scanning them and then they don‟t have to go in the
machine perfectly because the computer can match the marks and get the fields lined up. It probably
means you have fewer people having to enter these by hand. Probably a computer can do most of it.

Scanning process:
Confidentiality:
Overall Impression: First page looks the same. The questions are the same. Some may be missing. Codes are in middle.

R4

Form Comparison:
Flip Out Page:
Notice Barcodes?:
Yes:
No:
Scanning process:
Confidentiality:

2nd page almost same…layout is different. More room for additional degrees. Questions are the same.
Background is all together. Lines [in comment box] on back are more convenient.
The flip out better at end. I don‟t like it in the middle. It interrupts. Perhaps putting them at the end.
No
The bar code could be for anonymity.
That it looks at information.
“The color is different, but I don‟t see any other differences on the first page. The new one seems like „oh
god, more questions, more white space‟ but that‟s only because I just finished filling out the other one. I
just notice [the marks] which usually mean that this is experimental. The layout is getting at the same
questions, but in a different format. I am not sure which layout I like better, I guess the new one if I had to
choose.”

Overall Impression:
Form Comparison: See above.

He liked the 2009 flip out better. Saying that having the flip out in the back is “more comforting.” He liked

R5

Flip Out Page: the flip out all on one page because he can look at it while filling in the questions.
Notice Barcodes?: “No.”
He did not notice the markings at first. He thought that the markings were for scant Ron or experimental

Yes: purposes.
He assumed that bar codes are on everything and that if he didn‟t have the 2009 version to compare it to,
he wouldn‟t have thought anything of it. He said that the 2001 survey looks more impersonal and
anonymous.

No:
Scanning process: “I assume that there is a computer that reads in the writing.”

Page 131 of 165

Confidentiality:

He was “conflicted” because scanning eliminates as many people looking at the data with human eyes,
but it goes into a database. The survey is very personal because it contains contact information, marriage
information, salary and he was afraid of this going into a permanent database where it can be later held
against him in the future. “I mean I assume that when a human looks at it, then it is still going into a
database, but my first inclination is to fear the scant Ron.”
I just notice that there were instructions at the top use a pen or pencil and said to print. In my comments
and stuff I used cursive because it‟s quicker. It‟s a different color. What are these barcodes for? Are
these identifying? It confusing if it‟s not labeled what it is it makes people think what is that? Room for
additional comments and have been put in which is nice, A2 and A9 but the sections are now broken up
because of that addition. At the top of page 4…it would be helpful to have a header of top section. It tells
me go to C1…where is C1? It‟s broken up by list. I like background is a separate section altogether.
A9 on back is clearer that it is continuation. I liked how they italicized congratulations…

Overall Impression:
Form Comparison: ABOUT FOS LIST – Why can‟t this be in the very end…it breaks the flow

R6

Flip Out Page:
Notice Barcodes?:

If you really wanted people to read this disclaimer thing…I honestly don‟t think you really do have to read
it. I like the instructions on the older version it bigger. I like how they go directly to the list fields in the
newer version and the additional fields are put here and not in the back. Same comment about the
additional degrees. Old version was not obvious that it had space for two and now it‟s broken up. Which
I guess makes it clearer. Again there is that number that you don‟t what that number is. I like that its not
squeezed in it seems more substantial (Section A). I am still debating if there should be a header (page
4). This is the part of the survey where there is a lot “go to go to” and you‟re going to and its block by this
insert in the middle which I really think should be at the very end. If you really want to have this insert
here it would be helpful to have a page number next to skip. I like how background information is in one
separate section. The box at the end is a better way to giving the information. Things that are important
are bold. I like the logo.
Initially I thought it was a code for the version of the survey and then I thought it was an identifier for that

Yes: particular paper survey. I am really sure which of those is true.
No:
It makes things quicker. Its assigned number code - Why is there a bar code there but the other pages

Scanning process: there only a number?
Confidentiality:
I like the color better, it seems easier to read. If you‟re really interested in people reading the paragraph

Overall Impression: on the front, the text should be bigger. The layout is good.

R7

It seems shorter, but I see it‟s just because the field list is in the middle. I think the white and black font
stand out better with this color.

Form Comparison: B3 & B4 haven‟t been changed. I think those questions are redundant.
Flip Out Page: It‟s a little easier to find the code because I don‟t have to flip out the page.
Page 132 of 165

Notice Barcodes?:
Yes: No, I didn‟t notice it. I didn‟t have any reason to pay attention to it.
I think the bar code is used as a control item for you. Like tracking item. It doesn‟t affect my view of the

No: survey at all.
Scanning process: I don‟t have much of an understanding. Just that the barcode holds some data that you encode.
I have no concerns with confidentiality, but I have some concern over the loss of jobs from doing scanning

Confidentiality: instead of manual data entry.
I like the color. It‟s better than the first one. It provides a better contrast. I can see these icons, it‟s easier
to read. The color is just easier on the eye.
The font looks easier to read. Things look just clearer.
So there are more boxes here. I guess it gives people the option of putting in more fields, which I think is
good, instead of them going to the back cover page.
So, again, I probably would have made the mistake of only checking the boxes that apply (in A5).
A6 still only has one box for primary or secondary. This last check box is still not aligned; I might just skip
over this and not pay attention to that.
For page 3, it looks pretty much the same. I don‟t really see that many differences. Again, I like the color.
This is nice. For question A9. If you checked yes, your eye flows down the page. It feels like a better
progression instead of going off to the right. I like the bottom of page 3 in 2010. It feels like there isn‟t a
lot of text crammed in to the page.
On page 4. This is much better. It seems like there‟s more space and clearly laid out. It doesn‟t look
busy. There‟s just a big section break. It looks like things are easier to read.
For page 5. I don‟t understand why the list can‟t start away. It feels like a waste of a page. But If the
goal is to have the fields right next to each other.
It‟s awkward to have the list of fields in the middle. When you turn the page, you think you‟re done. It
looks distracting or misleading. Overall. I just like that there‟s less information on the page. Again for
question b8, if you‟re giving them an option, it would be nice to know before people put in the exact
amount. On b10, do people have the option of marking multiple secondary work activities?

R8

Overall Impression:
Form Comparison:
Flip Out Page:
Notice Barcodes?: No.
Yes:
No: So that it individualizes the specific form. That when this is scanned in, it links the information to me.
Scanning process: I have no understanding of the scanning process.
Confidentiality:

R9
Overall Impression:

“I like this color better [blue] it‟s easier on my eyes, pleasant, otherwise looks the same. Two paragraphs
on front page are easier to read. Inside also easier to read, clearer, type is offset better, background
bigger, bigger font, crisper so lot easier to read but they may be because I already know the other survey
so I‟m biased.”

Page 133 of 165

“I like the color better so much easier to read. Looks like pretty much the same questions, the black and
white fonts both stand out better against the blue background. Questions are easier to read, A9 is easier
when it‟s below rather than bottom right. I like the new [field of study list] better, but it would be better at
the end, more logical says “go to the end.” Section B same, just easier to read. Fold out is distracting.
[back page] Website stands out more, more obvious, clear, that‟s good. I like the bigger comments box,
there‟s more room to write.”

Form Comparison:
Flip Out Page: “This is the same…does not fold out which is better, more logical to have it at the end.”
Notice Barcodes?: “I noticed the bar code.”

“Good question. I think the bar code is for scanning but I don‟t know. It doesn‟t bother me; so many

Yes: things have bar codes.”
No: “I think the marks are for centering on a machine, copying? Putting into a database?”
Scanning process: “I know how to use a scanner and make a copy; I only do it at home.”
Confidentiality:
Type looks a little bigger or bolder. It does have a bar code at the top. The icons are just switched
around. Multiple field boxes. No. There must be quite a few people with interdisciplinary research if
they‟re all put on the same page.

R10

Overall Impression: Looks the same.
Form Comparison:
Flip Out Page: The lists of codes are in the middle, which is fine.
Notice Barcodes?:
Yes: Tracking.
No:
When send these out, the barcode is recorded for a certain individual. When you receive it back, you can

Scanning process: see who got the survey. No one‟s name would be recorded with survey.
Confidentiality:

Overall Impression:

R11

Form Comparison:

“I realize it is somewhat different. Actually, it addressed the issue of asking for additional degrees. I think
it is better as an open ended question. If it was close ended you could miss data.”
He had no problems with the layout. “It is pretty self explanatory and easy to follow. It‟s easy for someone
who is very visual.”
“A15 isn‟t necessary if you are asking A9. It seems like that wouldn‟t be needed if A9 is more openended.”
“The flip out in the middle is very convenient. In [2009 version], the flip out wasn‟t actually on page seven,

Flip Out Page: but in the new one it is actually on page six, like it says. It makes more sense this way.”
Notice Barcodes?:
He did not notice the marks. He believes that the marks tie the survey to the social security number. It is

Yes: also added for accuracy.
Page 134 of 165

No:
Scanning process: He thinks that scanning identifies the bar code and ties it to the data on the specific form.
Confidentiality:
Overall Impression: “It seems shorter at first because of the insert in the middle. It does seem more vibrant and visual.”

Form Comparison:

R12

Flip Out Page:
Notice Barcodes?:
Yes:

“The front seems the same. There is a barcode, but I have no reaction to that. It wouldn‟t entice me either
way. .Page two looks the same. Page three is slightly different. I have no reaction to the layout changes.
Referring to section A he says, “I prefer the questions that are relevant to the section be on the same
page [referring to section A]. "He did like section C on the 2010 survey.
“This is better off in the back instead of interrupting the survey. Normally these are in the back. I the
beginning I saw this and thought that was it. People are going to say I am done. It is standard procedure
to put it in the back.”

“No, I didn‟t notice the scanning marks. I guess it is just for internal processing to identify the survey. It

No: has no affect.”
Scanning process: “It probably goes into some databank.”
Confidentiality: “There is an element of human error. I don‟t think that [scanning] is positive or negative.”
Overall Impression: At first blush it seems pretty much the same.
On A2, you have more spaces here for more fields. I like better the (‟09) version. Because I think the two
is sufficient. I think two fields is probably sufficient for most people. Then there might be some who want
to supply 3 or 4, but there‟s a chance to do it in the end.
For the average person, for questions A8 – A13, my guess is that the brown form is probably better.
There will be some respondents who will have 2 or 3 undergraduate or postsecondary degrees. But the
advantage of the brown form, is that A9 – A13 are all on the same page. Where as you have to flip on
the blue form. The advantage of the blue form is that you might get a little more clarity and rigor on first
additional degree, second additional degree. Whereas on the brown form, the distinction between first
and second is not quite as explicit. There are spaces for two, but you don‟t have first or second in big
bold letters.

R13

It seems to me that having A9 – A13 on the same page.

Form Comparison: For the rest, I don‟t see significant differences at all.
Flip Out Page:

I prefer the flip out because it‟s less of an interrupter. It tends to stop your progress more. You turn the
page, and you see a list of codes. On the brown form, the information is there when you need it and not
there when you don‟t.

Page 135 of 165

Notice Barcodes?: I did not notice them.
Yes:
I do not know what they are for. I don‟t know if they are to scan the responses. I don‟t know what they‟re

No: for and I would not have gone through the trouble of finding out. It would not have given me pause.
X – Knowing that they‟re there, does that give you pause?

Scanning process: R – No.
Confidentiality:
Overall Impression: Page 3 – A9 I like separate white boxes. When I filled it out I was wondering why MD DDS.
Form Comparison: A10 to A13 on next page - I think IT is better.
List in between is sort of breaking it and people might think it‟s the end of questionnaire. I see the list is

R14

Flip Out Page: in between section „B‟ instead of end – which I thought was better.
Notice Barcodes?: Yeah, I did.
Yes: I am thinking those barcodes will help the survey go to machine instead of personally manually entering.
No:
In the past, the scantrons, while I was is school we used HB pencil. That will make easier for person

Scanning process: analyzing results.
No, because info could be stolen and hear about that a lot these days. I am hoping these surveys will be

Confidentiality: destroyed so more secure.
Overall Impression: I like this color better. Page 3 – I like this layout. Page separated into sections in a more intuitive way.
Color easier to read…Page 2 pretty similar-additional fields more convenient
New page 3 layout better
A9 odd in 2009-might think A9 – A13 is same section. 2010 clearer.

R15

Form Comparison:
Flip Out Page: It‟s not as convenient if it was at the end. I like if it was a flip out its easier to lift up the edge..
Notice Barcodes?: I did and wondered why there wasn't one on the original
Yes: Automated interpretation
No:
Not something I have ever done but I would guess it is feed into machine. With the bracketed corners it

Scanning process: tell the machine where the answers are on the page.
Confidentiality:

Page 136 of 165

A lot of it looks very, very similar. Are we picking out. The questions are just about the same, but I like
this layout on the second page on the previous degrees. It‟s a little easier to follow. Separates the
additional degrees and it makes it easier to skip. So those arrows work well.
These questions are all the same. The layout is fine. Not having the „did you earn an MD‟ and
community college question – not having it at the top of the page is kind of nice it in here, and not
separate from anywhere else. I don‟t know if I would have missed it but I guess this would make it harder
to miss.
Post graduate plans, it looks kind of identical. It‟s kind of nice having the fold out like this. I like this
better. It‟s all together, plain, on two pages.
I still missed the „are you Hispanic or Latino‟ I probably still would have gone though. It‟s just me, I‟m

Overall Impression: guessing.
So this one added more fields for interdisciplinary.

R16

This looks the same, except the change of layout, which is fine. Time that I wasn‟t working on degree –
did this disappear? It just went to the next page, which is fine. Like I said, getting rid of the things on the
top of the page was nice [A14 and A15 of 2009 quex]. Well it‟s easier when it‟s all together.
Moving on to part B. Not really any thoughts that come to mind. It‟s there.
No real preference in Part B in how it‟s laid out. It‟s fine.
Moving on Part C, background. It‟s nice. I do like that it‟s not flip [referring to the FOS list], it's all one
page, so. If I would have torn out the middle section, it seems it would only have to be the first section
where I had to flip through to find.

Form Comparison:
Flip Out Page:
Notice Barcodes?: No.
Yes:
No: Scanning purposes. If it were aligned in a feed copier it would get scanned. Don‟t know, just a thought.
Not too well. I imagine there‟s a way to run it through and scan it full page, but it. When looking at the

Scanning process: market it looks like it would go this way. But I guess it‟s more my predisposition more than anything else.
Confidentiality:

R17

I still don‟t know what cross reference means, it‟s strange. It looks the same. Page 3 additional degrees
clearer. Would include part time teaching or lectureships as an option. Would still include additional
degrees with the other degree information, you forget what that was.

Overall Impression:
Form Comparison: I like A9 on the red form because you can just skip over to doing this. No strong preferences
Page 137 of 165

I like the codes at the end. Prefers flip out page…I can just flop it open. Here you have to search for it a

Flip Out Page: little bit.
Marks on the corners No…I did notice these codes on the bottom of the page. I figured they were for

Notice Barcodes?: identifying the survey or that it‟s some sort of code for the mock up.
Yes: Marks – I would associate these with some sort of printers proof.
No:
Scanning process: As in putting on a scanner and put into a computer. Get a photographic image of it.
Confidentiality:

Overall Impression:

R18

“I like the color. It is more soothing and less offensive than the other one. Thank you for making page
seven open the way that it is supposed to open. Having the disciplines in the middle is fine. I like how the
sections start at the top and I like the way that section A is broken up.”
“The cover looks the same. I didn‟t pay attention to the seals.” He also noted that he preferred the ‟09
instructions. “The font sizes changed. I prefer the old one because it grabs your attention better. The
additional line is nice for A2. I don‟t understand why you need writing and codes. You could just put the
codes. That just seems redundant. Section B doesn‟t start at the top of the page but it is probably better
because there are more questions on the page than just A14 & A15. I don‟t know if it is strange having
the middle section. There are a lot of blank sports. It seems like a waste.”

Form Comparison:
Flip Out Page: “Probably the middle.”
Notice Barcodes?: “Yes.”

“No thoughts. No suspicions.”

Yes: “He thinks that the bar code is a way to electronically have access to give every survey a code number.”
No:
He thinks that there is software that has character recognition and that it may be possible to get all the

Scanning process: information without having to type it in.
“No. The end result is still there. The method doesn‟t bother me. Maybe it is more secure because no

Confidentiality: human will actually see specifics and human error can be avoided.”
The color is brighter it makes it stand out a little more. Give it more life. The barcode makes it seem a

Overall Impression: little bit more official or that it is being tracked. The white jumps off the page.

R19

Form Comparison:

This one is definitely brighter and you can pick out words a little better. Same content other then the
barcode. Shrinking the instructions is probably a good thing. Most people when they are taking a survey
know what to do. More choices for fields but I can‟t think of many dissertations that have more than two.
Page 3 is a slightly better format it you want to see the different degree right away. I think this formats a
little better. A9 to A15 reading top to bottom it is quite easy to miss the word. Here (New) there are
spread out and you can see where the answers are supposed to go and you can pick out the questions a
lot easier. Red might flow a little bit better because of this skipping. I like that they did not try to start the
next section (Part – C) in this little bit of space here. It starts on next page.

Page 138 of 165

The field of study list open up like this is different and I kind of like this better that way I don‟t have it open
kind of getting in the way like it was before. Now that the field of study is not at the end you are not
phishing for more questions.

Flip Out Page:
Notice Barcodes?:
Yes: For scanning.
No:
Scanning process: To me it that these are just guides to make sure to line up paper with the machine.
Confidentiality:
Overall Impression:

At first I don‟t see much difference. Room for secondary fields seems good. Like the format of [2010] for
A9 to A13. Comments at the end not very salient. They would be better on bottom of second to last
page.
A2 – if research was interdisciplinary. Would see 3 spots and would fill 3 fields with looking at italics. 2

R20

Form Comparison: lines necessary. A9
Flip Out Page: Nice opens same as opposed to fold out. Still better @ end of book…Move comments to last page.
Notice Barcodes?:
Yes: Scanning No…basic gave exams on bubble sheets.
No:
Scanning process:
Confidentiality:

Page 139 of 165

Appendix 4 – Cognitive Interview Email Letter
Dear Dr. ,
Thank you for participating in the 2008 Survey of Earned Doctorates (SED), and congratulations
on completing your doctorate degree. We are writing to ask your assistance in helping us finalize
our 2010 questionnaire.
We are recruiting recent doctorate recipients who completed the 2008 survey to participate in a
confidential interview concerning possible changes to the SED questionnaire. Your feedback
would be valuable to us as we consider the impacts of modifying the questionnaire. Upon
completion of the interview, NORC will compensate you $75 in appreciation for your time
and cooperation.
We are conducting interviews between October 1 – October 15, 2008, Monday through Friday,
from 8 am to 5pm. Some evening and weekend times are available if you are unable to
participate during these hours. Interviews can be conducted at our convenient downtown Chicago
or University of Chicago Hyde Park locations. Please email or call us toll free at 1-800-248-8649
to schedule an appointment.
Thank you for your participation in the SED!
Cynthia Simko, Senior Survey Director
NORC
312-759-4066
1-800-248-8649
[email protected]

Page 140 of 165

Appendix 4 – Cognitive Interview Letter

Dear ,
Thank you for participating in the 2008 Survey of Earned Doctorates (SED), and congratulations
on completing your doctorate degree. We are writing to ask your assistance in helping us finalize
our 2010 questionnaire.
We are recruiting recent doctorate recipients who completed the 2008 survey to participate in a
confidential interview concerning possible changes to the SED questionnaire. Your feedback
would be valuable to us as we consider the impacts of modifying the questionnaire. Upon
completion of the interview, NORC will compensate you $75 in appreciation for your time
and cooperation.
We are conducting interviews between October 1 and October 15, 2008, Monday through Friday,
from 8am to 5pm. Some evening and weekend times are available if you are unable to participate
during these hours. Interviews can be conducted at our convenient downtown Chicago or
University of Chicago Hyde Park locations. Please email or call us toll free at 1-800-248-8649 to
schedule an appointment.
Thank you for your participation in the SED!
Cynthia Simko, Senior Survey Director
NORC
312-759-4066
1-800-248-8649
[email protected]

Our mission is to conduct high quality social science research in the public interest.

Page 141 of 165

Appendix 4 – Cognitive Interview Phone Script
Hello,
My name is Mireya Dominguez, and I am calling from the National Opinion Research
Center at the University of Chicago. I am calling in regards to the Survey of Earned
Doctorates (SED) interview letter we sent you two weeks ago. Do you recall receiving
that letter?
Yes—Great! Would you be able to help us by scheduling a convenient time to conduct
the interview? Remember, upon completion of the interview, NORC will
compensate you $75 in appreciation for your time and cooperation.
No—Okay, well let me quickly summarize what we’re doing. We are recruiting recent
doctorate recipients who completed the 2008 survey to participate in a confidential
interview concerning possible changes to the SED questionnaire. Our hope is to get
valuable feedback from you so that we can understand the impact of modifying the
questionnaire. Upon completion of the interview, NORC will compensate you $75
in appreciation for your time and cooperation.
We are conducting interviews between October 1 – 15, 2008, Monday through Friday,
from 8 am to 5pm. Some evening and weekend times are available if you are unable to
participate during these hours. Interviews can be conducted at our convenient downtown
Chicago or university of Chicago Hyde Park locations. Would you be able to help us by
scheduling a time to conduct the interview?

Respondent Name: ______________________________________
Date: _ _ / _ _/2008
Time: _ _ : _ _

am
pm

Page 142 of 165

SED

Survey of Earned Doctorates

July1, 2008 to June 30, 2009

Conducted by

for
NSF

Please complete:
First Name

Middle Name

Last Name

Suffix (e.g., Jr.)

Cross Reference: Birth name or former name legally changed
Name of Doctoral Institution
Type of Research Doctoral Degree (e.g., Ph.D, Ed.D, etc.)

City or Branch
Date Degree Granted (mm/yyyy)

This information is solicited under the authority of the National Science Foundation Act of 1950, as amended. ALL INFORMATION YOU PROVIDE WILL BE TREATED AS
CONFIDENTIAL and used only for research or statistical purposes by your doctoral institution, the survey sponsors, their contractors, and collaborating researchers for the
purpose of analyzing data, preparing scientific reports and articles, and selecting samples for a limited number of carefully defined follow-up studies. The last four digits
of your Social Security Number are also solicited under the NSF Act of 1950, as amended; provision of it is voluntary. It will be kept confidential. It is used for quality control
to assure that we identify the correct persons, especially when data are used for statistical purposes in Federal program evaluation. Any information publicly released
(such as statistical summaries) will be in a form that does not personally identify you. Your response is voluntary and failure to provide some or all of the requested
information will not in any way adversely affect you.
The time needed to complete this form varies according to individual circumstances, but the average time is estimated to be 19 minutes. If you have comments regarding
this time estimate, you may write to the National Science Foundation, 4201 Wilson Blvd., Arlington, VA 22230, Attention: NSF Reports Clearance Officer. A Federal agency
may not conduct or sponsor a collection of information unless it displays a currently
validofOMB
Page 143
165control number.
OMB No.: 3145-0019 Approval Expires 05/31/2009

INSTRUCTIONS
Thank you for taking the time to complete this questionnaire. Directions are provided for each question.
• If you have not already done so, please PRINT your name on the front cover.
• Please print all responses; you may use either a pen or a pencil.

Part A ­ EDUCATION
A5. Which of the following were sources of financial
support during graduate school?

A1. What is the title of your dissertation?
mark (X) this box if the title below refers to a
■ Please
performance, project report, or musical or literary composition

Mark (X) Yes or No for each

required instead of a dissertation.

Yes

No

■ . . . ■

b Grant . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

c Teaching assistantship . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

d Research assistantship . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

e Other assistantship . . . . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

f Traineeship . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

g Internship, clinical residency . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

h Loans (from any source) . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

i Personal savings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■

j Personal earnings during graduate school . . . . . . . . . . . . . . . . ■ . . . ■
(other than sources listed above)
k Spouse’s, partner’s, or family’s earnings or savings . . . . ■ . . . ■
l Employer reimbursement/assistance . . . . . . . . . . . . . . . ■ . . . ■
m Foreign (non­U.S.) support . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■
n Other ­ Specify . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ■ . . . ■
a Fellowship, scholarship . . . . . . . . . . . . . . . . . . . . . . . . .

Title
_____________________________________________________________________________
_____________________________________________________________________________
__________________________________________________________________________

A2. Please write the name of the primary field of your
dissertation research.
__________________________________________________________________________

Name of Field

Using the list on page 7, choose the code that best
describes the primary field of your dissertation
research.
Number of Field

If your dissertation research was interdisciplinary,
list the name and number of your secondary field.
__________________________________________________________________________

A6. Which TWO sources listed in A5 provided the most support?

Name of Field

Enter letters of primary and secondary sources
Number of Field
If there were more than two fields, additional fields should be
reported on page 10.

A3. Please name the department (or interdisciplinary
committee, center, institute, etc.) of the university
that supervised your doctoral studies.

1

Primary source of support

2

Secondary source of support

■ Mark (X) if no secondary source
A7. When you receive your doctoral degree, how much
money will you owe that is directly related to your
undergraduate and graduate education?

__________________________________________________________________________

Department/Committee/Center/Institute/Program

Mark (X) one in each column

A4. If you received full or partial tuition remission
(waiver) for your doctoral studies, was it:

UNDERGRADUATE

GRADUATE

■ None
2 ■ $10,000 or less
3 ■ $10,001 ­ $20,000
4 ■ $20,001 ­ $30,000
5 ■ $30,001 ­ $40,000
6 ■ $40,001 ­ $50,000
7 ■ $50,001 ­ $60,000
8 ■ $60,001 ­ $70,000
9 ■ $70,001 or more ­ Specify

■ None
2 ■ $10,000 or less
3 ■ $10,001 ­ $20,000
4 ■ $20,001 ­ $30,000
5 ■ $30,001 ­ $40,000
6 ■ $40,001 ­ $50,000
7 ■ $50,001 ­ $60,000
8 ■ $60,001 ­ $70,000
9 ■ $70,001 or more ­ Specify

$

$

1

Mark (X) one

■ I did not receive any tuition remission
2 ■ for less than 1/3 of tuition
3 ■ between 1/3 and 2/3 of tuition
4 ■ more than 2/3 of tuition, but less than full
5 ■ full tuition remission

1

Page 144 of 165

2

1

A8. The next few questions ask about the degrees you have received. Please provide the following information for this doctoral
degree, your most recent master’s degree, and your first bachelor’s degree in the appropriate columns below.
This research
doctoral degree

■ ■

a. Have you received a degree of this type? . . . . . . X Yes
b. Month/ year degree granted . . . . . . . . . . . . . . . .

No

Month

Most recent master’s degree
(e.g. MS, MA, MBA)
or equivalent

First bachelor’s degree
(e.g. BA, BS, AB)
or equivalent

■ ■

■ ■

Yes

No

Month
Year

c. Month / year that you started your degree . . . . . .

Month

No

Month
Year

Month
Year

d. Primary field of study . . . . . . . . . . . . . . . . . . . . .

Yes

Year
Month

Year

Year

__________________________________

__________________________________ __________________________________

__________________________________

__________________________________ __________________________________

__________________________________

__________________________________ __________________________________

__________________________________

__________________________________ __________________________________

e. Field number from list on p. 7. . . . . . . . . . . . . . .
f. Institution name . . . . . . . . . . . . . . . . . . . . . . . . .

g. Branch or city . . . . . . . . . . . . . . . . . . . . . . . . . .
h. State or province . . . . . . . . . . . . . . . . . . . . . . . .

USA

i. Country . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
A9. Excluding those above, have you attained
any additional postsecondary degrees?

■ Yes ■ No

A10. Was a master’s degree a prerequisite for
admission to your doctoral program?

■ Yes ■ No

A11. In what month and year did you first
enter graduate school in any program
or capacity, in any university?
A12. How many years were you:
a. taking courses or preparing for exams
for this doctoral degree (including a
master’s degree, if that was part of
your doctoral program)?
b. working on your dissertation after
coursework and exams (non­course
related preparation, writing and defense)?
A13. Was there any time from the year you
entered your doctoral program and
the award of your doctorate that you
were not working on your degree
(that is, not taking courses or
working on your dissertation)?
If yes, please provide the number of years

If yes, please list the additional degree(s), granting
institution(s), and years.

Month
Year

Degree Type

_____________________________________________

Degree Field

_____________________________________________

Field Number, p. 7

_____________________________________________

Month/Year Granted

_____________________________________________

Institution

_____________________________________________

Branch or City

_____________________________________________

State or Country

_____________________________________________

Degree Type

_____________________________________________

Degree Field

_____________________________________________

Field Number, p. 7

_____________________________________________

Month/Year Granted

_____________________________________________

Institution

_____________________________________________

Branch or City

_____________________________________________

State or Country

_____________________________________________

Years (round to whole years)

Years (round to whole years)

■ Yes ■ No

Years (round to whole years)

Page 145 of 165

3

If there are more than two degrees, additional degrees
should be reported on page 10.

A14. Did you earn college credit from a community or two­
year college?
1

■

Yes

2

■

A15. Are you earning, or have you earned, an MD
or a DDS?

No

1

■

Yes

2

■

No

Part B ­ POSTGRADUATION PLANS
B5. What will be the main source of financial support for
your “postdoc” or further training within the next year?

B1. In what country or state do you intend to live after
graduation (within the next year)?

■ in U.S.
2 ■ not in U.S.

1

Mark (X) one

State

■ U.S. government
2 ■ Industry/business
3 ■ College or university
4 ■ Private foundation
5 ■ Nonprofit, other than private foundation or college
6 ■ Foreign government
7 ■ Other ­ Specify
1

Country

B2. Do you intend to take a “postdoc” position?
(A “postdoc” is a temporary position primarily for gaining additional
education and training in research, usually awarded in academe,
industry, government, or a non­profit organization.)
1

■

Yes

2

■

No

B3. What is the status of your postgraduate plans
(in the next year)?
Mark (X) one

■ Returning to, or continuing in, predoctoral employment
2 ■ Have signed contract or made definite commitment for
a “postdoc” or other work

1

■ Negotiating with one or more specific organizations
4 ■ Seeking position but have no specific prospects
5 ■ Other full­time degree program (e.g., MD, DDS, JD, MBA, etc.)
6 ■ Do not plan to work or study (e.g., family commitments, etc.)
7 ■ Other ­ Specify

8

GO
TO
B4

B6. What type of principal employer will you be working
for (or training with) in the next year?
Mark (X) one

3

EDUCATION

■ U.S. 4­year college or university other than medical school
2 ■ U.S. medical school (including university­affiliated hospital or medical center)
3 ■ U.S. university­affiliated research institute
4 ■ U.S. community or two­year college
5 ■ U.S. preschool, elementary, middle, secondary school or school system
6 ■ Foreign educational institution
1

SKIP
TO
C1

B4. What best describes your (within the next year)
postgraduate plans?

GOVERNMENT (other than education institution)

■ Foreign government
8 ■ U.S. federal government
9 ■ U.S. state government
10 ■ U.S. local government

Mark (X) one

7

“POSTDOC” OR FURTHER TRAINING

■ “Postdoc” fellowship
2 ■ “Postdoc” research associateship
3 ■ Traineeship
4 ■ Internship, clinical residency
5 ■ Other Training ­ Specify

■ Unknown

1

PRIVATE SECTOR (other than education institution)

GO
TO
B5

■ Not for profit organization
12 ■ Industry or business (for profit)

11

OTHER

■ Self­employed
14 ■ Other ­ Specify
13

EMPLOYMENT

■ Employment (other than “postdoc” or further training)
7 ■ Military service
8 ■ Other Employment­ Specify
6

SKIP
TO
B6

B7. Please name the organization and geographic
location where you will work or study.
Name . . . . . . . . . . . .
State (if U.S.) . . . . . .
Country (if not U.S.) .

Page 146 of 165

4

B8. What will be your basic annual salary for this principal
job (in the next year)? Do not include bonuses or
additional compensation for summertime teaching or
research. If you are not salaried, please estimate your
earned income.

B10.What will be your primary and secondary work activities?
Mark (X) one in each column
a PRIMARY b SECONDARY

■ . . . . . 1 ■

Teaching . . . . . . . . . . . . . . . . . . . . . . . . . 2 ■ . . . . . 2 ■

Management or administration . . . . . . . . 3 ■ . . . . . 3 ■

Professional services to individuals . . . . . 4 ■ . . . . . 4 ■
Other ­ Specify . . . . . . . . . . . . . . . . . . . . 5 ■ . . . . . 5 ■

Research and development . . . . . . . . . . . 1

$

__________________________________

If you prefer not to report an exact amount, please
indicate into which range you expect your salary to fall:
Mark (X) one

■ $30,000 or less
■ $30,001 ­ $35,000
3 ■ $35,001 ­ $40,000
4 ■ $40,001 ­ $50,000
5 ■ $50,001 ­ $60,000
6 ■ $60,001 ­ $70,000

■ $70,001 ­ $80,000
■ $80,001 ­ $90,000
9 ■ $90,001 ­ $100,000
10 ■ $100,001 ­ $110,000
11 ■ $110,001 or above
12 ■ Don’t know

1

7

■ Mark (X) if no secondary work activities

8

2

B9. How many months does this salary cover?
Number of Months

Part C ­ BACKGROUND INFORMATION
C1. Are you ­
1

■

Male

2

■

C4. What is the highest educational attainment of your
mother and father?
Female

Mark (X) one for each parent

C2. What is your marital status?

a MOTHER

b FATHER

■ . . . . .1 ■
■ . . . . .2 ■
Some college . . . . . . . . . . . . . . . . . . . . . . 3 ■ . . . . . 3 ■
Bachelor’s degree . . . . . . . . . . . . . . . . . . .4 ■ . . . . . 4 ■
Master’s degree . . . . . . . . . . . . . . . . . . . . 5 ■ . . . . . 5 ■
(e.g., MA, MS, MBA, MSW, etc.)
Professional degree . . . . . . . . . . . . . . . . . 6 ■ . . . . . 6 ■
(e.g., MD, DDS, JD, D.Min, Psy.D., etc.)
Research doctoral degree . . . . . . . . . . . . .7 ■ . . . . . 7 ■

Not applicable/Unknown . . . . . . . . . . . . . .8 ■ . . . . . 8 ■

Mark (X) one

Less than high/secondary school graduate . .1

■ Married
2 ■ Living in a marriage­like relationship
3 ■ Widowed
4 ■ Separated
5 ■ Divorced
6 ■ Never married

High/secondary school graduate . . . . . . . 2

1

C3. Not including yourself or your spouse/partner, how many
dependents (children or adults) do you have ­ that is, how
many others receive at least one half of their financial
support from you?

C5. What is your place of birth?
State (if U.S.) . . . . . .

OR

Country (if not U.S.) .

Write in number of dependents

5 years of age or younger . .

C6. What is your date of birth?

6 to 18 years . . . . . . . . . . .

19 years or older . . . . . . . .

Month

■ Mark (X) if none

Page 147 of 165

5

Day

Year

1 9

C7. What is your citizenship status?

C14. What is your racial background?

Mark (X) one

Mark (X) one or more

U.S. CITIZEN

a

■ Since birth
2 ■ Naturalized

■ American Indian or Alaska Native

SKIP
TO
C9

1

Specify tribal affiliation(s)

NON­U.S. CITIZEN

■ With a Permanent U.S. Resident Visa (“Green Card”)
4 ■ With a Temporary U.S. Visa

■ Native Hawaiian or other Pacific Islander

c ■ Asian

d ■ Black or African­American

e ■ White

b

GO
TO
C8

3

C8. (If a non­U.S. citizen)
Of which country are you a citizen?

C15. Please fill in the last four digits of your
Social Security Number.

__________________________________________________________________________

Specify country of present citizenship

X X X ­ X X ­

C9. In what state or country was the high school/secondary
school that you last attended?

C16. In case we need to clarify some of the information
you have provided, please list an e­mail address and
telephone number where you can be reached.

State (if U.S.) . . . . . .

OR

Country (if not U.S.) .

__________________________________________________________________________

E­mail Address

C10. Are you a person with a disability?

■ Yes
2 ■ No

1

GO TO C11

__________________________________________________________________________

Daytime or Cell Telephone

SKIP TO C12

C17. Please provide your address and the name and
address of a person who is likely to know where you
can be reached.

C11. Which of the following categories describes your
disability(ies)?
Mark (X) one or more

YOUR CURRENT ADDRESS:

■ Blind/Visually Impaired

b ■ Deaf/Hard of Hearing

c ■ Physical/Orthopedic Disability

d ■ Learning/Cognitive Disability

e ■ Vocal/Speech Disability

f ■ Other ­ Specify

a

__________________________________________________________________________

Street Address
__________________________________________________________________________

City/State/Country/Zip or Postal Code
CURRENT ADDRESS OF A PERSON WHO IS LIKELY TO KNOW WHERE
YOU CAN BE REACHED:
__________________________________________________________________________

Name

C12. Are you Hispanic or Latino?

■ Yes
2 ■ No
1

__________________________________________________________________________

Street Address
GO TO C13
__________________________________________________________________________

City/State/Country/Zip or Postal Code

SKIP TO C14

C13. Which of the following best describes your Hispanic
origin or descent?

The results of this survey will be published in a Summary
Report. For information on the publications available from this
survey, please go to http://www.nsf.gov/statistics/doctorates.

Mark (X) one

■ Mexican or Chicano

2 ■ Puerto Rican

3 ■ Cuban

4 ■ Other Hispanic ­ Specify

1

Please use the back cover to make any additional comments
you may have about this survey.
Thank you for completing the questionnaire. Please return
this questionnaire to your GRADUATE SCHOOL for for­
warding to Survey of Earned Doctorates, NORC at the
University of Chicago, 1 N. State Street, Floor 16, Chicago,
IL 60602.
If you have questions or concerns about the survey, you
may contact us by e­mail at 4800­[email protected] or
phone at 1­800­248­8649.
Page 148 of 165

6

Pl

eas
e

ope
nt

his
p

age
for t
h

Page 149 of 165

7

e Field

of Study List
The Field of Study listing
on pages 8 and 9 is to
be used in responding to
items A2, A8, and A9.
Please choose the code
that best describes the
name of your field.

BUSINESS MANAGEMENT/ADMINISTRATION
900
905
910
915
901
921

Accounting
Banking/Financial Support Services
Business Administration & Management
Business/Managerial Economics
Finance
Human Resources Development

916
920
917
930

International Business/Trade/Commerce
Marketing Management & Research
Management Information Systems/Business Statistics
Operations Research (also in ENGINEERING &
in MATHEMATICS)

935 Organizational Behavior (see also
PSYCHOLOGY/Industrial & Organizational)
938 Business Management/Administration, General
939 Business Management/Administration, Other

COMMUNICATION
940 Communication Research
957 Communication Theory

950 Film, Radio, TV & Digital Communication
947 Mass Communication/Media Studies

958 Communication, General
959 Communication, Other

COMPUTER & INFORMATION SCIENCES
400 Computer Science

410 Information Science & Systems

419 Computer & Information Science, Other

810
807
822
815

845
825
830
835

EDUCATION
RESEARCH & ADMINISTRATION
840 Counseling Education/Counseling & Guidance
800 Curriculum & Instruction
805 Educational Administration & Supervision
820 Educational Assessment/Testing/Measurement
TEACHER EDUCATION
858 Adult & Continuing Teacher Education
852 Elementary Teacher Education
TEACHING FIELDS
860 Agricultural Education
861 Art Education
862 Business Education
864 English Education
870 Family & Consumer/Human Science (also in
Fields Not Elsewhere Classified)
OTHER EDUCATION
898 Education, General

Educational/Instructional Media Design
Educational Leadership
Educational Psychology (also in PSYCHOLOGY)
Educational Statistics/Research Methods

Higher Education/Evaluation & Research
School Psychology (also in PSYCHOLOGY)
Social/Philosophical Foundations of Education
Special Education

850 Pre­elementary/Early Childhood Teacher Education

856 Secondary Teacher Education

866
868
874
876
878
880

882
884
885
888
889

Foreign Languages Education
Health Education
Mathematics Education
Music Education
Nursing Education
Physical Education & Coaching

Reading Education
Science Education
Social Science Education
Trade & Industrial Education
Teacher Education & Professional Development, Other

899 Education, Other

ENGINEERING
300
303
306
309
312
315
318
321
324

Aerospace, Aeronautical & Astronautical Engineering
Agricultural Engineering
Bioengineering & Biomedical Engineering
Ceramic Sciences Engineering
Chemical Engineering
Civil Engineering
Communications Engineering
Computer Engineering
Electrical, Electronics & Communications Engineering

376
327
330
333
336
339
342
345
348
351

Engineering Management & Administration
Engineering Mechanics
Engineering Physics
Engineering Science
Environmental Health Engineering
Industrial & Manufacturing Engineering
Materials Science Engineering
Mechanical Engineering
Metallurgical Engineering
Mining & Mineral Engineering

357 Nuclear Engineering
360 Ocean Engineering
363 Operations Research (also in MATHEMATICS
& in BUSINESS MANAGEMENT)
366 Petroleum Engineering
369 Polymer & Plastics Engineering
372 Systems Engineering
398 Engineering, General
399 Engineering, Other

HUMANITIES
HISTORY
706 African History
700 American History (U.S. & Canada)
703 Asian History
FOREIGN LANGUAGES & LITERATURE
768 Arabic
758 Chinese
740 French
743 German
LETTERS
732 American Literature (U.S. & Canada)
720 Classics
723 Comparative Literature
735 Creative Writing
OTHER HUMANITIES
770 American/U.S. Studies
773 Archaeology
776 Art History/Criticism/Conservation
792 Bible/Biblical Studies
795 Drama/Theater Arts

705 European History
710 History, Science & Technology & Society
707 Latin American History

708 Middle/Near East Studies
718 History, General
719 History, Other

746 Italian
762 Japanese
752 Russian

755 Slavic (other than Russian)
749 Spanish
769 Other Languages & Literature

734 English Language
733 English Literature (British & Commonwealth)
724 Folklore

736 Speech & Rhetorical Studies
738 Letters, General
739 Letters, Other

780
786
787
788
789

Music
Music Theory & Composition
Music Performance
Musicology/Ethnomusicology
Music, Other

785
790
798
799

Fishing & Fisheries Sciences/Management
Food Science
Food Science & Technology, Other
Forest Sciences & Biology
Forest/Resources Management
Forestry & Related Science, Other
Horticulture Science
Natural Resources/Conservation

030 Plant Pathology/Phytopathology (also in
BIOLOGICAL SCIENCES)
039 Plant Sciences, Other
046 Soil Chemistry/Microbiology
049 Soil Sciences, Other
080 Wildlife/Range Management
072 Wood Science & Pulp/Paper Technology
098 Agriculture, General
099 Agricultural Science, Other

Philosophy
Religion/Religious Studies
Humanities, General
Humanities, Other

LIFE SCIENCES
AGRICULTURAL SCIENCES/NATURAL RESOURCES
005 Agricultural Animal Breeding
055
000 Agricultural Economics
043
025 Agricultural & Horticultural Plant Breeding
044
020 Agronomy & Crop Science
066
010 Animal Nutrition
070
014 Animal Science, Poultry (or Avian)
079
019 Animal Science, Other
050
081 Environmental Science
074

Page 150 of 165

88
8

LIFE SCIENCES (continued)
BIOLOGICAL/BIOMEDICAL SCIENCES
130 Anatomy
110 Bacteriology
100 Biochemistry (see also PHYSICAL SCIENCES/
Chemistry, other)
102 Bioinformatics
103 Biomedical Sciences
133 Biometrics & Biostatistics
105 Biophysics (also in PHYSICS)
107 Biotechnology
129 Botany/Plant Biology
158 Cancer Biology
HEALTH SCIENCES
210 Environmental Health
211 Environmental Toxicology
220 Epidemiology
212 Health Systems/Services Administration
222 Kinesiology/Exercise Science

136
142
139
145
148
137
170
151
157
154
160
163

Cell/Cellular Biology & Histology
Developmental Biology/Embryology
Ecology
Endocrinology
Entomology
Evolutionary Biology
Genetics/Genomics, Human & Animal
Immunology
Microbiology
Molecular Biology
Neurosciences
Nutrition Sciences

166
175
180
185
115
120
125
169
189
198
199

Parasitology
Pathology, Human & Animal
Pharmacology, Human & Animal
Physiology, Human & Animal
Plant Genetics
Plant Pathology/Phytopathology (also in
AGRICULTURAL SCIENCES)
Plant Physiology
Toxicology
Zoology
Biology/Biomedical Sciences, General
Biology/Biomedical Sciences, Other

240
230
215
245

Medicinal/Pharmaceutical Sciences
Nursing Science
Public Health
Rehabilitation/Therapeutic Services

200
250
298
299

Speech­Language Pathology & Audiology
Veterinary Sciences
Health Sciences, General
Health Sciences, Other

450
455
498
499

Statistics (also in SOCIAL SCIENCES)
Topology/Foundations
Mathematics/Statistics, General
Mathematics/Statistics, Other

MATHEMATICS
425
430
420
460
435

Algebra
Analysis & Functional Analysis
Applied Mathematics
Computing Theory & Practice
Geometry/Geometric Analysis

440 Logic
445 Number Theory
465 Operations Research (also in ENGINEERING & in
BUSINESS MANAGEMENT/ADMIN.)

PHYSICAL SCIENCES
ASTRONOMY
500 Astronomy
ATMOSPHERIC SCIENCE & METEOROLOGY
510 Atmospheric Chemistry & Climatology
512 Atmospheric Physics & Dynamics
CHEMISTRY
520 Analytical Chemistry
522 Inorganic Chemistry
526 Organic Chemistry
GEOLOGICAL & EARTH SCIENCES
542 Geochemistry
540 Geology
552 Geomorphology & Glacial Geology
OCEAN/MARINE SCIENCES
585 Hydrology & Water Resources
590 Oceanography, Chemical & Physical
PHYSICS
560 Acoustics
576 Applied Physics
561 Atomic/Molecular/Chemical Physics
565 Biophysics (also in BIOLOGICAL SCIENCES)

505 Astrophysics
514 Meteorology
518 Atmospheric Science/Meteorology, General

519 Atmospheric Science/Meteorology, Other

530 Physical Chemistry
532 Polymer Chemistry
534 Theoretical Chemistry

538 Chemistry, General
539 Chemistry, Other (see also BIOLOGICAL/Biochemistry)

544 Geophysics & Seismology
548 Mineralogy & Petrology
546 Paleontology

550 Stratigraphy & Sedimentation
558 Geological & Earth Sciences, General
559 Geological & Earth Sciences, Other

595 Marine Sciences
599 Ocean/Marine, Other
574
568
569
564

Condensed Matter/Low Temperature Physics
Nuclear Physics
Optics/Photonics
Particle (Elementary) Physics

570
572
578
579

Plasma/Fusion Physics
Polymer Physics
Physics, General
Physics, Other

Experimental Psychology
Family Psychology
Human Development & Family Studies
Industrial & Organizational (see also BUSINESS
MANAGEMENT/Organization Behavior)
624 Personality Psychology

627
633
636
639
648
649

Physiological/Psychobiology Psychology
Psychometrics & Quantitative Psychology
School Psychology (also in EDUCATION)
Social Psychology
Psychology, General
Psychology, Other

667
670
674
676
678
682

686
690
694
695
698
699

Sociology
Statistics (also in MATHEMATICS)
Urban Affairs/Studies
Urban/City, Community & Regional Planning
Social Sciences, General
Social Sciences, Other

PSYCHOLOGY
600
603
606
609
612
618

Clinical Psychology
Cognitive Psychology & Psycholinguistics
Comparative Psychology
Counseling
Developmental & Child Psychology
Educational Psychology (also in EDUCATION)

615
620
613
621

SOCIAL SCIENCES
650
652
657
658
662
668

Anthropology
Area/Ethnic/Cultural/Gender Studies
Criminal Justice & Corrections
Criminology
Demography/Population Studies
Econometrics

Economics
Geography
International Relations/Affairs
Linguistics
Political Science & Government
Public Policy Analysis

FIELDS NOT ELSEWHERE CLASSIFIED (NEC)
960 Architecture/Environmental Design
964 Family/Consumer Science/Human Science
(also in EDUCATION)
968 Law

972
974
976
980

Library Science
Parks/Sports/Rec./Leisure/Fitness
Public Administration
Social Work

Page 151 of 165

89
88

984 Theology/Religious Education (see also OTHER
HUMANITIES/Religion/Religious Studies)
989 Other Fields, NEC

ADDITIONS TO QUESTIONS
A2. (continued)

To the Doctorate Recipient:
Congratulations on earning a doctoral degree! This
is an important accomplishment for you. Your
accomplishment is also significant for both this nation
and others, as the new knowledge generated by
research doctorates enhances the quality of life in this
country and throughout the world. Because of the
importance of persons earning research doctorates,
several Federal agencies–listed on the cover–sponsor
this Survey of Earned Doctorates.

__________________________________________________________________________

Name of Field
Number of Field
__________________________________________________________________________

Name of Field
Number of Field

A9. (continued)

The basic purpose of this survey is to gather objective
data about doctoral graduates. These data are
important in improving graduate education both at
your home institution and beyond. Often, decisions
made by governmental and private agencies to
develop new programs, or to support present ones, are
based in part on the data developed from this survey.
If you have any comments about the survey, please
provide them in the space below.

Degree Type

________________________________________________________

Degree Field

________________________________________________________

Field Number, p. 7

________________________________________________________

Month/Year Granted

________________________________________________________

Institution

________________________________________________________

Branch or City

________________________________________________________

State or Country

________________________________________________________

Degree Type

________________________________________________________

Degree Field

________________________________________________________

Field Number, p. 7

________________________________________________________

Month/Year Granted

________________________________________________________

Institution

________________________________________________________

Branch or City

________________________________________________________

State or Country

________________________________________________________

On behalf of the sponsoring Federal agencies, I thank
you for your participation in this survey.
Best wishes,
Dr. Lynda T. Carlson
National Science Foundation

Comments about the survey:

Please return this questionnaire to your GRADUATE SCHOOL for forwarding to:

Survey of Earned Doctorates, NORC at the University of Chicago, 1 N. State Street, Floor 16, Chicago, IL 60602.

If you have questions or concerns about the survey, you may contact us by e­mail at 4800­[email protected] or phone 1­800­248­8649.

OFFICE USE ONLY
Case ID:

Instit. Code:

Grad Date:

PROCESSING
Editing

Receipt
Initials

Date

Initials

Ver. Adjust
Initials

Main Disp.:

CADE
Date

Initials

Retrieval
Date

Initials

Updates
Date

Page 152 of 165

10

Date

Initials

Date

6100-71002159-01

SED

Survey of Earned Doctorates
July1, 2009 to June 30, 2010
Conducted by

for
NSF

Please complete:

First Name

Middle Name

Last Name

Suffix (e.g., Jr.)

Cross Reference: Birth name or former name legally changed
Name of Doctoral Institution
Type of Research Doctoral Degree (e.g., Ph.D, Ed.D, etc.)

City or Branch
Date Degree Granted (mm/yyyy)

This information is solicited under the authority of the National Science Foundation Act of 1950, as amended. ALL INFORMATION YOU PROVIDE WILL BE TREATED AS
CONFIDENTIAL and used only for research or statistical purposes by your doctoral institution, the survey sponsors, their contractors, and collaborating researchers for the
purpose of analyzing data, preparing scientific reports and articles, and selecting samples for a limited number of carefully defined follow-up studies. The last four digits
of your Social Security Number are also solicited under the NSF Act of 1950, as amended; provision of it is voluntary. It will be kept confidential. It is used for quality control
to assure that we identify the correct persons, especially when data are used for statistical purposes in Federal program evaluation. Any information publicly released
(such as statistical summaries) will be in a form that does not personally identify you. Your response is voluntary and failure to provide some or all of the requested
information will not in any way adversely affect you.
The time needed to complete this form varies according to individual circumstances, but the average time is estimated to be 19 minutes. If you have comments regarding
this time estimate, you may write to the National Science Foundation, 4201 Wilson Blvd., Arlington, VA 22230, Attention: NSF Reports Clearance Officer. A Federal agency
may not conduct or sponsor a collection of information unless it displays a currently
validofOMB
Page 153
165control number.
OMB No.: 3145-0019 Approval Expires 05/31/2009

INSTRUCTIONS: Thank you for taking the time to complete this questionnaire. Directions are provided for each question.
• If you have not already done so, please PRINT your name on the front cover.
• Please print all responses; you may use either a pen or a pencil.

Part A - EDUCATION
A5. Which of the following were sources of financial
support during graduate school?

A1. What is the title of your dissertation?
mark (X) this box if the title below refers to a
■ Please
performance, project report, or musical or literary composition

Mark (X) Yes or No for each

required instead of a dissertation.

Yes
a Fellowship, scholarship . . . . . . . . . . . . . . . . . . . . . . . . .

Title
_____________________________________________________________________________

b Grant . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
c Teaching assistantship . . . . . . . . . . . . . . . . . . . . . . . . .

_____________________________________________________________________________

d Research assistantship . . . . . . . . . . . . . . . . . . . . . . . . .

__________________________________________________________________________

e Other assistantship . . . . . . . . . . . . . . . . . . . . . . . . . . . .
f Traineeship . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

A2. Please write the name of the primary field of your
dissertation research.

g Internship, clinical residency . . . . . . . . . . . . . . . . . . . . .
h Loans (from any source) . . . . . . . . . . . . . . . . . . . . . . . . .

__________________________________________________________________________

i Personal savings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Name of Field

j Personal earnings during graduate school . . . . . . . . . . . . . . . .
(other than sources listed above)

Using the list on page 6, choose the code that best
describes the primary field of your dissertation
research.

k Spouse’s, partner’s, or family’s earnings or savings . . . .
l Employer reimbursement/assistance . . . . . . . . . . . . . . .

Number of Field

m Foreign (non-U.S.) support . . . . . . . . . . . . . . . . . . . . . . .

If your dissertation research was interdisciplinary,
list the name and number of your secondary field.

n Other - Specify . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

__________________________________________________________________________

No

■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■
■. . . ■

A6. Which TWO sources listed in A5 provided the most support?

Name of Field

Enter letters of primary and secondary sources
Number of Field
If there were more than two fields, please list these additional fields.

1

Primary source of support

2

Secondary source of support

__________________________________________________________________________

■ Mark (X) if no secondary source

Name of Field

A7. When you receive your doctoral degree, how much
money will you owe that is directly related to your
undergraduate and graduate education?

Number of Field
__________________________________________________________________________

Mark (X) one in each column

Name of Field

a UNDERGRADUATE

■ None
2 ■ $10,000 or less
3 ■ $10,001 - $20,000
4 ■ $20,001 - $30,000
5 ■ $30,001 - $40,000
6 ■ $40,001 - $50,000
7 ■ $50,001 - $60,000
8 ■ $60,001 - $70,000
9 ■ $70,001 or more - Specify

Number of Field

1

A3. Please name the department (or interdisciplinary
committee, center, institute, etc.) of the university
that supervised your doctoral studies.
__________________________________________________________________________

Department/Committee/Center/Institute/Program

A4. If you received full or partial tuition remission
(waiver) for your doctoral studies, was it:
Mark (X) one

■ I did not receive any tuition remission
2 ■ for less than 1/3 of tuition
3 ■ between 1/3 and 2/3 of tuition
4 ■ more than 2/3 of tuition, but less than full
5 ■ full tuition remission

1

$

Page 154 of 165

2

b GRADUATE

■ None
2 ■ $10,000 or less
3 ■ $10,001 - $20,000
4 ■ $20,001 - $30,000
5 ■ $30,001 - $40,000
6 ■ $40,001 - $50,000
7 ■ $50,001 - $60,000
8 ■ $60,001 - $70,000
9 ■ $70,001 or more - Specify
1

$

A8. The next few questions ask about the degrees you have received. Please provide the following information for this doctoral
degree, your most recent master’s degree, and your first bachelor’s degree in the appropriate columns below.
This research
doctoral degree

a. Have you received a degree of this type? . . . . . .

X
■
■
Yes

b. Month/ year degree granted . . . . . . . . . . . . . . . .

No

Most recent master’s degree
(e.g. MS, MA, MBA)
or equivalent

First bachelor’s degree
(e.g. BA, BS, AB)
or equivalent

■ ■

■ ■

Yes

Month

No

Month
Year

c. Month / year that you started your degree . . . . . .

Yes

Month
Year

Month

Month
Year

No

Year
Month

Year

Year

d. Primary field of study . . . . . . . . . . . . . . . . . . . . .

e. Field number from list on p. 6. . . . . . . . . . . . . . .
f. Institution name . . . . . . . . . . . . . . . . . . . . . . . . .

g. Branch or city . . . . . . . . . . . . . . . . . . . . . . . . . .
h. State or province. . . . . . . . . . . . . . . . . . . . . . . .

USA

i. Country . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

A9. Excluding those above, have you attained any additional postsecondary degrees?

■ Yes ■ No
If yes, please list the additional degree(s), granting
institution(s), and years.
First Additional Degree
Degree Type
Degree Field
Field Number, p. 6
Month/Year Granted
Institution
Branch or City
State or Country

Second Additional Degree

_________________________________________________________

Degree Type

_________________________________________________________

_________________________________________________________

Degree Field

_________________________________________________________

_________________________________________________________

Field Number, p. 6

_________________________________________________________

_________________________________________________________

Month/Year Granted

_________________________________________________________

_________________________________________________________

Institution

_________________________________________________________

_________________________________________________________

Branch or City

_________________________________________________________

_________________________________________________________

State or Country

_________________________________________________________

If there are more than two degrees, additional degrees
should be reported on the back cover.

6100-71002159-01
Page 155 of 165

3

A10.Was a master’s degree a prerequisite for admission to
your doctoral program?

A13.Was there any time from the year you entered your
doctoral program and the award of your doctorate that
you were not working on your degree (that is, not taking
courses or working on your dissertation)?

■ Yes ■ No
A11.In what month and year did you first enter graduate
school in any program or capacity, in any university?

■ Yes ■ No
If yes, please provide the number of years

Month
Years (round to whole years)
Year

A14. Did you earn college credit from a community or twoyear college?

A12.How many years were you:
a. taking courses or preparing for exams for this doctoral
degree (including a master’s degree, if that was part of
your doctoral program)?

1

■ Yes

2

■ No

A15. Are you earning, or have you earned, an MD
or a DDS?

Years (round to whole years)

b. working on your dissertation after coursework and
exams (non-course related preparation and research,
writing and defense)?

1

■ Yes

2

■ No

Years (round to whole years)

Part B - POSTGRADUATION PLANS
B1. In what country or state do you intend to live after
graduation (within the next year)?

■ in U.S.
2 ■ not in U.S.

1

B4. What best describes your (within the next year)
postgraduate plans?
Mark (X) one

State

“POSTDOC” OR FURTHER TRAINING

■ “Postdoc” fellowship
2 ■ “Postdoc” research associateship
3 ■ Traineeship
4 ■ Internship, clinical residency
5 ■ Other Training - Specify

Country

1

B2. Do you intend to take a “postdoc” position?
(A “postdoc” is a temporary position primarily for gaining additional
education and training in research, usually awarded in academe,
industry, government, or a non-profit organization.)
1

■ Yes

2

■ No

GO
TO
B5

B3. What is the status of your postgraduate plans
(in the next year)?
EMPLOYMENT

Mark (X) one

■ Returning to, or continuing in, predoctoral employment
2 ■ Have signed contract or made definite commitment for
a “postdoc” or other work
1

■ Negotiating with one or more specific organizations
4 ■ Seeking position but have no specific prospects
5 ■ Other full-time degree program (e.g., MD, DDS, JD, MBA, etc.)
6 ■ Do not plan to work or study (e.g., family commitments, etc.)
7 ■ Other - Specify

■ Employment (other than “postdoc” or further training)
7 ■ Military service
8 ■ Other Employment- Specify
6

GO
TO
B4

3

SKIP
TO
C1

Page 156 of 165

4

SKIP
TO
B6

Pl

eas
e

tur
n

thi
s

pag
e

for t
h

e Field

of Study List
The Field of Study listing
on pages 6 and 7 is to
be used in responding to
items A2, A8, and A9.
Please choose the code
that best describes the
name of your field.

Page 157 of 165

858

BUSINESS MANAGEMENT/ADMINISTRATION
900
905
910
915
901
921

Accounting
Banking/Financial Support Services
Business Administration & Management
Business/Managerial Economics
Finance
Human Resources Development

916
920
917
930

International Business/Trade/Commerce
Marketing Management & Research
Management Information Systems/Business Statistics
Operations Research (also in ENGINEERING &
in MATHEMATICS)

935 Organizational Behavior (see also
PSYCHOLOGY/Industrial & Organizational)
938 Business Management/Administration, General
939 Business Management/Administration, Other

COMMUNICATION
940 Communication Research
957 Communication Theory

950 Film, Radio, TV & Digital Communication
947 Mass Communication/Media Studies

958 Communication, General
959 Communication, Other

COMPUTER & INFORMATION SCIENCES
400 Computer Science

410 Information Science & Systems

419 Computer & Information Science, Other

810
807
822
815

845
825
830
835

EDUCATION
RESEARCH & ADMINISTRATION
840 Counseling Education/Counseling & Guidance
800 Curriculum & Instruction
805 Educational Administration & Supervision
820 Educational Assessment/Testing/Measurement
TEACHER EDUCATION
858 Adult & Continuing Teacher Education
852 Elementary Teacher Education
TEACHING FIELDS
860 Agricultural Education
861 Art Education
862 Business Education
864 English Education
870 Family & Consumer/Human Science (also in
Fields Not Elsewhere Classified)
OTHER EDUCATION
898 Education, General

Educational/Instructional Media Design
Educational Leadership
Educational Psychology (also in PSYCHOLOGY)
Educational Statistics/Research Methods

Higher Education/Evaluation & Research
School Psychology (also in PSYCHOLOGY)
Social/Philosophical Foundations of Education
Special Education

850 Pre-elementary/Early Childhood Teacher Education

856 Secondary Teacher Education

866
868
874
876
878
880

882
884
885
888
889

Foreign Languages Education
Health Education
Mathematics Education
Music Education
Nursing Education
Physical Education & Coaching

Reading Education
Science Education
Social Science Education
Trade & Industrial Education
Teacher Education & Professional Development, Other

899 Education, Other

ENGINEERING
300
303
306
309
312
315
318
321
324

Aerospace, Aeronautical & Astronautical Engineering
Agricultural Engineering
Bioengineering & Biomedical Engineering
Ceramic Sciences Engineering
Chemical Engineering
Civil Engineering
Communications Engineering
Computer Engineering
Electrical, Electronics & Communications Engineering

376
327
330
333
336
339
342
345
348
351

Engineering Management & Administration
Engineering Mechanics
Engineering Physics
Engineering Science
Environmental Health Engineering
Industrial & Manufacturing Engineering
Materials Science Engineering
Mechanical Engineering
Metallurgical Engineering
Mining & Mineral Engineering

357 Nuclear Engineering
360 Ocean Engineering
363 Operations Research (also in MATHEMATICS
& in BUSINESS MANAGEMENT)
366 Petroleum Engineering
369 Polymer & Plastics Engineering
372 Systems Engineering
398 Engineering, General
399 Engineering, Other

HUMANITIES
HISTORY
706 African History
700 American History (U.S. & Canada)
703 Asian History
FOREIGN LANGUAGES & LITERATURE
768 Arabic
758 Chinese
740 French
743 German
LETTERS
732 American Literature (U.S. & Canada)
720 Classics
723 Comparative Literature
735 Creative Writing
OTHER HUMANITIES
770 American/U.S. Studies
773 Archaeology
776 Art History/Criticism/Conservation
792 Bible/Biblical Studies
795 Drama/Theater Arts

705 European History
710 History, Science & Technology & Society
707 Latin American History

708 Middle/Near East Studies
718 History, General
719 History, Other

746 Italian
762 Japanese
752 Russian

755 Slavic (other than Russian)
749 Spanish
769 Other Languages & Literature

734 English Language
733 English Literature (British & Commonwealth)
724 Folklore

736 Speech & Rhetorical Studies
738 Letters, General
739 Letters, Other

780
786
787
788
789

Music
Music Theory & Composition
Music Performance
Musicology/Ethnomusicology
Music, Other

785
790
798
799

Fishing & Fisheries Sciences/Management
Food Science
Food Science & Technology, Other
Forest Sciences & Biology
Forest/Resources Management
Forestry & Related Science, Other
Horticulture Science
Natural Resources/Conservation

030 Plant Pathology/Phytopathology (also in
BIOLOGICAL SCIENCES)
039 Plant Sciences, Other
046 Soil Chemistry/Microbiology
049 Soil Sciences, Other
080 Wildlife/Range Management
072 Wood Science & Pulp/Paper Technology
098 Agriculture, General
099 Agricultural Science, Other

Philosophy
Religion/Religious Studies
Humanities, General
Humanities, Other

LIFE SCIENCES
AGRICULTURAL SCIENCES/NATURAL RESOURCES
005 Agricultural Animal Breeding
055
000 Agricultural Economics
043
025 Agricultural & Horticultural Plant Breeding
044
020 Agronomy & Crop Science
066
010 Animal Nutrition
070
014 Animal Science, Poultry (or Avian)
079
019 Animal Science, Other
050
081 Environmental Science
074

Page 158 of 165

868

LIFE SCIENCES (continued)
BIOLOGICAL/BIOMEDICAL SCIENCES
130 Anatomy
110 Bacteriology
100 Biochemistry (see also PHYSICAL SCIENCES/
Chemistry, other)
102 Bioinformatics
103 Biomedical Sciences
133 Biometrics & Biostatistics
105 Biophysics (also in PHYSICS)
107 Biotechnology
129 Botany/Plant Biology
158 Cancer Biology
HEALTH SCIENCES
210 Environmental Health
211 Environmental Toxicology
220 Epidemiology
212 Health Systems/Services Administration
222 Kinesiology/Exercise Science

136
142
139
145
148
137
170
151
157
154
160
163

Cell/Cellular Biology & Histology
Developmental Biology/Embryology
Ecology
Endocrinology
Entomology
Evolutionary Biology
Genetics/Genomics, Human & Animal
Immunology
Microbiology
Molecular Biology
Neurosciences
Nutrition Sciences

166
175
180
185
115
120
125
169
189
198
199

Parasitology
Pathology, Human & Animal
Pharmacology, Human & Animal
Physiology, Human & Animal
Plant Genetics
Plant Pathology/Phytopathology (also in
AGRICULTURAL SCIENCES)
Plant Physiology
Toxicology
Zoology
Biology/Biomedical Sciences, General
Biology/Biomedical Sciences, Other

240
230
215
245

Medicinal/Pharmaceutical Sciences
Nursing Science
Public Health
Rehabilitation/Therapeutic Services

200
250
298
299

Speech-Language Pathology & Audiology
Veterinary Sciences
Health Sciences, General
Health Sciences, Other

450
455
498
499

Statistics (also in SOCIAL SCIENCES)
Topology/Foundations
Mathematics/Statistics, General
Mathematics/Statistics, Other

MATHEMATICS
425
430
420
460
435

Algebra
Analysis & Functional Analysis
Applied Mathematics
Computing Theory & Practice
Geometry/Geometric Analysis

440 Logic
445 Number Theory
465 Operations Research (also in ENGINEERING & in
BUSINESS MANAGEMENT/ADMIN.)

PHYSICAL SCIENCES
ASTRONOMY
500 Astronomy
ATMOSPHERIC SCIENCE & METEOROLOGY
510 Atmospheric Chemistry & Climatology
512 Atmospheric Physics & Dynamics
CHEMISTRY
520 Analytical Chemistry
522 Inorganic Chemistry
526 Organic Chemistry
GEOLOGICAL & EARTH SCIENCES
542 Geochemistry
540 Geology
552 Geomorphology & Glacial Geology
OCEAN/MARINE SCIENCES
585 Hydrology & Water Resources
590 Oceanography, Chemical & Physical
PHYSICS
560 Acoustics
576 Applied Physics
561 Atomic/Molecular/Chemical Physics
565 Biophysics (also in BIOLOGICAL SCIENCES)

505 Astrophysics
514 Meteorology
518 Atmospheric Science/Meteorology, General

519 Atmospheric Science/Meteorology, Other

530 Physical Chemistry
532 Polymer Chemistry
534 Theoretical Chemistry

538 Chemistry, General
539 Chemistry, Other (see also BIOLOGICAL/Biochemistry)

544 Geophysics & Seismology
548 Mineralogy & Petrology
546 Paleontology

550 Stratigraphy & Sedimentation
558 Geological & Earth Sciences, General
559 Geological & Earth Sciences, Other

595 Marine Sciences
599 Ocean/Marine, Other
574
568
569
564

Condensed Matter/Low Temperature Physics
Nuclear Physics
Optics/Photonics
Particle (Elementary) Physics

570
572
578
579

Plasma/Fusion Physics
Polymer Physics
Physics, General
Physics, Other

Experimental Psychology
Family Psychology
Human Development & Family Studies
Industrial & Organizational (see also BUSINESS
MANAGEMENT/Organization Behavior)
624 Personality Psychology

627
633
636
639
648
649

Physiological/Psychobiology Psychology
Psychometrics & Quantitative Psychology
School Psychology (also in EDUCATION)
Social Psychology
Psychology, General
Psychology, Other

667
670
674
676
678
682

686
690
694
695
698
699

Sociology
Statistics (also in MATHEMATICS)
Urban Affairs/Studies
Urban/City, Community & Regional Planning
Social Sciences, General
Social Sciences, Other

PSYCHOLOGY
600
603
606
609
612
618

Clinical Psychology
Cognitive Psychology & Psycholinguistics
Comparative Psychology
Counseling
Developmental & Child Psychology
Educational Psychology (also in EDUCATION)

615
620
613
621

SOCIAL SCIENCES
650
652
657
658
662
668

Anthropology
Area/Ethnic/Cultural/Gender Studies
Criminal Justice & Corrections
Criminology
Demography/Population Studies
Econometrics

Economics
Geography
International Relations/Affairs
Linguistics
Political Science & Government
Public Policy Analysis

FIELDS NOT ELSEWHERE CLASSIFIED (NEC)
960 Architecture/Environmental Design
964 Family/Consumer Science/Human Science
(also in EDUCATION)
968 Law

972
974
976
980

Library Science
Parks/Sports/Rec./Leisure/Fitness
Public Administration
Social Work

Page 159 of 165

878

984 Theology/Religious Education (see also OTHER
HUMANITIES/Religion/Religious Studies)
989 Other Fields, NEC

Page 160 of 165

8

B5. What will be the main source of financial support for
your “postdoc” or further training within the next year?

B7. Please name the organization and geographic
location where you will work or study.

Mark (X) one

Name . . . . . . . . . . . .

■ U.S. government
■ Industry/business
3 ■ College or university
4 ■ Private foundation
5 ■ Nonprofit, other than private foundation or college
6 ■ Foreign government
7 ■ Other - Specify
1

State (if U.S.) . . . . . .

2

Country (if not U.S.) .

B8. What will be your basic annual salary for this principal
job (in the next year)? Do not include bonuses or
additional compensation for summertime teaching or
research. If you are not salaried, please estimate your
earned income.

$

__________________________________

8

■ Unknown

If you prefer not to report an exact amount, please
indicate into which range you expect your salary to fall:

B6. What type of principal employer will you be working
for (or training with) in the next year?

Mark (X) one

Mark (X) one

■ $30,000 or less
2 ■ $30,001 - $35,000
3 ■ $35,001 - $40,000
4 ■ $40,001 - $50,000
5 ■ $50,001 - $60,000
6 ■ $60,001 - $70,000
1

EDUCATION

■ U.S. 4-year college or university other than medical school
2 ■ U.S. medical school (including university-affiliated hospital or medical center)
3 ■ U.S. university-affiliated research institute
4 ■ U.S. community or two-year college
5 ■ U.S. preschool, elementary, middle, secondary school or school system
6 ■ Foreign educational institution
1

■ $70,001 - $80,000
8 ■ $80,001 - $90,000
9 ■ $90,001 - $100,000
10 ■ $100,001 - $110,000
11 ■ $110,001 or above
12 ■ Don’t know
7

B9. How many months does this salary cover?
Number of Months

GOVERNMENT (other than education institution)

■ Foreign government
8 ■ U.S. federal government
9 ■ U.S. state government
10 ■ U.S. local government

B10. What will be your primary and secondary work activities?

7

Mark (X) one in each column
a PRIMARY b SECONDARY

■.....1 ■
Teaching . . . . . . . . . . . . . . . . . . . . . . . . . 2 ■ . . . . . 2 ■
Management or administration . . . . . . . . 3 ■ . . . . . 3 ■
Professional services to individuals . . . . . 4 ■ . . . . . 4 ■
Other - Specify . . . . . . . . . . . . . . . . . . . . 5 ■ . . . . . 5 ■
Research and development . . . . . . . . . . . 1

PRIVATE SECTOR (other than education institution)

■ Not for profit organization
12 ■ Industry or business (for profit)
11

OTHER

■ Self-employed
14 ■ Other - Specify
13

■ Mark (X) if no secondary work activities

6100-71002159-01
Page 161 of 165

9

Part C - BACKGROUND INFORMATION
C5. What is your place of birth?

C1. Are you 1

■ Male

2

■ Female

State (if U.S.) . . . . . .
OR
Country (if not U.S.) .

C2. What is your marital status?
Mark (X) one

C6. What is your date of birth?

■ Married
2 ■ Living in a marriage-like relationship
3 ■ Widowed
4 ■ Separated
5 ■ Divorced
6 ■ Never married

1

Month

Day

Year

1 9

C7. What is your citizenship status?
Mark (X) one
U.S. CITIZEN

■ Since birth
2 ■ Naturalized
1

C3. Not including yourself or your spouse/partner, how many
dependents (children or adults) do you have - that is, how
many others receive at least one half of their financial
support from you?

NON-U.S. CITIZEN

■ With a Permanent U.S. Resident Visa (“Green Card”)
4 ■ With a Temporary U.S. Visa
3

Write in number of dependents

C8. (If a non-U.S. citizen)
Of which country are you a citizen?

5 years of age or younger . .
6 to 18 years . . . . . . . . . . .

__________________________________________________________________________

Specify country of present citizenship

19 years or older . . . . . . . .

C9. In what state or country was the high school/secondary
school that you last attended?

■ Mark (X) if none

State (if U.S.) . . . . . .
OR
Country (if not U.S.) .

C4. What is the highest educational attainment of your
mother and father?
Mark (X) one for each parent
a MOTHER

SKIP
TO
C9

b FATHER

■.....1 ■
High/secondary school graduate . . . . . . . 2 ■ . . . . . 2 ■
Some college . . . . . . . . . . . . . . . . . . . . . . 3 ■ . . . . . 3 ■
Bachelor’s degree . . . . . . . . . . . . . . . . . . . 4 ■ . . . . . 4 ■
Master’s degree . . . . . . . . . . . . . . . . . . . . 5 ■ . . . . . 5 ■
(e.g., MA, MS, MBA, MSW, etc.)
Professional degree . . . . . . . . . . . . . . . . . 6 ■ . . . . . 6 ■
(e.g., MD, DDS, JD, D.Min, Psy.D., etc.)
Research doctoral degree . . . . . . . . . . . . . 7 ■ . . . . . 7 ■
Not applicable/Unknown . . . . . . . . . . . . . . 8 ■ . . . . . 8 ■
Less than high/secondary school graduate . . 1

Page 162 of 165

10

GO
TO
C8

C10. Are you a person with a disability?

■ Yes
2 ■ No

1

C15. Please fill in the last four digits of your
Social Security Number.

GO TO C11

X X X - X X SKIP TO C12

C16. In case we need to clarify some of the information
you have provided, please list an e-mail address and
telephone number where you can be reached.

C11. Which of the following categories describes your
disability(ies)?
Mark (X) one or more

■ Blind/Visually Impaired
b ■ Deaf/Hard of Hearing
c ■ Physical/Orthopedic Disability
d ■ Learning/Cognitive Disability
e ■ Vocal/Speech Disability
f ■ Other - Specify

__________________________________________________________________________

a

E-mail Address
__________________________________________________________________________

Daytime or Cell Telephone

C17. Please provide your address and the name and
address of a person who is likely to know where you
can be reached.
YOUR CURRENT ADDRESS:
__________________________________________________________________________

C12. Are you Hispanic or Latino?

■ Yes
2 ■ No
1

Street Address

GO TO C13

__________________________________________________________________________

City/State/Country/Zip or Postal Code

SKIP TO C14

CURRENT ADDRESS OF A PERSON WHO IS LIKELY TO KNOW WHERE
YOU CAN BE REACHED:

C13. Which of the following best describes your Hispanic
origin or descent?
Mark (X) one

__________________________________________________________________________

Name

■ Mexican or Chicano
2 ■ Puerto Rican
3 ■ Cuban
4 ■ Other Hispanic - Specify
1

__________________________________________________________________________

Street Address
__________________________________________________________________________

City/State/Country/Zip or Postal Code

C14. What is your racial background?
Mark (X) one or more
a

■ American Indian or Alaska Native

b

The results of this survey will be published in a
Summary Report. For information on the publications
available from this survey, please go to:

c

http://www.nsf.gov/statistics/doctorates.

Specify tribal affiliation(s)

■ Native Hawaiian or other Pacific Islander
■ Asian
d ■ Black or African-American
e ■ White

Please use the space on page 12 to make any additional
comments you may have about this survey.
Thank you for completing the questionnaire. Please
return this questionnaire to your GRADUATE
SCHOOL for forwarding to Survey of Earned
Doctorates, NORC at the University of Chicago,
1 N. State Street, Floor 16, Chicago, IL 60602.
If you have questions or concerns about the survey,
you may contact us by e-mail at:
[email protected]

6100-71002159-01

or phone at: 1-800-248-8649.
Page 163 of 165

11

ADDITIONS TO QUESTIONS
A9. (continued from page 3)

To the Doctorate Recipient:
Congratulations on earning a doctoral degree!

Third Additional Degree

This is an important accomplishment for you. Your
accomplishment is also significant for both this
nation and others, as the new knowledge generated
by research doctorates enhances the quality of life in
this country and throughout the world. Because of
the importance of persons earning research doctorates, several Federal agencies–listed on the cover–
sponsor this Survey of Earned Doctorates.
The basic purpose of this survey is to gather objective
data about doctoral graduates. These data are
important in improving graduate education both at
your home institution and beyond. Often, decisions
made by governmental and private agencies to
develop new programs, or to support present ones,
are based in part on the data developed from this
survey. If you have any comments about the survey,
please provide them in the space below.

Degree Type

_________________________________________________________

Degree Field

_________________________________________________________

Field Number, p. 6

_________________________________________________________

Month/Year Granted

_________________________________________________________

Institution

_________________________________________________________

Branch or City

_________________________________________________________

State or Country

_________________________________________________________

Fourth Additional Degree
Degree Type

_________________________________________________________

Degree Field

_________________________________________________________

Field Number, p. 6

_________________________________________________________

Month/Year Granted

_________________________________________________________

Institution

_________________________________________________________

Branch or City

_________________________________________________________

State or Country

_________________________________________________________

On behalf of the sponsoring Federal agencies, I thank
you for your participation in this survey.
Best wishes,
Dr. Lynda T. Carlson
National Science Foundation
Comments about the survey:

_______________________________________________________________________________________________________________________________________________________________________________
_______________________________________________________________________________________________________________________________________________________________________________
_______________________________________________________________________________________________________________________________________________________________________________
_______________________________________________________________________________________________________________________________________________________________________________
_______________________________________________________________________________________________________________________________________________________________________________
_______________________________________________________________________________________________________________________________________________________________________________
_______________________________________________________________________________________________________________________________________________________________________________
_______________________________________________________________________________________________________________________________________________________________________________

OFFICE USE ONLY
Case ID:

Instit. Code:

Grad Date:

PROCESSING
Editing

Receipt
Initials

Date

Initials

Ver. Adjust
Initials

Main Disp.:

CADE
Date

Initials

Retrieval
Date

Initials

Updates
Date

Page 164 of 165

12

Date

Initials

Date

SURVEY OF EARNED DOCTORATES (SED)
Cognitive Interview Participant Background Sheet
1. Contact Information
Name:
Address:
City, State, Zip:
Day phone:
Evening phone:
Email address:
2. When is the best day of the week and time of day to reach you by telephone?
3. What is your date of birth?
4. What is your doctoral field of study?
5. From what university did you receive your doctoral degree?
6. Are you:

Male

Female

7. Month and year you began your doctoral program:
Month and year did you graduate:
8. Is English your first language?

Yes

No

9. Are you currently a U.S. Citizen?

Yes

No

10. In what country or state to you intend to live after graduation (within the next year)?
In U.S.
 State:
Not in U.S.  Country:

11. What is the status of your postgraduate plans (in the next year)? (Mark
one)
Returning to, or continuing in, pre-doctoral employment
Have signed contract or made definite commitment for other work or study
Negotiating with one or more specific organizations
Seeking position but have no specific prospects
Do not plan to work or study
Other – specify:
12. Have you completed a copy of the SED questionnaire?

Yes

No

13. Are you available on October 1 – October 15,2008 Monday through Friday, either during the day or
evening? (Please fill in possible times)

If you have questions, please contact Mireya, 1-800-248-8649

Page 165 of 165