Youth Survey

APPENDIX B

• WEB WELCOME

• QUESTIONNAIRE

• FREQUENTLY ASKED QUESTIONS

WEB WELCOME

ORI FACULTY SURVEY WEB WELCOME SCREEN

Welcome to the Training PhD’s Faculty Survey -

A research site maintained by Mathematica Policy Research, Inc.

MPR link

Your participation is voluntary but important. Your answers will be kept confidential, and any results will be reported only in aggregate form.

If you have general questions about the study, please click on the FAQ for more information. If you experience technical problems, please call 1-xxx-xxx-xxxx or email [email protected].

You may stop and restart this survey at any time. All answers up to the point where you leave off will be saved automatically. For your protection, your session will time out after 10 minutes of inactivity, and you will need to log in again to continue.

Click the “Next” button below to continue. By clicking the “Next” button, you are agreeing to participate in this study.

Next

QUESTIONNAIRE

ORI Faculty Survey Web Questionnaire

Web Version 1

October 2, 2007

ELIGIBILITY SCREENER

1. Do you currently have primary responsibility for overseeing at least one doctoral student’s research leading to his or her doctorate?

 Only include PhD students or MD/PhD students.

1  Yes GO TO A1

0  No

2. In the last five years, did you have primary responsibility for overseeing at least one doctoral student’s research leading to his or her doctorate?

 Only include PhD students or MD/PhD students.

1  Yes GO TO A1

0  No

[If NO to BOTH questions, GO TO BOX below, then End.]

BOX. In the last 5 years, about how many doctoral students did you work with informally?

• By “informally,” we mean that you did not have official responsibilities in overseeing students’ work but you gave them advice, support, or guidance.

| | | NUMBER OF DOCTORAL STUDENTS

End. Thank you for your interest in participating in this research. At this time, we are only surveying faculty who have doctoral student training responsibilities

A. FACULTY ROLES

A1. Institutions vary in what they call faculty members who work most closely with a student on his or her dissertation research. Does your institution refer to these faculty members as…

[PROGRAMMER: ROTATE ITEMS a, b, c]	CHECk Yes or No for Each Item
	Yes	No
a. Mentors?	1 	0 
b. Advisors?	1 	0 
c. Supervisors?	1 	0 
d. Other? (Please specify)	1 	0 

A2. [FILL: “Do” if Screener 1=Yes; FILL: “Did” if Screener 2=Yes] your doctoral students refer to you as their…

[PROGRAMMER: ROTATE ITEMS a, b, c]	CHECk Yes or No for Each Item
	Yes	No
a. Mentors?	1 	0 
b. Advisors?	1 	0 
c. Supervisors?	1 	0 
d. Other? (Please specify)	1 	0 

A3. What do you prefer to be called?

CHECK ONLY ONE ANSWER

1  Advisor

2  Mentor

3  Supervisor

4  Other (Please specify)

A4. In your view, what are the three most important responsibilities of a(n) [FILL: A3 RESPONSE]?

1.

2.

3.

The next set of items are about mentor and advisor roles.

A5. Some people think that the terms ‘advisor’ and ‘mentor’ are synonymous and describe the same type of relationship a faculty member would have with doctoral students. Others view the terms as describing two distinct types of faculty and doctoral student relationships.

For the following list of activities, please indicate whether you think it is an activity that only an advisor would engage in, an activity that only a mentor would engage in, whether both would engage in it, or whether neither would engage in it.

	CHECK ONLY ONE ANSWER FOR EACH ITEM
	Advisor Only	Mentor Only	Both	Neither
a. Provide financial support	1 	2 	3 	4 
b. Chair student’s dissertation committee	1 	2 	3 	4 
c. Help students choose classes	1 	2 	3 	4 
d. Help students choose topics of research	1 	2 	3 	4 
e. Measure progress and accomplishments through feedback (written or verbal)	1 	2 	3 	4 
f. Train students in good research practices	1 	2 	3 	4 
g. Train students in identifying and handling research misconduct	1 	2 	3 	4 
h. Set standards for data collection	1 	2 	3 	4 
i. Prepare contract or grant proposals	1 	2 	3 	4 
j. Co-author papers and presentations with students	1 	2 	3 	4 
k. Sponsor students for desirable positions such as assistantships, practica, or internships	1 	2 	3 	4 
l. Help students gain greater exposure and visibility in the field	1 	2 	3 	4 
m. Provide networking opportunities	1 	2 	3 	4 
n. Provide career counseling	1 	2 	3 	4 
o. Provide professional socialization (e.g., passing on values and norms of the profession)	1 	2 	3 	4 
p. Teach life skills or social skills	1 	2 	3 	4 
q. Serve as a role model	1 	2 	3 	4 
r. Serve as a friend	1 	2 	3 	4 
s. Provide moral support	1 	2 	3 	4 

B. YOUR DOCTORAL STUDENTS

The next several questions are about your activities with doctoral students.

B1. In the last 5 years, for how many doctoral students have you had primary responsibility?

• By “primary responsibility,” we mean that you had official responsibilities in overseeing students’ research leading to their doctorates.

• Only include PhD or MD/PhD students.

| | | NUMBER OF DOCTORAL STUDENTS

B2. For how many of these [FILL: B1 NUMBER] students do you currently have primary responsibility?

• Only include PhD or MD/PhD students.

| | | NUMBER OF DOCTORAL STUDENTS

B3. As the person who [FILL: “has” if B2 > 0; “had” if B2=0] primary responsibility to oversee doctoral student research, what [FILL: “is” if B2 > 0; “was” if B2=0] your title?

CHECK ONLY ONE ANSWER

1  Do not have a title for this responsibility

2  Advisor

3  Mentor

4  Some other title (Please specify)

B4. For how many of these [FILL: B1 NUMBER] students did you consider yourself…

Number

of Students

a. an advisor only? | | |

b. a mentor only? | | |

c. both an advisor and a mentor? | | |

d. neither an advisor nor a mentor? | | |

B5. In the last 5 years, how many of these [FILL: B1 NUMBER] doctoral students earned PhD’s or MD/PhD’s?

• Do not include current students who have not yet completed their degrees.

• Do not include students who left the program without completing their degrees.

| | | NUMBER OF DOCTORAL STUDENTS

B6. In the last 5 years, not including these [FILL: B1 NUMBER] students, about how many doctoral students did you work with informally?

• By “informally,” we mean that you did not have official responsibilities in overseeing students’ work, but you gave them advice, support, or guidance.

| | | NUMBER OF DOCTORAL STUDENTS

IF B5 = 0, SKIP TO D1

B7. Please indicate if you did each of the following activities with all, some, or none of the [FILL:  B5 NUMBER] students who received their doctorates in the last 5 years.

	CHECK ONLY ONE ANSWER FOR EACH ITEM
	DID FOR ALL	DID FOR SOME	DID FOR NONE
a. Helped secure funding for doctoral studies?	1 	2 	3 
b. Discussed good research practices?	1 	2 	3 
c. Reviewed with student the rules of working in a lab?	1 	2 	3 
d. Prepared with student human or animal subjects protections protocols (IRB or IACUC)?	1 	2 	3 
e. Discussed methods of data management such as data recording, custody, and ownership?	1 	2 	3 
f. Provided student with written data management rules?	1 	2 	3 
g. Discussed research misconduct policies?	1 	2 	3 
h. Interpreted student’s original data with student?	1 	2 	3 
i. Reviewed research data with student for publication?	1 	2 	3 
j. Taught student how to write grant or contract proposals?	1 	2 	3 
k. Co-authored publication with student where the student was named as the first author?	1 	2 	3 
l. Co-authored publication with student where the student was not named as the first author?	1 	2 	3 
m. Assisted with preparing presentations?	1 	2 	3 
n. Took student to a meeting or conference?	1 	2 	3 
o. Helped student to develop professional relationships with others in the field?	1 	2 	3 
p. Discussed student’s professional goals with student?	1 	2 	3 
q. Gave your personal email address or home telephone number?	1 	2 	3 

C. STUDENT OUTCOMES

The next questions are about your doctoral students.

C1. You indicated that in the last 5 years, [FILL: B5 NUMBER] students received their doctorates. How many of these students completed their degrees in…

a. less than 4 years? | |

b. in 4 years? | |

c. in 5 years? | |

d. in 6 years? | |

e. in 7-9 years? | |

f. in 10 or more years? | |

C2. Prior to completing the doctoral program, how many of these [FILL: B5 NUMBER] students were listed as an author on at least one publication (article in peer-reviewed journal, book, book chapter, etc.)?

• Do not count any students with publications that were “in progress”—that is, under review, being revised or edited, or accepted for publication but not yet published.

• Do not count any students with presentations, informal papers (not peer-reviewed), or theses or dissertations, unless they were also published.

| | | NUMBER OF STUDENTS

C3. After they received their doctorates, how many of your [FILL: B5 NUMBER] students…

	NUMBER OF STUDENTS
ACADEMIC INSTITUTION
a. stayed on at your institution in a position (such as an academic position, a non‑academic position or postdoc)?	| |
b. went to another institution to take a position (such as an academic position, a non‑academic position or postdoc)?	| |
PRIVATE SECTOR
c. went to work in the private sector?	| |
d. went to work in private practice or to work for themselves?	| |
GOVERNMENT
e. went to work for the government (local, state, or federal)?	| |
UNEMPLOYED
f. were unemployed and seeking employment?	| |
g. were unemployed and not seeking employment?	| |
OTHER
h. pursued additional education other than post-doc?	| |
i. did something else? (Please specify)	| |
j. Do not know what happened to them	| |

D. INSTITUTIONS, DEPARTMENTS, AND PROGRAMS

D1. In your doctoral program, which of the following best describes how doctoral students are paired with advisors?

CHECK ONLY ONE ANSWER

1  Students select faculty members to be their advisors

2  Faculty members select which students they will work with

3  Faculty members and students jointly decide to pair up

4  The program or department pairs students with faculty members based

on some criteria (e.g., availability, funds, interests, etc.)

5  Other (Please specify)

D2. Institutions vary in who takes primary responsibility for different activities.

For each activity below, please indicate whether it is the institution’s, the faculty member’s, or some other entity’s primary responsibility.

Example: If the institution mandates that all doctoral students must complete a training in how to conduct research responsibly, but it is up to each faculty member to conduct this training, you would mark, “Primarily Institution’s Responsibility.” If, on the other hand, it is each faculty member’s decision to train their own students in this skill, you would mark “Primarily Faculty Member’s Responsibility.”

	CHECK ONLY ONE ANSWER FOR EACH ITEM
Whose primary responsibility is it to…	Primarily Institution’s Responsibility	Primarily Faculty Member’s Responsibility	Primarily Other Entity’s Responsibility	What other entity was this?
a. Provide financial support?	1 	2 	3 	________________ ________________ ________________
b. Provide training in responsible conduct of research (RCR)?	1 	2 	3 	________________ ________________ ________________
c. Provide training in identifying research misconduct?	1 	2 	3 	________________ ________________ ________________
d. Provide policy on authorship?	1 	2 	3 	________________ ________________ ________________
e. Set standards for data collection?	1 	2 	3 	________________ ________________ ________________
f. Provide training in data management?	1 	2 	3 	________________ ________________ ________________
g. Provide training in understanding IRB or IACUC regulations or completing IRB or IACUC packages?	1 	2 	3 	________________ ________________ ________________
h. Manage cases of misconduct such as data falsification?	1 	2 	3 	________________ ________________ ________________
i. Monitor doctoral student progress (such as whether taking the right number of credits, taking qualifying exams on time, completing paperwork for the dissertation)?	1 	2 	3 	________________ ________________ ________________

D3. To the best of your knowledge, is there a formal, written policy or guideline describing a faculty member’s responsibilities in working with doctoral students provided by…

	CHECk Yes or No for Each Item
	Yes	No	Don’t Know
a. the graduate program?	1 	0 	d 
b. your institution?	1 	0 	d 
c. other? (Please specify)	1 	0 	d 

IF D3a AND D3b AND D3c = No OR Don’t Know, SKIP TO D6

D4. Have you read all or part of [FILL: “your institution” if D3b=Yes; “the graduate program” if D3a=Yes AND D3b=No or DK; “D3c other specify” if D3c=Yes AND (D3a and D3b=No or DK)] policy or guideline?

1  Yes

0  No SKIP TO D6

D5. How useful to you was this policy or guideline?

CHECK ONLY ONE ANSWER

1  Very useful

2  Somewhat useful

3  Not very useful

4  Not at all useful

D6. How useful would it be to you to have this kind of policy or guideline?

1  Very useful

2  Somewhat useful

3  Not very useful

4  Not at all useful

D7. What are the one or two main reasons why this policy or guideline (is/would be) useful?

IF D3a AND D3b AND D3c=NO OR DON’T KNOW, SKIP TO D10, ELSE SKIP TO D9

D8. What are the one or two main reasons why this policy or guideline (is not/would not be) useful?

IF D3a AND D3b AND D3c=NO OR DON’T KNOW, SKIP TO D10, ELSE CONTINUE TO D9

D9. Still thinking about these policies or guidelines on a faculty member’s responsibility in working with doctoral students, have any of the following ever taken place at this institution?

	CHECk ONLY ONE ANSWER FOR EACH ITEM
	Yes	No
a. You talked to the department chair or another senior department faculty member about these policies or guidelines?	1 	0 
b. You talked with your doctoral students about these policies or guidelines?	1 	0 
c. Your doctoral students asked you about the policies or guidelines?	1 	0 
d. You gave a talk, workshop or brown bag on these policies or guidelines either for your department, the graduate program, or for the university at large?	1 	0 

D10. Does the graduate program offer faculty training sessions in…

	CHECk ONLY ONE ANSWER FOR EACH ITEM
	Yes	No	Don’t Know
a. advising doctoral students?	1 	0 	d 
b. mentoring doctoral students?	1 	0 	d 
c. developing students’ research skills?	1 	0 	d 
d. The Responsible Conduct of Research (RCR)?	1 	0 	d 
e. Human or animal subjects protection?	1 	0 	d 
f. “Train the Trainer” program on better mentoring?	1 	0 	d 

D11. Are faculty required to attend the training in…

[PROGRAMMER: Display only “Yes” items from D10]

	Yes	No	Don’t Know
a. advising doctoral students?	1 	0 	d 
b. mentoring doctoral students?	1 	0 	d 
c. developing students’ research skills?	1 	0 	d 
d. The Responsible Conduct of Research (RCR)?	1 	0 	d 
e. Human or animal subjects protection?	1 	0 	d 
f. “Train the Trainer” program on better mentoring?	1 	0 	d 

D12. Have you attended the training in…

[PROGRAMMER: Display only “Yes” items from D10]

	Yes	No	Don’t Know
a. advising doctoral students?	1 	0 	d 
b. mentoring doctoral students?	1 	0 	d 
c. developing students’ research skills?	1 	0 	d 
d. The Responsible Conduct of Research (RCR)?	1 	0 	d 
e. Human or animal subjects protection?	1 	0 	d 
f. “Train the Trainer” program on better mentoring?	1 	0 	d 

D13. Have you ever taught a training in…

	CHECk Yes or No for Each Item
	Yes	No
a. advising doctoral students?	1 	0 
b. mentoring doctoral students?	1 	0 
c. developing students’ research skills?	1 	0 
d. The Responsible Conduct of Research (RCR)?	1 	0 
e. Human or animal subjects protection?	1 	0 
f. “Train the Trainer” program on better mentoring?	1 	0 

D14. To what extent does your department reward faculty members for their work with doctoral students? Would you say…

CHECK ONLY ONE ANSWER

1  A great deal

2  Some

3  Not much

4  Not at all

D15. Please give one or two examples [FILL: “of these rewards” if D14=A great deal or Some; FILL: “of rewards the department could give” if D14=Not much or Not at All].

D16. To what extent does your institution reward faculty members for their work with doctoral students? Would you say…

CHECK ONLY ONE ANSWER

1  A great deal

2  Some

3  Not much

4  Not at all

D17. Please give one or two examples [FILL: “of these rewards” if D16=A great deal or Some; FILL: “of rewards the institution could give” if D16=Not much or Not at All].

E. PROFESSIONAL ACTIVITY

• This section is about your professional and research background.

E1. In the last 5 years, how many . . .

1 Presentations have you given at regional, national or international conferences? Do not count presentations of the same work more than once.

| | | NUMBER OF PRESENTATIONS

2 Articles, authored by you, have been accepted for publication in a refereed professional journal?

| | | NUMBER OF ARTICLES

3 Books or book chapters, authored by you, have been published or accepted for publication?

| | | NUMBER OF BOOKS OR

BOOK CHAPTERS

E2. Is any of your work currently supported by an extramural grant or contract?

1  Yes

0  No SKIP TO E7

E3. How many extramural grants or contracts currently fund your work?

| | NUMBER OF GRANTS OR CONTRACTS

E4. How many of these grants or contracts are from…

| | National Institutes of Health

| | National Science Foundation

| | Other government agencies

| | Non-profit foundations

| | For-profit companies

| | Other sources (Please specify)

E5. What is your approximate current amount of annual grant or contract funding from all sources?

Note: Your best estimate is fine.

$ | | |,| | | |,| | | |.00

E6. Currently, how many of your doctoral students are supported in any way by your extramural grants or contracts?

| | | NUMBER OF SUPPORTED

DOCTORAL STUDENTS

If None, enter zero.

E7. Are you the principal investigator of a research group?

Note A ‘research group’ can be a team that

shares a laboratory.

1  Yes

0  No SKIP TO F1

E8. How many doctoral students do you currently supervise in your research group?

| | | NUMBER OF DOCTORAL

STUDENTS

F. FACULTY RESPONSIBILITIES

F1. In total, about how many hours do you spend in a typical 7-day week engaged in activities related to your position at this institution?

| | | TOTAL NUMBER OF HOURS PER WEEK

F2. About what percentage of these total hours do you typically spend on each of the following activities?

____% a. Teaching undergraduate courses

(Include in-class time, class preparation, grading, laboratory time)

____% b. Teaching graduate courses

(Include in-class time, class preparation, grading, laboratory time)

____% c. Working with your doctoral students on their research

____% d. Your own research

____% e. Preparing grant applications or proposals

____% f. Overseeing a lab

____% g. Clinical practice

____% h. Departmental or institutional administrative activities or service

____% i. Other (Please specify)

100 % Total

[PROGRAMMER: All of the activities at this institution need to total to 100 percent]

F3. You indicated that you typically spend the following percentage of time on each of these activities. On a scale of 1 to 5 where 1 is “Very Unsatisfied” and 5 is “Very Satisfied,” please indicate how satisfied you are with the percentage of time you spend on each activity and then, what percentage of your time you would ideally like to spend on each activity.

[PROGRAMMER: FILL percentages from question F2 in this column]

	a.	b.					c.
	Percentage of Time You Indicated	Current Level of Satisfaction with Percentage of Time You Spend on Activity					Percentage of Time You Would Ideally Spend
		Very Unsatisfied		Neither Satisfied nor Unsatisfied		Very Satisfied
		1	2	3	4	5
a. Teaching undergraduate courses (Include in-class time, class preparation, grading, laboratory time)	______%	1 	2 	3 	4 	5 	______%
b. Teaching graduate courses (Include in-class time, class preparation, grading, laboratory time)	______%	1 	2 	3 	4 	5 	______%
c. Working with your doctoral students on their research	______%	1 	2 	3 	4 	5 	______%
d. Your own research	______%	1 	2 	3 	4 	5 	______%
e. Preparing grant applications or proposals	______%	1 	2 	3 	4 	5 	______%
f. Overseeing a lab	______%	1 	2 	3 	4 	5 	______%
g. Clinical practice	______%	1 	2 	3 	4 	5 	______%
h. Departmental or institutional administrative activities or service	______%	1 	2 	3 	4 	5 	______%
i. Other (Please specify)	______%	1 	2 	3 	4 	5 	______%

[PROGRAMMER: If F3c_c > F3a_c, then ask F4, else SKIP TO G1]

F4. You indicated that you would ideally like to spend more time working with your doctoral students on their research. What are the one or two main reasons why you do not spend more time working with doctoral students now?

G. BACKGROUND INFORMATION

The final questions ask for some demographic information. Your personal information will not be shared with others and will only be used to analyze results.

G1. What is your faculty rank?

CHECK ONLY ONE ANSWER

1  Full professor

2  Associate professor

3  Assistant professor

4  Adjunct faculty

5  Instructor or lecturer

6  Other (Please specify)

G2. Are you currently serving in an administrative position as:

	CHECk Yes or No for Each Item
	Yes	No
a. Department chair?	1 	0 
b. Dean?	1 	0 
c. Other? (Please specify)	1 	0 

G3. What is your tenure status at [FILL UNIVERSITY]?

CHECK ONLY ONE ANSWER

1  Tenured

2  On tenure track, but not tenured

3  Not on tenure track, but institution has tenure system

4  Institution has no tenure system

G4. In what year did you become a faculty member at this institution?

| | | | | YEAR

G5. Which of the following degrees do you have?

	CHECk Yes or No for Each Item
	Yes	No
a. Bachelor’s degree (BA, BS, AB, etc.)	1 	0 
b. Master’s degree (MA, MS, etc.)	1 	0 
c. Doctoral degree (PhD, EdD, etc.)	1 	0 
d. Professional degree (MD, JD, DDS, etc.)	1 	0 
e. Other? (Please specify)	1 	0 

G6. In what year did you receive your most recent degree?

| | | | | YEAR

G7. In what country were you born?

1  USA SKIP TO G9

2  Other (Please specify)

G8. In what year did you come to the United States?

| | | | | YEAR

G9. Are you of Hispanic or Latino origin or descent?

1  Yes, Hispanic or Latino

0  No, not Hispanic or Latino

G10. What is your race?

CHECK ALL THAT APPLY

1  White

2  Black or African American

3  Asian

4  Native Hawaiian or other Pacific Islander

5  American Indian or Alaska Native

6  Other (Please specify)

G11. What is the year of your birth?

19 | | |

YEAR

G12. Are you…

1  Male

2  Female

G13. Someone from the study team may contact you in the future as a follow-up to this survey. Are you willing to be contacted?

1  Yes

0  No

END. Thank you for participating in this survey.

FREQUENTLY ASKED QUESTIONS

	Training Ph.D.s: Faculty Views on their Role and their Institution’s Role to Promote the Development of Responsible Researchers
What is the purpose of this study?	The Office of Research Integrity (ORI) is interested in learning more about faculty and their institution’s roles in the successful development of Ph.D. and M.D./Ph.D. students. Doctoral students’ perceptions about their graduate experiences have been reported, and similar information is needed from the faculty perspective.
Who is conducting the study?	ORI has contracted with Mathematica Policy Research, Inc. (MPR), a nationally recognized policy research organization, to conduct this study. For more than 35 years, Mathematica has provided research-based information to improve policy and programs in education, health, and employment. For more information about Mathematica, visit our website at www.mathematica-mpr.com.
Who is eligible to participate in this study?	All National Institutes of Health (NIH) 2005 and 2006 grant recipients who have had primary responsibility for overseeing a Ph.D. or M.D./Ph.D. student in the last five years.
How was I selected?	Lists of 2005-2006 NIH grant recipients were used to select the sample. A total of 10,000 grant recipients were randomly selected from these lists.
What will I be asked to do?	You will be asked to complete a self-administered, web-based questionnaire. The questionnaire will cover topics related to your doctoral student responsibilities and activities. There will also be questions about the participation of your department and academic institution in the research experiences of doctoral students.
How long will it take?	The self-administered web-based questionnaire will take about 20 minutes to complete.
What are the risks associated with participation?	There are no risks associated with participation in this research. You will be assigned a unique user ID and password. Rigorous MPR confidentiality and security information technology guidelines will be in place to protect the security of the information transmitted over the web. Data will be stored on a secure web server within company firewalls.
What are the benefits to participating?	ORI will have information about faculty, departmental, and institutional roles in the research training of Ph.D. and M.D./Ph.D. students. The knowledge gained from a better understanding of current practices and policies will inform a discussion of best practices, such as guidelines for faculty activities and responsibilities in the development of responsible researchers. Faculty members, and the interested public, will also learn more about these practices and policies when the results are published in peer-reviewed journals.
Will the information be confidential?	All data will be kept strictly confidential. Individual names will not be reported, all results will be presented in aggregate form.
What if I have questions?	Please contact Janice Ballou at Mathematica Policy Research, Inc. toll-free at 1-xxx-xxx-xxxx or via email at [email protected].

Thank you for helping us with this study.