NCSES - User Interview and Survey for Developing a Digital Science and Engineering Indicators

Science and Engineering Indicators (SEI)

Community Survey Instrument

Thank you for agreeing to participate in this survey on the Science and Engineering Indicators (SEI) report. The purpose of this survey is to understand your experience with and perception of the biennial Science and Engineering Indicators report issued by the National Science Board (NSB). The report is produced by the National Center for Science and Engineering Statistics (NCSES) of the National Science Foundation under the guidance of the NSB.

NCSES is exploring options for transitioning the Indicators report from a print publication with a secondary digital version to a primarily digital publication. Your input will help NCSES and the NSB make design decisions about the report. We are trying to learn more about how you use (or may use in the future) the Indicators report, your experience as an user (or potential user) of the report, and how it could be made better. Please keep in mind that this study is focused on the SEI report, and not on other NCSES datasets or publications (except as they are integrated into the Indicators report). No personal information will be associated with your responses to this survey, and all responses will be held confidential by NCSES and its contractor on this project, SRI International.

This survey is anticipated to take approximately 10 minutes to complete.

Science and Engineering Indicators Users Survey

Background – User Profile

Which of these user communities do you belong to? Please select all that apply
	Federal government agency
	Congressional staffers
	State government agency
	Academic or research professional staff
	Graduate student
	Nonprofit organization
	Professional association
	Science policy community
	Industry / business
	Science journalist
	NSF staff
	Other: (Specify)

Have you ever used the Science and Engineering Indicators Report?
	Yes
	No

(if #2 no, advance to item 6)

(if #2 yes)

The last time I used the SEI report:	Strongly disagree	Disagree	Agree	Strongly agree	Don’t know / Not applicable
It was easy to find the answer to my question
The answer to my question was presented clearly
Supporting data were provided in an appropriate format
The textual narrative was informative
The charts or data visualizations were useful in interpreting the information.

(if “Strongly disagree” or “Disagree” in #3 is checked)

If you disagreed with any of the statements in question #3, please explain why.

(if #2 yes)

How do you usually use the Science and Engineering Indicators report? Please select all that apply (if #2 yes)
	As a reference
	As background for reports or articles
	As background for program planning
	As background for policy formulation or analysis
	As background for proposal development
	As verification or validation of specific issues
	For information to be used in speeches and hearings
	General research
	Other: (Specify)

What other policy indicator reports do you use? (For example: the Department of Education’s The Condition of Education or the World Bank’s World Development Indicators.

(if #2 no, advance to item 14)

(if #2 yes)

Have you ever had difficulty finding what you were looking for in the Science and Engineering Indicators report? If yes, what were you looking for and how did you ultimately find the answer you were looking for?
	No
	Yes: (Specify)

Accessing the Science and Engineering Indicators

(if #2 yes)

How often do you use the Science and Engineering Indicators report?
	Approximately once per month
	Approximately once every 3 months
	Approximately once every 6 months
	Approximately once per year
	Other: (Specify)

(if #2 yes)

Which format of the report do you usually use?
	The published hard-copy edition
	The online edition (Web page or PDF versions)
	Both

(if #2 yes)

How do you usually navigate through the report? Please select all that apply.
	Browse or skim sections
	Look for answers for your questions
	Find or look for specific data or analysis
	Look for supporting data or analysis to support a position
	Read most or all sections
	Other: (specify)

(if #2 yes and “Look for answers for your questions” in #9 is checked)

If you usually use the report to look for answers for your questions, how difficult or easy is it to find the answers?
	Very difficult
	Somewhat difficult
	Somewhat easy
	Very easy

(if #2 yes)

How often do you use the following components of the Science and Engineering Indicators report?	Always	Often	Sometimes	Never
Chapter overviews
Most or all of a chapter
Text from selected chapters
Chapter highlights
Graphics from chapters
Tables from chapters
Appendix tables
Presentation slides

(if #2 yes)

Which parts of the Science and Engineering Indicators report are most useful to you? Please select all that apply.
	Chapter overviews
	Most or all of the chapter
	Text from selected chapters
	Chapter highlights
	Graphics from chapters
	Tables from chapters
	Appendix tables
	Presentation slides
	Other (specify)

(if #2 yes)

If you access the report online, how often do you extract data or download data tables?
	Always
	Often
	Sometimes
	Never

SEI Digital Future

Based on your experience with other digital documents or your own impressions, in what ways would making Science and Engineering Indicators a primarily-digital document improve its usefulness and value to you?

Are you aware of any other reports or other online resources that could serve as a good model for the Science and Engineering Indicators? What makes these reports good examples to follow?

What features would you like to see in a new digital version of the Science and Engineering Indicators report? How could these new features enhance your use of the SEI report?