Att H - Survey Screenshots

Surveys of State, Tribal, Local and Territorial (STLT) Governmental Health Agencies

NORS_evaluation_ATTACHMENT_H_SurveyInstrument_Online Version

National Outbreak Reporting System: An Evaluation of Foodborne Disease Outbreak Surveillance and Technical Requirements for Reporting

OMB: 0920-0879

Document [pdf]
Download: pdf | pdf
NORS: Evaluation of Foodborne Disease Outbreak Reporting
Introduction

 

Form approved: OMB No. 0920­0879: Expiration Date 03/31/2014  
The NORS­Foodborne team is conducting a survey to evaluate the National Outbreak Reporting System
(NORS) for foodborne disease outbreak reporting. We are asking all Reporting Site Administrators (RSAs)
responsible for entering foodborne disease outbreak reports into NORS to complete the survey. 
Your participation is voluntary. By returning the survey you are consenting to participate. There is no penalty
for declining to participate and there are no foreseen risks to you or your state if you do not participate. You
will receive no direct benefits from participating in the survey; however, your participation will help to
improve the reporting system. 
The information you provide will not be considered to constitute your NORS reporting agency's official policy
or position, and will not be used beyond the scope of this evaluation without your permission. We would like
to share the results of this evaluation with participating NORS reporting agencies, but all responses will be
kept anonymous. 
The survey will take approximately 20 minutes to complete. The survey must be completed in one sitting, so
please make sure that you have ample time to complete the entire survey before starting.  
Your time, assistance, and input are invaluable and greatly appreciated.  
If you have any questions about this survey, please contact Maho Imanishi ([email protected], 404­718­4689),
Karunya Manikonda ([email protected], 404­639­3530) or Hannah Gould ([email protected], 404­639­3315) at the CDC
Enteric Diseases Epidemiology Branch. 
Public reporting burden of this collection of information is estimated to average 20 minutes per response, including the 
time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and 
completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not 
required to respond to a collection of information unless it displays a currently valid OMB control number. Send 
comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for 
reducing this burden to CDC/ATSDR Information Collection Review Office, 1600 Clifton Road NE, MS D­74, Atlanta, 
Georgia 30333; ATTN: PRA (0920­0879).  

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 1: General Questions

 

*1. State
6  

*2. Are you at a local, state, or territorial health department?
j Local
k
l
m
n

 

Other 
 
j State
k
l
m
n

j Territorial 
k
l
m
n

 

j Other (please specify)
k
l
m
n

 
 

3. What is your job title or function?
c Foodborne/enteric disease epidemiologist
d
e
f
g
c Health officer
d
e
f
g

 

 

c Food program director
d
e
f
g
c State epidemiologist
d
e
f
g

 

 

c Other (please specify)
d
e
f
g

 
 

4. How often does your NORS reporting agency enter foodborne disease outbreaks into
NORS?
j As they occur (‘real time’)
k
l
m
n
j Weekly
k
l
m
n

 

 
 

j Monthly
k
l
m
n

j Every 6 months
k
l
m
n

 

 

j Annually
k
l
m
n

j When CDC closes out data
k
l
m
n
j Other (please specify)
k
l
m
n

 

 

5
6  

NORS: Evaluation of Foodborne Disease Outbreak Reporting
5. How does your NORS reporting agency use foodborne disease outbreak data collected
by NORS? (choose up to 3)
c For outbreak investigations
d
e
f
g

 

c For analyses of foodborne disease outbreaks
d
e
f
g

 

c To learn about investigations by other states
d
e
f
g

 

c To respond to requests for data (e.g., The Freedom of Information Act, open records requests)
d
e
f
g

 

Other 
 
c To inform other state or local agencies
d
e
f
g

c To verify state outbreak database
d
e
f
g

 

c My agency does not use the NORS data
d
e
f
g
c Other (please specify)
d
e
f
g

 

 

5
6  

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 2: Questions about the NORS interface

 

6. On a scale from 1 to 5, where 1 is not user­friendly, and 5 is very user­friendly, how
Enter 

would you rate the NORS interface...
I didn't use it 
1 (Not user­
friendly)

2

3

4

5 (Very user­
friendly)

Not sure

and I cannot 
find someone 
who did

...in 2009 when NORS first 

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

launched?
...today?

7. Comparing NORS with the electronic Foodborne Outbreak Reporting System (eFORS),
do you feel the system for foodborne disease outbreak reporting is better or worse?
j Much better
k
l
m
n

 

j A little bit better
k
l
m
n
j About the same
k
l
m
n

 

j A little bit worse
k
l
m
n
j Much worse
k
l
m
n

 

 

 

j Not sure/I never used eFORS
k
l
m
n

 

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
 

8. Please tell us why you feel the NORS system for foodborne disease outbreak reporting
is better or worse than eFORS.
5

6  

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 2: Questions about the NORS Interface

 

9. Comparing NORS with eFORS, how has the number of foodborne disease outbreaks
reported to CDC from your NORS reporting agency changed since the introduction of
NORS in January 2009?
j Many more foodborne disease outbreaks reported
k
l
m
n

 

j Slightly more foodborne disease outbreaks reported
k
l
m
n

 

j About the same number of foodborne disease outbreaks reported
k
l
m
n
j Slightly fewer foodborne disease outbreaks reported
k
l
m
n
j Many fewer foodborne disease outbreaks reported
k
l
m
n

 

 

 

 

j Don’t know
k
l
m
n

j Not sure/I never used eFORS
k
l
m
n

 

10. In 2009 , did your agency experience any interface problems when using NORS to
enter foodborne outbreak reports?
 

j Yes
k
l
m
n
j No
k
l
m
n

 

j Do not remember or not sure
k
l
m
n

 

j I wasn't here or did not enter any reports in 2009 and could not find someone who was
k
l
m
n

 

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
 

11. In 2009 , how frequently did your agency experience the following interface problems
when using NORS to enter foodborne outbreak reports?
Never

Sometimes

Often

System (interface) froze or was non­responsive

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Lost data or failed data retrieval

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Locked out of the system

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Tabs within the interface did not appear when expected

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Other interface problems (please specify)  

5
6

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 2: Questions about the NORS interface

 

12. In the past 3 months, did your agency experience any interface problems when using
NORS to enter foodborne outbreak reports?
 

j Yes
k
l
m
n
j No
k
l
m
n

 

j Do not remember or not sure
k
l
m
n

 

j I wasn't here 3 months ago or did not enter any reports in the past 3 months and could not find someone who was
k
l
m
n

 

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
 

13. In the past 3 months , how frequently did your agency experience the following
interface problems when using NORS to enter foodborne outbreak reports?
Never

Sometimes

Often

System (interface) froze or was non­responsive

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Lost data or failed data retrieval

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Locked out of the system

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Tabs within the interface did not appear when expected

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Other interface problems (please specify) 

5
6

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 2: Questions about the NORS interface

 

14. Who do you first contact when you encounter a technical issue?
j CDC (NORS team)
k
l
m
n

 

j IT personnel in your health department
k
l
m
n
j Colleagues in your health department
k
l
m
n

 

 

 

j Not sure
k
l
m
n

j Other (please specify)
k
l
m
n

 

5
6  

15. When you encounter a technical problem that affects routine data entry into NORS that
requires CDC’s assistance, in general, how quickly...
Haven’t 
encountered a 
1­2 days

1 week

2 weeks

>2 weeks

Don’t know

technical problem 
that required me to 
contact CDC

...does CDC respond to your 

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

inquiry?
...is the issue resolved?

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 2: Questions about the NORS interface

 

16. Approximately what proportion of foodborne disease outbreaks were not entered
because of technical problems with the NORS interface...
None

<10%

10% ­ <25%

25% ­ <50%

50% or more

Don’t know

...in 2009?

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

...in the past year?

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

17. Does your NORS reporting agency solely house its foodborne disease outbreak data
in NORS (i.e., agency does not have its own outbreak data system)?
 

j Yes
k
l
m
n
j No
k
l
m
n

 

j Don't know
k
l
m
n

 

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
 

18. What other type of system does your NORS reporting agency currently use to house
foodborne disease outbreak reports? (Choose all that apply)
c Paper­based system
d
e
f
g
c Excel spreadsheet
d
e
f
g
c Access database
d
e
f
g

 

 

 

c State­specific electronic reporting database
d
e
f
g
c Other (please specify)
d
e
f
g

 

 

5

6  

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 2: Questions about the NORS interface

 

19. Does your NORS reporting agency currently send any foodborne disease isolate or
outbreak data through Public Health Information Network Messaging System (PHINMS)?
 

j Yes
k
l
m
n
j No
k
l
m
n

 

j Don't know
k
l
m
n

 

20. How would you prioritize the following planned future NORS enhancements (not
specific to foodborne disease outbreaks)? Please rank at least 4.
1 (Most needed)

2

3

4

5 (Least needed)

Increase allowed size for attachments

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

NORSDirect (i.e. feature to support direct upload of site 

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Grant read/write access to a specific user

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Other (please specify below)

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

data into NORS)
Access a specific outbreak report from the NORS Admin 
screen

Other (please specify) 

5

6

21. Do you feel like you and other NORS users have received enough training or guidance
about how to enter foodborne disease outbreak data into NORS?
 

j Yes
k
l
m
n
j No
k
l
m
n

 
 

j Not sure
k
l
m
n

NORS: Evaluation of Foodborne Disease Outbreak Reporting
22. What topics would you like further training on? (Choose all that apply)
c NORS interface navigation
d
e
f
g

 

c Enhanced database download feature (Full Download)
d
e
f
g

 

c NORSDirect (i.e., uploading data directly into NORS via Public Health Information Network Messaging System (PHINMS)) as soon as this 
d
e
f
g
feature is available 

c Mode of transmission assignment (i.e., when to select food as the primary mode of transmission versus other modes of transmission)
d
e
f
g
c None
d
e
f
g

 

 

c Other (please specify)
d
e
f
g

 

5

6  

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 3: Questions on data quality

 

23. Approximately what proportion of detected foodborne disease outbreaks are entered
into NORS in your NORS reporting agency?
j 90­100%
k
l
m
n
j 75­<90%
k
l
m
n
j 50­<75%
k
l
m
n
j <50%
k
l
m
n

 
 
 

 
 

j Don’t know
k
l
m
n

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
 

24. Which of the following factors most influence whether a detected foodborne disease
outbreak is reported to NORS? (Choose up to 3)
c Pathogen
d
e
f
g

 

c Vehicle of the outbreak
d
e
f
g

 

c Location where the outbreak occurred
d
e
f
g

 

c Time of the year the outbreak occurred
d
e
f
g

 

c Quality of evidence about the outbreak (e.g., laboratory confirmation, implicated food)
d
e
f
g
c Available personnel and financial resources
d
e
f
g

 

c What else is happening in the state (e.g. non­foodborne outbreaks)
d
e
f
g
c IT issues at your health department
d
e
f
g
c IT issues with NORS
d
e
f
g

 

 

 

 

 

c Don’t know
d
e
f
g
c None
d
e
f
g

 

c Other (please specify)
d
e
f
g

 

5

6  

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 3. Questions on data quality

 

25. On average, how many people review each foodborne disease outbreak report before
it is entered in NORS?
j Don't know
k
l
m
n

 

j Enter number if known:
k
l
m
n

 

 

26. On a scale from 1 to 5, where 1 is low priority (data entered only if time/staff available)
and 5 is high priority (make time to enter all the data), how would you rate the effort your
NORS reporting agency puts into entering data on all foodborne disease outbreaks into
NORS?
1 (low priority)

2

3

4

5 (high priority)

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Don't know or prefer not 
to say

j
k
l
m
n

27. On a scale of 1 to 5, where 1 is low impact (does not affect reporting) and 5 is high
impact (significantly affects reporting), how important is grant funding from Epidemiology
and Laboratory Capacity (ELC) or Affordable Care Act (ACA) for reporting to NORS in your
NORS reporting agency?
1 (low impact)

2

3

4

5 (high impact)

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Don't know or prefer not 
to say

j
k
l
m
n

28. In 2009, many health departments were dealing with H1N1 outbreaks. Did your NORS
reporting agency experience decreased resources available to work on foodborne
disease outbreaks?
Yes

No

Don't know

For detection (e.g., lab capacity):

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

For investigation:

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

For data entry and reporting:

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 4: Questions on mode of transmission in NORS

 

29. The revised guidance for reporting outbreaks was sent out in June 2012 (Click here to
access the revised guaidance). Is the description of each mode of transmission in the
guidance document useful and clear in deciding how to report outbreaks?
j Useful and clear
k
l
m
n

 

j Useful, but not clear
k
l
m
n

 

j Clear, but not useful
k
l
m
n

 

j Neither useful or clear
k
l
m
n

 

 

j Don’t know
k
l
m
n

30. Does your NORS reporting agency have a specific protocol to follow to determine
which outbreaks are reported as foodborne? [if you are willing to share the protocol,
please provide in the textbox or email to [email protected]]
 

j Yes
k
l
m
n
j No
k
l
m
n

 
 

j Not sure
k
l
m
n
Protocol:  

5

6

31. Since 2009, outbreaks with other primary modes of transmission can also be reported
(food, water, animal contact, environment, or undetermined). As a result, many states have
noted that it can be difficult to determine the primary mode of transmission for some
outbreaks.
Is this a problem that you have experienced?
 

j Yes
k
l
m
n
j No
k
l
m
n

 
 

j Not sure
k
l
m
n

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
 

32. For each of the combination(s) that have caused you problems in NORS (since 2009),
how likely would the outbreaks have been reported as foodborne disease outbreaks in
eFORS (before 2009)?
If a combination did not cause you problems, please select “No problems.”
No problems

Don't know if 
problems

Not likely reported

Somewhat likely 
reported

Very likely reported

Don't Know if 
reported

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Foodborne vs. water

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Foodborne vs. animal 

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

j
k
l
m
n

Foodborne vs. person­to­
person

contact
Foodborne vs. environmental 
contamination
Foodborne vs. 
indeterminate/other/unknown
Comment (optional) 

5
6

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Part 4: Questions on mode of transmission in NORS

 

33. If your NORS reporting agency usually picks a "default" when the mode of
transmission is not clear, which mode is considered "default" in your agency?
j None ­­ no default
k
l
m
n
j Foodborne
k
l
m
n
j Water
k
l
m
n

 

 

 

j Person­to­person
k
l
m
n
j Animal contact
k
l
m
n

 

 

j Environmental contamination
k
l
m
n
j Indeterminate/other/unknown
k
l
m
n
 

j Not sure
k
l
m
n

 

 

 

NORS: Evaluation of Foodborne Disease Outbreak Reporting
Final Comments

 

Thank you for completing the survey. The results of the evaluation will be shared with the participating state
and local public health agencies via email/written report and in a webinar. 
If you have any questions about this survey, please contact Maho Imanishi ([email protected], 404­718­4689),
Karunya Manikonda ([email protected], 404­639­3530), or Hannah Gould ([email protected], 404­639­3315) at the CDC
Enteric Diseases Epidemiology Branch. 

34. Please provide any additional feedback you have on NORS. Your response is
invaluable to help to improve the NORS reporting system.
5

6  


File Typeapplication/pdf
File Modified2012-11-27
File Created2012-11-27

© 2024 OMB.report | Privacy Policy