Survey of Immunohistochemistry Validation Practices and Procedures

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Results for the pilot test post-survey for Immunohistochemistry Validation Practices and Procedures.
Pilot responses and questionnaire responses reviewed by Drs Nakhleh, Fitzgibbons, Ms Souers and Ms Fatheree via conference call
on 1-5-15.
Pilot Tester Information
Institution Name and Address

7 Respondents
4 MDs (IHC Directors)
3 Histology Supervisors
2 Non-Respondents (CDC contacts, non CAP PT customers)

Time to complete IHC Validation
survey (not including this form)

Average: 25 minutes
Range: 15 – 60 minutes
2 @ 15
1 @ 25
1@ 30
2 @ 20
1 @ 60 (most time spent finding the data)

1

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Strongly Agree

2
3
After reading the introduction, my interest in continuing the survey is high
1
Average: 4
Range:2-4
3
The introduction helped me understand what to expect from this survey.
1
2
Average: 4
Range: 3-4
3
The amount of detail provided was adequate.
1
2
Average: 4
Range: 3-4
What recommendations do you have for the Introduction?
• List of definitions is a bit off-putting – can you put them somewhere else –like end- but clearly refer to them?
• I hardly read directions –note I had seen elements of survey before

Agree

Neutral

Disagree

Strongly Disagree

Survey Introduction

4

5

4

5

4

5

Recommendation by Biostats to leave definitions at beginning for consistency.

2

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Section I: IHC Validation Procedure survey questions 1-7
Summary: Questions 1-7 all ACCEPTABLE from respondents except for following comments on #5
.
Q #.

Elements

Specific Observations/Other Comments

Question clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

1.

2.

3.

3

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Q #.

Elements

Specific Observations/Other Comments

Question clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

4.

5.

How is this different from Q3 – I know you are trying to split out predictive
markers but seems redundant
Modified answers for clarity.
Typo – stray “ in question stem
Corrected.

6.

7.

4

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Section II: Re-Validation Procedures survey questions 8-9
Summary: Both acceptable except for comments listed below:
Revised order of questions for better flow. These are the original pilot question numbers.
Q #.

8.

Elements

Specific Observations/Other Comments

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision
•
•

9.

Question
clarity

○ Acceptable
○ Needs revision

•

Answers (clarity and no. of
responses)

Suggest breakdown into 2 separate questions
o Done
If you want respondents to list number of cases they used for
revalidation, add an empty box in the Number of Cases column
o Taken care of by Forms Dept
o Answer boxes for ‘change incubation or retrieval time’ is
missing. Taken care of by Forms Dept
o This is a complex question and could be confusing to some.
The Number of cases will have to look like a blank or answer
box. Taken care of by Forms Dept
Also there should be a comment field. Instructing “0” when number
not specified in protocol is not fair. Guideline leaves discretion for
lab director in many of the options and this could be formulated
prior to –illegible-project. Added additional responses to address

○ Acceptable
○ Needs revision

5

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

6

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Section III: Documentation Procedures survey questions 10-11
Summary: Both acceptable except for comments listed below:
Q #.

Elements

Specific Observations/Other Comments

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

10.

•
•
Done

Suggest breakdown into 2 separate questions
Same as comments for number 9

11.
•
•

Answers misaligned
Same as above – with adding empty boxes

Done – added minimum overall concordance rate also

7

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Section IV: General IHC Laboratory Data – Survey Questions 12-16
Summary: All Acceptable except for comment on Q16 below
Q #.

Elements

Specific Observations/Other Comments

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

12.

13.

14.

8

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Q #.

Elements

Specific Observations/Other Comments

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

15.

16.
This needs to allow multiple answers
Clarified by adding ‘primary’ to question but multiple answers would be acceptable

9

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Section V: Awareness and Adoption – Survey Questions 17-20
Summary: All Acceptable except for comment on Q19 and Q20 below

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

17.

18.

19.

20.

Need to stipulate more than one answer is acceptable
Comment meant for Q20 because (check all that apply is there)

•
•

More than one answer acceptable??
Not specified if single or multiple answers are acceptable – implied
with ‘most difficult’.
Added “choose up to 3 responses”

10

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Section VI: Conclusion
Summary: All Acceptable except for one comment
Q #.
Elements
Question
clarity

○ Acceptable
○ Needs revision

Answers (clarity and no. of
responses)

○ Acceptable
○ Needs revision

Specific Observations/Other Comments

21.

Disagree

Neutral

Agree

Strongly Agree

The confidentiality information made me comfortable with submitting the survey.
Average: 4
Range: 3-4
The amount of detail provided about the outcome of the survey was adequate.
Average: 4
Range: 3-4
What recommendations do you have for the Conclusion?
None

Strongly Disagree

Would be good to specify MD after first 3 choices
Added clarifying credentials to capture specifics for “ IHC Laboratory Director”

1

2

3

4

5

1

2

3

4

5

11

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

Strongly Disagree

Disagree

Neutral

Agree

Strongly Agree

Overall Survey Review
Goals and Objectives

The survey questions are easy to understand.
Average: 4
Range: 4-5

1

2

3

4

5

The answer choices are clearly written.
Average: 4
Range: 4-5

1

2

3

4

5

I was always able to find an appropriate answer to choose
Average: 4
Range: 3-4

1

2

3

4

5

The order of questions was easy to follow.
All: 4

1

2

3

4

5

Overall, the length of the survey was (circle one)
All: Appropriate
too short

appropriate

too long

12

Survey of Immunohistochemistry Validation Practices and Procedures
PILOT Questions
CAP Pathology Laboratory Quality Center: Cooperative Grant with Centers for Disease Control and Prevention

What did you like best about the survey?
• Survey is well structured and questions are clearly stated
• Made you think about what I do
• Pretty straight forward

If given the option to change parts of the survey what changes would you make?
Need a comment box at end of survey and for Q9 and Q11
Added free text comment box at end. Changed responses for Q9 and Q11 to address better.
Additional thoughts/comments:
None

13