Att I8 Example Instrument Testing Activity

Attachment I8: Example of Instrument Testing

The third party administer (Deloitte Consulting, LLP) will ensure the online survey accurately reflects the approved questionnaire. Testers will confirm that they following aspects of the survey and are fully functional, in that:

• The online survey matches the approved questionnaire; this includes that all introductory and explanatory text, question text, choice text, and that the question order is the same as in the written approved questionnaire

• The skip logic is correctly programmed and reflects the intent of the questionnaire

• No question requires an answer

• Mutually exclusive responses are programmed as mutually exclusive

• Questions are in the correct format, e.g. a single-punch question does not allow multiple responses

• Mandatory questions are programmed correctly so that questions are asked a second time (with a “decline to answer” option) if a respondent tries to move past the question without responding (please note: ‘mandatory’ questions do not require a response but a response is encouraged as these are high priority questions that either collect important demographic information or determine skip patterns)

• The survey flow is logical and visually appealing

• The survey uses consistent language, grammar, punctuation, and capitalization

• Offline data capture functionality maintains data offline until upload

Example skip logic testing activity

Test Case 1.0
Trigger	Condition	Branch	Expected Outcome	Testing Result
WHEN	IF	TARGET	OUTCOME	PASS/FAIL
Q7. Have you ever tried cigarette smoking, even one or two puffs? A. Yes. B. No	Q7 = B	Q11. How old were you when you first tried smoking a cigarette?	Not Displayed
Q7. Have you ever tried cigarette smoking, even one or two puffs? A. Yes. B. No	Q7 = B	Q12. About how many cigarettes have you smoked in your entire life?	Not Displayed
Q7. Have you ever tried cigarette smoking, even one or two puffs? A. Yes. B. No	Q7 = B	Q13. During the past 30 days, on how many days did you smoke cigarettes?	Not Displayed
Q7. Have you ever tried cigarette smoking, even one or two puffs? A. Yes. B. No	Q7 = B	Q14. During the past 30 days, on the days you smoked, about how many cigarettes did you smoke per day?	Not Displayed
Q13. During the past 30 days, on how many days did you smoke cigarettes? A. 0 days B. 1 or 2 days C. 3 to 5 days D. 6 to 9 days E. 10 to 19 days F. 20 to 29 days G. All 30 days	Q13 = A	Q14. During the past 30 days, on the days you smoked, about how many cigarettes did you smoke per day?	Not Displayed
Q7. Have you ever tried cigarette smoking, even one or two puffs? A. Yes. B. No	Q7 = B	Q15. When was the last time you smoked a cigarette, even one or two puffs? (Please choose the first answer that fits)	Not Displayed
Q7. Have you ever tried cigarette smoking, even one or two puffs? A. Yes. B. No	Q7 = B	Q16. During the past 30 days, what brand of cigarettes did you usually smoke? (Choose only one answer)	Not Displayed
Q13. During the past 30 days, on how many days did you smoke cigarettes?	Q13 = A	Q16. During the past 30 days, what brand of cigarettes did you usually smoke? (Choose only one answer)	Not Displayed
Q7. Have you ever tried cigarette smoking, even one or two puffs? A. Yes. B. No	Q7 = B	Q17. Menthol cigarettes are cigarettes that taste like mint. During the past 30 days, were the cigarettes that you usually smoked menthol?answer)	Not Displayed
Q13. During the past 30 days, on how many days did you smoke cigarettes?	Q13 = A	Q17. Menthol cigarettes are cigarettes that taste like mint. During the past 30 days, were the cigarettes that you usually smoked menthol?answer)	Not Displayed
Q19. Have you ever tried smoking cigars, cigarillos, or little cigars, such as Black and Milds, Swisher Sweets, Dutch Masters, White Owl, or Phillies Blunts, even one or two puffs? A. Yes B. No	Q19 = B	Q20. How old were you when you first tried smoking a cigar, cigarillo, or little cigar, even one or two puffs?	Not Displayed
Q19. Have you ever tried smoking cigars, cigarillos, or little cigars, such as Black and Milds, Swisher Sweets, Dutch Masters, White Owl, or Phillies Blunts, even one or two puffs? A. Yes B. No	Q19 = B	Q21. During the past 30 days, on how many days did you smoke cigars, cigarillos, or little cigars?	Not Displayed