NYTS Interviewer Guide – Item Set 1

Form Approved

OMB No. 0920-0621

Exp. Date 01/31/2024

NYTS Interviewer Guide – Item Set 1

(Demographics, E-Cigarettes and Other Heated Tobacco Products, Messaging, Social Media, and Advertisements)

Instructions:  

1. Introduce yourself and ensure that tech is working; respondent should be able to access the web survey and share their screen. 

2. Briefly discuss the goal of the larger survey and the goal of this interview (i.e., to understand how easy or hard these questions are to answer) 

1. This is YOUR interview. YOUR chance to give important feedback so kids like you can have a better survey experience.  

3. Remind the student of consent highlights: 

1. If possible, take the survey in a private location, away from other family members or your parents.

2. Information will not be shared and is only used internally without your name and personal information 

3. You can skip any question. But, if you feel the question is so uncomfortable that you want to skip it, I’ll ask you why you feel that way.

4. The interview will be recorded, and we will take notes.

4. Read the OMB statement:

   1. CDC estimates the average public reporting burden for this collection of information as 2 hours per response, including the time for reviewing instructions, searching existing data/information sources, gathering and maintaining the data/information needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to CDC/ATSDR Information Collection Review Office, 1600 Clifton Road NE, MS D-74, Atlanta, Georgia 30333; ATTN: PRA (0920-0621).

5. Explain process. 

1. Read each question to yourself and answer it through the web survey.

2. Pause when you see a stop sign in the survey and I’ll ask you some questions about how you answered.

3. There are no wrong answers to any of the questions you will see. In fact, we aren’t going to use the answers you provide in any way. We are more interested in what you think of the questions and response choices you will see. We want your honest feedback about what you think about these questions and response choices. We didn’t write any of these questions so nothing you say about them will bother us.

4. Jump in with comments as you’re trying to answer.  

6. Start with a practice question to make sure they understand how probes work.  

7. Avoid use or reference to the National Youth Tobacco Survey or NYTS to minimize the introduction of bias.

8. After you explain the instructions ask if the respondent has any questions.

Generic probes (use these when the respondent hesitates or appears confused about an item):

1. In your own words, what is this question asking?

2. Are there any unfamiliar or confusing words in this question?

3. How sure are you about your answer? Why?

4. How do you think we could make this question less confusing or easier to understand?

5. Was anything about this question uncertain or uncomfortable?

   1. If so, what is it?

   2. If so, do you think others would not want to respond honestly to this question?

Question/Screen (verbatim from NYTS interview)			Question-specific Probes (if required)		Notes (for interviewer use)
Demographics
The first eight questions ask some background information about you.
How old are you? 9 years old 10 years old 11 years old 12 years old 13 years old 14 years old 15 years old 16 years old 17 years old 18 years old 19 years old or older
What is your sex? Male Female
What grade are you in? 6th 7th 8th 9th 10th 11th 12th Ungraded or other grade
Are you Hispanic, Latino, Latina, or of Spanish origin? (Select one or more) No, not of Hispanic, Latino, Latina, or Spanish origin à [EXCLUSIVE] Yes, Mexican, Mexican American, Chicano, or Chicana Yes, Puerto Rican Yes, Cuban Yes, Another Hispanic, Latino, Latina, or Spanish origin			[IF HISPANIC]: Are the categories clear? Are there any other categories that you think we should include (i.e. LatinX)?
What race or races do you consider yourself to be? (Select one or more) American Indian or Alaska Native Asian Black or African American Native Hawaiian or Other Pacific Islander White
Which of the following best describes you? Heterosexual (straight) Gay or lesbian Bisexual I describe my sexual orientation some other way I am not sure about my sexual orientation (questioning) I do not know what this question is asking			How did you come up with your answer? Were there any categories you hadn’t heard before? Were there other answer categories you wish were there?
What sex were you assigned at birth, on your original birth certificate? Male Female Refused I don’t know			In your own words, what is this question asking? How clear or confusing was the question? How easy or hard to answer?
Do you currently describe yourself as male, female, or transgender? Male Female Transgender None of these			In your own words, what is this question asking? How clear or confusing was the question? How easy or hard to answer? Were there any categories you hadn’t heard before? Were there other answer categories you wish were there?
Question Group Probes: Were these questions what you expected to see when you saw the introduction (“The first eight questions ask some background information about you”)? How clear or confusing were these questions? Did the answer options for race match what you expected to see? Did they include the race you would usually consider yourself to be? Did you feel comfortable answering these questions? Did you feel comfortable answering these questions so early in the survey?
1.2 E-cigarette use
The next several sections of questions ask about your use of particular kinds of tobacco products, such as e-cigarettes, cigarettes, cigars, smokeless tobacco, hookahs, roll-your own-cigarettes, pipes, snus, dissolvable tobacco, bidis, heated tobacco products, and nicotine pouches. At the beginning of each section, you will see a brief description and an image showing examples of each kind of tobacco product.
The next several questions are about electronic cigarettes or e-cigarettes, such as JUUL, Vuse, NJOY, Puff Bar, blu, or Bidi Stick. You also may know them as vapes, mods, e-cigs, e-hookahs, or vape-pens. E-cigarettes are battery powered devices that usually contain a nicotine-based liquid that is vaporized and inhaled. For the rest of this survey, these products and devices will be called e-cigarettes.				How clear or confusing was the description of e-cigarettes? Were there any unfamiliar words in the description? How well did the description fit the images shown? To what extent did you use the images versus the description in order to understand what types of products it was asking about? Is ‘e-cigarette’ a term that you or other people your age use? Are there are other terms that should be used? What tobacco products do you think of as e-cigarettes? Do vapes fit into that category? How do e-cigarettes differ from regular cigarettes?
Have you ever used an e-cigarette, even once or twice? Yes No
[INTERVIEWER: CONTINUE BELOW FOR EVER E-CIGARETTE USERS. NEVER E-CIGARETTE USERS WILL SKIP TO PAGE X.]
Question Universe: ever e-cigarette users [known] How old were you when you first used an e-cigarette, even once or twice? 8 years old or younger 9 years old 10 years old 11 years old 12 years old 13 years old 14 years old 15 years old 16 years old 17 years old 18 years old 19 years old or older
Question Universe: ever e-cigarette users [known] In total, on how many days have you used e-cigarettes in your entire life? 1 day 2 to 10 days 11 to 20 days 21 to 50 days 51 to 100 days Over 100 days				[IF MORE THAN ONE DAY:] Walk me through how you figured out your answer to this question. How sure are you about your answer?
Question Universe: ever e-cigarette users [or unknown] During the past 30 days, on how many days did you use e-cigarettes? Specify: |__|__| (Range 0 – 30)				How easy or hard was it to answer with a specific number of days? How would you respond to this item if you did not use e-cigarettes during the past 30 days?
Question Universe: ever/current e-cigarette users [known] When was the last time you used an e-cigarette, even one or two times? (Please choose the first answer that fits) Earlier today cNot today, but sometime during the past 7 days Not during the past 7 days, but sometime during the past 30 days Not during the past 30 days, but sometime during the past 6 months Not during the past 6 months, but sometime during the past year 1 to 4 years ago 5 or more years ago
Question Universe: ever/current e-cigarette users [known] Why did you first use an e-cigarette? (Select one or more) A friend used them A family member used them To try to quit using other tobacco products, such as cigarettes They cost less than other tobacco products, such as cigarettes They were easier to get than other tobacco products, such as cigarettes I’ve seen people on TV, online, or in movies use them They are less harmful than other forms of tobacco, such as cigarettes They were available in flavors, such as menthol, mint, candy, fruit, or chocolate I could use them unnoticed at home or at school I could use them to do tricks I was curious about them I was feeling anxious, stressed, or depressed To get a high or buzz from nicotine I used them for some other reason (specify:)				How easy or hard was it to remember why you first used an e-cigarette? How confident are you in your response? Were there any responses that applied to you that you didn’t select? If so, why? Any responses missing that should be added? Any responses that we can delete?
Question Universe: current e-cigarette users [known] INTERVIEWER: ASK IF CURRENT E-CIGARETTE USER. OTHERWISE, SKIP TO NEXT QUESTION. Why do you currently use e-cigarettes? (Select one or more) A friend uses them A family member uses them To try to quit using other tobacco products, such as cigarettes They cost less than other tobacco products, such as cigarettes They are easier to get than other tobacco products, such as cigarettes I’ve seen people on TV, online, or in movies use them They are less harmful than other forms of tobacco, such as cigarettes They are available in flavors, such as menthol, mint, candy, fruit, or chocolate I can use them unnoticed at home or at school I can use them to do tricks I am curious about them Because I feel anxious, stressed, or depressed To get a high or buzz from nicotine I use them for some other reason (specify:)				Do you consider yourself a current e-cigarette user? What does “current use” mean to you?
Question Universe: ever e-cigarette user [known] Have you ever purchased an e-cigarette device (including disposable devices), pod, cartridge, single hit, or e-liquid refill while at school or on school property? Yes No
Question Group Probes: How easy or hard was it for you to answer these questions? Why? Which were hardest? How clear or confusing were the different answer options for these questions? What does “Select one or more” mean to you? [INTERVIEWER: SKIP IF PAST 30-DAY E-CIGARETTE USER] When you were answering these questions about e-cigarettes, were you thinking about tobacco and nicotine, or were you thinking about other substances like marijuana?
[INTERVIEWER: CONTINUE BELOW FOR PAST 30-DAY E-CIGARETTE USERS. OTHERWISE, SKIP TO PAGE X.]
Question Universe: past 30-day e-cigarette user [known] Which of the following best describes the type of e-cigarette you have used in the past 30 days? If you have used more than one type, please think about the one you use most often. A disposable e-cigarette (for example, Puff Bar or Bidi Stick) An e-cigarette that uses pre-filled or refillable pods or cartridges (for example, JUUL, Vuse, or Suorin) An e-cigarette with a tank that you refill with liquids (including mod systems that can be customized by the user) I don’t know the type				How did you figure out which type of e-cigarette you used? If needed, did the brand examples help you decide? Which of the response options were confusing?
Question Universe: past 30-day e-cigarette user [known] During the past 30 days, what e-cigarette brands did you use? (Select one or more) Bidi Stick blu JAK JUUL Hyde Leap Logic Mojo NJOY Posh (including Posh Plus) Puff Bar SMOK (including NOVO) STIG Suorin Vuse Some other brand(s) not listed here (specify): ________________________ Not sure / I don’t know the brand				If some other brand: Is that a common brand where you live? Do you know other people your age who use that brand? Have you heard of any of the brands listed here or do any of them sound familiar? If not sure/don’t know: Is there a reason you don’t remember the brand, like that someone else bought it for you or you buy lots of different brands? Have you heard of any of the brands listed here or do any of them sound familiar?
Question Universe: past 30-day e-cigarette user reporting >1 brand [known] During the past 30 days, what brand of e-cigarettes did you usually use? (Choose only one answer) I did not use a usual brand Bidi Stick blu JAK JUUL Hyde Leap Logic Mojo NJOY Posh (including Posh Plus) Puff Bar SMOK (including NOVO) STIG Suorin Vuse Some other brand not listed here (specify): __________________________ Not sure / I don’t know the brand
Question Universe: past 30-day e-cigarette users [known] Did any of the e-cigarettes that you used in the past 30 days contain nicotine? A. Yes B. No C. Don’t know				In your own words, can you describe what nicotine is? How do you know if your e-cigarette contained nicotine?
Question Universe: past 30-day e-cigarette users [known] Nicotine salts, or “nic salts”, is a type of nicotine that is found in some e-liquids, pods, and cartridges. Did any of the e-cigarettes that you used in the past 30 days contain nicotine salts? Yes No Don’t know				For those reporting Don’t Know: did you not know what nicotine salts were? Or did you not know if your product contained them?
Question Universe: past 30-day e-cigarette user [known] Were any of the e-cigarettes that you used in the past 30 days flavored to taste like menthol, mint, clove or spice, alcoholic drinks, candy, fruit, chocolate, or any other non-tobacco flavor? Do not think about tobacco flavor when answering this question. Yes No Don’t Know				What does “non-tobacco flavor” mean to you in this question? What does “tobacco flavor” mean? Would you have answered differently if it didn’t say “Do not think about tobacco flavor when answering this question?
Question Universe: past 30-day e-cigarette user [known] Were any of the e-cigarettes that you used in the past 30 days flavored to taste like tobacco? Yes No Don’t Know				What does “flavored to taste like tobacco” mean to you? Did you think about added artificial flavorings, naturally occurring tobacco flavor, or both?
Question Universe: past 30-day users of flavored e-cigarettes What flavors were the e-cigarettes that you have used in the past 30 days? (Select one or more) Tobacco-flavor Menthol Mint Spice (such as cinnamon, vanilla, or clove) Fruit Chocolate Alcoholic drinks (such as wine, margarita, or other cocktails) Non-alcoholic drinks (such as coffee, soda, lemonade, or other beverage) Candy, desserts, or other sweets Some other flavor not listed here (Specify): __________________________				What do you think of the answer choices? What’s the difference between menthol and mint?
Question Universe: past 30-day user of flavored e-cigarettes Did any of the flavors that you used in the past 30 days have names or descriptions that included the word “ice” or “iced” (for example, blueberry ice or strawberry ice)? Yes No Don’t know				Have you ever heard of “iced” flavors? Was anything about this question confusing?
Question Universe: past 30-day user of flavored e-cigarettes Did any of the flavors that you used in the past 30 days have a name that did not describe a specific flavor, such as “solar,” “purple,” “jazz,” “island bash,” “fusion” or some other word or phrase? Yes (specify): ___________________ No Don’t know				Was anything about this question confusing? Would you describe these flavors any differently? Are any example words (e.g., jazz) missing?
Question Universe: past 30-day e-cigarette user [known] During the past 30 days, how did you get your e-cigarette devices, pods, cartridges, or e-liquid refills? (Select one or more) I bought them myself I had someone else buy them for me I asked someone to give me some Someone offered them to me I got them from a friend I got them from a family member I took them from a store or another person I got them in some other way (specify): _____________________________				Were any response options confusing?
Question Universe: past 30-day e-cigarette user [known] During the past 30 days, where did you buy your e-cigarette devices, pods, cartridges, or e-liquid refills? (Select one or more) I did not buy e-cigarettes during the past 30 days à [EXCLUSIVE RESPONSE] I bought them from another person (a friend, family member, or someone else) A gas station or convenience store A grocery store A drugstore A mall or shopping center kiosk/stand A vending machine On the Internet (such as a product website, online vape or tobacco store or other online marketplace) Through the mail Through a delivery service (such as DoorDash or Postmates) A vape shop or tobacco shop Some other place not listed here (specify): __________________________				If did not buy last 30 days: Where did you get your e-cigarette products? Did you pay any money for them? [INTERVIEWER: NOTE RESPONSE FROM PRIOR QUESTION]
Question Universe: past 30-day e-cigarette user (who got a product from someone else) Earlier you answered that you got or bought your e-cigarette devices, pods, cartridges, or e-liquid refills from another person, such as a friend or family member during the past 30 days. How old was this person? Younger than 18 years old 18 years old 19 years old 20 years old 21 years old or older I don’t know
Question Universe: past 30-day e-cigarette user (who got a product from someone else) During the past 30 days, which of the following e-cigarette product(s) did you get or buy from another person? (Select one or more) A new e-cigarette device (including disposable devices) A pod, cartridge, or e-liquid refill A hit or a drag from another person’s e-cigarette device Something else (specify:) _______________________________________				Were any of the response options confusing?
Question Universe: past 30-day e-cigarette user [known] During the past 30 days, how often did you use someone else’s e-cigarette device? Never Rarely Sometimes Most of the Time Always
Question Universe: past 30-day users of e-cigarettes [known] Are you seriously thinking about quitting e-cigarettes? (Please choose the first answer that fits) Yes, during the next 30 days Yes, during the next 6 months Yes, during the next 12 months Yes, but not during the next 12 months No, I am not thinking about quitting e-cigarettes				If “no”, why not? Are they truly not interested in quitting, or do they not consider that they would even need to quit (e.g., they do not consider themselves to be e-cigarette users)
Question Universe: past 30-day users of e-cigarettes [known] During the past 12 months, how many times have you stopped using e-cigarettes for one day or longer because you were trying to quit using e-cigarettes for good? I did not try to quit during the past 12 months 1 time 2 times 3 to 5 times 6 to 9 times 10 or more times
Question Universe: e-cigarette users who reported ≥1 quit attempt in past 12 months [known] When you tried to quit using e-cigarettes, did you use any of the following? (Select one or more) I did not use any resources à [EXCLUSIVE] Help or advice from a parent or caregiver Help or advice from a friend or peer Help or advice from a teacher or coach Help, advice, or counseling from a doctor or health care provider Treatment from a hospital, medical center, or some other facility Help or advice you found on the Internet A mobile app or texting program A telephone helpline or Quitline Something else (specify): ________________________________				Which of the response options were confusing? Any options missing? Any options that can be deleted?
Question Group Probes: Were words in this new to you? Which ones? What did they mean in your own words? Which of the response options seemed confusing? How easy or hard was it to remember the brands you used? Was there anything confusing about these questions? What was it? How easy or hard was it to answer for the past 30 days? [IF NOT ALREADY PROBED]: How easy or hard was it to remember your specific experiences, like flavors and where you got your products from? When you were answering these questions about e-cigarettes, were you thinking about tobacco and nicotine, or were you thinking about other substances like marijuana?
[INTERVIEWER: CONTINUE BELOW FOR NEVER E-CIGARETTE USERS. CURRENT E-CIGARETTE USERS WILL SKIP TO PAGE X.]
Question Universe: never e-cigarette users [known] Have you ever been curious about using an e-cigarette? Definitely yes Probably yes Probably not Definitely not
Question Universe: never e-cigarette users [known] Do you think that you will try an e-cigarette soon? Definitely yes Probably yes Probably not Definitely not
Question Universe: never e-cigarette users [known] Do you think you will use an e-cigarette in the next year? Definitely yes Probably yes Probably not Definitely not
Question Universe: never e-cigarette users [known] If one of your best friends were to offer you an e-cigarette, would you use it? Definitely yes Probably yes Probably not Definitely not
Question Group Probes: In your own words, what is the difference between “definitely yes/no” and “probably yes/no”? How easy or hard was it to imagine what you would do? What experiences did you think about? When you were answering these questions about e-cigarettes, were you thinking about tobacco and nicotine, or were you thinking about other substances like marijuana?
Vaping
Question/Screen (verbatim from NYTS interview)				Question-specific Probes (if required)			Notes (for interviewer use)
The next questions ask about other substances that could be vaped.
Have you ever vaped any of the following substances (even once)? Response options: Yes, No, Don’t Know Marijuana (also called pot, weed, or cannabis), including THC, THC concentrates, hash oil, or waxes CBD or CBD oils Synthetic marijuana or cannabinoids, such as K2 or Spice Another substance Specify): ___________________
Have you vaped any of the following substances during the past 30 days? Response options: Yes, No, Don’t Know Marijuana (also called pot, weed, or cannabis), including THC, THC concentrates, hash oil, or waxes CBD or CBD oils Synthetic marijuana or cannabinoids, such as K2 or Spice Another substance Specify): ___________________
Question Group Probes: How easy or hard was it to differentiate between the different things you could vape? How are marijuana and CBD the same or different? How sure were you about your answers? How comfortable were you responding to questions about marijuana? How comfortable were you responding to questions about CBD? How comfortable were you responding to questions about synthetic marijuana? How honestly do you think people will respond to questions about use of these substances?
Heated Tobacco
The next section is about heated tobacco products such as iQOS or Eclipse. You may know them as heated cigarettes or “heat-not-burn” tobacco products. Heated tobacco products heat processed tobacco leaf in the form of sticks (“heatsticks”), plugs, or capsules to produce a vapor that the user inhales. They are different from e-cigarettes, which heat a liquid to produce a vapor. Do not think about e-cigarettes when answering these questions.		In your own words, what is a heated tobacco product? How is a heated tobacco product different from an e-cigarette or vape in your mind? Have you heard of any of the examples of heated tobacco products given (iQOS, glo, Eclipse)? How well did the description fit the images shown? To what extent did you use the images versus the description in order to understand what types of products it was asking about?
Before today, have you heard of heated tobacco products? Yes No Don’t know/Not Sure
Have you ever used a heated tobacco product, even just one time? Yes No Don’t Know/Not Sure		[IF DON’T KNOW]: What makes you unsure about having used heated tobacco products?
[INTERVIEWER: CONTINUE BELOW FOR EVER (OR DK) HEATED TOBACCO USERS. NEVER USERS SKIP TO PAGE X.]
Question Universe: ever heated tobacco product user [or unknown/don’t know] During the past 30 days, on how many days did you use a heated tobacco product? Specify: |__|__| (Range 0 – 30)		[IF NOT ALREADY PROBED]: How easy or hard was it to answer with a specific number of days?
[INTERVIEWER: CONTINUE BELOW FOR PAST 30 DAY HEATED TOBACCO USERS. EVER USERS SKIP TO PAGE X.]
Question Universe: past 30-day heated tobacco product user [known] Were any of the heated tobacco products that you used in the past 30 days flavored to taste like menthol, mint, clove or spice, alcoholic drinks, candy, fruit, chocolate, or any other non-tobacco flavor? Do not think about tobacco flavor when answering this question. Yes No Don’t Know
Question Universe: past 30-day heated tobacco product user [known] Were any of the heated tobacco products that you used in the past 30 days flavored to taste like tobacco? Yes No Don’t Know
Question Universe: past 30-day users of flavored heated tobacco products What flavors were the heated tobacco products that you have used in the past 30 days? (Select one or more) Tobacco-flavor Menthol Mint Spice (such as cinnamon, vanilla, or clove) Fruit Chocolate Alcoholic drinks (such as wine, margarita, or other cocktails) Non-alcoholic drinks (such as coffee, soda, lemonade, or other beverage) Candy, desserts, or other sweets Some other flavor not listed here (Specify): ________________________
Question Universe: past 30-day heated tobacco product user [known] During the past 30 days, how did you get your heated tobacco products? (Select one or more) I bought them myself I had someone else buy them for me I asked someone to give me some Someone offered them to me I got them from a friend I got them from a family member I took them from a store or another person I got them in some other way (Specify): ____________________________
Question Universe: past 30-day heated tobacco product user [known] During the past 30 days, where did you buy your heated tobacco products? (Select one or more) I did not buy heated tobacco products during the past 30 days à [EXCLUSIVE RESPONSE] I bought them from another person (a friend, family member, or someone else) A gas station or convenience store A grocery store A drugstore A mall or shopping center kiosk/stand A vending machine On the Internet (such as a product or store website, eBay, or Facebook Marketplace) Through the mail Through a delivery service (such as DoorDash or Postmates) A vape shop or tobacco shop Some other place not listed here (Specify): __________________________
Question Group Probes: Can you describe the heated tobacco products you’ve used? What else would you call it? [IF NOT ALREADY PROBED]: How easy or hard was it to remember your specific experiences, like flavors and where you got your products from during the past 30 days? Did you also think about specific experiences outside of this 30-day window?
Antitobacco Messaging
The next seven questions are about different topics related to antitobacco messaging.
A warning label tells you if a product is harmful to you and can be either a picture or words. During the past 30 days, how often did you see a warning label on… Response options: Never, Rarely, Sometimes, Most of the time, Always, I didn’t see this tobacco product packaging in the past 30 days An e-cigarette package? A cigarette package? A cigar, cigarillo, or little cigar package? A package of chewing tobacco, snuff, or dip? A package of hookah tobacco?		[IF NEVER USER AND RESPONDS]: Where did you see this packaging in the past 30 days? Did you see warning labels on any other tobacco products that we did not ask about?
In the past 12 months, have you seen or heard The Real Cost, on television, the internet, social media, or radio as part of ads about tobacco? Yes No Not sure		How clear was “television, the internet, social media, or the radio”? Are there any other places you may have seen these ads? How sure were you that the ads you saw were from The Real Cost (vs. some other anti-tobacco message)?
E-cigarette Advertisements
The next five questions ask about e-cigarette advertisements. Do not think about cigarettes or other tobacco products when answering these questions.
When you are using the Internet, how often do you see ads or promotions for e-cigarettes? I do not use the Internet Never Rarely Sometimes Most of the time Always	What does “using the internet” mean to you? What kinds of ads where you thinking of?
When you read newspapers or magazines, how often do you see ads or promotions for e-cigarettes? I do not read newspapers or magazines Never Rarely Sometimes Most of the time Always	Did you include online or electronic newspapers or e-cigarettes?
When you go to a convenience store, supermarket, gas station, kiosk/storefront, or shopping center, how often do you see ads or promotions for e-cigarettes? I never go to a convenience store, supermarket, gas station, kiosk/storefront, or shopping center Never Rarely Sometimes Most of the time Always	What types of stores were you thinking about? Where there any types of stores you weren’t sure whether to include? Where there any response options that didn’t make sense?
When you watch TV or streaming services (such as Netflix, Hulu, or Amazon Prime), or go to the movies, how often do you see ads or promotions for e-cigarettes? I do not watch TV or streaming services, or go to the movies Never Rarely Sometimes Most of the time Always	In your own words, what is this question asking that’s different from the earlier question asking about “using the internet” Would you change your answer after thinking about it?
When you watch TV or streaming services (such as Netflix, Hulu, or Amazon Prime), or go to the movies, how often do you see people or characters using e-cigarettes? I do not watch TV or streaming services, or go to the movies Never Rarely Sometimes Most of the time Always	What do you think this question is asking that’s different from the last question? Is it ever hard to tell the difference between an ad and a character? What about in YouTube videos or similar?
Question Group Probes: At the beginning of this section, it said, “Do not think of cigarettes or other tobacco products when answering these questions.” How easy or hard was it to separate e-cigarettes from cigarettes or other tobacco products for these questions? How well did the response options (Never, Rarely, etc.) fit the questions?
E-cigarettes and Social Media
The next several questions ask about e-cigarettes and social media (such as YouTube, Instagram, Snapchat, Twitter, Facebook, Reddit, TikTok, or Twitch). Do not think about cigarettes or other tobacco products when answering these questions.
How often do you use social media? Never / I don’t use social media à [skip to next section] Less than one time per week About one time per week A few times per week Less than 1 hour, daily About 1-2 hours, daily About 3-4 hours, daily 4 hours or more, daily	Did any response options seem unclear or not useful? What timeframe were you thinking of when answering this question?
Question Universe: students who report using social media When you use social media, how often do you see posts or content (pictures, videos, or text) related to e-cigarettes? Never à [SKIP TO Q135] Less than monthly Monthly Weekly Daily	How easy or hard was it to answer this question? How clear or unclear were the question and response options? If they see posts: Do these posts promote (i.e., say positive things) e-cigarettes or do these posts discuss the negative effects of e-cigarettes? Who made these posts?
Question Universe: students who report seeing e-cigarette posts On which social media sites have you seen posts or content related to e-cigarettes? (Select one or more) Facebook Instagram Snapchat TikTok Twitch Twitter Reddit YouTube Some other site (specify: _______________________)	In your own word, what is a “social media site”? Did you include apps when answering? Would it change your answer?
Question Universe: students who report using social media When you use social media, how often do you post pictures or videos of yourself or someone else using e-cigarettes? Never Less than monthly Monthly Weekly Daily	Can you re-phrase the question in your own words? Were you thinking of all the pictures you posted or just of those featuring someone using e-cigarettes? Would you answer differently after thinking about this?
Question Universe: students who report using social media When you use social media, how often have you liked, commented, or shared posts or content (pictures, videos, or text) related to e-cigarettes? Never Less than monthly Monthly Weekly Daily	In your own words, what is this question asking? What kind of posts or content were you thinking of? Is there any other methods of interaction with social media content that you think are missing?
Question Universe: students who report using social media Who usually posted the content related to e-cigarettes on your social media? (Select one or more) People I know in real life Online friends I have not met in real life Celebrities or social media influencers E-cigarette brands or sellers Online news articles Public health campaigns (e.g., Truth Initiative, Real Cost) Other (Specify): _______________________________________	How well did the response options match the question for you?
Tobacco Advertisements
The next five questions ask about advertisements for cigarettes and other tobacco products (cigarettes, cigars, smokeless tobacco, hookahs, roll-your-own cigarettes, pipes, snus, dissolvable tobacco, bidis, heated tobacco products, and nicotine pouches). Do not think of e-cigarettes when answering these questions.
When you are using the Internet, how often do you see ads or promotions for cigarettes or other tobacco products? I do not use the Internet Never Rarely Sometimes Most of the time Always		What does “using the internet” mean to you? What kinds of ads where you thinking of?
When you read newspapers or magazines, how often do you see ads or promotions for cigarettes or other tobacco products? I do not read newspapers or magazines Never Rarely Sometimes Most of the time Always		Did you include online or electronic newspapers or e-cigarettes?
When you go to a convenience store, supermarket, gas station, kiosk/storefront, or shopping center, how often do you see ads or promotions for cigarettes or other tobacco products? I never go to a convenience store, supermarket, gas station, kiosk/storefront, or shopping center Never Rarely Sometimes Most of the time Always		What types of stores were you thinking about? Where there any types of stores you weren’t sure whether to include? Where there any response options that didn’t make sense?
When you watch TV or streaming services (such as Netflix, Hulu, or Amazon Prime), or go to the movies, how often do you see ads or promotions for cigarettes or other tobacco products? I do not watch TV or streaming services, or go to the movies Never Rarely Sometimes Most of the time Always		In your own words, what is question asking that’s different from the earlier question asking about “using the internet” Would you change your answer after thinking about it?
When you watch TV or streaming services (such as Netflix, Hulu, or Amazon Prime), or go to the movies, how often do you see people or characters using cigarettes or other tobacco products? I do not watch TV or streaming services, or go to the movies Never Rarely Sometimes Most of the time Always		What do you think this question is asking that’s different from the last question? Is it ever hard to tell the difference between an ad and a character? What about in YouTube videos or similar?
Question Group Probes: At the beginning of this section, it said, “Do not think of e-cigarettes when answering these questions.” How easy or hard was it to separate cigarettes from e-cigarettes for these questions? What did you think about when the question asked about “cigarettes or other tobacco products?” How well did the response options (Never, Rarely, etc.) fit the questions?