NYTS Pilot SupSta A_OMB_OSH

2017 NATIONAL YOUTH TOBACCO SURVEY Computer Based Pilot Survey

OMB No. 0920-16AWN

SUPPORTING STATEMENT: PART A

ICRO’s Desk Officer Review

December 1, 2016

Submitted by:

Ahmed Jamal, MBBS, MPH

Centers for Disease Control and Prevention

Office on Smoking and Health

Epidemiology Branch

4770 Buford Highway NE, MS-F 79

Atlanta, GA 30341

Phone: 770-488-5077

E-mail: [email protected]

Centers for Disease Control and Prevention

Department of Health and Human Services

TABLE OF CONTENTS

A. JUSTIFICATION

A.1. Circumstances Making the Collection of Information Necessary

A.2. Purpose and Use of Information Collection

A.3. Use of Improved Information Technology and Burden Reduction

A.4. Efforts to Identify Duplication and Use of Similar Information

A.5. Impact on Small Businesses or Other Small Entities

A.6. Consequences of Collecting the Information Less Frequently

A.7. Special Circumstances Relating to the Guidelines of 5 CFR 1320.5

A.8. Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency

A.9. Explanation of Any Payment or Gift to Respondents

A.10. Assurance of Confidentiality Provided to Respondents

A.11. Justification for Sensitive Questions

A.12. Estimates of Annualized Burden Hours and Costs

A.13. Estimates of Other Total Annual Cost Burden to Respondents or Record Keepers

A.14. Annualized Cost to the Government

A.15. Explanation for Program Changes or Adjustments

A.16. Plans for Tabulation and Publication and Project Time Schedule

A.17. Reason(s) Display of OMB Expiration Date is Inappropriate

A.18. Exceptions to Certification for Paperwork Reduction Act Submissions

REFERENCES

LIST OF ATTACHMENTS

1. Authorizing Legislation

B1. 60-Day Federal Register Notice

B2. Public Comment on the 60-Day Federal Register Notice and CDC Response

C. State Tobacco Control Reports that Cite National Youth Tobacco Survey Data

D. Publications from Prior Cycles of the National Youth Tobacco Survey

E1. State-level Recruitment Script for the National Youth Tobacco Survey

E2. State-level Recruitment Script for the National Youth Tobacco Survey Supplemental Document – State Letter of Invitation

F1. District-level Recruitment Script for the National Youth Tobacco Survey

F2. District-level Recruitment Script for the National Youth Tobacco Survey Supplemental Document – District Letter of Invitation

G1. School-level Recruitment Script for the National Youth Tobacco Survey

G2. School-level Recruitment Script for the National Youth Tobacco Survey Supplemental Documents – School Letter of Invitation and NYTS Fact Sheet for Schools

G3. School-level Recruitment Script for the National Youth Tobacco Survey Supplemental Documents – Letter to Agreeing Schools

H1. Data Collection Checklist for the National Youth Tobacco Survey

H2. Data Collection Checklist for the National Youth Tobacco Survey Supplemental Documents – Letter to Teachers in Participating Schools

I1. National Youth Tobacco Survey Questionnaire

I2. National Youth Tobacco Survey Questionnaire Supplemental Documents – Parental Permission Form Distribution Script

I3. National Youth Tobacco Survey Questionnaire Supplemental Documents – Parental Permission Form and Fact Sheet (English Version)

I4. National Youth Tobacco Survey Questionnaire Supplemental Documents – Parental Permission Form and Fact Sheet (Spanish Version)

I5. National Youth Tobacco Survey Questionnaire Supplemental Documents – Parental Permission Form Reminder Notice (English Version)

I6. National Youth Tobacco Survey Questionnaire Supplemental Documents – Parental Permission Form Reminder Notice (Spanish Version)

I7. National Youth Tobacco Survey Questionnaire Supplemental Documents – Questionnaire Administration Script

I8. Example: Instrument Testing Activity

J. IRB Approval Letter

K. Sample Table Shells

L. Detailed Sampling and Weighting Plan

LIST OF TABLES

Table A.12a – Estimated Annualized Burden Hours

Table A.12b – Annualized Estimated Cost to Respondents

Table A.14a – Annualized Study Cost

Table B.1a – Distribution of Schools by Urban Status and School Type

Table B.3a – Major Means of Quality Control

• Goal of the study: The NYTS electronic pilot is designed to assess the overall distribution and determinants of tobacco use behaviors among youth enrolled in grades 6-12 compared to the paper and pencil (PAPI) mode.

• Intended use of the resulting data: The purpose of the 2017 NYTS electronic pilot is to evaluate the effectiveness and efficiency of using of an electronic mode of data collection for the survey. The objective is to assess the efficiency and reliability of electronic survey data collection about national tobacco usage among youth in grades 6-12.

• Methods to be used to collect: The NYTS pilot evaluation will use the same repeat cross-sectional design as the paper and pencil NYTS. The information collection proposed in this request is similar to previous NYTS OMB-approved sampling strategy and recruitment methods (OMB No. 0920-0621; exp. 1/31/2018).

• The subpopulation to be studied: NYTS pilot is proposed to be conducted among a nationally representative sample of students in approximately 64 schools (both public and private) enrolled in grades 6-12.

• How data will be analyzed: Data will be compared to the paper-based survey results. The primary purpose of the NYTS electronic pilot evaluation is to assess the use of an electronic device to administer the survey.

OVERVIEW

CDC requests OMB approval for one year to conduct a pilot evaluation of an electronic mode of administration of the National Youth Tobacco Survey (NYTS). This Pilot is an electronic-based version of the NYTS previously administered via paper and pencil (PAPI) by CDC in 2004, 2006, 2009, and on an annual basis for years 2011-2016. The most recent OMB approval was for NYTS information collection in 2015, 2016, and 2017 (“2015 - 2017 National Youth Tobacco Survey (NYTS),” OMB no. 0920-0621, exp. 1/31/2018).

The need to test an electronic version of the NYTS has been prompted by the introduction of technology in survey administration, the adaptability of technology by students, and the potential gain in efficiency and effectiveness of data collection, analyses and dissemination of findings along with a potential cost-savings by using modern technology. The pilot evaluation will be used to better understand how an electronic mode could be used in the future to administer surveys to students. The NYTS pilot evaluation will use the same repeat cross-sectional design as the paper and pencil NYTS to develop national estimates of tobacco use behaviors and exposure to pro- and anti-tobacco influences among students enrolled in grades 6-12. The estimated burden per response will be 35 minutes.

A. JUSTIFICATION

A.1 CIRCUMSTANCES MAKING THE COLLECTION OF INFORMATION NECESSARY

This statement supports a request to obtain approval for a new information collection request to conduct the school-based National Youth Tobacco Survey (NYTS) Pilot for one year. The NYTS electronic pilot is designed to assess overall distribution and determinants of tobacco use behaviors among youth enrolled in grades 6-12 compared to the paper and pencil National Youth Tobacco Survey. The justification for the NYTS electronic pilot is based on five factors of comparison with the paper NYTS: (1) assessing respondent burden; 2) understanding reliability and efficiencies of electronic mode data collection; (3) assessing reliability and validity of survey results obtained from electronic data; (4) assessing cost-effectiveness of electronic administration; and (5) measuring the length of time between data collection and dissemination of findings.

CDC is responsible for administering the NYTS. Data previously collected from NYTS have been used to inform and evaluate the National Comprehensive Tobacco Control Program; inform progress towards achieving Healthy People 2020 objectives related to tobacco and youth; provide data to inform the Department of Health and Human Service’s Tobacco Control Strategic Action Plan, and provide national and state-level benchmark data for Youth Tobacco Surveys and for international comparison through the Global Youth Tobacco Survey. CDC is also responsible for leading and coordinating national strategic efforts aimed at preventing tobacco initiation, promoting tobacco cessation, protecting nonsmokers from secondhand smoke, and eliminating tobacco-related health disparities. A comprehensive tobacco control program must have surveillance and evaluation systems to track and document a wide range of short-term, intermediate, and long-term intervention outcomes in the population, the data from which can inform public health policy efforts, as well as demonstrate programmatic and fiscal accountability (CDC, 2014a). CDC wishes to understand the impact, validity, and efficiencies of switching to an electronic mode of data collection for the NYTS.

The objective of this survey is to assess the efficiency and reliability of electronic survey data collection about national tobacco usage among youth in grades 6-12. By using a computer-assisted self-interview approach, the survey can incorporate automated collection techniques, conditional ‘skip logic’ routing, and adaptive survey design in an efficient and reliable mode which minimizes respondent burden. In addition, we aim to understand if this pilot meets expectations of students for survey data collection given the increased use of technology in the classroom. Participating students will complete the survey in person in a classroom setting. Findings from the electronic data will be compared to the paper-based survey results.

The NYTS pilot will provide increased understanding of the effects of using a computer-assisted self-interview to measure knowledge, attitudes, perceptions and behaviors related to multiple tobacco products (cigarettes, cigars, etc.). The pilot electronic administration is essential to the future design, implementation, and evaluation of comprehensive youth tobacco prevention and control programs by a variety of federal, state, and local stakeholders.

CDC requests OMB approval to conduct the NYTS electronic pilot in 2017. The NYTS is conducted in a school-based setting. Respondents are students in grades 6-12.

A.2 PURPOSE AND USE OF INFORMATION COLLECTION

The primary purpose of the NYTS electronic pilot evaluation is to assess the use of an electronic device to administer the survey.

The specific aims of the electronic survey are to:

1. Assess respondent burden of electronic administration compared to PAPI mode.

2. Compare the administration of the electronic survey mode to the PAPI mode to compare reliability and efficiencies.

3. Understand overall validity in results of using an electronic mode.

4. Better understand perceptions of students’ confidentiality when using an electronic mode of collection.

5. Test for efficiencies and challenges to efficiencies in cost, data validation, and turnaround time in the dissemination of results.
   
   

CDC’s Office on Smoking and Health will use the results of the NYTS electronic pilot to test the practical considerations of administering the NYTS via an electronic device. Results will also be used to help guide evaluate the impact of automated collection techniques and electronic survey administration on response burden.

There is currently very little up to date information available on validity, and efficiencies in using an electronic device mode of data collection in schools. Several government agencies will be interested in the results of the Pilot survey as they will help inform some of their own thinking around data collection in schools.

The NYTS electronic survey results are of interest not only to CDC, but also to other Federal agencies and departments.

A.3 USE OF IMPROVED INFORMATION TECHNOLOGY AND BURDEN REDUCTION

To reduce burden, the NYTS methodology is transformed from the conventional paper-based survey to a sophisticated, state-of-the-art computer-based survey, which enables students to submit survey responses using hand-held computer tablets. By converting to a computer-based data collection methodology, the survey will incorporate conditional ‘skip logic’ routing and adaptive survey design in a user-friendly and intuitive interface that makes data collection as simple and efficient as possible.

A.4 EFFORTS TO IDENTIFY DUPLICATION AND USE OF SIMILAR INFORMATION

This would be first time CDC would be testing the validity and efficiency of electronic administration of NYTS. There has not been any mode administration testing done for the NYTS.

. A.5 IMPACT ON SMALL BUSINESSES OR OTHER SMALL ENTITIES

This data collection will not involve small businesses

A.6 CONSEQUENCES OF COLLECTING THE INFORMATION LESS FREQUENTLY

The Pilot version of the NYTS is only planned for one year. It is necessary to conduct the survey in the same year a PAPI NYTS will be conducted. This will allow for the greatest comparison in results.

A.7 SPECIAL CIRCUMSTANCES RELATING TO THE GUIDELINE OF 5 CFR 1320.5

This request fully complies with the regulation 5 CFR 1320.5.

A.8 COMMENTS IN RESPONSE TO THE FEDERAL REGISTER NOTICE AND EFFORTS TO CONSULT OUTSIDE THE AGENCY

A 60-day Federal Register Notice was published in the Federal Register on August 10, 2016 vol. 81, No. 154, pp. 52869-52870 (See Attachment B). CDC did not receive public comments related to this notice.

Consultations on the design, instrumentation, products, and statistical aspects of the NYTS have occurred at critical junctures during its original design and have continued since it originally received OMB clearance. The purposes of such consultations were to ensure the technical soundness and user relevance of survey results; to verify the importance, relevance, and accessibility of the information sought in the survey; to assess the clarity of instructions; and to minimize respondent burden.

Historically, the state YTS began as a questionnaire developed by and for a small group of state health departments for use in evaluating their tobacco prevention and control program expansions, funded largely by the Master Settlement Agreement. To facilitate state efforts to design, implement, and evaluate their tobacco use prevention and control programs, CDC provided technical assistance to states to enhance the relevance and decrease the respondent burden of the core YTS questionnaire. Thus, periodically, CDC met with representatives from a growing number of states to review their perceptions of the utility of data produced by the YTS, identify and remove redundancies, and identify the most relevant indicators. The core state YTS questionnaire in the summer of 1999 became the core for the first NYTS conducted in the fall of 1999. In February, 2005, CDC met with state and U.S. territory representatives to again solicit stakeholder input on the core YTS instrument.

Although Legacy was responsible for the design, instrumentation, education products, and statistical aspects of the first three cycles of NYTS, Legacy actively consulted with CDC and other partners during each survey cycle. The purpose of these consultations was to ensure the technical soundness; to verify the importance, relevance, and accessibility of the information sought in the survey; to assess the clarity of instructions; and to minimize respondent burden.

The NYTS explicitly drew on a long tradition of consultations that occurred to support other school-based data collections including the lessons derived especially to: (1) develop and implement a sampling plan that efficiently oversamples racial and ethnic minority groups; (2) optimize institutional receptiveness toward the survey and (3) effectively field an anonymous classroom-based survey that can be understood readily by respondents. Consultations were conducted in August 2015 with:

• Bill Ward, Senior Research Scientist Assessments Division: National Assessment Branch, National Center for Education Statistics; [email protected]

• Roberta Woods, Assessment Division Webmaster Assessments Division Administrative Support Services Branch, National Center for Education Statistics: [email protected]

A.9 EXPLANATION OF ANY PAYMENT OR GIFT TO RESPONDENTS

Schools will be given $500 in appreciation for their participation in NYTS electronic pilot. This is the same amount as the NYTS paper version for 2017. No payments will be offered or made to student respondents. OMB first suggested that CDC offer school incentives on school-based surveys as a means of improving school response rates and, thereby, improving the generalizability of results. Increasingly in recent years, school-based data collections, most of which do not fall under OMB review, have offered financial incentives to increase or maintain school participation rates. CDC believes that offering school incentives helps maintain, or slightly increase, school participation rates despite the growing number of competing, non-instructional demands placed on schools, including standardized testing.

A.10 ASSURANCE OF CONFIDENTIALITY PROVIDED TO RESPONDENTS

During recruitment, districts and schools will be informed that anonymity will be maintained throughout data collection, that all data will be safeguarded closely, and that no institutional or individual identifiers will be used in study reports. Anonymity will be promised to students and their parents on the parental permission forms. Additionally, at the start of the survey administration sessions, professionally trained NYTS electronic pilot data collectors will remind students that their responses will be captured anonymously (Questionnaire Administration Script, Attachment I7). At the conclusion of the survey administration session, students will be instructed to hand their tablet to the data collector. The students’ data will immediately be uploaded to the cloud database and erased from the tablet.

This data collection has received IRB approval from the CDC Human Research Protection Office. This approval is noted on the parental permission forms. The current NYTS IRB Approval Letter is in Attachment J.

Privacy Impact Assessment Information

The NYTS electronic pilot will select a representative sample that will support national estimates by grade, public/private school type, and size of school for students enrolled in grades 6-12. The design will further support separate estimates of the prevalence rates of tobacco use among students by school level (middle and high school) type, grade, and size. The procedures for stratification and sample selection are consistency with those from previous cycles of NYTS.

The PAPI sample design vendor will impose a school size threshold as an additional criterion for eligibility. By removing the frame those schools with an aggregate enrollment of less than 25 students across eligible grades, we can improve efficiency and safeguard privacy.

The NYTS electronic pilot takes about 35 minutes to complete. No personal identifiable information is collected in the survey (e.g., student name, class, school, etc.).

On the day of the survey, the data collector will bring all materials needed to conduct the survey. The data collector will work with the respective classroom teacher to determine which students have completed the necessary parental permission form process (using the Data Collection Checklist), and consequently are eligible to take the survey.

After the survey is completed, students will be instructed to return the tablet to the data collector. The data will be immediately uploaded to the cloud database and deleted from the tablet. As the NYTS electronic pilot administration is completed in each selected class, the classroom-specific tablet will be stored in a school-specific box labeled with a school identification number (for weighting purposes only). Sealed school boxes will be transmitted by the NYTS electronic pilot trained data collector to the data collection contractor’s survey processing center.

The 2017 NYTS electronic pilot will be a web based questionnaire delivered on a tablet consisting of 88 questions on a variety of tobacco related topics (Attachment I1). The questions are identical to the existing, approved NYTS questions currently administered using the paper-based method. The questions include prevalence of tobacco product use, knowledge and attitudes, media and advertising, exposure to secondhand smoke, minors’ access and enforcement, school curriculum, and cessation.

Students who have obtained parental permission to participate, and are in classrooms selected to participate, will be asked to report about their tobacco use behaviors and behavioral determinants on the tablet.

All selected schools, students, and their parents will be informed that anonymity will be maintained throughout data collection, that all data will be safeguarded closely, and that no institutional or individual identifiers will be used in study reports. Anonymity will be promised to students and their parents on parental permission forms. Students will be reminded that their responses are anonymous at the start of the survey administration session by a professionally trained NYTS electronic pilot data collector.

All contractor staff involved with the project are required to sign a non-disclosure, intellectual property, non-competition and non-solicitation agreement which is a statement of personal commitment to safeguard data obtained.

Data collected from school administrators during recruitment is information that is already available in the public domain; school administrators will not provide personal information. The data collected on the NYTS electronic pilot are not identifiable.

As a means to monitor the parental permission form process and to ensure surveys are completed only by students for whom permission has been obtained, teachers are asked to enter student names on the Data Collection Checklist (similar to a class roll) (Appendix H1). Teachers can substitute any other information in place of student names (such as student ID numbers or letters) on the Data Collection Checklist as long as it will allow them to individually determine which students received parental permission to participate. This information will be conveyed to the data collector on the survey administration day.

The Data Collection Checklist is an optional tool to assist in managing the parental permission and student assent process. It will be destroyed at the end of the study. No individually identifiable information is collected on the NYTS electronic pilot survey (e.g., student name, class, school, etc.), therefore there is no way to connect students’ names to their response data.

Participation in the NYTS electronic pilot should pose little or no effect on the respondent’s privacy.

No individually identifiable information is collected on the NYTS electronic pilot survey (e.g., student name, class, school, etc.), therefore there is no way to connect students’ names to their response data.

For the NYTS electronic pilot, participation is voluntary and respondents will be assured that there is no penalty if they decide not to respond, either to the information collection as a whole or to any particular question.

Although teachers are asked to record student names or another identifier on the Data Collection Checklist (Attachment H1), this information is only used to manage the parental permission and student assent process. Consent to record and provide this information to the CDC or data collection contractor will not be sought. The Data Collection Checklist will be destroyed at the end of the study.

At each school, local procedures for sending home parental permission forms will be followed. Schools will be asked to ensure permission forms are distributed at least 7 days before the survey administration. Teachers track the return of parental permission forms on the Data Collection Checklist to ensure that only students with parental permission participate. A waiver of written student assent was obtained for the participation of children because this research presents no more than minimal risk to subjects, parental permission is required for participation, the waiver will not adversely affect the rights and welfare of the students because they are free to decline to take part, and it is thought that some students may perceive they are not anonymous if they are required to provide stated assent and sign a consent/assent document. Students are told “Participating in this survey is voluntary and your grade in this class will not be affected, whether or not you answer the questions.” Completion of the survey implies student assent.

CDC’s authorized data collection contractor has several security procedures in place to safeguard data. Data that are collected at school remain under the exclusive control of the contractor’s field staff until they are shipped to the contractor’s survey processing center. School personnel are not responsible for collecting and storing any data. The tablets will be stored in a locked file room (within a secured facility), accessible only to staff directly involved in the project. All electronic data will be stored on secured servers and will be accessible only to staff directly involved in the project.

Staff in the CDC Information Collection Review Office have reviewed this application and have determined that the Privacy Act does not apply. No identifying information will be retained in the data record that would enable an individual survey to be tracked back to a particular student.

A.11 JUSTIFICATION FOR SENSITIVE QUESTIONS

Seventy-four of the 88 questions on the NYTS electronic pilot are specific to tobacco-related issues (Attachment I1). Those pertaining to actual tobacco use, especially when asked of underage children, may be considered sensitive by some parents, students, or the school community. However, because getting accurate information on this topic is critical, the NYTS electronic pilot questionnaire must contain these sensitive questions. During the past 25 years, one of the primary responsibilities of CDC has been to monitor priority risk behaviors among youth. To monitor such behaviors, CDC must ask youth about them. Students are told in the instructions to the NYTS electronic pilot (Attachment I7) that “In order to help develop better education programs, educators and health officials must collect comprehensive data on the attitudes, knowledge, and behaviors of middle and high school students (grades 6‑12) with respect to tobacco, and on other influences that might make a youth susceptible to tobacco use in the future.” Students also are instructed to read the front cover of the questionnaire booklet which states, “This survey is about tobacco. We would like to know about you and the things you do that may affect your health. Your answers will be used for programs for young people like yourself.”

The remaining seven questions are demographic factors, two of which ask about race and ethnicity, and two of which are mandatory questions from Department of Health and Human Services Office on Minority Health. OMB considers questions about race and ethnicity to be sensitive. On October 30, 1997, the Office of Management and Budget (OMB) published "Standards for Maintaining, Collecting, and Presenting Federal Data on Race and Ethnicity" (Federal Register, 62 FR 58781 - 58790). The 1997 standards reflect a change in data collection policy, making it possible for Federal agencies to collect information that reflects the increasing diversity of the U.S. population stemming from growth in interracial marriages and immigration. Under this policy, federal agencies are required to offer respondents the option of selecting one or more race responses from a list of five designated racial categories. Additionally, the standards provide for the collection of data on whether or not a person is of "Hispanic or Latino" culture or origin. Such standards also foster comparability across data collections carried out by various agencies. The race and ethnicity questions in the NYTS electronic pilot follow all guidelines for the development of data collection questions, formats, and associated procedures to implement the 1997 standards.

The questions were developed in close cooperation with representatives from school systems across the nation and are presented in a straightforward and sensitive manner. Parental permission to participate in the NYTS electronic pilot will be obtained.

A.12 ESTIMATES OF ANNUALIZED BURDEN HOURS AND COSTS

Federal tobacco control and surveillance activities must adapt to a dynamic product environment. From time to time, CDC may modify instrument content to reflect changes in the federal government’s need for information to inform public health and regulatory activities. These modifications will be submitted to OMB through the Change Request mechanism.

Before requesting OMB approval of changes to the NYTS electronic pilot questionnaire, CDC may also conduct (i) cognitive testing of new questions, (ii) cognitive testing of proposed changes in the wording of, or response options associated with individual questions, and/or (iii) pre-testing of the NYTS electronic pilot as a whole, to ensure that burden per response remains compatible with administration in one class period. Detailed descriptions of these information collections will also be submitted to OMB under the Change Request mechanism.

The estimated burden for this information collection is based on over 10 years of experience conducting the NYTS. The planned information collection involves administration of the NYTS electronic pilot questionnaire (Attachment I1) to independent samples of students in the spring of 2017. Respondents include state-level, district-level, and school-level administrators who provide information in the Recruitment Scripts for the NYTS (Attachments E1, F1, and G1), teachers who complete the Data Collection Checklist for the NYTS (Attachment H1).

For the 2017 pilot cycle of data collection, the total number of respondents, by type, will include: state-level administrators (n=6), district-level administrators (n=45), and school-level administrators (n=64) who provide information in the Recruitment Script for the NYTS electronic pilot; teachers (n=292) who complete the Data Collection Checklist for the NYTS electronic pilot; and students (n=6,100) who receive instructions for and complete the NYTS electronic pilot. There are no costs to respondents except their time.

The total burden estimated for the NYTS electronic pilot and associated support activities is 3,689 hours. The totals for this cycle are provided in Table 1.

Table A.12a - Estimated Annualized Burden Hours

Type of Respondent	Form Name	No. ofRespondents	No. of Responses per Respondent	Average Burden Per Response (In Hours)	Total Burden (In Hours)
State Administrators	State-level Recruitment Script for the National Youth Tobacco Survey	6	1	30/60	3
District Administrators	District-level Recruitment Script for the National Youth Tobacco Survey	45	1	30/60	23
School Administrators	School-level Recruitment Script for the National Youth Tobacco Survey	64	1	30/60	32
Teachers	Data Collection Checklist for the National Youth Tobacco Survey	292	1	15/60	73
Students	National Youth Tobacco Survey	6,100	1	35/60	3,558
	Total				3,689

There are no direct costs to the respondents themselves or to participating schools. However, the cost for administrators, teachers, and students can be calculated in terms of their time. In each category, the estimated respondent burden hours have been multiplied by an estimated average hourly salary for persons in that category. The U.S. Bureau of Labor Statistics is the source for hourly wages (http://www.bls.gov/oes/current/oes_nat.htm) (U.S. Bureau of Labor Statistics, 2014). The estimated burden cost in terms of the value of time students spend in responding are based on a minimum wage for students aged less than 20 years of $4.25/hour. The total estimated respondent burden cost for conducting the 2017 NYTS is $80,944.

Table A.12b - Estimated Annualized Burden Costs

Type of Respondent	Form Name	No. of Respondents	No. of Responses per Respondent	Average Burden Per Response (In Hours)	Hourly Wage Rate	Total Respondent Costs
State Administrators	State-level Recruitment Script for the National Youth Tobacco Survey	6	1	30/60	$43.36	$130.08
District Administrators	District-level Recruitment Script for the National Youth Tobacco Survey	45	1	30/60	$58.18	$1,309.05
School Administrators	School-level Recruitment Script for the National Youth Tobacco Survey	64	1	30/60	$43.59	$1,394.88
Teachers	Data Collection Checklist for the National Youth Tobacco Survey	292	1	15/60	$27.55	$2,011.15
Students	National Youth Tobacco Survey	6,100	1	35/60	$4.25	$15,122.92
	Total					$19,968.08

A.13. ESTIMATES OF OTHER TOTAL ANNUAL COST BURDEN TO RESPONDENTS OR RECORD KEEPERS

There will be no respondent capital and maintenance costs. All capital and start-up costs including, but not limited to sampling, record maintenance, and information collection are included in the annualized costs to the government (see section A.14).

A.14. ANNUALIZED COSTS TO THE GOVERNMENT

The study is funded under Contract No. GS-23F-9777H. The total contract award to Deloitte Consulting to conduct the 2017 NYTS electronic pilot is $­­­­893,303. These costs cover the activities in Table 3 below. Some activities will be conducted during the pre-clearance period and others will occur post-clearance.

Additional costs will be incurred indirectly by the government in personnel costs of staff involved in oversight of the study and in conducting data analysis. It is estimated that two CDC employees will be involved for approximately 20% and 35% of their time (for federal personnel 100% time = 2,080 hours annually) at salaries of $58.09 and $46.43 per hour, respectively. The direct annual costs in CDC staff time will be approximately $24,248 + $33,915 = $58,163 annually. The total estimated annualized cost for the study, including the contract cost and federal government personnel cost, is $951,466.

Table A,14a - Annualized Study Cost

Activity	Cost
Contract Costs
Core Team Labor – Planning, Training, Evaluation	$476,125
Dedicated Data Collection Teams	$230,400
Travel – Data Collection	$86,778
Computer Tablet/Licensing	$60,000
School Compensation for Survey Completion	$25,000
Tablet Logistics	$15,000
Subtotal	$893,303
Federal Employee Time Cost
20% time for one FTE	$24,248
35% time for one FTE	$33,915
Subtotal	$58,163
Total Estimated Annualized Cost to the Federal Government	$951,466

*Components may not sum to this figure due to rounding.

A.15. EXPLANATION FOR PROGRAM CHANGES OR ADJUSTMENTS

This is a new data/information collection.

A. 16. PLANS FOR TABULATION AND PUBLICATION AND PROJECT TIME SCHEDULE

Data will be tabulated in ways that will address the principal research purposes outlined in A.2. The planned analyses to be conducted are described briefly below:

1. Estimate the prevalence of tobacco use behaviors and behavioral determinants among middle and high school students overall and by sex, grade in school, and race/ethnicity--Descriptive statistics (percentages and confidence intervals) will be calculated to address this objective.

2. Assess whether tobacco use behaviors and behavioral determinants vary by sex, grade in school, and race/ethnicity--Cross tabulations, Chi-squared analyses, and regression analysis initially will be conducted to address this objective.

3. Determine the associations between tobacco use behaviors and behavioral determinants –Chi-squared and logistic regression analyses will be used.

4. Describe trends in tobacco use behaviors and behavioral determinants among middle and high school students overall and by sex, grade in school, and race/ethnicity--Multiple regression analyses that controls for sex, grade in school, and race/ethnicity and that simultaneously assesses linear and higher order time effects will be used.

5. Examine the effects of schools and local areas (school districts or PSUs) in estimating the prevalence of tobacco use-- multilevel models will be used.

Examples of the table shells that will be completed through analysis of the data are in Attachment K.

CDC’s publication of data from prior cycles of NYTS was largely limited to the MMWR. The 2000 YTS and NYTS data and 2001-2002 YTS and NYTS data were published as MMWR Surveillance Summaries (CDC, 2001). Selected results from the 2004 NYTS were reported in an MMWR weekly article (CDC, 2005). Another weekly MMWR article published in 2009 presented NYTS data on cigarette brand preference among middle and high school students who are established smokers also were published (CDC, 2009). Trend analyses on the use of tobacco by middle and high schools students from 2000-2009 was cited in a special MMWR published in August of 2010 (CDC, 2010). Updated data on current tobacco use among middle and high school students was published in a weekly MMWR summary in 2012 (CDC, 2012a). Two weekly MMWRs were published in 2013 describing e-cigarette use among middle and high school students (CDC, 2013a) and another report provided an overview of all tobacco product use among this population (CDC, 2013b). CDC will continue to publish NYTS results initially through the MMWR, which will be distributed to other Federal agencies, state and local health and education agencies, national health and education organizations, universities, and the general public. Additionally, NYTS results and a public use data set are available on the CDC web site at: http://www.cdc.gov/tobacco/data_statistics/surveys/NYTS/index.htm.

CDC and FDA also have released NYTS results through a variety of government publications, websites, peer-reviewed scientific journals, and annual conferences of national organizations focused on tobacco use, prevention and control, preventive medicine, public health, adolescent health, and epidemiology. A recent supplement was published in the American Journal of Preventive Medicine, with eight research articles co-authored by CDC and FDA describing new findings from the 2012 NYTS. An article was published in JAMA Pediatrics (Dutra & Glantz, 2014) to examine e-cigarette use and conventional cigarette smoking. In addition, data from the NYTS from 2000 through 2012 were used to assess patterns and trends of current tobacco use (cigarettes, cigars, and other tobacco products) among U.S. high school students (Arrazola et al., 2013). CDC hosted a podcast summarizing data on the popularity of emerging tobacco products, including e-cigarettes, among middle and high school students (Arrazola, R.A., 2013).

For the Pilot version of the survey, the results of the comparison to the PAPI NYTS will likely be a focus of publication efforts. The nature of the comparison will likely be of interest to a number of survey specialty groups.

The following represents our proposed schedule of activities for the NYTS, in terms of months after receipt of OMB clearance. The end date for data collection is constrained by the dates on which schools close for the summer. In addition, given that some twelfth grade students may be absent during the final weeks of the school year, it is highly desirable to complete data collection two months before schools close for the summer; i.e., by the end of March.

Key project dates will occur during the following time periods for the 2017 data collection:

Activity	Time Period
Recruit and schedule schools	1 to 3 months after OMB clearance
Pre-install survey software on computer tablets	1 to 2 months after OMB clearance
Train field data collectors	2 months after OMB clearance
Collect data	2 to 5 months after OMB clearance
Process data	3 to 6 months after OMB clearance
Weight/clean data	7 to 8 months after OMB clearance
Produce data file with documentation	9 months after OMB clearance
Analyze data	10 to 11 months after OMB clearance
Publish results	15 to 17 months after OMB clearance

Data collection is currently scheduled to occur during January through March, 2015. The time schedule for the 2017 and 2018 data collection will be analogous to that of the 2015 data collection. Results will be published in early 2018 initially in the MMWR, and subsequently in other publications.

A.17. REASON(S) DISPLAY OF OMB EXPIRATION DATE IS INAPPROPRIATE

The display of the OMB expiration date is not inappropriate.

A.18. EXCEPTIONS TO CERTIFICATION FOR PAPERWORK REDUCTION ACT SUBMISSIONS

There are no exceptions to the certification.

REFERENCES

American Cancer Society (2013a). Cancer Prevention & Early Detection: Facts and Figures 2013. Atlanta, GA: American Cancer Society, 2013.

American Cancer Society (2013b). Child and Teen Tobacco Use. Atlanta, GA: American Cancer Society.

American Cancer Society (2013c). Smokeless Tobacco: Who Uses Smokeless Tobacco? Retrieved from http://www.cancer.org/cancer/cancercauses/tobaccocancer/smokeless-tobacco

American Legacy Foundation (2000a). Cigarette Smoking Among Youth: Results from the 1999 National Youth Tobacco Survey. First Look Report 1. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2000b). Pathways to Established Smoking: Results from the 1999 National Youth Tobacco Survey. First Look Report 3. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2000c). The Relationship Between Cigarette Use and Other Tobacco Products: Results from the National Youth Tobacco Survey. First Look Report 4. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2000d). What Youth Think About Smoking: Results from the 1999 National Youth Tobacco Survey. First Look Report 2. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2000e). Youth Access to Cigarettes: Results from the 1999 National Youth Tobacco Survey. First Look Report 5. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2001a). Cigarette Smoking Among Youth: Results from the 2000 National Youth Tobacco Survey. First Look Report 7. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2001b). Youth Exposure to Environmental Tobacco Smoke. First Look Report 6. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2002). Using Multiple Strategies in Tobacco Use Prevention Education. First Look Report 8. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2003a). The Relationship between Cigarette Use and Other Tobacco Products: Results from the 2000 National Youth Tobacco Survey. First Look Report 10. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2003b). Youth Tobacco Cessation: Results from the 2000 National Youth Tobacco Survey. First Look Report 11. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2004). Cigarette Smoking among Youth: Results from the 2002 National Youth Tobacco Survey. First Look Report 13. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2005). Beyond Cigarettes: The Use Of Other Tobacco Products. First Look Report 15. Washington, DC: American Legacy Foundation.

American Legacy Foundation (2012). Tobacco Fact Sheet: Cigars, Cigarillos, and Little Cigars. Retrieved from http://www.legacyforhealth.org/content/download/642/7502/version/2/file/Fact_Sheet-Cigars_Cigarillos_LittleCigars.pdf

American Medical Association (2006). 2006 Annual Tobacco Report. Retried from http://www.ama-assn.org/ama1/pub/upload/mm/471/bot15A06.doc

Appleyard, J., Messeri, P., & Haviland, D. (2001). Smoking among Asian American and Hawaiian/Pacific Islander youth: new data from the 2000 National Youth Tobacco Survey. Asian American Pacific Islander Journal of Health, 9(1), 5-14.

Apelberg,B., Backinger, C., Curry, S. (2014). Enhancing Youth Tobacco Surveillance to Inform Tobacco Product Regulation American Journal of Preventive Medicine, Volume 47, Issue 2 , S1 - S3.

Arrazola, R.A. (2013, November 21). Young Smokers. Centers for Disease Control and Prevention. Podcast retrieved from http://www2c.cdc.gov/podcasts/player.asp?f=8630364

Arrazola, R.A., Kuiper, N.M., & Dube, S.R. (2013). Patterns of Current Use of Tobacco Products Among U.S. High School Students for 2000-2012-Findings From the National Youth Tobacco Survey. Journal of Adolescent Health, 54(1), 54-60. http://dx.doi.org/10.1016/j.jadohealth.2013.08.003.

Asian Pacific Partners for Empowerment and Leadership (2000). Critical Policy Issues on Tobacco Prevention and Control for the Asian American and Pacific Islander Community. The Robert Wood Johnson Foundation.

Asian Pacific Partners for Empowerment and Leadership (2002). Making Tobacco Relevant for Asian American and Pacific Islander Communities. The Robert Wood Johnson Foundation, Centers for Disease Control and Prevention, Office on Smoking and Health, Campaign for Tobacco-Free Kids.

Aslam, N. & Bushra, R. (2010). Active Smoking in Adolescents of Karachi, Pakistan. Oman Medical Journal, 25(2), 142.

CDC (2001). Youth Tobacco Surveillance–United States, 2000. MMWR; 50(SS-4).

CDC (2005). Tobacco Use, Access, and Exposure to Tobacco in Media Among Middle and High Schools Students – United States, 2004. MMWR; 54(12):297-301.

CDC (2009). Cigarette Brand Preference Among Middle and High School Students Who Are Established Smokers- United States, 2004 and 2006. MMWR; 58(05): 112-115.

CDC (2010). Tobacco Use Among Middle and High School Students—United States, 2000-2009. MMWR; 59(33):1063-1068.

CDC (2012a). Current Tobacco Use Among Middle and High School Students – United States, 2011. MMWR; 61(31): 581-585.

CDC (2012b). National Youth Tobacco Survey. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention. Available at http://www.cdc.gov/tobacco/data_statistics/surveys/nyts.

CDC (2013a). Notes from the field: Electronic cigarette use among middle and high school students—United States, 2011-2012. Morbidity and Mortality Weekly Report; 62(35), 729–730.

CDC (2013b). Tobacco Product Use Among Middle and High School Students- United States, 2011 and 2012. Morbidity and Mortality Weekly Report; 62(45), 893-897.

CDC (2013c). Winnable Battles Progress Report- 2010-2015. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention.

CDC (2014a). Best Practices for Comprehensive Tobacco Control Programs – 2014. Atlanta, GA: U.S. Department of Health and Human Services, CDC, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health.

CDC (2014b). Budget Request Summary- Fiscal Year 2015. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention.

CDC (2014c). Winnable Battles. Retrieved from http://www.cdc.gov/winnablebattles/

CDC (2014d). Annual Performance Report and Performance Plan- Fiscal Year 2014. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention.

Dutra, L.M. & Glantz, S.A. (2014). Electronic Cigarettes and Conventional Cigarette Use Among US Adolescents: A Cross-sectional Study. JAMA Pediatrics, published online March 06, 2014. doi:10.1001/jamapediatrics.2013.5488.

FDA (2014). FDA Proposes to Extend Its Tobacco Authority to Additional Tobacco Products, including e-cigarettes. FDA NEWS RELEASE. N.p., 24 Apr. 2014. Web. 9 May 2014. http://www.fda.gov/newsevents/newsroom/pressannouncements/ucm394667.htm

Frieden, T.R. (2010). A framework for public health action: The health impact pyramid. American Journal of Public Health, 100(4), 590-595.

Institute of Medicine (2011). Leading Health Indicators for Healthy People 2020: Letter Report. Washington, DC: The National Academies Press.

Lee S., Grana R.A., & Glantz, S.A. (2013). Electronic Cigarette Use Among Korean Adolescents: A Cross-Sectional Study of Market Penetration, Dual Use, and Relationship to Quit Attempts and Former Smoking. Published online November 25, 2013. Journal of Adolescent Health. doi:10.1016/j.jadohealth.2013.11.003.

Martin-Pujol, A., Fernandez, E., Schiaffino, A., Moncada, A., Ariza, C., Blanch, C., Martinez-Sanchez J.M., & the RESPIR-NET research group. (2013). Tobacco smoking, exposure to second-hand smoke, and asthma and wheezing in schoolchildren: a cross-sectional study. Acta Pediatric, 102(7), 305-309.

National Institute on Drug Abuse (2003). Youths’ Opportunities to Experiment Influence Later Use of Illegal Drugs. National Institute on Drug Abuse, 17(5).

National Institute on Drug Abuse (2014). Monitoring the Future national results on drug use: 1975-2013: Overview, Key Findings on Adolescent Drug Use. National Institute on Drug Abuse, National Institutes of Health. Ann Arbor, MI: Institute for Social Research, The University of Michigan.

Neergaard, J., Singh, P., Job, J., & Montgomery, S. (2007). Waterpipe smoking and nicotine exposure: A review of the current evidence. Nicotine and Tobacco Research, 9(10), 987–994.

Richardson, A., He, J.P., Curry, L., & Merikangas, K. (2012). Cigarette smoking and mood disorders in U.S. adolescents: Sex-specific associations with symptoms, diagnoses, impairment and health services use. Journal of Psychosomatic Research, 72(4), 269-275.

Shelley, D., Cantrell, J., Faulkner, D., Haviland, L., Healton, C., & Messeri, P. (2005). Physician and Dentist Tobacco use Counseling and Adolescent Smoking Behavior: Results from the 2000 National Youth Tobacco Survey. Pediatrics, 115(3), 719-725. American Legacy Foundation.

Singh T, Arrazola RA, Corey CG, et al. Tobacco Use Among Middle and High School Students — United States, 2011–2015. MMWR Morb Mortal Wkly Rep 2016;65:361–367

Smith, J.R., Novotny, T.E., Edland, S.D., Hofstetter, C.R., Lindsay, S.P., & Al-Delaimy, W.K. (2011). Determinants of Hookah Use among High School Students. Nicotine and Tobacco Research, (13)7, 565-572.

Starr, G., Rogers, T., Schooley, M., Porter, S., Wiesen, E., & Jamison, N. (2005). Key outcome indicators for evaluating comprehensive tobacco control programs. Atlanta, GA: Centers for Diesease Control and Prevention.

The University of California (2012). Tobacco Use among Asian American, Native Hawaiian and Pacific Islander Communities in California. The California Cancer Research Fund.

U.S. Bureau of Labor Statistics (2014). May 2013 National Occupational Employment and Wage Estimates, United States. Retrieved from http://www.bls.gov/oes/current/oes_nat.htm

Upadhyaya, H.P., Deas, D.D., Brady, K.T., & Kruesi, M. (2002). Cigarette smoking and psychiatric comorbidity in children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 41(11), 1294-1305.

USDHHS (2010a). How Tobacco Smoke Causes Disease: The Biology and Behavioral Basis for Smoking-Attributable Disease: A Report of the Surgeon General. Atlanta, GA: U.S. Department of Health and Human Service, Public Health Service, CDC, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health, 2010.

USDHHS (2010b). Healthy People 2020. Washington, D.C.: U.S. Department of Health and Human Services. Available at: http://healthypeople.gov/2020/default.aspx

USDHHS (2012a). Ending the Tobacco Epidemic: Progress toward a Healthier Nation. Washington, DC: US Department of Health and Human Services, Office of the Assistant Secretary for Health.

USDHHS (2012b). Preventing Tobacco Use Among Youth and Young Adults: A Report of the Surgeon General. Atlanta, GA: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health.

USDHHS (2014). The Health Consequences of Smoking- 50 years of Progress: A Report of the Surgeon General. Atlanta, GA: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health.

USDHHS, HRSA (2004). Promising Practices in MCH Needs Assessment: A Guide Based on a National Study. U.S. Department of Health and Human Services, Health Resources and Services Administration.

USDHHS, NIH, & NCI (2007). NCI’s President’s Cancer Panel 2006-2007 Annual Report: Promoting Healthy Lifestyles: Policy, Program, and Personal Recommendations for Reducing Cancer Risk. U.S. Department of Health and Human Services, National Institutes of Health, National Cancer Institute.

USDHHS, NIH, & NIDA (2007). Director’s Report to the National Advisory Council on Drug Abuse. U.S. Department of Health and Human Services, National Institutes of Health, National Institute on Drug Abuse.

7