Information Collection Request
New
National Tobacco Education Campaign
Rough-Cut Testing of Television, Radio, Print, and Digital Advertisements
(OMB No. 0920-0910)
Supporting Statement: Part A
Program Official/Contact
Michelle O’Hegarty, PhD
Office on Smoking and Health
National Center for Chronic Disease Prevention and Health Promotion
Centers for Disease Control and Prevention
4770 Buford Highway, NE MS F-79
Atlanta, Georgia 30341
770-488-5582
FAX: 770-488-5939
Email: [email protected]
May 7, 2019
TABLE OF CONTENTS
JUSTIFICATION
1. Circumstances Making the Collection of Information Necessary
2. Purpose and Use of Information Collection
3. Use of Improved Information Technology and Burden Reduction
4. Efforts to Identify Duplication and Use of Similar Information
5. Impact on Small Businesses or Other Small Entities
6. Consequences of Collecting the Information Less Frequently
7. Special Circumstances Relating to the Guidelines of 5 CFR 1320.5
8. Comments in Response to the Federal Register Notice & Efforts to Consult Outside Agency
9. Explanation of Any Payment or Gift to Respondents
10. Protection of the Privacy and Confidentiality of Information Provided by Respondents
11. Institutional Review Board (IRB) and Justification for Sensitive Questions
12. Estimates of Annualized Burden Hours and Costs
13. Estimates of Other Total Annual Cost Burden to Respondents and Record Keepers
14. Annualized Cost to the Federal Government
15. Explanation for Program Changes or Adjustments
16. Plans for Tabulation and Publication and Project Time Schedule
17. Reason(s) Display of OMB Expiration Date is Inappropriate
18. Exceptions to Certification for Paperwork Reduction Act Submissions
LIST OF ATTACHMENTS
Attachment 1: Online Questionnaire Email Invitation to Potential Respondents
Attachment 2: Online Questionnaire Recruitment Screener
Attachment 3: Online Questionnaire
Attachment 4: Online Questionnaire Main Screenshots
Attachment 5: Toluna Terms and Conditions
Attachment 6: Battelle Institutional Review Board Approval
Attachment 7: Toluna Privacy Policy
Notes on Excluded Attachments. In this information collection request (ICR), CDC outlines a plan to test rough-cut advertisements (ads) with content that may be considered sensitive. The draft materials are not included because the near-final, “rough-cut” ads have not been approved for public distribution by HHS/Assistant Secretary for Public Affairs (ASPA). To support adequate review of this Gen IC by OMB, the Centers for Disease Control and Prevention requests permission to provide OMB with a secure link to the draft materials.
Supporting Statement: Summary
Goal of the Proposed
Project: The
goal of this proposed project
is to test reactions to 10 rough- cut ads in television, radio,
print, and digital formats designed to encourage people who smoke
to quit. These ads will illustrate the harmful effects that
smoking-related diseases, such as heart disease, Buerger’s
disease, and chronic obstructive pulmonary disease, have on the
people who used to smoke as well as the family. Rough-cut ads are
near-final versions of ads with unedited photos, placeholder
voiceovers, etc. The resulting information will be used to refine
the rough-cut ads to develop into final ads for a future Tips
From
Former Smokers®
(Tips®)
campaign.
Intended use of the resulting data:
Once collected data is
analyzed, the results will yield information to produce clear,
credible, believable, and effective ads to motivate people who
smoke to quit smoking conventional cigarettes completely.
Methods
to be used to collect data: Quantitative
methods will be used to collect data on 10 ads. Ads
will be tested in 4 formats (television, radio, print, and
digital). There will be a total of 10 ads or 10 tests. Quantitative
data will be collected through online surveys (which include a
screener and a questionnaire) of 20,116 respondents, 16,000 of
which are expected to view ads and complete the questionnaire. The
survey will collect information about the participants’
reactions to the rough-cut ads as well as basic demographic and
tobacco use information to understand whether and how these factors
may influence individuals’ responses to these messages.
Populations to be studied: The
population will be adults who smoke cigarettes and adults who don’t
smoke, aged 18-54 years. How
data will be analyzed: The
resulting data will be analyzed using statistical techniques for
quantitative data. Data will be analyzed using aggregate measures
such as percentages and means. Analyses will focus on whether
participants’ evaluations of ad clarity, credibility,
believability, and effectiveness differ across ads. Additionally,
data from open-ended questions (e.g., about the main message of the
ad) will be analyzed qualitatively using thematic analysis.
Part A. Justification for Information Collection
While significant improvements have been made in reducing the smoking rate in the United States since the first Surgeon General’s Report came out more than 50 years ago, cigarette smoking is still the leading cause of preventable disease and death in the United States, accounting for more than 480,000 deaths every year, or one of every five deaths (U.S. Department of Health and Human Services (HHS), 2014). In addition, more than 16 million Americans live with a smoking-related disease (HHS, 2014). In 2018, the prevalence of cigarette smoking among adults was 13.7% (Creamer et al., 2019). In March 2012, the Centers for Disease Control and Prevention (CDC) launched the first-ever paid national tobacco education campaign—Tips From Former Smokers® (Tips®)1. The Tips® campaign profiles real people who are living with serious long-term health effects from smoking and secondhand smoke exposure. The primary audience is adults who smoke, ages 18 through 54. Secondary audiences include family members, health care providers, and faith communities. The goals of the Tips® campaign are to:
Build public awareness of the immediate health damage caused by smoking and exposure to secondhand smoke;
Encourage people who smoke to quit, and let them know that free help is available; and
Encourage people who smoke not to smoke around others and encourage people who don’t smoke to protect themselves and their families from exposure to secondhand smoke.
To date, the Tips® campaign has had a significant impact on cessation behaviors among U.S. adults who smoke over time because of the continued use of graphic, hard-hitting, emotional ads (Davis, Patel, Shafer et al., 2017). During 2012–2018, the campaign was associated with approximately one million sustained quits among U.S. adults who smoke, and more than 16.4 million quit attempts (Murphy-Hoefer, Davis, King, Rodes, & Beistle, 2019). The Tips® campaign has also been associated with increased knowledge of tobacco-related health risks (Huang, Thrasher, Abad et al., 2015.) In addition, during the first year of the campaign, an estimated 6 million people who don’t smoke talked with friends and family about the dangers of smoking. Furthermore, economic analysis of the campaign has shown that for every $2,000 we spend on the ads, we prevent a death (CDC, 2019). More information about the impact of the campaign can be found at cdc.gov/tipsimpact.
Given that more than 480,000 Americans still die every year, it is important to continue a national tobacco education campaign that motivates people who smoke to try to quit and lets them know that free resources are available to help them if needed. Standard accepted advertising practices include developing new ads in order to continue to motivate the audience to change their behavior. Some of the ads have been used every year since the 2012 launch. CDC, in collaboration with their contractor, The Plowshare Group, and subcontractors, Qualtrics and Battelle, will test a set of rough-cut TV, radio, print, and digital ads for a future Tips® campaign media buy.
Rough-cut testing is a standard advertising research activity used in the development of communication campaigns and is the step that immediately precedes the development of final ads. Rough-cut testing is crucial to ensuring that the ad informs the target audience of the health consequences caused by smoking cigarettes and motivates them to act (e.g., quit smoking cigarettes or talk to a loved one about the dangers of smoking cigarettes). Additionally, rough-cut testing is a way to measure any unanticipated confusion, ambiguity, or lack of understanding of the ad’s message.
The objective of the proposed project is to test rough-cut television, radio, print, and digital ads among adults who smoke and adults who don’t smoke, ages 18-54. The content in these ads is derived from the life experiences of adults who used to smoke cigarettes and their family members. Ads will be tested in 4 formats (television, radio, print, and digital). There will be a total of 10 ads or 10 tests.
Information gleaned from subpopulation analyses will inform ad development and communication channels. Ad reactions will be analyzed with the full sample, as well as between and within several subpopulations defined by smoking status, socioeconomic status (SES), and age. People who smoke will be classified as either low-SES or non-low-SES based on education, employment status, and income. Participants will be classified as low-SES people who smoke if they meet criteria for people who smoke and at least two of the following three criteria:
Have a high school education or less, or completed high school without further schooling;
Have a household income in 2019 of less than $25,000; and/or
Are currently unemployed (excluding retirees and the disabled).
Age group and SES subpopulation analyses are important to the analysis plan; they will be used to prioritize ad development and communication channels. The subpopulations of interest are as follows:
Young adults who smoke (18-26 years of age)
Young adults who do not smoke (18-26 years of age)
Older adults who smoke (27-54 years of age)
Older adults who do not smoke (27-54 years of age)
Low-SES adults who smoke (18-54 years of age)
Non-low-SES who smoke (18-54 years of age)
Stratified sampling will used to reach subpopulation recruitment goals while minimizing the number of respondents required. Recruitment targets by strata for people who smoke and people who don't smoke are detailed in Table A.1 and Table A.2.
Table A.1 Recruitment Targets for Each Ad: People Who Smoke* |
|||
Age group: 18-26 SES group: Low |
Age group: 18-26 SES group: Non-low |
Age group: 27-54 SES group: Low |
Age group: 27-54 SES group: Non-low |
200 |
200 |
200 |
200 |
* Recruitment goal per ad: 400 respondents ages 18-26 and 400 respondents ages 27-54
Table A.2 Recruitment Targets for Each Ad: People Who Do Not Smoke* |
|
Age group: 18-26 |
Age group: 27-54 |
400 |
400 |
*Recruitment goal per ad: 800 respondents ages 18-54
In order to assess how the rough-cut ads are perceived across a number of measures, including perceived effectiveness (PE) (Davis, Duke, Shafer et al., 2017), believability, comprehension, and emotional reactions, approximately 16,000 respondents will view and react to rough-cut ads that focus on the harmful effects that smoking-related diseases, such as heart disease, Buerger’s disease and chronic obstructive pulmonary disease have on people who used to smoke, as well as the family.2 Of these, 400 respondents from each subpopulation of people who smoke and 400 respondents from each subpopulation of people who don’t smoke will view each of the 10 ads. Recruitment for each stratum will close when that stratum is filled. The maximum number of respondents for each ad is 1,600 (800 + 800) and the maximum number of respondents for all ads is 16,000 (1,600 x 10). Section A.12 and Part B includes additional information on sample size calculations.
A.2 Purpose and Use of Information Collection
This proposed project is part of a collection of ICRs submitted under a dedicated generic clearance to develop campaign ads. Previous ICRs approved under this generic clearance to assist with ad development include message platform testing, creative concept testing, and rough-cut testing. For example, the program received OMB approval to test 2020 rough-cut ads on July 29, 2019 (OMB No. 0920-0910). The ads tested in July 2019 – September 2019 will air as part of the 2020 Tips® campaign. The rough-cut ads that test well with the target audience in the proposed project will be used as part of a future Tips® campaign. If this information collection is not performed, CDC will not know whether these rough-cut ads communicate credibly and effectively with the target audience. This could result in the production of ads that are not effective in encouraging people who smoke to quit.
Potential participants will be recruited from an existing, online, convenience panel managed by Toluna (see https://us.toluna.com/#/ for more detail on this panel). The panel provider maintains demographic information about panelists in its proprietary database, which is not released (see Toluna Privacy Policy, Attachment 7), and this information will be used to ensure that the invitation to participate in this project (Attachment 1) will target only individuals who are likely to be eligible. An online, project-specific screener (Attachment 2) will be used to confirm respondents’ age, state of residency, level of education, income, employment status and tobacco use behavior.
Following the screening process, eligible respondents will complete the online questionnaire (Attachment 3). The purpose of the online questionnaire is to show respondents the rough-cut ads. The questionnaire will measure demographic characteristics, tobacco use behaviors and perceptions, and reactions to the ads (e.g., PE, confusion, believability, emotional response, effect on motivation to quit smoking, etc.). Respondents will be randomized to one of the 10 rough-cut ads being tested (meaning, each respondent will see or hear only one ad). Randomization of respondents ensures that there is a similar distribution of individuals with different measured and unmeasured characteristics across ads. Overall, this is designed to have high internal validity even though external validity (i.e., generalizability) is low because of the volunteer sample. The project design is summarized in Figure A.1 and key variables are summarized in Table A.3.
Figure A.1. Diagram of Proposed Project Design, Enrollment, Allocation, and Analyses
Table A.3. Key Variables
|
A.3 Use of Improved Information Technology and Burden Reduction
During data collection, all information (from the screener and the questionnaire) will be collected electronically utilizing an integrated Web-based software platform (see Attachment 4). Web-based surveys are an especially convenient option for eliciting feedback on visual, audio, and textual stimuli such as the rough-cut ads to be tested. The use of a web-based platform also offers a number of benefits for managing the quantitative data collection:
First, use of an existing online panel will allow CDC to obtain information quickly so that needed adjustments to health messaging can be made expeditiously and campaign development can progress rapidly from planning to implementation. The panel used for this testing is very large (more than 1.7 million people in the U.S.), allowing quick selection of participants from extremely small subgroups of the population. Samples from this panel are not designed to generate nationally representative samples or precise population parameters but rather are used as a highly efficient, low cost, and low burden method of data collection for formative rough-cut testing.
Second, when a respondent enters the screener for this project, the link to his or her identifiable information is severed (i.e., the link to the identifiable information maintained by the panel provider). None of the information collected through screening or the online questionnaire is identifiable, providing a secure environment for participants.
Third, this technology permits participants to complete the instruments in private. Providing the participant with a methodology that improves privacy makes reporting of potentially embarrassing or stigmatizing behaviors (e.g., tobacco use) less threatening and enhances response validity and response rates.
Finally, the web-based software system includes embedded logic that will route respondents efficiently through the screener and onto the online questionnaire (or a “thank you” screen, if the respondent is found to be ineligible). This approach can increase participation rates (which decreases time and costs related to information collection procedures) by reducing the number of respondents needed to complete the screener in order to achieve the desired enrolled sample size (i.e., by reducing drop off between the screener and questionnaire).
Overall, the software supports an efficient assignment and routing process, as well as a smooth user experience that would be difficult to attain in other modes of data collection.
A.4 Efforts to Identify Duplication and Use of Similar Information
The U.S. Department of Health and Human Service’s Office of the Assistant Secretary for Planning and Evaluation (ASPE) has reviewed this proposed collection of information and has determined that it does not duplicate other collections. To prepare for data collection, CDC reviewed existing published literature, and unpublished qualitative pretesting reports (e.g., the findings from previous formative testing) when they were available.
CDC collaborates with other federal government agencies that sponsor or endorse health communication projects, such as FDA’s Center for Tobacco Products (CTP). Staff members in CDC’s Office on Smoking and Health work closely with staff in CTP’s Office of Health Communication and Education. Regularly scheduled conference calls are held to review plans and share research findings of mutual interest. These collaborations serve as information channels, help prevent redundancy, and promote use of consistent measures of effectiveness. Coordination activities include the review of data collection instruments and other support materials for testing purposes.
FDA CTP is investing in a number of public education campaigns aimed at youth and young adults, such as The Real Cost, Fresh Empire, and This Free Life to educate them about the dangers of regulated tobacco products.
CDC continues to share findings from its information collection efforts with CTP to ensure that message and campaign development is complementary and not duplicative.
Points of contact for this coordination are:
CDC: Brian Armour, Associate Director for Science, Office of the Associate Director for Science, telephone (404) 498-3014, email [email protected]
CDC: Elizabeth Courtney-Long, Health Scientist, Office of the Associate Director for Science, telephone (404-498-0264), email [email protected]
CDC: Diane Beistle, Chief, Health Communications Branch, telephone (770) 488-5066, email [email protected]
CDC: Lindsey McCarter, Team Lead, Campaign Development, Health Communications Branch, telephone (770) 488-4239, email [email protected]
CDC: Michelle O’Hegarty, Health Communications Specialist, Campaign Development, Health Communications Branch, telephone (770) 488-5582, email [email protected]
FDA: Matthew Walker, Lead Health Scientist, Office of Health Communication and Education, telephone (240) 402-3824, email [email protected]
FDA: Tesfa Alexander, Center for Tobacco Products, telephone (301) 796-7745, email [email protected]
FDA: Chaunetta Jones, FDA, Center for Tobacco Products, telephone (240) 402-0427, email [email protected]
FDA: Janine Delahanty, FDA, Center for Tobacco Products, telephone: (240) 402-9705, email: [email protected]
A.5 Impact on Small Business or Other Small Entities
This data collection will not involve small businesses or other small entities.
A.6 Consequences of Collecting the Information Less Frequently
This is a one-time information collection request.
A.7 Special Circumstances Relating to the Guidelines of 5 CFR 1320.5
There are no special circumstances that require data collection to be conducted in a manner inconsistent with 5 CFR 1320.5 (d) (2). The information collection fully complies with the guidelines in 5 CFR 1320.5.
A.8 Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency
A.8.a Federal Register Announcement
A Notice was published in the Federal Register on December 13, 2017, volume 82, number 238, pp. 58609-58611. No public comments about this data collection were received by CDC.
A.8.b Consultations
The Tips® campaign has been funded primarily with funds from the Affordable Care Act/Public Health Fund designated for smoking education since 2010. CDC did not consult outside of the agency on the rough-cut ads.
A.9 Explanation of Any Payments or Gift to Respondents
Participants will be drawn from the established Toluna panel system, which provides points to panelists to encourage participation (see Attachment 5: Toluna’s Terms and Conditions). Immediately upon completion of the survey, each respondent will be provided with points equivalent to $0.50. These points are accrued with other points when the panelist takes part in other surveys through the Toluna panel system. At any time, the panelist can redeem their points for different products, such as gift cards. Studies have indicated that a monetary gift can increase response rates (Church, 1993; Greenbaum, 2000; Haveman, 2010).
A.10
Protection of the Privacy and Confidentiality of Information Provided
by Respondents
This
submission has been reviewed by staff in CDC’s National Center
for Chronic Disease Prevention and Health Promotion, who determined
that the Privacy Act does not apply.
This
determination is based on the fact no personal identifiers will be
collected in this proposed project to reduce the likelihood of
identification or re-identification. CDC has contracted with The
PlowShare Group for this information collection and The PlowShare
Group’s data collection and formative research subcontractors
are Qualtrics
and Battelle. All data collected and
delivered
to CDC from The PlowShare Group’s data collection and formative
research subcontractors will be in aggregate form only. Further, the
information that will be reported to and maintained by CDC is not
considered a record as defined by the Privacy Act: it will not
include individuals’ education,
financial transactions, medical history, and criminal or employment
history and name, or the identifying number, symbol, or other
identifier assigned to any individual, such as a finger or voice
print or a photograph. Staff
from CDC, Qualtrics, and Battelle participated in planning the
information collection; staff from each will interpret data but will
not receive any Personally Identifiable Information (PII) on the
respondents. Battelle’s Institutional Review Board (IRB)
reviewed this project and determined it to be exempt (Attachment 6).
The IRB’s primary concern is protecting respondents’
rights, one of which is maintaining the privacy of
participant information to the fullest extent of the law.
Privacy and Confidentiality of Online Questionnaire System
All information for the self-administered screening process and self-administered questionnaire will be collected electronically in a secure, web-based data collection system (as described in Section A2 and Part B). The identifiable information about Toluna panelists is maintained in a proprietary records system and is not released to CDC or other contractors/subcontractors (see Attachment 7: Toluna Privacy Policy). Although demographic information (e.g., age, state of residency, socioeconomic status) and tobacco use status will be confirmed through screening, no direct personal identifiers (e.g., date of birth [including day, month, year], name, phone number, address, email address, social security number, photograph, biometric information, or any other unique identifier that can be linked to an individual) will be collected or maintained as part of the Screener or Questionnaire (Attachments 2 and 3). A system of records notice (SORN) is not required because (1) the information collected is not considered a record as defined by the Privacy Act and (2) the records are not retrieved using a personal identifier.
When the respondent begins the questionnaire, all identifiable links to the existing system of records are severed. As such, because it does not exist, CDC will not have direct contact with or access to any PII about participants during this stage. Toluna does have access to the email address of panel subscribers, but no match back is possible with the survey response data. IP addresses will not be stored by the online questionnaire system, and no first- or third-party cookies will be stored during questionnaire completion. No link between the respondent’s email and the specific survey is made after the potential respondent clicks on the link to start the survey.
Data
Security
All
findings will be reported in aggregate form only. All information
will be stored on password-protected databases to which only
Qualtrics employees working on this project have access. Qualtrics
will keep the quantitative data in non-aggregate form for six months
after information collection has been completed, and then the
respondent-level data will be deleted from the password-protected
databases. Qualtrics will provide CDC and Battelle with the
de-identified data, to be used for analyses. Only CDC, Qualtrics, and
Battelle employees involved in data analysis will have access to the
data. CDC will handle the de-identified data in accordance with the
record control schedule (maintained at least six years, but no longer
than ten years). No desktop or laptop computer will contain any PII.
To prevent unauthorized access to their data servers (such as
“hacking”), Qualtrics is currently certified and has
achieved the distinguished ISO 27001 accreditation. With this
achievement, Qualtrics’ data systems have assurance that all
data will be managed in a secure environment. This means that
Qualtrics has been formally audited and has been certified compliant
with the standard ISO 27001 accreditation. CDC will retain and
destroy records in accordance with the applicable CDC Records Control
Schedule (Table
A.4.).
Table A.4. Access Controls |
||
Technical Controls |
Physical Controls |
Administrative Controls |
|
|
|
A.11 Institutional Review Board (IRB) and Justification for Sensitive Questions
IRB Approval
All procedures have been developed in accordance with federal, state, and local guidelines to ensure that the rights and privacy of participants are protected and maintained. Battelle’s IRB has reviewed this proposed project and determined it to be exempt (Attachment 6).
Sensitive Questions
The majority of questions asked in the Online Questionnaire Recruitment Screener (Attachment 2) and Online Questionnaire (Attachment 3) will not be of a sensitive nature. There will be no requests for a respondent’s Social Security Number (SSN). Questions asked during the screening about tobacco use and some demographic information (e.g., age) could be considered sensitive, although these items would not generally be considered highly sensitive. It will also be necessary to ask some questions considered to be sensitive in order to assess individuals’ attitudes and behaviors about tobacco products and to test ads about the specific health behavior of cigarette smoking. These items are not generally considered highly sensitive either. Participants will be informed of the applicable privacy safeguards. Sensitive information will only be requested when necessary to describe sample characteristics (e.g., age). Such questions will include a “prefer not to answer” option. This proposed project also includes a number of procedures and methodological characteristics that will minimize potential negative reactions to potentially sensitive questions, including the following:
The online questionnaire is entirely self-administered and maximizes participant privacy by being conducted online, without the need to verbalize responses.
Participants will be provided with a phone number and email for the principal investigator and for the IRB, should they have any questions or concerns about the proposed project or their rights as a participant.
A.12 Estimates of Annualized Burden Hours and Costs
The 10 rough-cut ads will be tested with approximately 16,000 respondents. As described in Section A.1, each rough-cut ad will be tested with approximately 1,600 respondents for each ad. Each rough-cut ad will be viewed or listened to by approximately 800 people who smoke and 800 people who don’t smoke.
To obtain this sample size, approximately 20,116 respondents are anticipated to initiate the online screener (Attachment 2); this estimate is based on two factors from prior experiences in the field. First, it is anticipated that roughly 18 percent of screener respondents (n=3,621) will be deemed ineligible for the proposed project because of not meeting inclusion criteria. Second, of those deemed eligible (n=16,495), an estimated three percent (n=495) will start but not complete the questionnaire. Thus, 20,116 respondents are needed to obtain the sample size of 16,000.
The burden per respondent for completing the screener is two minutes. The total estimated burden for respondents who complete the screener (N=20,116) is 671 hours. The burden per respondent for completing the online questionnaire is 13 minutes. The total estimated burden for those who complete the questionnaire (n=16,000) is 3,467 hours. Those who start but do not complete the questionnaire are estimated to spend about one-half of that time (7 minutes) on the questionnaire. Thus, the total estimated burden for those who start but do not complete the online questionnaire (n=495) is 58 hours. As outlined in Table A.5., the total estimated burden for the entire project is 4,196 hours.
Table A.5. Estimated Annualized Burden to Respondents |
|||||
Type of Respondent |
Form Name |
Number of Respondents |
Number of Responses per Respondent |
Average Burden per Response (in hours) |
Total Burden (in hours) |
Adult who smoke and adults who don’t smoke who are ages 18-54 |
Online Recruitment Screener (Attachment 2) |
20,116 |
1 |
2/60 |
671 |
Online Questionnaire (Attachment 3) |
16,000 |
1 |
13/60 |
3,467 |
|
495 |
1 |
7/60 |
58 |
||
Total 4,196 |
|||||
|
The estimated cost of the time devoted to this information collection by respondents is $104,816.08 as summarized in Table A.6. To calculate this cost, we used the mean hourly wage of $24.98, which represents the Department of Labor estimated mean for state, local, and private industry earnings (Bureau of Labor Statistics, 2018). There are no direct costs to respondents associated with participation in this information collection.
Table A.6. Estimated Annualized Cost to Respondents |
|||||||
Type of Respondent |
Form Name |
Number of Respondents |
Number of Responses per Respondent |
Average Burden per Response (in hours) |
Total Burden (in hours) |
Hour Wage Rate |
Total Cost |
Adults who smoke and adults who don’t smoke who are ages 18-54 |
Online Recruitment Screener (Attachment 2) |
20,116 |
1 |
2/60 |
671 |
$24.98 |
$16,761.58 |
Online Questionnaire (Attachment 3) |
16,000 |
1 |
13/60 |
3,467 |
$24.98 |
$86,605.66 |
|
495 |
1 |
7/60 |
58 |
$24.98 |
$1,448.84 |
||
Total $104,816.08 |
A.13 Estimates of Other Annual Cost Burden to Respondents and Record Keepers
There will be no respondent capital and maintenance costs.
A.14 Annualized Cost to the Government
Approximately 6.25% of one full-time equivalent (FTE) and 1.9% of one senior manager will be required to oversee the information collection activities for one month. Responsibilities will include internal coordination and review of materials and reports and maintaining proper accounting of burden hours. The agency estimates that it will take a GS-13, at a wage rate of $58.10/hour, approximately 10 hours to manage the project, totaling about $581.00. It is estimated to take a GS-15, at a wage rate of $68.34/hour, approximately three hours to oversee the total project, totaling $205.00. The total average annualized cost to the government for CDC oversight is $786.
Contractors will conduct the majority of information collection and management activities on CDC’s behalf. The total cost of the data collection contractors is $97,000 which includes consultation, instrument design and development, respondent incentives, data collection and analysis, and final report. Qualtrics will collect the information from the participants. Activities are coordinated through a contract with The PlowShare Group, a specialist in media campaigns. The grand total cost for the project, including government and contractor cost, is $97,786.
Table A.7. Total Project Costs |
||||
Government Personnel |
Percent Time Commitment |
Hour Time Commitment |
Hourly Basic Rate |
Total |
GS-13 |
6.25% |
10 |
$58.10 |
$581 |
GS-15 |
1.9% |
3 |
$68.34 |
$205 |
Subtotal, Government Personnel Contract Costs Total Costs |
$786 |
|||
$97,000 |
||||
$97,786 |
A.15 Explanation for Program Changes or Adjustments
This is a new data collection.
A.16 Plans for Tabulation and Publication and Project Time Schedule
Data Tabulation Plans
The information will be used to inform the development of final ads for a future Tips® campaign. It is anticipated that information collection will begin May 6, 2020 so an OMB approval date of May 5, 2020 is requested. The resulting quantitative data will be analyzed using conventional tabulation techniques. These dates may be adjusted depending on the approval process of this package.
Publication and Dissemination Plans
These ads will be aired as part of future media buys. Additionally, a comprehensive formative evaluation report summarizing findings from this information collection will be provided to CDC.
Project Time Schedule
Table A.8 Project Time Schedule
Table A.8. Project Time Schedule |
|
Activity |
Time Schedule |
Email invitations sent to respondents for quantitative testing |
1-30 days after OMB approval |
Online data collection |
1-30 days after OMB approval |
Complete field work |
30-45 days after OMB approval |
Validation |
45-55 days after OMB approval |
Data analysis |
55-65 days after OMB approval |
Report writing |
65-150 days after OMB approval |
A.17 Reason(s) Display of OMB Expiration is Inappropriate
An exemption to this requirement is not being requested. The expiration date of OMB approval will be displayed on all information collection instruments.
A.18 Exceptions to Certification for Paperwork Reduction Act Submissions
There are no exceptions to the certification.
References
Bureau of Labor Statistics. (2018). May 2018 National Occupational Employment and Wage Estimates - United States. Retrieved from http://www.bls.gov/oes/current/oes_nat.htm
Centers for Disease Control and Prevention. (2019). Tips From Former Smokers®: Tips® Impact and Results. Retrieved November 25, 2019 from https://www.cdc.gov/tobacco/campaign/tips/about/impact/campaign-impact-results.html
Church, A. H. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public opinion quarterly, 57(1), 62-79.
Creamer, M.R., Wang, T.W., Babb, S., Cullen, K.A., Day, H., Willis, G. … Neff, L. (2019). Tobacco Product Use and Cessation Indicators Among Adults — United States, 2018. Morbidity and Mortality Weekly Report, 68(45), 1013-1019.
Davis, K. C., Duke, J., Shafer, P., Patel, D., Rodes, R., & Beistle, D. (2017). Perceived effectiveness of antismoking ads and association with quit attempts among smokers: Evidence from the Tips From Former Smokers campaign. Health communication, 32(8), 931-938.
Davis, K.C., Patel, D., Shafer, P., Duke, J., Glover-Kudon, R., Ridgeway, W., & Cox, S. (2017). Association between media doses of the Tips From Former Smokers campaign and cessation behaviors and intentions to quit among cigarette smokers, 2012-2015. Health Education & Behavior, 1-9.
Department of Health and Human Services (HHS). (2014). The Health Consequences of Smoking—50 Years of Progress: A Report of the Surgeon General. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health.
Greenbaum, R. T. (2000). Selecting the right site: Where do states locate place-based economic development programs? Paper presented at the Proceedings. Annual Conference on Taxation and Minutes of the Annual Meeting of the National Tax Association.
Haveman, R. H. (2010). Principles to guide the development of population health incentives. Prev Chronic Dis, 7(5), A94.
Huang, L.L., Thrasher, J.F., Abad, E.N., Cummings, K.M., Bansal-Travers, M. Brown, A., Nagelhout, G.E. (2015). The U.S. national Tips From Former Smokers antismoking campaign: Promoting awareness of smoking-related risks, cessation resouces, and cessation behaviors. Health Education & Behavior, 42, 480-486.
Murphy-Hoefer, R., Davis, K., King, B.A., Rodes, R., Beistle, D. (2019). Over half a million quits & going strong: How the Tips®campaign continues to help smokers quit smoking for good. National Conference on Tobacco or Health, Minneapolis, MN, August 27-29, 2019 (poster session).
1 Use of trade names is for identification only and does not imply endorsement by the U.S. Department of Health and Human Services.
2 To achieve this final sample size, it is anticipated that the total number of respondents who need to initiate the screener is 20,116 accounting for attrition. More detail on how this number was calculated this is included in Section A.12.
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | Peak, Stephanie A |
File Modified | 0000-00-00 |
File Created | 2021-01-14 |