2008 Marketing Materials Focus Groups
Background/Overview
Research is an integral part of the IRS e-file marketing cycle and monitoring e-product development. Research is performed at the beginning of the cycle for the purpose of identifying the customers and their likes and dislikes prior to developing a product. In addition, it is performed once the product is offered in order to determine its acceptance and how to improve it. Results from the research provide ETA and the other Business Operating Divisions (BODS) with usage volume, penetration rates, and taxpayer profiles as to who does and does not use each product. Research also provides BODS with detailed information to guide the next season’s marketing campaign and/or and how to direct outreach and marketing efforts. Finally, it provides the feedback necessary to determine if the funding was spent wisely and achieved the expected results. Following is a Statement Of Work for qualitative marketing research for ETA Marketing Campaign Materials.
Each year, the IRS conducts a coordinated marketing campaign designed to increase usage of electronic filing. In addition to standard existing campaign messages, IRS is planning two important new elements for its FS2009 marketing campaign – (1) a new e-IRS logo, which is intended to communicate the concept of an “electronic IRS”; and (2) a series of environmental messages linked to tax filings/paying taxes.
Objectives of data collection
The specific objectives of this research are to: (1) assess Taxpayers' reactions to the two new elements, and to make sure the campaign is as effective as possible; (2) determine if the new “e-IRS” logo is easily understood by Taxpayers as a symbol of electronic interaction with the IRS; and (3) determine how Taxpayers respond to environmental messages tied to filing their tax filing and paying taxes. Especially important in this is to learn if saving paper helps to motivate people to file electronically.
Methodology
Sample design
This research will be conducted via focus groups, specifically a series of 6 focus groups (2 with Tax Professionals and 4 with Taxpayers), with approximately 10 target participants per group. For maximum cost efficiency and to secure national feedback, Russell recommends that these 6 groups be conducted across 3 total markets/cities – e.g., one in the East (with, e.g., 1 Tax Pro group and 1 Taxpayer group), one in the Midwest (2 Taxpayer groups), and one in the West (1 Tax Pro group and 1 Taxpayer group). Participants in these groups will be screened and recruited via telephone, after having been drawn on an “nth” selection basis from lists (extracts) provided by the IRS in consultation with Russell, and with Russell providing telephone number lookups. (Note: all IRS lists would be handled only by Russell staff and not by any external firms, with the Safeguards detailed in Russell’s response to the BPA RFQ fully enforced.) In terms of List Size, IRS would ideally provide a 50 times ratio of list to # participants per group per city.
Data collection date
The 6 focus groups will be conducted after OMB authorization, or in September, 2008.
Data to be collected
Data to be collected are detailed in the attached pre-recruit screener and moderator guides.
How data will be used
Results will be analyzed by Taxpayers and Tax Professionals.
Who is conducting research
The research is being conducted by Russell Research, Inc.
Location – region/city and facilities
The phone pre-recruiting phase of the study will be conducted from the national telephone interviewing facilities of Russell Research in Wayne, New Jersey. Russell’s partner focus group facilities in each city would host the groups, with room for one-way mirror viewing by IRS personnel and with audiotaping only (no videotaping is anticipated).
Stipend
Each group would last an hour and a half and participants would be incentivized at $125 per Tax Professional and $100 per Taxpayer. Russell’s partner focus group facilities in each city would host the groups, with room for one-way mirror viewing by IRS personnel and with audiotaping only (no videotaping is anticipated).
These stipend levels are what are currently being recommended by focus facilities around the country.
Recruitment efforts
All respondents will be recruited from lists to be provided by IRS. Russell will provide lookup of telephone numbers of potential respondents on the lists provided by IRS.
All pre-recruit interviews will be conducted by telephone from the Russell-Wayne field center in New Jersey, using the above lists – with respondents selected for interviewing on an every “nth” basis from each list. Telephone interviewing will be manually conducted in order to avoid having any electronic trail of interviewing records, with all paper versions of the completed surveys destroyed after completion of the survey – this to comply with the Safeguards agreement between Russell and the Government.
Methods to maximize response rate
The survey will employ the following methods to maximize response: 1) at least 3 and up to 5 interviewing attempts on each respondent; and 2) assigning refusals on initial attempts to senior interviewing personnel trained in refusal conversion.
Expected Response Rate
The response rate for this study is expected to be approximately 60% (or similar to the level found for other surveys conducted by Russell Research on behalf of the IRS).
Test structure/design
A total of 6 focus groups (2 with Tax Professionals and 4 with Taxpayers), with approximately 10 target participants per group for a total of 60 participants.
In order to assure that 10 targeted participants actually come to each focus group, 13 qualifying participants will be pre-recruited for each group – totaling 78 total pre-recruits (13 x 6).
Efforts to not duplicate research
No other marketing materials focus groups are currently being conducted for ETA or IRS Marketing, thus there is no duplication with other research.
Participants Criteria
To qualify for this survey, respondents would need only to be included on IRS lists being drawn by the IRS in consultation with Russell and be willing to participate in the focus groups.
Privacy, Security, Disclosure, Confidentiality
The information in the IRS lists will be protected from disclosure by Russell’s strict non-disclosure safeguards (see below). Note: These lists will not contain tax return or taxpayer information. In addition, survey participants will not be identified in any of the documents or files used for this project. Nonetheless, as with all IRS studies, Russell will limit and control the amount of information collected to those items that are necessary to accomplish the research questions. Russell will carefully safeguard the security of data utilized as well as the privacy of the survey respondents (as detailed below). Russell will also apply fair information and record-keeping practices to ensure protection of all survey respondents. The criterion for disclosure laid out in the Privacy Act, the Freedom of Information Act, and section 6103 of the Internal Revenue Code provides for the protection of information as well as its releases to authorized recipients.
Russell’s Non-Disclosure Safeguards
Having undergone a formal security audit in the past associated with IRS research and aware of the penalties that apply to disclosure, Russell has a government-approved system in place for safeguarding IRS lists and assuring non-disclosure of any information from any IRS study. This system assures that Russell will comply with the following requirements:
All work shall be performed under the supervision of Russell’s responsible employees.
Any Taxpayer or Tax Professional information made available in IRS lists shall be used only for the purpose of carrying out the provisions of this contract. Information contained in such material shall be treated as confidential and shall not be divulged or made known in any manner to any person except as may be necessary in the performance of the contract. Russell understands that inspection by or disclosure to anyone other than an officer or employee of Russell requires prior written approval of the Internal Revenue Service – this would not be issue, as no others would have access the data.
C. Russell understands that should a person (contractor or subcontractor) or any employee make any unauthorized inspection(s) or disclosure(s) of confidential tax information, the terms of the Default clause (FAR 52.2499), incorporated herein by reference, may be invoked, and the person (contractor or subcontractor) will be considered to be in breach of this contract.
C1. Taxpayer and Tax Professional names and addresses will be accounted for upon receipt and properly stored before, during, and after processing. In addition, all related output shall be given the same level of protection as required for the source material. Russell agrees to abide by its contract requirements that:
The following safeguards will be provided by Russell for protecting the lists:
Names and addresses will be provided in and worked from hard copy only.
Since the files may have to be printed and divided into sub-samples for use by different researchers in our national telephone facility, the contractors would also impose strict hard copy controls (with responsible senior supervisors in control of the data at all times and dispensing data to interviewers on a sign-in, sign-out basis.
2. With scheduling issues, it is not possible to name (this far in advance of the interviewing) the interviewers who will be working on the project. The Supervisors names will also be provided from Russell’s national telephone center.
Russell’s Non-Disclosure Safeguards (Cont’d.)
3. The manager of the Russell facility will have control of one or more hard copy pieces of the sample.
4. The manager will personally supervise each interviewer’s use of the sample throughout the screening process, will not allow samples to leave the interviewing room, and will keep the samples locked in his/her personal files when not in use (for other security reasons).
5. The manager’s personal office in the telephone facility will be locked when not in use (for other security reasons).
6. The facility itself is always locked at the end of each interviewing day/evening.
7. Russell’s facility employs cameras throughout its interviewing facility to monitor the movements of interviewers, lists, etc.
8. After completion of all interviews and validation, the hard copy samples would be shredded by Russell (within approximately 8 weeks of the conclusion of the survey).
9. Russell will provide the names of the people that will have access to the hard copy data including the interviewers under the direct control and supervision of the manager at the telephone facility.
10. Russell certifies that the data processed during the performance of this contract shall be completely purged from all data storage components of our facility and that no output will be retained by the contractors at the time the IRS work is completed. In the case that immediate purging of all data storage is not possible, Russell certifies that any IRS data remaining in any storage component will be safeguarded to prevent unauthorized disclosures.
Any spoilage or any intermediate hard copy printout, which may result during the processing of IRS data, shall be given to the IRS Contracting Officer or his/her designee. When this is not possible, Russell will be responsible for the destruction of the spoilage or any intermediate hard copy printouts, and will provide the IRS Contracting Officer or his/her designee with a statement containing the date of destruction, description of material destroyed, and the method used.
As it has in the past, the Internal Revenue Service shall have the right to send its officers and employees into the offices and plants of Russell for inspection of the facilities and operations provided for the performance of any work under this contract. On the basis of such inspection, the Contracting Officer may require specific measures in any cases where Russell is found to be non-compliant with contract safeguards.
Burden Hours
While it is anticipated that all of the potential respondents contacted for this study will qualify, the response rate will likely be similar to that of the past – or about 60%. Assuming it is about the same, a total of 130 Tax Professionals and Taxpayers will have to be called in order to reach the 78 who agree to participate in the study, leaving 52 not participating.
The contact time to determine non-participation could be up to 2 minutes, with the resulting burden for non-participants being 52 x 2 = 104 minutes / 60 minutes = 1.7 burden hours.
The contact time to pre-recruit those who are willing to participate but do not ultimately show up at the focus groups could be up to 4 minutes, with the resulting burden for non-participants being 18 x 4 = 72 minutes / 60 minutes = 1.2 burden hours.
Then, for those Taxpayers and Tax Professionals who do participate in the focus groups, the length of the groups is expected to be 90 minutes, with the time burden for that group being 60 x 90 minutes = 5,400 total minutes / 60 minutes = 90.0 burden hours.
Thus, the total burden hours for the study would be (1.7 + 1.2 + 90 =) 92.9 hours.
Project Cost: $39, 122
Attachments
Pre-recruit Screener/Questionnaire – Attached
Cover letter/correspondence
Not applicable here
Telephone screeners – Attached
Not applicable here
File Type | application/msword |
File Title | Word Document |
Author | IRS-Russell Collaboration |
Last Modified By | mdsloa00 |
File Modified | 2008-07-31 |
File Created | 2008-07-30 |