OMB
SUPPORTING STATEMENT STUDY TO MEASURE CUSTOMER SATISFACTION
ACOUNTS MANAGEMENT ADJUSTMENTS – CY2010 JANUARY 1, 2010 -
DECEMBER 31, 2010 TIRNO-05-Z-00014
Introduction
Background/Overview
The
Internal Revenue Service (IRS) engages a balanced measurement system
consisting of business results, customer satisfaction, and employee
satisfaction. This initiative is part of the Service-wide system of
balanced organizational performance measures mandated by the IRS
Restructuring and Reform Act of 1998. This is also a result of
Executive Order 12862, which requires all government agencies to
survey their customers and incorporate customer preferences in their
process improvement efforts.
Wage
and Investment (W&I)- Customer Accounts Services (CAS)- Accounts
Management is responsible for:
Responding
to taxpayers’ technical and account inquiries,
Resolving
customer account issues,
Providing
account settlement (payment options), and
• Working
related issues.
As
an important customer interface for W&I, Accounts Management is
requesting feedback from customers (i.e., taxpayers) to continuously
improve its operations. The results facilitate more effective
management of W&I Accounts Management by:
Providing
insight from the customer’s perspective about possible
improvements.
Providing
useful input for program evaluation and execution at the
programmatic and field office level of service delivery.
Objectives
of Data Collection
The
objective of the survey is to gauge customer expectations and
perceptions about the Accounts Management process. This Adjustments
customer satisfaction survey project has two primary goals:
Track
customer satisfaction at the ten W&I Adjustment sites; and
Identify
operational improvements.
Methodology
Sample
Design
The
sample universe consists of taxpayers with closed cases controlled
in IDRS. The contractor will select 3,000 taxpayers per quarter
(stratifying by the ten W&I Accounts Management sites),
resulting in a total of 1000 completed questionnaires each quarter
(100 per site) and 4,000 completed questionnaires per year (400 per
site).
The
Adjustments Customer Satisfaction Survey has already been developed
and is currently in use. Completion of the survey takes
approximately five minutes. The questionnaire is based on the
contractor’s Net Impression methodology, which asks
respondents to evaluate various aspects of their experience and to
provide an overall summary evaluation. The questionnaire was
developed based on inputs from focus groups with customers who had
received correspondence from the IRS regarding their tax return or
who had filed an amended return.
The
survey includes several ratings questions evaluating service
delivery during the Accounts Management process as well as several
demographic items. In addition, ample space is provided for
suggestions for improvement.
Data
to be Collected
Accounts
Management Adjustments taxpayer customer satisfaction respondent
data is collected.
How
Data Collected & Used
The
contractor administers the survey by mail on a monthly basis.
Standard procedures are used in order to obtain the highest response
rate possible for the mail survey. These include at a minimum: 1)
an advance letter about the survey; 2) the initial survey with a
cover letter; 3) a postcard reminder; and, 4) a second letter and
survey to non-respondents.
The
contractor summarizes the quantitative ratings on a quarterly basis,
and produces a national report showing customer satisfaction scores
on all Accounts Management survey items and overall improvement
priorities for the function. The contractor delivers one national
report each quarter and 10 site reports a year. The reports contain
individual site scores on each of the survey items and improvement
priorities for the individual sites. The contractor includes any
relevant database variables in the analysis and will weight the
survey responses as necessary to reflect accurately the entire
customer base.
Reports
of survey findings are distributed to the IRS each quarter. Each
report is delivered approximately five weeks after the survey
cut-off date for the quarter. For the quarterly reports, the
contractor uses basic and advanced statistical techniques including,
but not limited to, analysis of variance and the prioritization of
improvement priorities using contractor’s established
technique.
Survey
scoring for this contract is based on the Customer Satisfaction
Survey Score response average to the keystone question –
“Regardless of whether you agree or disagree with the final
outcome, how would you rate your overall satisfaction with the way
your issue was handled?” Questions utilize a 5-point rating
scale, with 1 being very dissatisfied and 5 being very satisfied.
All survey responses generated are kept “private to the extent
of the law”. The contractor ensures that taxpayers responding
to the survey are guaranteed anonymity.
Dates
of Collection Begin/End
Data
collection runs the 2010 calendar year from January 1, 2010 through
December 31, 2010.
Who
is Conducting the Research/Where
The
contractor is responsible for ensuring the sample is pulled and to
conduct data analysis. A separate GPO contractor will be responsible
for printing and administering the survey via mail, and then
providing the dataset to the contractor.
Cost
of Study
The
estimated cost for this survey is $133,133.
Expected
Response Rate
The
expected response rate is 33.3%. The expected response rate on this
survey is lower than the OMB 50% target rate since the sample
consists of taxpayers with compliance issues. They either owe money
to the IRS or have unfiled tax returns. This group of taxpayers
generally doesn’t seek out the IRS. In addition, there are no
incentives offered to encourage taxpayers to respond to the survey.
Mail surveys also traditionally yield lower response rates than
other methodologies such as telephone or in-person interviews.
Telephone and in-person techniques offer the advantage of
interviewer contact who can further encourage taxpayers to respond
through refusal conversion techniques. The mail survey methodology
employs best practices in maximizing response rates by sending out
enough mailings as justified without creating extra burden for
taxpayers.
With
regard to the low response rate, the IRS will assume that all data
collected from this survey is qualitative in nature, and that no
critical decisions will be made by this office solely from the
analysis of data from this survey. The results from this survey are
simply one piece of a larger set of information needed to assess the
needs related to services provided by the IRS.
Methods
to Maximize Response Rate
The
questionnaire length is minimized to reduce respondent burden;
thereby, tending to increase response rates. Respondents are assured
anonymity of their responses. Also, weighting procedures can be
applied to adjust aggregated data from those who do respond.
Test
Structure and Design
The
Adjustments questionnaire is an established and tested survey
instrument. If changes are made to the questionnaire, they are
expected to be minor.
Efforts
to avoid Duplicate Research
This
is the only Customer Satisfaction survey currently conducted by W&I
Customer Account Services for closed Adjustments cases at their
sites
Participants
Criteria
Survey
participants are manually pulled from Accounts Management
Adjustments closed cases in a random sample by IRS employees at each
of the 10 site locations.
Privacy,
Disclosure and Security Issues
The
IRS will ensure compliance with the Taxpayer Bill of Rights II. All
participants will be treated fairly and appropriately.
The
security of the data used in this project and the privacy of
participants will be carefully safeguarded at all times. Security
requirements are based on the Computer Security Act of 1987 and
Office of Management and Budget Circular A-130, Appendices A7B.
Physical security measures include a locked, secure office.
Audiotapes are stored in locked cabinets. Transcription of
audiotapes are stored in locked cabinets or shredded. Data security
at the appropriate levels has been accomplished. Systems are
password protected, users profiled for authorized use, and
individual audit trails generated and reviewed periodically. The IRS
will apply and meet fair information and record keeping practices to
ensure privacy protection of all participants. This includes
criterion for disclosure—laid out in the Privacy Act of 1974,
the Freedom of Information Act, and Section 6103 of the Internal
Revenue Code—all of which provide for the protection of
taxpayer information as well as its release to authorized
recipients. Privacy will be safeguarded; participants will not be
identified to IRS personnel. In addition, no participant names will
be mentioned in the reports or data files. Participants will be
advised that comments will be audio taped. Privacy is assured by
virtue of agency policy.
Pursuant
to the Federal Information Security Management Act (FISMA), Title
III of the E-Government Act of 2002, P.L. 107-347, the contractor
shall provide minimum security controls required to protect Federal
information and information systems. The term ‘information
security’ means protecting information and information systems
from unauthorized access, use, disclosure, disruption, modification,
or destruction in order to provide confidentially, integrity and
availability.
The
contractor shall provide information security protections
commensurate with the risk and magnitude of the harm resulting from
the unauthorized access, use, disclosure, disruption, modification,
or destruction of information collected or maintained by or on
behalf of the agency; or information systems used or operated by an
agency or by a contractor of an agency. This applies to individuals
and organizations having contractual arrangements with the IRS,
including employees, contractors, contractors, and outsourcing
providers, which use or operate information technology systems
containing IRS data. The contractor shall comply with Department of
Treasury Directive TD P 85-01, Treasury Security Manual TDP 71-10,
and Internal Revenue Manual 10.8.1 Information Technology Security
Policy and Guidance. The contractor shall comply with IRS Internal
Revenue Manuals (IRM) and Law Enforcement Manuals (LEM) when
developing or administering IRS information and information systems.
The contractor shall comply with the Taxpayer Browsing Protection
Act of 1997 - Unauthorized Access (UNAX), the Act amends the
Internal Revenue Code 6103 of 1986 to prevent the unauthorized
inspection of taxpayer returns or tax return information.
Contractors systems that collect, maintain, operate or use agency
information or an information system on behalf of the agency (a
General Support System (GSS), Major or Minor Application with a FIPS
199 security categorization) must ensure annual reviews, risk
assessments, security plans, control testing, a Privacy Impact
Assessment (PIA), contingency planning, and certification and
accreditation, at a minimum meet NIST guidance, if required by the
IRS.
The
contractor shall be subject to at the option / discretion of the
agency, to periodically test, (but no less than annually) and
evaluate the effectiveness of information security controls and
techniques. The assessment of information security controls may be
performed by an agency independent auditor, security team or
Inspector General, and shall include testing of management,
operational, and technical controls of every information system that
maintain, collect, operate or use federal information on behalf of
the agency. The agency and contractor shall document and maintain a
remedial action plan, also known as a Plan of Action and Milestones
(POA&M) to address any deficiencies identified during the test
and evaluation. The contractor must cost-effectively reduce
information security risks to an acceptable level within the scope,
terms and conditions of the contract. The contractor shall maintain
procedures for detecting, reporting, and responding to security
incidents, and mitigating risks associated with such incidents
before substantial damage is done to federal information or
information systems. The contractor shall immediately report all
computer security incidents that involve IRS information systems to
the IRS Computer Security Incident Response Center (CSIRC). Any
theft or loss of IT equipment with federal information / data must
be reported within one hour of the incident to CSIRC. Those
incidents involving the loss or theft of sensitive but unclassified
(SBU) data (i.e. taxpayer, PII) shall be reported to CSIRC,
first-line manager, and Treasury Inspector General for Tax
Administration (TIGTA). Based on the computer security incident
type, CSIRC may further notify the Treasury Computer Security
Incident Response Capability (TCSIRC) in accordance with TCSIRC
procedures.
Burden
Hours
The
survey interview is designed to minimize burden on the taxpayer. The
time that a respondent takes to complete the mail survey is
carefully considered and only the most important areas are being
surveyed. The average time of survey completion is expected to be 7
minutes. The questions are generally one sentence in structure and
on an elementary concept level.
Based
on a sample of potential respondents of 12,000 (10 sites, 300 per
site each quarter) and a response rate of 33.3%, we expect 4,000
survey participants (400 per site), leaving 8,000 non-participants.
The contact time to determine non-participants could take up to two
minutes to read the pre-contact letter, with the resulting burden
for non-participants
being 8,000 x 2 minute = 16,000/60 minutes=267
burden hours.
For
participants, the time to complete the survey is 7 minutes. This
reflects the time to read the pre-notification letter (2 minutes)
and time needed to complete the survey (5 minutes maximum). The time
burden for participants
is 4,000 x 7 minutes/60 minutes = 467
burden hours.
The
total burden hours for the survey would be (267 + 467) 734
burden hours.
Attachments
Accounts
Management Adjustments Survey L1-Advance letter (pre-note) about the
survey L2-Cover letter with the survey L3-Postcard reminder
L4-Second letter and survey to non-respondents
File Type | text/rtf |
File Title | Microsoft Word - Adjustments Survey OMB Submission CY2010 rev #1.doc |
Author | f1kfb |
Last Modified By | XHFNB |
File Modified | 2010-01-29 |
File Created | 2010-01-06 |