Description of FY 21 800# Caller Survey

DOCUMENTATION FOR THE GENERIC CLEARANCE

OF CUSTOMER SATISFACTION SURVEYS OMB No. 0960-0526

TITLE OF INFORMATION COLLECTION: Fiscal Year (FY) 2021 800 Number Caller Survey

SSA SUB-NUMBER:

DESCRIPTION OF ACTIVITY:

BACKGROUND

The Social Security Administration (SSA) conducts surveys with individuals who do business with us to assess their satisfaction with the specific mode of contact they used. As part of this effort, we conduct the 800 Number Caller Survey, in which we interview members of the public who called SSA’s 800 number to transact their business. We designed the survey, which we conduct shortly after the participant’s call, to (1) measure public perception of SSA’s 800 number service; and (2) collect information that will assist us in understanding the customer experience behind satisfaction ratings. SSA has been conducting a satisfaction survey with the 800 number caller population since 1989.

SURVEY

Description of Survey

SSA conducts the 800 Number Caller Survey over a six-month period in FY 2021. An SSA contractor conducts the survey interviews by telephone. The survey covers a variety of topics related to SSA’s 800 number service, including the following:

• Callers’ satisfaction with how quickly they were served on the 800 number;

• Callers’ ease of getting the automated system to understand the type of service needed;

• Whether callers chose to conduct business using an automated service, and whether they were able to complete their business that way;

• Whether callers were connected immediately or had to wait on hold for an agent;

• Amount of time spent on hold waiting to speak to an agent;

• Callers’ satisfaction with the courtesy of the agent;

• Whether the agent was able to take care of the caller’s business during the call;

• The caller’s rating of the 800 number service overall;

• The nature of the caller’s business and the type of benefits involved;

• Whether callers tried to take care of their business some other way before calling the 800 number, and what action they took; and

• Whether callers are more likely to use self-service options since the global pandemic.

Statistical Information

Sample Selection

SSA draws the sample for the 800 Number Caller Survey from the automatic number identifier (ANI) detail data supplied by the contractor for SSA’s national 800 number telephone network. During the six-month sample selection period, we process ANI data to identify completed calls that represent individuals who “got through” to the 800 number. We select individuals who have used automated services and/or spoken to a representative, or hung up while waiting.

SSA’s 800 number receives close to 40 million calls each year. Based on this volume, we anticipate that over the six-month period of the survey the 800 number will handle roughly 20 million calls. From the universe, we will randomly select 1,400 unique telephone numbers, each week via a random generator program that uses selected digits of the current date and time. We will use these originating numbers to attempt to contact and interview the individuals who placed the sample calls. During the initial contact, we will screen out calls that originate from a public or business telephone, since we cannot usually identify individuals who call from such locations.

Methodology

An SSA-approved contractor will conduct this survey by telephone and translate the survey questionnaire into computer-assisted interviewing (CATI) software so that interviewing and data input of the individual’s responses occur simultaneously. The CATI software also ensures that we ask only questions pertinent to the individual’s circumstances, allowing for complicated question paths while still minimizing response burden.

Response Rate

To maximize the response rate for this survey, SSA will:

• Select samples each week (to minimize the time between the customers’ service experience and the survey);

• Transmit sample listings to the contractor within a week of the 800 number call;

• Have the contractor make at least 3 attempts to reach the caller over a 1‑week period in an effort to obtain the highest possible response rate;

• Have the contractor arrange call attempts for daytime, evenings, weekend hours;

• Have the contractor arrange callbacks and leaves messages for the sampled individual as necessary, and provide a toll-free number for return calls to encourage participation;

• Provide Spanish-speaking interviewers as necessary.

In past years, using this methodology with similar populations, we typically achieved response rates around 30 percent. In the most recent 800 Number Caller Survey for FY 2019, the response rate was 26 percent. Considering the telephone number is the only contact information available to the contractor, this response rate is remarkably good. We routinely review the information recorded by the contractor to monitor any significant trends in the reasons for non-response and to ensure the contractor makes adequate efforts to achieve a good response rate.

Sampling Variability

The key variable in the 800 Number Caller Survey is overall satisfaction with telephone service. In the FY 2019 800 Number Caller Survey, the overall satisfaction rating was 69 percent excellent, very good or good. Our proposed weekly sample size of 1,400 is large enough to allow for the screening of business calls and, assuming a 30 percent response rate from the remaining sample, will provide a sampling variability at the 95‑percent confidence level of +/‑2.4 percent for this key indicator of satisfaction.

SSA’s Office of Quality Review and Office of Office of Analytics and Improvement (OAI) are responsible for sampling and data analysis. Douglas Turnbull, Director, Division of Modeling, OQI, SSA, provides statistical support. OMB can reach Mr. Turnbull at (410) 966-2595.

IF FOCUS GROUP MEMBERS WILL RECEIVE A PAYMENT, INDICATE AMOUNT (No more than $25 can be authorized under OMB rules):

We will not compensate participants in this survey.

USE OF SURVEY RESULTS

SSA will use the results of this study to assess customer satisfaction, and evaluate and improve various aspects of its 800 number service.

BURDEN HOUR COMPUTATION (Number of responses (X) estimated response time (/60) = annual burden hours):

Category of Respondent	No. of Respondents	Participation Time (minutes)	Burden (hours)
800 Number Caller	33,600	5	2,800

NAME OF CONTACT PERSON: Jennifer Fink

Generic Clearance 800 Number Caller Survey

November 2020