Producer Price Index Unser Survey Justification

OMB Approval No. 1225-0059

CUSTOMER SATISFACTION SURVEY AND CONFERENCE EVALUATION CLEARANCE FORM

A. SUPPLEMENTAL SUPPORTING STATEMENT

A.1. Title:	Producer Price Index User Survey
A.2. Compliance with 5 CFR 1320.5: Yes _X___ No _____				A.3. Assurances of confidentiality: No pledge of confidentiality will be given.
A.4. Federal cost: $5,000—Includes staff time to develop and administer the survey.				A.5. Requested expiration date (Month/Year): 03/2013
A.6. Burden Hour estimates: a. Number of Respondents: 3350 a.1. % Received Electronically 100% b. Frequency: One-time c. Average Response Time: 10 minutes d. Total Annual Burden Hours: 558.33 Hours				A7. Does the collection of information employ statistical methods? ____X___ No _______ Yes (Complete Section B and attach BLS review sheet).
A.8. Abstract: The BLS Producer Price Index (PPI) program produces a variety of data series related to the prices received by domestic producers for their products. The program is currently in the process of updating its strategic plan and wants to obtain feedback from its major customers. To accomplish this, a link will be placed on the PPI pages of the BLS website with the message “Brief Survey: Help Us Improve Our Data.” When visitors voluntarily click on this link, they will be taken to a short survey. We followed this procedure in a similar survey conducted in 2008, and in a two month period, 356 visitors completed the questionnaire for an estimated 0.04% response rate. For those respondents who click on the survey link, we will leave the links active until we get 350 respondents. In addition, the PPI staff will send a survey request to 20000 known users of PPI data. Based on past experience, a response rate of 15% (or 3000 known-users) is expected. Online Link Total 350 Known-Users 3000 Total 3350 Therefore, the total expected burden is 558.33 respondent hours: 3350 respondents x 10 min = 33500 min/60 min/hr = 558.33 respondent hours The purpose of this user survey is to obtain feedback about products on the PPI program website including the usefulness of the information provided, what products data users actually use, how they currently apply those data to real-world problems, and suggestions for improvements or new products. In addition, an attempt will be made to find out more about the users who respond to these surveys, including their occupations, how well the website is meeting their needs, and ratings of the quality of the information obtained. The information obtained will only be used for internal planning purposes. No personally identifiable information will be collected. We will not be using a random sample for the survey.
Program Official		Date	Departmental Clearance Officer		Date

2. SURVEYS AND EVALUATIONS EMPLOYING STATISTICAL METHODS

B.1. Describe (including a numerical estimate) the potential respondent universe and any sampling or

other respondent selection methods to be used. Data on the number of entities (e.g., establishments, State and

local government units, households, or persons) in the universe covered by the collection and in the

corresponding sample are to be provided in tabular form for the universe as a whole and for each of the

strata in the proposed sample. Indicate expected response rates for the collection as a whole. If the collection

had been conducted previously, include the actual response rate achieved during the last collection.

Sampling Frame

The BLS website (www.bls.gov) served an average of 1.5 million users each month in 2005. There were nearly six million visits (including new and return visitors) to the website in July, 2012. Of the 30+ million pageviews on the BLS site in July 2012, about 1.1% accessed pages belonging to the Producer Price Index program. We will invite users of these webpages to complete the user survey.

In addition, an email solicitation will be sent to individuals who have had previous contact with the PPI program through information requests and interactions at conferences and tradeshows. This list consists of 20000 email addresses.

Expected Response Rates

The BLS website routinely conducts a pop-up customer satisfaction survey of users. That survey, the American Customer Satisfaction Index (ACSI) survey, is conducted by ForeSee Results, Inc. for BLS. Currently, their overall response rate is about 4%, with about a 20% completion rate for visitors who accept the survey invitation. This rate is similar to other user surveys conducted on websites.

Given this information and based on past experience using a similar approach, we anticipate that 0.04% of visitors to the website will click on the link for the survey invitation. However, it is difficult to calculate a response rate because we are not conducting a random sample. We are only placing a text link on the appropriate webpages and asking users to voluntarily complete the user survey. Since this is a convenience or opportunity sample, we will not be randomly selecting participants and will not deploy the survey via pop-up technology.

Previous customer satisfaction surveys in which an email invitation was sent to known users has yielded a response rate of approximately 15%. We expect a similar response rate for those sent an email invitation for this survey.

B.2. Describe the procedures for the collection of information including:

• Statistical methodology for stratification and sample selection,

• Estimation procedure,

• Degree of accuracy needed for the purpose described in the justification,

• Unusual problems requiring specialized sampling procedures, and

• Any use of periodic (less frequently than annual) data collection cycles to reduce burden.

B.3. Describe methods to maximize response rates and to deal with issues of non‑response. The accuracy and reliability of information collected must be shown to be adequate for intended uses. For collections based on sampling, a special justification must be provided for any collection that will not yield "reliable" data that can be generalized to the universe studied.

Procedures

A link asking users if they would like to provide feedback about the website will be placed on the webpages containing Producer Price Index content.

We will also ask individuals who have previously expressed interest in PPI data to participate via an email message.

We hope to obtain about 3350 total responses across the email and web link methods and will keep the survey link on the PPI portion of the BLS website until we achieve this goal.

Sampling

We will not use a random sample for the survey.

Methods to Reduce Non-Response

As noted, we will be soliciting respondents through a text link on a webpage. Since we won’t know the number of visitors to pages on the website or the number of persons who read the invitation (text link), it is not possible to calculate a response rate. We hope to obtain about 3350 usable responses. We will try to reach different types of users by sending a link to our web survey to known data users.

B.4. Describe any tests of procedures or methods to be undertaken.

Questionnaire Testing

The questionnaire has been reviewed by questionnaire design experts in the Office of Survey Methods Research at BLS, and has also already been reviewed by members of the Producer Price Index program who gave feedback on the items. This review improved the text of the question items, the usefulness of the questions, and the overall flow of the survey.

B.5. Provide the name, affiliation (company, agency, or organization) and telephone number of individuals consulted on statistical aspects of the design and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.

Name	Agency/Company/Organization	Number Telephone
Brandon Kopp	BLS/OSMR	202-691-7514

INSTRUCTIONS FOR COMPLETING CUSTOMER SATISFACTION SURVEY AND CONFERENCE EVALUATION CLEARANCE FORM

A.1. Title: Provide the title for the customer satisfaction or conference evaluation. This should be consistent with what appears on the collection instrument.

A.2. Compliance with 5 CFR 1320.5: If the survey or evaluation complies with 5 CFR 1320.5 (see below), mark an “X” next to “YES.” If the survey or conference evaluation does not comply with 5 CFR 1320.5, mark an “X” next to “No” and explain any special circumstances that would cause an information collection to be conducted in a manner:

• requiring respondents to report information to the agency more often than quarterly;

• requiring respondents to prepare a written response to a collection of information in fewer than 30 days after receipt of it;

• requiring respondents to submit more than an original and two copies of any document;

• requiring respondents to retain records, other than health, medical, government contract, grant‑in‑aid, or tax records for more than three years;

• in connection with a statistical survey, that is not designed to produce valid and reliable results that can be generalized to the universe of study;

• requiring the use of a statistical data classification that has not been reviewed and approved by OMB;

• that includes a pledge of confidentiality that is not supported by authority established in statute or regulation, that is not supported by disclosure and data security policies that are consistent with the pledge, or which unnecessarily impedes sharing of data with other agencies for compatible confidential use; or

• requiring respondents to submit proprietary trade secret, or other confidential information unless the agency can demonstrate that it has instituted procedures to protect the information's confidentiality to the extent permitted by law.

A.3. Assurances of confidentiality: Describe any assurance of confidentiality provided to respondents and the basis for the assurance in statute, regulation, or agency policy (if applicable, otherwise omit).

A.4. Federal costs: Provide estimates of annualized cost to the Federal government. For example, this could include quantification of hours, operational expenses (such as equipment, overhead, printing, and support staff), and any other expense that would not have been incurred without this collection of information. These estimates should only include expenses that would not have been incurred without this collection of information.

A.5. Requested expiration date: Enter the date thru which you would like approval to conduct your customer satisfaction survey and/or conference evaluation. The date entered here should be consistent with the time you need to conduct the survey/evaluation. Please note that this date cannot extend beyond the expiration date currently assigned to OMB No. 1225-0059).

A.6. Burden Hour and burden costs estimates:

a. Enter the number of respondents (i.e., number of those to which the survey or conference evaluation is addressed).

a.1. Enter the estimated percentage of responses that will be submitted electronically. This item does not apply to conference evaluations.

b. Enter the frequency for which the survey and/or conference evaluation will be conducted. For example, if the collection is conducted on an annual basis, enter “annually.” If the collection will only be conducted once then retired, enter “one-time.” If the collection is triggered by an event (such as a customer’s experience with a product or service), enter “on occasion.” Other frequencies could include: Monthly, Bi-monthly, Semi-annually, or Bi-annually.

c. Enter the average time it would reasonably take to complete the survey or conference evaluation. Average response time includes the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information.

d. Enter the total estimated annual burden hours for the collection of information. Generally, for the purposes of customer satisfaction and conference evaluations submitted under 1225-0059, this is obtained by multiplying the average response time by the number of respondents.

A.7. Does the collection of information employ statistical methods? If the collection of information does not employ statistical methods, enter a “X” next to “NO.” If statistical methods are employed, enter an “X” next to “YES” and complete Section B -SURVEYS AND EVALUATIONS EMPLOYING STATISTICAL METHODS and attach a BLS concurrent sheet signed by the BLS reviewer.

Statistical methodology involves drawing a sample from a defined population and inferring the results obtained to the population from which the sample was drawn. The important point here is inference to the population. If inferences are not being made and the results are used only internally for planning purposes, statistical methodology is not being used. However, if the results will be made public and inferences are likely to be made, proper statistical methodology is required.

Please note, BLS review should be conducted prior to submitting for Departmental review.

A.8. Abstract: Provide a statement covering the agency’s need for the information, uses to which it will be put, and a brief description of the respondents. Other than for 1-time surveys and conference evaluations, describe whether, and to what extent, the collection of information involves the use of automated, electronic, mechanical, or other technological collection techniques or other forms of information technology (e.g., permitting electronic submission of responses).

Note: Guidance for completing Section B., Statistical Methods, is provided within the form.

U.S. DEPARTMENT OF LABOR

Bureau of Labor Statistics Concurrence of Customer Satisfaction Surveys Employing Statistical Methods

TO: DATE: FAX:

[Enter program sponsor contact] _____ /_____/______ ______-_____-_______

FROM: PHONE

[Enter name of BLS reviewer] ______-_____-_______

ACTION: Review the attached report proposal, indicate approval or disapproval and return to the Sponsoring agency or program. Comments shall not be made on the proposed report but in the comments space below.

TITLE OF SURVEY OR EVALUATION

CLEARANCE

______ Approved ______ Disapproved (See comments below)

______ Approved with caveats (See comments below)

COMMENTS Think! Privacy Act

(Insert additional pages as needed)

(Attach sheet if additional space is necessary)

Disclaimer: BLS is approving only the statistical methodology as presented in the written documentation, and not necessarily passing judgment on the questionnaire itself nor on the necessity to conduct the collection of information.

SIGNATURE OF BLS REVIEWER DATE

_____ /_____/______

DL-1-150A (Rev. 5/03)