Supporting statement Part B

SUPPORTING STATEMENT FOR REQUEST FOR MODIFICATION OF -- 2900-0227

NATION-WIDE CUSTOMER SATISFACTION SURVEYS

B. Collections of Information Employing Statistical Methods

1. Provide a numerical estimate of the potential respondent universe and describe any sampling or other respondent selection method to be used. Data on the number of entities (e.g., households or persons) in the universe and the corresponding sample are to be provided in tabular format for the universe as a whole and for each stratum. Indicate expected response rates. If this has been conducted previously include actual response rates achieved.

Veteran patient population 5,000,000

Potential respondent universe: 632,000 patients/year

Expected response rate: Average of 48% (n=301,244)

Sampling methodology: Random selection based on social security numbers and specific visit type at or coordinated through a VA facility

2. Describe the procedures for the collection of information, including:

a. Statistical methodology for stratification and sample selection

b. Estimation procedure

c. Degree of accuracy needed

d. Unusual problems requiring specialized sampling procedures

e. Any use of less frequent than monthly data collection to reduce burden

Veterans are sampled monthly for inclusion in SHEP in the following way: Inpatients who have been discharged in the past month from the admitting bed section to home are eligible. Sufficient numbers are selected to ensure adequate representation at the facility division level for stable estimates of the percentage of veteran patients responding overall quality very good or excellent, within 5 percentage points. For outpatients, the only difference is that a fixed number (15) of veteran patients are selected in each stratum (new primary care, established primary care, and specialty care patients) at each site of care. Once veteran patients are selected, letters are sent soliciting their response to a variety of questions concerning their care at VA facilities. Veterans are asked to return the surveys to the Office of Quality and Performance contracted data collection vendor. The sample size has been determined to be of a sufficient size to give statistically reliable data for each VISN and VA facility. The monthly data collection provides for sufficiently timely identification of problem areas and undertaking of steps toward remediation. This allows VA to provide quality medical services to veterans.

All survey questionnaires are translated into Puerto Rican Spanish for those veterans seeking services at or through the VA Medical Center San Juan, Puerto Rico and its affiliated facilities. Questionnaires are provided in both English and Spanish, allowing the veteran to choose the version that they are most comfortable responding with.

3. Describe methods to maximize response rate and to deal with issues of non-response. The accuracy and reliability of information collected must be shown to be adequate for intended uses. For collections based on sampling, a special justification must be provided for any collection that will not yield “reliable” data that can be generalized to the universe studied.

Questionnaires are mailed to veterans via first class mail; a postage-paid return envelope is included. A modified Dillman Total Design Methodology (TDM) is used. The TDM process incorporates several strategies designed to minimize the burdens of survey participation and establish trust. Procedurally the TDM involves five carefully spaced mailings:

Week 0 Pre-survey notification letter

Week 1 Survey questionnaire

Week 2 Thank you/reminder postcard

OQP has found the first mailing adequate to achieve very good (45% to 60% range) response rates among veterans.

Sociodemographic information for the survey sample is obtained from central files in the VA Austin Automation Center. Individual identifiers are subsequently stripped from the database to maintain respondent confidentiality.

4. Describe any tests of procedures or methods to be undertaken. Testing is encouraged as an effective means of refining collections to minimize burden and improve utility. Tests must be approved if they call for answers to identical questions of 10 or more individuals.

A separate request for a pilot study of HCAHPS in the VHA population has been submitted and is pending. Results of testing in other federal healthcare systems are available, and have found excellent performance for the HCAHPS instrument in measuring patient satisfaction among inpatients.

5. Provide the name and telephone number of individuals consulted on statistical aspects of the design and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.

Dr. John R. Elter

Director of Surveys

Office of Quality and Performance Durham

919-993-3035 Ext 224

James Flaherty

Administrative Officer, Survey Section

Performance Analysis Center for Excellence

Office of Quality and Performance

919-993-3035 Ext 222

Page 2