Justification Part B

/home/ec2-user/sec/disk/omb/icr/200906-1205-002/doc/12244701

JUSTIFICATION PART B

STATISTICAL METHODS

B-1. Respondent Universe and Sampling Methodology

a. Respondent Universe. The respondent universe for paid and denied claims comprises fifty-two State Workforce Agencies (SWAs), employers, and third parties. Within each SWA, the universe for paid claims is defined as all intrastate and interstate weeks paid (or offset) in the State Unemployment Insurance (UI), Unemployment Compensation for Federal Employees (UCFE), and Unemployment Compensation for Ex-servicemembers (UCX) programs. For denied claims, each SWA defines three universes of formal, documented denial decisions or determinations of ineligibility for benefits. These denial decisions are based on (a) monetary issues; (b) separation issues; and (c) nonseparation, or "continuing eligibility" issues.

2. Sampling Methodology.

BAM Paid Claims

SWAs select systematic random samples of paid UI claims each week and use the results of the BAM paid claims investigations to estimate accurately the number and dollar value of proper and improper payments (overpayments and underpayments), and their rates of occurrence. BAM paid claims also provides information that can be used for program improvement, including the type of payment error, error cause, responsible party, point of detection within the system, and the actions of claimants, employers, and agencies prior to the BAM investigation.

The Department has supplied each SWA with software that performs quality assurance edits of the sampling frames and randomly selects the BAM paid claims samples. Each week a random sample is selected of both intrastate and interstate original payments (including combined wage claims) made for a week of unemployment under the state UI, UCX or UCFE programs. A sample of 360 cases per year is pulled in the ten states with the smallest UI program workloads (defined as average annual UI weeks paid during the most recent five calendar years) and 480 cases per year in the other states. State BAM staff audit each selected claim, examining all aspects of a claimant's eligibility to receive unemployment compensation during the sampled week. In their investigation, staff verify wages used to establish monetary entitlements, the claimant's reason for being unemployed, efforts to find work during the week and any other factors which would have affected the claimant’s entitlement to a benefit during the sampled week or the amount of the benefit paid. Effective January 2008, paid claims selected for BAM must be matched with the National Directory of New Hires. The findings are then coded and entered into a database that is maintained on a computer located in each SWA. The Department uploads state BAM results (minus claimant Social Security Number) to a database maintained by the ETA Office of Workforce Security. The Department publishes annual performance results and uses the data for various analytical and evaluative purposes.

BAM Denied Claims

Each week, SWAs select systematic random samples from the three separate sampling frames constructed from the universes of claims for UI for which eligibility was denied for monetary, separation, or nonseparation reasons. Samples are selected using the same sampling frame edit and sample selection software used for paid claims. The Department estimates the accuracy of decisions to deny claimants UI, based on the results of the case investigations for these samples.

Investigation of BAM denied claims follows the paid claims case investigation methodology. It evaluates denials accuracy by investigating random samples of each of the three types of denials. All states sample a minimum of 150 cases of each type of denial in each calendar year. State BAM staff review agency records and contact claimants, employers, and all other relevant parties to verify information in agency records or obtain additional information pertinent to the determination that denies eligibility. Unlike the investigation of paid claims, in which all prior determinations affecting claimant eligibility for the compensated week selected for the sample are evaluated, the investigation of denied claims is limited to the issue upon which the denial determination is based.

The Department distributes a table of random start numbers to use with the BAM paid and denied claims sample selection software. A separate random number is provided for each sample pull (paid claims, monetary denials, separation denials, nonseparation denials) for each of the 52 weekly samples.

Scope: Both paid and denied intrastate and interstate claims in the State UI, UCFE, and UCX programs are included in the sampling frames. Paid and denied interstate claims are included in the sampling frames of the interstate liable State. The “liable” State is the State which pays the UI benefits (that is, that State’s Unemployment Trust Fund is charged). The “agent” State is the State that processes the UI claim.

Operational Definitions of Sampling Frames: Unless otherwise stated, definitions refer to those used in ET Handbook 401, 4th edition. ETA report cell references are those used in ET Handbook 402, 4th edition.

(1) Paid Weeks

Include only paid or compensated weeks that fall into all of the following: a) regular program type (UI, UCFE, UCX, or any combination thereof), b) weeks for which the payments/offsets are original payments (defined as the first valid payment/offset made by a state agency to a claimant for that week; offsets would normally recover overpayments established for previous weeks), c) weeks for which “total” or “part-total” payments/offsets are made, and d) weeks for which payments/offsets/intercepted payments are made to intrastate claimants, to interstate claimants by the liable State, or for combined wage claims.

Exclude weeks that all waiting weeks, weeks for which supplemental payments are made, weeks with stop payments, and all weeks paid under the Short Time Compensation (STC) [Workshare], Extended Benefits (EB), Trade Readjustment Allowance (TRA), Disaster Unemployment Assistance (DUA) programs, any temporary Federal-State supplemental compensation programs, or other special programs, such as Emergency Unemployment Compensation.

(2) Monetary Denials

Include all initial claims that meet the definition for inclusion in the ETA 5159 Claims and Activities report on lines 101 (State UI), 102 (UCFE, No UI), and 103 (UCX only), for item 2 (new intrastate, excluding transitional), item 6 (transitional), and item 7 (interstate received as liable State) and for which eligibility was denied because of:

• Insufficient wages,

• Insufficient hours/weeks/days,

• Failure of high quarter wage test,

• Requalification wage requirement, or

• Other State monetary eligibility requirement

Exclude denied claims made under the Short Time Compensation (STC) (Workshare), Extended Benefits (EB), Trade Readjustment Allowance (TRA), Disaster Unemployment Assistance (DUA), or any temporary Federal-State supplemental compensation programs.

(3) Separation Denials

Include all separation determinations that meet the definition for inclusion in the ETA 9052 Nonmonetary Determinations Time Lapse (Detection Date) report in cells c1 (intrastate), c5 (interstate), and c193 (multi-claimant) and for which eligibility was denied based on any of the following issues:

• Voluntary quit (either personal or work connected),

• Discharge,

• Labor dispute, or

• Other separation issue reportable under definitions in ET Handbook 401

Exclude denied claims made under the STC, EB, TRA, DUA, or any temporary Federal-State supplemental compensation programs.

(4) Nonmonetary-Nonseparation Denials

Include all nonmonetary-nonseparation determinations that meet the definition for inclusion in the ETA 9052 Nonmonetary Determinations Time Lapse (Detection Date) report in cells c97 (intrastate), c101 (interstate), and c193 (multiclaimant) and for which eligibility was denied based on any of the following issues:

• Able and/or available to work,

• Actively seeking work,

• Disqualifying/unreported income,

• Refusal of suitable work or offer of job referral,

• Refusal of referral to profiling services,

• Failure to report,

• Failure to register with the employment service, or

• Other nonseparation eligibility issue (for example, alien status, athlete, school employee, seasonality, removal of disqualification, and determination of whether claimant’s activities or status constitutes service or employment).

Exclude denied claims made under the STC, EB, TRA, DUA, or any temporary Federal-State supplemental compensation programs.

Frequency and Timing:

SWAs create a sampling frame file each week for all four universes. For paid claims, the survey population is selected from all weeks for which payments are made or offsets applied during a period that begins at 12:00 a.m. on Sunday and ends at 11:59 p.m. on Saturday. This interval is defined by the run time(s) of the computer programs that issue the checks or apply offsets.

The sampling frame for separation and nonseparation denied claims includes all decisions to deny UI claims issued during the period 12:00 a.m. Sunday to 11:59 p.m. Saturday. The date of the determination is the date printed on the determination notice. If no notice is issued, it is the date that the denial action was entered into the agency’s record system or that a permanent stop payment order was issued.

The sampling frame for monetary denied claims is constructed slightly differently as it is possible that a UI claim may initially be denied for insufficient wages but subsequently become monetarily eligible upon the addition of wages from out-of-State employers (combined wage claims), Federal wages (UCFE and/or UCX programs), or as a result of the application of alternate base period formulas. In order to allow time for SWAs to request and receive Federal, out of state, and recently earned wage credits, the sampling frame for monetary denials is constructed two weeks after the week ending date of the initial claim. For example, the sampling frame for batch 200910 (March 1 - 7, 2009) will consist of new initial and transitional claims filed on or before February 21 for which the most recent determination issued between February 15 and March 7 denies monetary eligibility.

c. Case Investigation. BAM paid and denied claims case investigations are conducted according to the methods and procedures documented in ET Handbook 395; case investigation procedures for both paid and denied claims are described in detail in chapter VI, except as noted in chapter VIII for denied claims investigations. The information that is collected is specified in the data collection instruments (DCIs) for both paid and denied claims.

BAM investigators collect DCI information from SWA records, claimant questionnaires, and interviews with employers and other the parties with information relevant to the paid or denied claim. The investigator then records this information in an automated database, which consists of individual data records for each sampled paid claim and denial.

All paid and denied claims investigations involve one state investigator and one claimant. The person whose claim was either paid or denied is contacted in-person, by telephone, or by mail.

BAM investigators obtain Information from employers and "third parties" -- persons other than the claimant or employer, such as a doctor, school, or labor union, who possess information pertinent to the paid or denied case.

Unlike the investigation of paid claims, in which all decisions affecting claimant eligibility that precede the compensated week selected for the sample are evaluated, the investigation of denied claims is limited to the issue upon which the denial decision was based. For example, if a continued week claim is denied because the agency determined the claimant was not available for work, then only the availability issue will be investigated. The monetary, separation and any other nonmonetary determinations which could have affected eligibility for the week claimed will not be investigated. SWAs have the flexibility to conduct the investigation of both paid denied claims for UI by in-person interview, telephone, mail or fax, as they deem appropriate.

B-2. Procedures for Collection of Information

a. Stratification and Sample Selection. For both paid and denied claims, each state’s sample is stratified by week (which BAM refers to as a batch). For denied claims, samples are selected from sampling frames for each of the three types of denials (monetary, separation, and nonseparation). Systematic samples are selected weekly using software and random start numbers provided by the Department. Annual estimates are weighted to reflect the sample stratification. The formulae used to produce weighted estimates for paid and denied claims accuracy rates are in Attachment B-1.

b. Estimation Procedure. See Attachment B-1 for the formulae used to estimate paid and denied claims accuracy rates and sampling variances.

c. Degree of Accuracy Needed. The Department has adopted a standard for data publication that the 95% confidence interval (roughly two times the standard error of estimate) will be estimated and displayed for each estimated accuracy rate. Attachment B-2 displays the estimated rates and sampling errors for calendar year (CY) 2007 BAM paid claims results for the following types of overpayments:

Annual Report Rate - The annual report rate includes fraud, nonfraud recoverable overpayments, nonfraud nonrecoverable overpayments, official action taken to reduce future benefits, and payments that are technically proper due to finality or other rules. The rate excludes payments determined to be "technically" proper due to law/rules requiring formal warnings for unacceptable work search efforts. All causes and responsible parties are included in this rate.

Operational Rate - The operational overpayment rate includes those overpayments that the states are reasonably expected to detect and establish for recovery -- fraud and nonfraud recoverable overpayments, excluding work search, employment service (ES) registration, base period wage issues and miscellaneous causes, such as benefits paid during a period of disqualification, redeterminations, and back pay awards.

Fraud - The definition of unemployment compensation fraud varies from state to state. The rate includes all causes and responsible parties.

Attachment B-3 displays the estimated rates and sampling errors for CY 2007 BAM denied claims results for monetary, separation, and nonseparation issues.

d. Unusual problems requiring specialized sampling procedures. BAM paid and denied claims does not involve any unusual problems requiring specialized sampling procedures.

e. Use of periodic data collection to reduce burden. Less frequent data collection cycles would not be an appropriate means for reducing burden. This issue is addressed in Part A of the Justification, section A-6. To make reliable estimates of accuracy in a highly seasonal program such as UI, sampling must occur continuously. BAM paid and denied claims samples are drawn weekly. The continuous investigation of these samples, with regular data entry, also provides up-to-date information on accuracy to facilitate continuous improvement. Because the samples are weekly, they can be aggregated over various time periods for analytical purposes.

B-3. Methods to Maximize Response Rates

Because claimants are required to provide information concerning their continued eligibility for UI benefits, nonresponse to the BAM claimant questionnaire can affect eligibility for benefit payments. The response rate for claimant contacts (that is, the percentage of claimant questionnaires completed) for BAM paid claims is nearly 90 percent. It is more difficult to obtain a complete questionnaire from claimants who were denied benefits. Some of these individuals have returned to work or have relocated and are unavailable for interview.

Even if claimant information cannot be obtained directly, BAM investigators can obtain sufficient information from SWA records, and other relevant parties in order to reach an informed decision concerning the accuracy of the decision to deny benefits. The BAM investigators verify all information provided by UI recipients or obtained from automated file systems and other agency records. They contact all employers for whom the claimant worked before becoming unemployed or who provided part-time work during the claims series or were contacted in job search, as well as interested third parties, such as labor unions or employment agencies. The national case completion rate when all contacts are considered has consistently been over 99 percent for both paid and denied claims.

In CY 2007, although the percentage of claimant questionnaires completed varied considerably by sample type, states were able to complete nearly all of their cases based on agency documentation, employer, and third party information. The following table summarizes claimant response by data collection method. Attachment B-4 displays the response rates for the CY 2007 BAM paid claims samples, and Attachment B-5 displays the response rates for the CY 2007 BAM denied claims samples.

BAM Case Completion and Claimant Interview Method -- CY 2007
Sample Type	Cases Sampled	Valid Cases*	Cases Completed	Percent Completed	In-Person	Tele-Phone	Mail	No Clmnt. Inter.
Paid Claims	24,815	24,811	24,802	99.96%	20.99%	38.16%	29.65%	11.19%
Monetary	8,218	7,963	7,960	99.96%	1.38%	48.42%	16.17%	34.02%
Separation	8,037	7,999	7,997	99.97%	1.49%	46.09%	20.08%	32.34%
Nonseparation	8,129	7,994	7,992	99.97%	1.63%	50.88%	21.81%	25.69%

^* Cases sampled minus cases deleted because they did not meet the definition for inclusion in the survey population and denied claims that were withdrawn by the claimant.

In order to reduce respondent burden and maximize claimant response, the number of data elements collected for DCA is significantly smaller than the amount of data collected for BAM paid claims. Because only information relevant to the monetary, separation, or nonseparation denial issue is verified, the number of data elements per case is one-third or less of the number collected for BAM paid claims, which investigates decisions at all three points in the UI claims process. In addition, SWAs follow up the initial claimant contact with a sufficient number of call-backs and re-contact attempts to demonstrate that a reasonable attempt was made to obtain the information.

SWAs administering the BAM program are encouraged to:

• Use all available data collection methods -- in-person, telephone, mail, e-mail, and fax -- to complete their investigations;

• Be as flexible as feasible in accommodating the schedules of claimants, employers, and other relevant parties;

• Develop clear and concise questionnaires and scripts which clearly explain the purpose of the data collection effort and minimize the time commitment of the respondent. To this end the Department shares examples and prototype case investigation materials in order to disseminate best practices as widely as possible;

• Clearly inform the respondents that the confidentiality of the information they provide will be strictly maintained and that any information that can identify an individual, such as a claimant’s social security number, will not be shared with the Department’s or any other State’s record systems; and

• Emphasize to respondents that the major objective of the BAM program is the improvement of the UI system, and that their cooperation will contribute to insuring that individuals who are in fact eligible for UI benefits receive them.

B-4. Tests of Procedures or Methods

Paid Claims

In 1991 the Department of Labor completed a pilot test of the feasibility and cost-effectiveness of telephone contacts in lieu of in-person interviews with claimants, employers, and third parties. Four States participated in the pilot test, giving a wide range of economic, social and geographical environments. Briefly, the pilot showed that the telephone was reasonably effective in detecting overpayment and underpayment errors: the patterns of erroneous payments by type and cause were basically the same as detected by the in-person control investigations. Although the rate of dollars overpaid discovered by the two methods in one State was virtually identical, in the other three the telephone estimate was only 60% of the in-person estimate. The pilot showed that the telephone methodology was very effective for certain aspects of BAM investigations, but less so for others. It also showed that BAM investigations could be done considerably less expensively by telephone--at about half the cost, confirming the estimate from a similar pilot project conducted in Idaho in the late 1980s.

Denied Claims

In 1987 the Department completed a five-State pilot test of using the BAM field-check methodology for determining the accuracy of benefit denial decisions. Three different sampling designs were evaluated in the 1986-87 pilot: (1) separate sampling frames for monetary, separation, and nonseparation (continuing eligibility) denials and a single sampling frame for all paid claims; (2) separate sampling frames for denials and decisions to affirm eligibility at the monetary, separation, and nonseparation points of determination in the UI claims process; and (3) a longitudinal approach, in which claimants were sampled at the time that the initial claim was filed, and eligibility determinations (either to deny or affirm eligibility) were investigated as they occurred during the claims process. The 1997-98 DCA pilot was based on model 1, which was the simplest design and preserved the design used for BAM paid claims. As noted in A-12, the Department has relied on results of the 1997-98 DCA pilot to estimate case-completion times and burden hours for national implementation of DCA.

B-5. Consultations on Statistical Aspects of the Design

The following individuals assisted in the development of the statistical design of BAM paid and denied claims and may be contacted for further information:

Andrew Spisak

Employment and Training Administration

Office of Workforce Security

Phone: 202-693-3196

E-mail: [email protected]

Estimation Procedure for Benefit Accuracy Measurement

BAM Paid Claims

1. Ratio Estimate of Overpayment Rate

The parameter to be estimated, R_o, is the ratio of Unemployment Insurance (UI) benefits overpaid to total UI benefits paid: R_o = Y/X, where Y = Total dollars overpaid in the population and X = Total UI benefits paid in the population.

R_o is estimated by the sample ratio:

r_o =

where:

H = Number of batches (weekly samples) in the period for which the estimate is being made.

N_h = Total number of UI payments in the population for batch h. (Note: This value is available from state automated record systems and does not have to be estimated.)

m_h = Number of completed sample cases in batch h.

x_hi = Amount of UI benefits paid/offset for the i^th case in batch h.

y_hi = Dollars overpaid for the i^th case in batch h.

Nonresponse is assumed to be random.

2. Sampling Variance of Ratio Estimate of Overpayment Rate

The following formula will be used to estimate the sampling variance of the ratio estimate of the BAM paid claims overpayment rate.

(Note: Because the sampling fractions, f_h=m_h/N_h, are negligible, the term (1-f_h) has been omitted from the equations.)

estVar(r_o)=

=

where:

is the sample variance of the dollars overpaid;

is the sample variance of the dollars paid/offset; and

is the sample covariance of the dollars overpaid and the dollars paid/offset.

X = Total population dollars paid/offset for the H batches.

(Note: This value is available from state automated record systems and does not have to be estimated.)

3. Ratio Estimate of Overpayment Rate for Subgroups

The parameter to be estimated, R_ok, is the ratio of Unemployment Insurance (UI) benefits overpaid to total UI benefits paid for population subgroup k: R_ok = Y_k/X_k, where Y_k=Total dollars overpaid in the population for the k^th subgroup and X_k=Total UI benefits paid in the population for the k^th subgroup.

R_ok is estimated by the sample ratio:

r_ok =

where:

x_hik = Amount of UI benefits paid/offset for the i^th case in the k^th subgroup in batch h.

x_hik = x_hi, for hi in the k^th subgroup, and

x_hik = 0, for hi not in the k^th subgroup

y_hik = Dollars overpaid for the i^th case in the k^th subgroup in batch h.

y_hik = y_hi, for hi in the k^th subgroup, and

y_hik = 0, for hi not in the k^th subgroup

Nonresponse is assumed to be random.

4. Sampling Variance of Ratio Estimate of Overpayment

Rate for Subgroups

The following formula will be used to estimate the sampling variances of the ratio estimate of the overpayment rate for subgroups.

(Note: Because the sampling fractions, f_h=m_h/N_h, are negligible, the term (1-f_h) has been omitted from the equations.)

estVar(r_ok)=

where:

is the sample variance of the dollars overpaid in the k^th subgroup;

is the sample variance of the dollars paid/offset in the k^th subgroup; and

is the sample covariance of the dollars overpaid and the dollars paid/offset.

is the estimated total dollars paid/offset for the H batches.

In the preceeding formulas,

x_hik = x_hi, for hi in the kth subgroup, and

x_hik = 0, for hi not in the kth subgroup;

y_hik = y_hi, for hi in the kth subgroup, and

y_hik = 0, for hi not in the kth subgroup

x_hk = Amount of UI benefits paid/offset in the k^th subgroup in the sample in batch h.

5. Ratio Estimate of Proper Payment Rate

The parameter to be estimated, R_p, is the ratio of Unemployment Insurance (UI) benefits properly paid to total UI benefits paid: R_p = Z/X, where Z = Total dollars properly paid in the population and X = Total UI benefits paid in the population.

R_p is estimated by the sample ratio:

r_p =

where H, N_h, m_h, and x_hi are defined as in 1., above, and

z_hi = Dollars properly paid (dollars paid - dollars overpaid) for the i^th case in batch h.

6. Sampling Variance of Ratio Estimate of Proper Payment Rate

The following formula will be used to estimate the sampling variance of the ratio estimate of the BAM paid claims proper payment rate.

(Note: Because the sampling fractions, f_h=m_h/N_h, are negligible, the term (1-f_h) has been omitted from the equations.)

estVar(r_p) =

where H, N_h, m_h, X, and s²_xh are defined as in 1. and 2., above;

s²_zh is the sample variance of the dollars properly paid; and

s_zxh is the sample covariance of the dollars properly paid and dollars paid.

7. Ratio Estimate of Proper Payment Rate for Subgroups

The parameter to be estimated, R_pk, is the ratio of Unemployment Insurance (UI) benefits properly paid to total UI benefits paid for population subgroup k: R_pk = Z_k/X_k, where Z_k=Total dollars properly paid in the population for the k^th subgroup and X_k=Total UI benefits paid in the population for the k^th subgroup.

R_pk is estimated by the sample ratio r_pk which is defined as the estimator r_ok in section 3, above, except that:

z_hik = Dollars properly paid (dollars paid - dollars overpaid) for the i^th case in the k^th subgroup in batch h.

z_hik = z_hi, for hi in the k^th subgroup, and

z_hik = 0, for hi not in the k^th subgroup

8. Sampling Variance of Ratio Estimate of Proper Payment

Rate for Subgroups

The following formula will be used to estimate the sampling variances of the ratio estimate of the proper payment rate for subgroups.

(Note: Because the sampling fractions, f_h=m_h/N_h, are negligible, the term (1-f_h) has been omitted from the equations.)

estVar(r_pk)=

where H, N_h, m_h, , and s²_xh(k) are defined as in 1.and 4., above;

s²_zh(k) is the sample variance of the dollars properly paid in the k^th subgroup; and

s_zxh(k) is the sample covariance of the dollars properly paid and dollars paid in the k^th subgroup.

9. Ratio Estimate of Underpayment Rate

The parameter to be estimated, R_u is the ratio of Unemployment Insurance (UI) benefits underpaid to total UI benefits paid: R_u = U/X, where U = Total dollars underpaid in the population and X = Total UI benefits paid in the population.

R_u is estimated by the sample ratio:

r_u=

where H, N_h, m_h, and x_hi are defined as in 1., above, and

u_hi = Dollars underpaid for the i^th case in batch h.

10. Sampling Variance of Ratio Estimate of Underpayment Rate

The following formula will be used to estimate the sampling variance of the ratio estimate of the BAM paid claims underpayment rate.

(Note: Because the sampling fractions, f_h=m_h/N_h, are negligible, the term (1-f_h) has been omitted from the equations.)

estVar(r_u) =

where H, N_h, m_h, X, and s²_xh are defined as in 1. and 2., above;

s²_uh is the sample variance of the dollars underpaid; and

s_uxh is the sample covariance of the dollars underpaid and dollars paid.

11. Ratio Estimate of Underpayment Rate for Subgroups

The parameter to be estimated, R_uk, is the ratio of Unemployment Insurance (UI) benefits underpaid to total UI benefits paid for population subgroup k: R_uk = U_k/X_k, where U_k=Total dollars underpaid in the population for the k^th subgroup and X_k=Total UI benefits paid in the population for the k^th subgroup.

R_uk is estimated by the sample ratio r_uk which is defined as the estimator r_ok in section 3, above, except that:

u_hik = Dollars underpaid for the i^th case in the k^th subgroup in batch h.

u_hik = u_hi, for hi in the k^th subgroup, and

u_hik = 0, for hi not in the k^th subgroup

12. Sampling Variance of Ratio Estimate of Underpayment

Rate for Subgroups

The following formula will be used to estimate the sampling variances of the ratio estimate of the underpayment rate for subgroups.

(Note: Because the sampling fractions, f_h=m_h/N_h, are negligible, the term (1-f_h) has been omitted from the equations.)

estVar(r_uk)=

where H, N_h, m_h, , and s²_xh(k) are defined as in 1.and 4., above;

s²_uh(k) is the sample variance of the dollars underpaid in the k^th subgroup; and

s_uxh(k) is the sample covariance of the dollars underpaid and dollars paid in the k^th subgroup.

Confidence Intervals

The 95% confidence interval for any estimated ratio r_θ (1, 3, 5, 7, 9, or 11, above) is:

Coefficient of Variation

The coefficient of variation (cv) of an estimate r_θ is:

BAM Denied Claims

Equations for Case Error Estimates

The following notation will be used:

H = the number of weeks (batches) in the period for which the estimate is

being made.

N_h = the number of denied claims in week h.

X_h = the number of claims in week h which were erroneously denied.

P_h = X_h/N_h = the proportion of claims in week h which were erroneously

denied.

N_ = = total number of denied claims in the period.

X_ = = total number of claims erroneously denied in the period.

The parameter to be estimated, P, is the proportion of claims erroneously denied during the period. Estimates will be made for each of the three denial universes -- monetary, separation, and nonseparation. We wish to estimate:

P = X_/N_ =

Now let

m_h = the number of completed sample claims for week h.

m_ = = total number of completed sample claims in the period.

x_h = the number of claims in week h which were erroneously denied.

= proportion of sample claims in week h which were erroneously denied.

If it is assumed that non-response is "at random", then .

It follows that is unbiased for P. Furthermore, as sampling is independent within each week (stratum), it follows that

where f_h = m_h/N_h. The usual estimator for is

.

If f_h is negligible then

can be used for variance estimation.

Proportions for Subgroups

The proportion of denial actions which were incorrectly decided may be estimated for population subgroups, for example UI program (State UI, UCFE, UCX), filing method (in-person, telephone, mail), or demographic classifications.

Building on the notation above, for the k^th subgroup and the h^th week let

N_hk = the number of denied claims.

X_hk = the number of claims were erroneously denied.

P_hk = X_hk/N_hk = the proportion of claims which were erroneously denied.

Then for the k^th subgroup we have

N_k = = total number of denied claims in the period.

X_k = = total number of claims erroneously denied in the period.

The parameter to be estimated, P_k, is the proportion of claims erroneously denied during the period for subgroup k. Analogous to previous work, we can write

P_k = X_k/N_k = .

Note that neither X_k nor N_k is known. For the k^th subgroup, h^th week, let

m_hk = the number of completed sample claims for week h.

x_hk = the number of claims in week h which were erroneously denied.

Assuming nonresponse is "at random", is unbiased for X_k and is unbiased for N_k. The ratio estimator is approximately unbiased for P_k, and

where f_hk = m_hk/N_hk and θ_hk = N_hk/N_h. Assuming that f_hk is negligible, an estimate for the variance is given by

where

and

{  .

Confidence Intervals

The 95% confidence interval for any estimate (u) is:

Coefficient of Variation

The coefficient of variation (cv) of an estimate u is:

UI Benefit Accuracy Measurement Rates -- CY 2007

Annual

Amount Report 95% CI Oper. 95% CI Fraud 95% CI

ST Sample Paid Rate +/- Rate +/- Rate +/-

__ _______ ________________ _______ ______ ______ ______ ______ ______

AK 480 $107,936,389 9.959% 2.484 6.806% 2.087 2.964% 1.468

AL 480 $230,612,297 11.674% 2.968 8.433% 2.511 3.816% 1.791

AR 480 $300,311,480 9.260% 2.407 8.518% 2.344 4.775% 1.848

AZ 481 $270,174,480 18.018% 3.452 9.609% 2.621 6.381% 2.196

CA 1,044 $5,007,138,790 5.783% 1.556 4.003% 1.314 3.544% 1.263

CO 477 $308,082,435 17.497% 3.437 3.965% 1.801 1.035% .952

CT 475 $552,664,329 5.088% 2.144 3.975% 1.876 3.796% 2.052

DC 360 $97,159,601 7.435% 2.597 5.280% 2.187 3.355% 1.801

DE 360 $101,454,749 10.119% 3.279 5.801% 2.593 6.439% 2.621

FL 480 $1,133,031,716 4.656% 1.835 4.473% 1.799 .831% .809

GA 480 $625,378,571 6.166% 2.293 2.264% 1.458 1.101% 1.095

HI 400 $121,592,782 7.162% 2.567 1.168% .907 .553% .705

IA 480 $333,328,012 12.022% 2.878 6.400% 2.061 .315% .463

ID 483 $128,070,829 11.126% 2.961 4.504% 1.841 2.876% 1.582

IL 564 $1,907,648,294 13.320% 2.849 6.942% 2.019 1.899% 1.242

IN 480 $731,010,100 18.109% 3.533 6.630% 2.404 1.680% 1.409

KS 495 $230,843,959 4.224% 1.835 3.992% 1.797 .717% .822

KY 485 $396,367,539 3.688% 1.653 2.855% 1.431 1.634% 1.103

LA 480 $159,544,344 46.511% 4.682 17.92% 3.588 6.263% 2.272

MA 683 $1,429,708,631 3.915% 1.352 2.535% 1.101 1.636% .990

MD 480 $439,663,744 9.869% 2.662 3.693% 1.657 1.472% 1.030

ME 360 $114,418,407 10.147% 3.431 4.053% 2.011 2.185% 1.593

MI 480 $1,737,449,091 9.207% 2.522 8.521% 2.464 2.468% 1.425

MN 480 $742,347,121 10.931% 3.913 8.014% 3.648 2.077% 1.424

MO 480 $423,533,672 6.946% 2.369 6.467% 2.332 3.381% 1.752

MS 479 $138,279,256 9.476% 2.712 5.708% 2.131 4.802% 2.025

MT 360 $66,280,549 7.421% 2.882 5.966% 2.688 .601% .549

NC 520 $914,579,224 9.530% 2.317 6.475% 1.947 2.454% 1.325

ND 360 $39,756,539 5.627% 2.548 2.599% 1.716 .539% .518

NE 482 $80,468,539 11.886% 2.973 7.999% 2.489 1.799% 1.165

NH 364 $83,171,186 6.541% 2.780 5.527% 2.626 .888% 1.110

NJ 484 $1,928,565,160 9.267% 2.163 5.896% 2.003 1.001% .787

NM 480 $119,803,236 23.507% 4.141 7.514% 2.636 6.003% 2.437

NV 483 $339,202,046 9.134% 2.815 8.941% 2.799 4.453% 1.878

NY 483 $2,253,146,925 7.760% 2.304 5.627% 1.991 3.890% 1.659

OH 486 $1,160,493,055 14.115% 2.965 5.635% 1.917 2.180% 1.266

OK 480 $159,435,984 4.667% 1.797 3.329% 1.480 .433% .484

OR 481 $539,856,247 16.474% 3.549 12.13% 3.103 8.245% 2.568

PA 480 $2,312,838,286 6.613% 2.100 5.135% 1.907 3.753% 1.723

PR 500 $201,617,049 9.888% 2.712 8.512% 2.591 7.394% 2.451

UI Benefit Accuracy Measurement Rates -- CY 2007

Annual

Amount Report 95% CI Oper. 95% CI Fraud 95% CI

ST Sample Paid Rate +/- Rate +/- Rate +/-

__ _______ ________________ _______ ______ ______ ______ ______ ______

RI 480 $222,469,978 4.332% 1.793 2.803% 1.311 2.200% 1.225

SC 520 $344,751,034 9.173% 2.407 7.415% 2.179 2.984% 1.488

SD 360 $21,709,497 6.918% 2.797 3.906% 2.350 .899% .978

TN 480 $397,824,073 7.428% 2.304 4.763% 1.789 2.183% 1.277

TX 480 $1,109,314,743 13.832% 3.176 7.176% 2.321 2.529% 1.375

UT 481 $104,477,649 8.126% 2.497 3.806% 1.643 1.868% 1.208

VA 480 $382,515,118 31.428% 4.423 10.90% 2.792 5.214% 2.154

VT 360 $88,374,907 3.850% 1.932 2.203% 1.441 .513% .599

WA 492 $697,969,798 6.189% 2.157 3.730% 1.632 1.864% 1.196

WI 480 $882,790,570 6.150% 2.142 3.830% 1.558 1.284% .962

WV 480 $138,460,499 4.322% 2.006 2.964% 1.628 1.321% 1.358

WY 360 $31,862,646 16.032% 4.168 5.703% 2.491 1.829% 1.254

US 24,802 $32,389,485,155 9.135% .495 5.616% .414 2.726% .316

Prepared By ETA Office of Workforce Security on 19 Feb 09

Denied Claims Accuracy Rates and Sampling Errors -- CY 2007

Adjusted

Samp Improper 95% C.I. Improper 95% C.I.

ST Type Sample* Population Denial (+/-) Denial# (+/-)

__ ____ _______ __________ ________ ________ ________ ________

AK MON 147 3,164 9.748% 5.655 6.924% 4.840

SEP 150 11,493 8.301% 3.829 8.301% 3.829

NS 150 14,322 8.081% 4.623 6.378% 4.203

AL MON 149 27,163 4.068% 4.264 2.251% 3.456

SEP 150 28,121 6.333% 3.752 3.149% 2.781

NS 150 22,976 13.491% 5.678 12.063% 5.316

AR MON 146 5,631 22.778% 8.007 15.460% 6.897

SEP 150 29,962 6.737% 3.816 6.097% 3.605

NS 150 14,521 9.167% 4.677 7.319% 4.184

AZ MON 151 23,218 8.297% 4.482 5.247% 3.290

SEP 151 19,449 2.741% 2.692 2.741% 2.692

NS 151 28,540 5.645% 3.467 4.344% 3.225

CA MON 152 166,817 23.791% 7.306 14.713% 6.071

SEP 165 267,748 6.656% 4.108 5.588% 3.535

NS 164 438,990 15.851% 5.824 8.486% 4.351

CO MON 120 1,548 17.681% 7.552 11.015% 6.333

SEP 156 50,432 7.687% 4.051 1.723% 1.950

NS 155 46,575 9.185% 4.501 7.752% 4.038

CT MON 150 4,402 10.671% 4.852 8.611% 4.645

SEP 148 16,573 9.473% 5.407 4.689% 3.997

NS 148 15,390 9.632% 4.978 9.250% 4.922

DC MON 136 1,925 8.303% 4.855 2.779% 3.085

SEP 150 4,439 5.305% 3.342 3.756% 2.977

NS 151 2,844 8.007% 3.974 5.650% 3.778

DE MON 126 386 41.192% 7.573 17.776% 6.112

SEP 150 5,762 .613% .584 .307% .584

NS 150 4,203 3.335% 3.349 2.663% 3.089

Footnotes

---------

* Excludes cases not meeting DCA definition for inclusion in population,

withdrawn claims, and claims for which monetary eligibility was

established upon receipt of CWC, UCFE, and/or UCX wage credits.

# Adjusted rate excludes erroneous denials that were corrected by agency

and claims for which eligibility was established through appeal prior

to DCA case completion.

Denied Claims Accuracy Rates and Sampling Errors -- CY 2007

Adjusted

Samp Improper 95% C.I. Improper 95% C.I.

ST Type Sample* Population Denial (+/-) Denial# (+/-)

__ ____ _______ __________ ________ ________ ________ ________

FL MON 153 67,648 12.374% 5.890 .747% 1.463

SEP 155 100,086 3.248% 2.576 .624% 1.222

NS 155 48,311 3.617% 2.633 1.310% 1.814

GA MON 138 23,430 33.159% 10.328 22.938% 9.542

SEP 152 71,991 3.736% 2.095 2.477% 2.431

NS 152 26,306 3.703% 2.704 3.703% 2.704

HI MON 145 707 3.807% 3.162 2.346% 2.547

SEP 150 6,385 6.458% 3.368 5.043% 2.754

NS 150 12,797 8.443% 4.445 8.443% 4.445

IA MON 150 5,987 15.843% 6.177 12.468% 6.070

SEP 153 22,314 16.713% 5.488 14.184% 5.210

NS 153 9,738 18.197% 6.016 13.398% 5.406

ID MON 149 867 13.603% 5.406 12.450% 5.384

SEP 151 6,271 5.795% 3.551 3.862% 3.085

NS 151 9,206 9.052% 4.736 7.307% 4.429

IL MON 178 36,303 15.773% 4.740 11.039% 4.316

SEP 181 64,973 14.156% 5.703 7.099% 4.376

NS 180 40,490 15.128% 5.095 9.202% 4.096

IN MON 147 43,151 9.222% 4.926 7.210% 4.299

SEP 150 43,100 17.471% 7.533 14.749% 7.275

NS 149 33,329 17.968% 5.555 17.294% 5.396

KS MON 152 11,043 2.477% 2.154 2.477% 2.154

SEP 154 18,420 1.230% 2.405 1.230% 2.405

NS 156 7,502 4.118% 4.112 4.118% 4.112

KY MON 115 13,156 17.799% 8.692 9.083% 6.305

SEP 156 29,616 4.798% 3.328 1.218% 1.687

NS 156 24,434 6.304% 3.627 6.304% 3.627

Footnotes

---------

* Excludes cases not meeting DCA definition for inclusion in population,

withdrawn claims, and claims for which monetary eligibility was

established upon receipt of CWC, UCFE, and/or UCX wage credits.

# Adjusted rate excludes erroneous denials that were corrected by agency

and claims for which eligibility was established through appeal prior

to DCA case completion.

Denied Claims Accuracy Rates and Sampling Errors -- CY 2007

Adjusted

Samp Improper 95% C.I. Improper 95% C.I.

ST Type Sample* Population Denial (+/-) Denial# (+/-)

__ ____ _______ __________ ________ ________ ________ ________

LA MON 155 15,105 22.538% 6.766 20.093% 6.445

SEP 156 24,051 9.837% 4.778 7.573% 4.345

NS 156 60,581 13.417% 12.834 13.052% 12.814

MA MON 150 8,646 10.968% 5.988 10.968% 5.988

SEP 150 33,773 15.436% 6.551 3.293% 3.112

NS 150 27,978 11.690% 6.320 3.764% 3.439

MD MON 149 12,554 4.820% 3.209 1.710% 1.991

SEP 150 48,085 5.840% 3.318 4.558% 2.804

NS 150 31,726 6.094% 3.806 4.192% 3.382

ME MON 144 2,914 14.931% 7.201 8.656% 6.473

SEP 150 6,920 3.200% 2.561 .925% 1.273

NS 150 18,265 7.786% 5.692 3.932% 4.033

MI MON 150 50,868 15.057% 5.397 12.173% 5.189

SEP 150 66,638 8.549% 4.577 5.277% 3.524

NS 149 128,350 10.286% 4.888 6.844% 4.148

MN MON 148 10,580 21.551% 7.083 19.501% 7.018

SEP 150 24,120 15.237% 5.766 5.047% 3.920

NS 149 47,356 15.848% 6.510 13.094% 6.358

MO MON 150 58,885 6.688% 4.177 5.427% 3.368

SEP 149 69,904 6.656% 4.751 4.895% 4.394

NS 150 74,315 32.807% 8.284 21.818% 7.578

MS MON 152 10,900 7.590% 4.734 3.104% 2.727

SEP 155 32,554 2.372% 2.113 1.396% 1.620

NS 156 12,266 2.606% 2.620 1.503% 2.102

MT MON 140 2,224 8.142% 4.540 7.338% 4.361

SEP 151 6,188 7.871% 4.677 4.476% 3.572

NS 151 1,572 8.774% 4.887 4.264% 2.849

Footnotes

---------

* Excludes cases not meeting DCA definition for inclusion in population,

withdrawn claims, and claims for which monetary eligibility was

established upon receipt of CWC, UCFE, and/or UCX wage credits.

# Adjusted rate excludes erroneous denials that were corrected by agency

and claims for which eligibility was established through appeal prior

to DCA case completion.

Denied Claims Accuracy Rates and Sampling Errors -- CY 2007

Adjusted

Samp Improper 95% C.I. Improper 95% C.I.

ST Type Sample* Population Denial (+/-) Denial# (+/-)

__ ____ _______ __________ ________ ________ ________ ________

NC MON 155 29,495 20.146% 5.902 10.331% 4.178

SEP 156 61,390 4.044% 3.276 3.519% 3.110

NS 156 29,641 15.401% 6.154 15.032% 6.112

ND MON 142 926 7.811% 5.310 6.839% 4.992

SEP 151 3,044 6.493% 4.000 3.778% 2.888

NS 151 13,312 8.293% 4.604 8.293% 4.604

NE MON 152 3,909 7.879% 4.598 7.879% 4.598

SEP 152 34,397 8.840% 4.405 6.775% 3.732

NS 151 6,322 32.378% 8.190 27.313% 8.021

NH MON 169 2,366 11.001% 4.837 9.955% 4.626

SEP 165 5,597 7.953% 4.526 4.762% 3.535

NS 163 19,008 13.244% 5.455 11.081% 4.987

NJ MON 153 42,408 9.208% 4.787 8.296% 4.441

SEP 156 64,561 5.278% 3.665 3.381% 2.963

NS 155 34,396 6.455% 4.104 3.978% 3.279

NM MON 113 2,084 38.773% 7.849 22.698% 9.560

SEP 155 10,027 5.555% 3.354 3.278% 2.771

NS 151 1,536 16.380% 5.446 14.579% 5.027

NV MON 139 3,568 25.976% 7.376 2.826% 2.861

SEP 151 21,474 9.892% 5.249 2.682% 2.443

NS 151 25,246 25.595% 8.250 6.550% 4.398

NY MON 141 54,729 27.137% 7.772 19.649% 6.862

SEP 152 87,475 5.231% 3.665 4.594% 3.447

NS 151 65,269 4.002% 3.337 3.409% 3.129

OH MON 151 62,463 28.760% 7.426 24.036% 7.327

SEP 151 59,770 13.766% 5.825 10.771% 5.005

NS 150 72,592 21.442% 6.484 17.698% 5.812

Footnotes

---------

* Excludes cases not meeting DCA definition for inclusion in population,

withdrawn claims, and claims for which monetary eligibility was

established upon receipt of CWC, UCFE, and/or UCX wage credits.

# Adjusted rate excludes erroneous denials that were corrected by agency

and claims for which eligibility was established through appeal prior

to DCA case completion.

Denied Claims Accuracy Rates and Sampling Errors -- CY 2007

Adjusted

Samp Improper 95% C.I. Improper 95% C.I.

ST Type Sample* Population Denial (+/-) Denial# (+/-)

__ ____ _______ __________ ________ ________ ________ ________

OK MON 149 13,001 4.918% 3.388 3.118% 2.734

SEP 155 20,648 4.586% 3.380 1.309% 1.808

NS 156 14,648 11.861% 4.931 11.196% 4.758

OR MON 147 7,760 7.739% 4.152 6.542% 3.873

SEP 155 28,789 11.171% 5.239 6.844% 4.291

NS 155 39,629 11.756% 4.926 10.548% 4.791

PA MON 155 50,431 11.201% 6.036 7.333% 5.056

SEP 156 78,320 11.937% 5.383 4.004% 3.298

NS 167 29,967 19.194% 6.786 16.245% 6.239

PR MON 152 7,734 68.417% 6.961 29.704% 8.650

SEP 151 9,062 1.879% 2.188 1.121% 1.616

NS 151 25,141 9.546% 4.900 9.546% 4.900

RI MON 150 2,475 16.276% 6.019 11.333% 4.817

SEP 150 5,650 .869% 1.182 .869% 1.182

NS 150 5,076 4.216% 5.062 4.216% 5.062

SC MON 153 31,805 10.866% 5.163 10.375% 5.072

SEP 156 49,245 8.661% 4.502 6.351% 4.011

NS 156 19,656 8.435% 4.636 6.286% 3.950

SD MON 150 1,993 2.242% 3.250 .703% 1.327

SEP 150 3,437 3.161% 2.803 1.619% 2.204

NS 150 5,888 8.798% 4.673 7.909% 4.343

TN MON 150 11,841 17.407% 7.168 13.638% 6.736

SEP 150 29,193 18.526% 6.652 8.065% 4.353

NS 149 5,283 23.596% 6.850 20.485% 6.720

TX MON 150 68,578 8.448% 4.574 8.448% 4.574

SEP 156 137,984 6.557% 3.986 6.557% 3.986

NS 156 147,866 20.664% 6.367 18.267% 6.179

Footnotes

---------

* Excludes cases not meeting DCA definition for inclusion in population,

withdrawn claims, and claims for which monetary eligibility was

established upon receipt of CWC, UCFE, and/or UCX wage credits.

# Adjusted rate excludes erroneous denials that were corrected by agency

and claims for which eligibility was established through appeal prior

to DCA case completion.

Denied Claims Accuracy Rates and Sampling Errors -- CY 2007

Adjusted

Samp Improper 95% C.I. Improper 95% C.I.

ST Type Sample* Population Denial (+/-) Denial# (+/-)

__ ____ _______ __________ ________ ________ ________ ________

UT MON 143 1,705 24.233% 7.668 22.454% 7.867

SEP 151 10,893 10.663% 5.408 8.821% 5.135

NS 147 43,829 8.818% 4.488 6.349% 4.180

VA MON 142 14,006 8.367% 4.994 4.693% 3.833

SEP 156 30,706 13.758% 5.792 13.031% 5.615

NS 156 21,044 6.688% 3.342 6.688% 3.342

VT MON 132 1,461 21.102% 8.091 17.634% 7.607

SEP 150 4,889 2.454% 2.402 .580% 1.116

NS 150 4,052 7.058% 4.397 7.058% 4.397

WA MON 174 19,945 2.059% 2.224 2.059% 2.224

SEP 182 44,854 8.348% 4.102 6.769% 3.684

NS 181 82,196 10.286% 4.624 8.468% 4.295

WI MON 152 17,197 6.028% 3.794 4.650% 3.499

SEP 156 46,906 16.165% 5.712 4.455% 3.336

NS 156 55,006 12.808% 5.448 12.185% 5.310

WV MON 146 1,762 13.719% 5.560 8.260% 4.366

SEP 151 9,942 4.945% 3.417 3.239% 2.828

NS 151 4,736 15.664% 5.854 14.967% 5.698

WY MON 148 1,356 9.995% 4.748 6.799% 4.453

SEP 150 2,762 2.727% 2.629 2.088% 2.329

NS 150 4,300 5.248% 4.420 2.868% 2.945

US MON 7,650 1,064,216 15.777% .791 10.716% .666

SEP 7,997 1,970,383 8.047% .585 5.166% .464

NS 7,992 1,978,520 13.732% .700 9.946% .632

Footnotes

---------

* Excludes cases not meeting DCA definition for inclusion in population,

withdrawn claims, and claims for which monetary eligibility was

established upon receipt of CWC, UCFE, and/or UCX wage credits.

# Adjusted rate excludes erroneous denials that were corrected by agency

and claims for which eligibility was established through appeal prior

to DCA case completion.

Prepared by ETA Office of Workforce Security on 19 Feb 09.

BAM Case Completion and Time Lapse -- CY 2007

Cases Percent 60 Day 90 Day 60 Day 90 Day

ST Sample Compl. Completed TL TL TL & TL &

__ ______ ______ _________ ______ ______ ______ ______

AK 480 480 100.00% 86.04% 99.38% 83.33% 98.75%

AL 480 480 100.00% 98.33% 100.0% 98.33% 100.0%

AR 480 480 100.00% 98.54% 100.0% 98.13% 100.0%

AZ 481 481 100.00% 89.60% 100.0% 88.98% 99.79%

CA 1,044 1,044 100.00% 84.77% 97.32% 80.84% 96.26%

CO 481 477 99.17% 91.89% 98.75% 91.06% 98.54%

CT 480 475 98.96% 92.50% 97.08% 92.50% 97.08%

DC 360 360 100.00% 99.17% 100.0% 98.89% 99.72%

DE 360 360 100.00% 85.00% 98.33% 82.78% 96.39%

FL 480 480 100.00% 99.79% 100.0% 99.79% 100.0%

GA 480 480 100.00% 100.0% 100.0% 100.0% 100.0%

HI 400 400 100.00% 94.50% 99.25% 93.75% 98.75%

IA 480 480 100.00% 80.63% 96.88% 80.42% 96.88%

ID 483 483 100.00% 96.27% 100.0% 95.86% 100.0%

IL 564 564 100.00% 85.46% 97.52% 82.98% 95.57%

IN 480 480 100.00% 95.42% 99.79% 95.42% 99.79%

KS 495 495 100.00% 95.15% 99.19% 93.54% 97.58%

KY 485 485 100.00% 88.66% 99.38% 87.63% 99.38%

LA 480 480 100.00% 91.67% 98.54% 90.42% 98.33%

MA 683 683 100.00% 95.02% 99.12% 90.92% 98.83%

MD 480 480 100.00% 98.54% 100.0% 98.33% 100.0%

ME 360 360 100.00% 71.39% 91.67%+ 70.83% 91.67%+

MI 480 480 100.00% 97.71% 100.0% 97.50% 100.0%

MN 480 480 100.00% 80.42% 93.96%+ 79.38% 93.96%+

MO 480 480 100.00% 94.17% 100.0% 94.17% 100.0%

MS 479 479 100.00% 87.06% 99.16% 86.85% 99.16%

MT 360 360 100.00% 97.50% 100.0% 92.22% 96.67%

NC 520 520 100.00% 90.77% 99.04% 90.58% 98.85%

ND 360 360 100.00% 88.06% 99.72% 87.78% 99.44%

NE 482 482 100.00% 90.25% 97.10% 89.83% 97.10%

Note: Case completion and time lapse percentages are based on sampled cases, excluding cases not meeting BAM population definition.

* Failed to meet 60 day time lapse standard of 70 percent complete.

+ Failed to meet 90 day time lapse standard of 95 percent complete.

& Time lapse includes code 3 reopen cases.

BAM Case Completion and Time Lapse -- CY 2007

Cases Percent 60 Day 90 Day 60 Day 90 Day

ST Sample Compl. Completed TL TL TL & TL &

__ ______ ______ _________ ______ ______ ______ ______

NH 364 364 100.00% 89.84% 95.88% 89.84% 95.88%

NJ 484 484 100.00% 88.22% 98.55% 88.02% 98.35%

NM 480 480 100.00% 95.83% 100.0% 95.42% 100.0%

NV 483 483 100.00% 85.30% 94.41%+ 84.89% 94.41%+

NY 483 483 100.00% 76.19% 90.89%+ 75.36% 90.48%+

OH 486 486 100.00% 91.36% 99.38% 91.15% 99.38%

OK 480 480 100.00% 93.75% 100.0% 93.33% 100.0%

OR 481 481 100.00% 95.43% 99.17% 95.22% 99.17%

PA 480 480 100.00% 74.17% 98.33% 73.96% 98.13%

PR 500 500 100.00% 91.60% 99.60% 90.60% 99.40%

RI 480 480 100.00% 81.46% 95.63% 81.04% 95.21%

SC 520 520 100.00% 97.50% 99.81% 97.50% 99.81%

SD 360 360 100.00% 79.44% 96.94% 76.94% 96.67%

TN 480 480 100.00% 81.88% 97.29% 81.67% 96.88%

TX 480 480 100.00% 73.33% 95.21% 67.71%* 90.83%+

UT 481 481 100.00% 97.92% 100.0% 97.51% 99.79%

VA 480 480 100.00% 77.29% 90.83%+ 76.04% 90.21%+

VT 360 360 100.00% 92.78% 99.72% 91.67% 99.72%

WA 492 492 100.00% 98.98% 100.0% 98.58% 100.0%

WI 480 480 100.00% 96.88% 100.0% 94.17% 98.13%

WV 480 480 100.00% 94.38% 99.38% 94.17% 99.38%

WY 360 360 100.00% 99.72% 100.0% 99.44% 99.72%

US 24,811 24,802 99.96% 90.29% 98.31% 89.24% 97.88%

Note: Time lapse percentages are based on all sampled cases,

excluding cases not meeting BAM population definition

* Failed to meet 60 day time lapse standard of 70 percent complete.

+ Failed to meet 90 day time lapse standard of 95 percent complete.

& Time lapse includes code 3 reopen cases.

Prepared by ETA Office of Workforce Security on 19 Feb 09

BAM DCA Case Completion and Time Lapse -- CY 2007

Sample DCA Cases Percent 60 Day 90 Day

ST Type Sample Cases Compl. Completed TL & TL &

__ __________ ______ ______ ______ _________ ______ ______

AK Monetary 150 148 148 100.00% 87.84% 99.32%

Separation 150 150 150 100.00% 84.00% 95.33%

Nonsep. 152 150 150 100.00% 91.33% 96.67%

AL Monetary 157 151 151 100.00% 98.68% 98.68%

Separation 150 150 150 100.00% 99.33% 99.33%

Nonsep. 150 150 150 100.00% 98.00% 98.00%

AR Monetary 155 150 150 100.00% 98.67% 100.0%

Separation 150 150 150 100.00% 100.0% 100.0%

Nonsep. 150 150 150 100.00% 98.67% 100.0%

AZ Monetary 151 151 151 100.00% 99.34% 100.0%

Separation 151 151 151 100.00% 98.01% 99.34%

Nonsep. 151 151 151 100.00% 98.68% 99.34%

CA Monetary 167 154 154 100.00% 85.71% 96.75%

Separation 168 165 165 100.00% 88.48% 97.58%

Nonsep. 164 164 164 100.00% 84.15% 90.24%

CO Monetary 164 153 152 99.35% 97.39% 98.04%

Separation 156 156 156 100.00% 99.36% 99.36%

Nonsep. 156 155 155 100.00% 97.42% 100.0%

CT Monetary 153 152 150 98.68% 92.76% 96.05%

Separation 152 150 148 98.67% 94.00% 96.67%

Nonsep. 152 150 148 98.67% 92.00% 95.33%

DC Monetary 150 150 150 100.00% 100.0% 100.0%

Separation 152 150 150 100.00% 100.0% 100.0%

Nonsep. 152 151 151 100.00% 100.0% 100.0%

DE Monetary 216 151 151 100.00% 77.48% 95.36%

Separation 152 150 150 100.00% 96.00% 98.00%

Nonsep. 152 150 150 100.00% 96.00% 98.67%

FL Monetary 156 156 156 100.00% 100.0% 100.0%

Separation 156 155 155 100.00% 100.0% 100.0%

Nonsep. 156 155 155 100.00% 100.0% 100.0%

Note: Case completion and time lapse percentages exclude deleted cases

(Program Code = 8 or 9) and withdrawn claims (Action Flag = 8).

* Failed to meet 60 day time lapse standard of 60 percent complete.

+ Failed to meet 90 day time lapse standard of 85 percent complete.

& Time lapse includes code 3 reopen cases.

BAM DCA Case Completion and Time Lapse -- CY 2007

Sample DCA Cases Percent 60 Day 90 Day

ST Type Sample Cases Compl. Completed TL & TL &

__ __________ ______ ______ ______ _________ ______ ______

GA Monetary 152 152 152 100.00% 100.0% 100.0%

Separation 152 152 152 100.00% 100.0% 100.0%

Nonsep. 152 152 152 100.00% 100.0% 100.0%

HI Monetary 157 151 151 100.00% 94.04% 98.01%

Separation 150 150 150 100.00% 94.67% 98.67%

Nonsep. 150 150 150 100.00% 94.67% 99.33%

IA Monetary 157 153 153 100.00% 92.16% 97.39%

Separation 153 153 153 100.00% 95.42% 100.0%

Nonsep. 160 153 153 100.00% 93.46% 99.35%

ID Monetary 151 151 151 100.00% 95.36% 100.0%

Separation 151 151 151 100.00% 98.68% 100.0%

Nonsep. 151 151 151 100.00% 98.01% 100.0%

IL Monetary 185 181 181 100.00% 81.77% 94.48%

Separation 183 181 181 100.00% 96.69% 100.0%

Nonsep. 181 180 180 100.00% 90.00% 96.11%

IN Monetary 150 148 148 100.00% 99.32% 100.0%

Separation 150 150 150 100.00% 98.00% 100.0%

Nonsep. 150 149 149 100.00% 97.99% 99.33%

KS Monetary 155 154 154 100.00% 97.40% 99.35%

Separation 154 154 154 100.00% 97.40% 98.05%

Nonsep. 156 156 156 100.00% 97.44% 98.08%

KY Monetary 156 156 156 100.00% 80.13% 100.0%

Separation 156 156 156 100.00% 83.97% 100.0%

Nonsep. 156 156 156 100.00% 83.97% 99.36%

LA Monetary 156 156 156 100.00% 98.72% 100.0%

Separation 156 156 156 100.00% 89.74% 100.0%

Nonsep. 156 156 156 100.00% 95.51% 100.0%

MA Monetary 150 150 150 100.00% 95.33% 100.0%

Separation 150 150 150 100.00% 94.67% 98.67%

Nonsep. 150 150 150 100.00% 92.67% 98.67%

Note: Case completion and time lapse percentages exclude deleted cases

(Program Code = 8 or 9) and withdrawn claims (Action Flag = 8).

* Failed to meet 60 day time lapse standard of 60 percent complete.

+ Failed to meet 90 day time lapse standard of 85 percent complete.

& Time lapse includes code 3 reopen cases.

BAM DCA Case Completion and Time Lapse -- CY 2007

Sample DCA Cases Percent 60 Day 90 Day

ST Type Sample Cases Compl. Completed TL & TL &

__ __________ ______ ______ ______ _________ ______ ______

MD Monetary 154 150 150 100.00% 98.67% 100.0%

Separation 150 150 150 100.00% 99.33% 100.0%

Nonsep. 150 150 150 100.00% 98.67% 100.0%

ME Monetary 173 151 151 100.00% 85.43% 98.68%

Separation 150 150 150 100.00% 96.00% 100.0%

Nonsep. 151 150 150 100.00% 93.33% 97.33%

MI Monetary 150 150 150 100.00% 100.0% 100.0%

Separation 153 150 150 100.00% 100.0% 100.0%

Nonsep. 151 149 149 100.00% 100.0% 100.0%

MN Monetary 160 150 150 100.00% 96.67% 98.67%

Separation 153 150 150 100.00% 94.67% 99.33%

Nonsep. 157 149 149 100.00% 98.66% 99.33%

MO Monetary 150 150 150 100.00% 96.00% 100.0%

Separation 150 149 149 100.00% 99.33% 100.0%

Nonsep. 151 150 150 100.00% 98.67% 100.0%

MS Monetary 156 155 155 100.00% 86.45% 99.35%

Separation 155 155 155 100.00% 93.55% 100.0%

Nonsep. 156 156 156 100.00% 95.51% 99.36%

MT Monetary 153 149 149 100.00% 95.30% 97.32%

Separation 151 151 151 100.00% 95.36% 98.01%

Nonsep. 155 151 151 100.00% 94.04% 96.69%

NC Monetary 156 155 155 100.00% 95.48% 99.35%

Separation 156 156 156 100.00% 93.59% 99.36%

Nonsep. 156 156 156 100.00% 94.87% 100.0%

ND Monetary 152 150 150 100.00% 89.33% 99.33%

Separation 152 151 151 100.00% 90.07% 100.0%

Nonsep. 152 151 151 100.00% 90.73% 99.34%

NE Monetary 156 152 152 100.00% 84.21% 92.76%

Separation 159 152 152 100.00% 85.53% 96.05%

Nonsep. 157 151 151 100.00% 82.78% 92.72%

Note: Case completion and time lapse percentages exclude deleted cases

(Program Code = 8 or 9) and withdrawn claims (Action Flag = 8).

* Failed to meet 60 day time lapse standard of 60 percent complete.

+ Failed to meet 90 day time lapse standard of 85 percent complete.

& Time lapse includes code 3 reopen cases.

BAM DCA Case Completion and Time Lapse -- CY 2007

Sample DCA Cases Percent 60 Day 90 Day

ST Type Sample Cases Compl. Completed TL & TL &

__ __________ ______ ______ ______ _________ ______ ______

NH Monetary 208 175 175 100.00% 96.57% 98.29%

Separation 168 165 165 100.00% 96.36% 100.0%

Nonsep. 168 163 163 100.00% 98.77% 100.0%

NJ Monetary 156 154 154 100.00% 97.40% 100.0%

Separation 156 156 156 100.00% 97.44% 100.0%

Nonsep. 156 155 155 100.00% 96.77% 100.0%

NM Monetary 155 151 151 100.00% 96.03% 100.0%

Separation 155 155 155 100.00% 94.19% 100.0%

Nonsep. 156 151 151 100.00% 96.69% 100.0%

NV Monetary 152 142 142 100.00% 88.73% 96.48%

Separation 152 151 151 100.00% 90.73% 95.36%

Nonsep. 152 151 151 100.00% 90.07% 95.36%

NY Monetary 156 152 152 100.00% 78.95% 90.13%

Separation 154 152 152 100.00% 82.89% 96.71%

Nonsep. 189 151 151 100.00% 80.79% 94.04%

OH Monetary 152 151 151 100.00% 94.04% 99.34%

Separation 151 151 151 100.00% 92.05% 98.68%

Nonsep. 152 150 150 100.00% 90.67% 99.33%

OK Monetary 156 152 152 100.00% 96.71% 100.0%

Separation 156 155 155 100.00% 98.71% 100.0%

Nonsep. 156 156 156 100.00% 97.44% 100.0%

OR Monetary 156 152 152 100.00% 96.05% 99.34%

Separation 156 155 155 100.00% 96.77% 100.0%

Nonsep. 156 155 155 100.00% 98.71% 100.0%

PA Monetary 157 156 156 100.00% 87.18% 98.72%

Separation 157 156 156 100.00% 87.82% 98.08%

Nonsep. 191 167 167 100.00% 81.44% 98.20%

PR Monetary 153 152 152 100.00% 70.39% 98.03%

Separation 151 151 151 100.00% 85.43% 99.34%

Nonsep. 151 151 151 100.00% 82.12% 99.34%

Note: Case completion and time lapse percentages exclude deleted cases

(Program Code = 8 or 9) and withdrawn claims (Action Flag = 8).

* Failed to meet 60 day time lapse standard of 60 percent complete.

+ Failed to meet 90 day time lapse standard of 85 percent complete.

& Time lapse includes code 3 reopen cases.

BAM DCA Case Completion and Time Lapse -- CY 2007

Sample DCA Cases Percent 60 Day 90 Day

ST Type Sample Cases Compl. Completed TL & TL &

__ __________ ______ ______ ______ _________ ______ ______

RI Monetary 150 150 150 100.00% 95.33% 99.33%

Separation 150 150 150 100.00% 85.33% 98.67%

Nonsep. 153 150 150 100.00% 91.33% 99.33%

SC Monetary 156 153 153 100.00% 98.69% 100.0%

Separation 156 156 156 100.00% 100.0% 100.0%

Nonsep. 156 156 156 100.00% 100.0% 100.0%

SD Monetary 153 150 150 100.00% 98.67% 99.33%

Separation 152 150 150 100.00% 70.67% 98.67%

Nonsep. 156 150 150 100.00% 74.00% 96.00%

TN Monetary 150 150 150 100.00% 80.00% 91.33%

Separation 150 150 150 100.00% 82.00% 89.33%

Nonsep. 150 149 149 100.00% 82.55% 93.96%

TX Monetary 156 156 156 100.00% 81.41% 92.95%

Separation 156 156 156 100.00% 80.77% 89.74%

Nonsep. 156 156 156 100.00% 85.26% 94.23%

UT Monetary 150 144 144 100.00% 98.61% 99.31%

Separation 151 151 151 100.00% 98.68% 100.0%

Nonsep. 151 147 147 100.00% 97.28% 97.96%

VA Monetary 156 152 152 100.00% 90.79% 97.37%

Separation 156 156 156 100.00% 92.31% 98.08%

Nonsep. 156 156 156 100.00% 93.59% 100.0%

VT Monetary 151 150 150 100.00% 96.00% 100.0%

Separation 150 150 150 100.00% 99.33% 100.0%

Nonsep. 151 150 150 100.00% 97.33% 99.33%

WA Monetary 182 182 182 100.00% 99.45% 100.0%

Separation 182 182 182 100.00% 99.45% 99.45%

Nonsep. 182 181 181 100.00% 100.0% 100.0%

WI Monetary 156 155 155 100.00% 96.77% 98.06%

Separation 156 156 156 100.00% 94.23% 95.51%

Nonsep. 156 156 156 100.00% 92.31% 96.79%

Note: Case completion and time lapse percentages exclude deleted cases

(Program Code = 8 or 9) and withdrawn claims (Action Flag = 8).

* Failed to meet 60 day time lapse standard of 60 percent complete.

+ Failed to meet 90 day time lapse standard of 85 percent complete.

& Time lapse includes code 3 reopen cases.

BAM DCA Case Completion and Time Lapse -- CY 2007

Sample DCA Cases Percent 60 Day 90 Day

ST Type Sample Cases Compl. Completed TL & TL &

__ __________ ______ ______ ______ _________ ______ ______

WV Monetary 157 154 154 100.00% 98.70% 100.0%

Separation 151 151 151 100.00% 97.35% 98.68%

Nonsep. 151 151 151 100.00% 100.0% 100.0%

WY Monetary 152 150 150 100.00% 99.33% 100.0%

Separation 150 150 150 100.00% 100.0% 100.0%

Nonsep. 151 150 150 100.00% 99.33% 100.0%

US Monetary 8,218 7,963 7,960 99.96% 92.97% 98.39%

Separation 8,037 7,999 7,997 99.97% 93.84% 98.66%

Nonsep. 8,129 7,994 7,992 99.97% 93.71% 98.40%

Note: Case completion and time lapse percentages exclude deleted cases

(Program Code = 8 or 9) and withdrawn claims (Action Flag = 8).

* Failed to meet 60 day time lapse standard of 60 percent complete.

+ Failed to meet 90 day time lapse standard of 85 percent complete.

& Time lapse includes code 3 reopen cases.

Prepared by ETA Office of Workforce Security on 19 Feb 09.

B-8