Download:
pdf |
pdfAttachment C
Source of the Data and Accuracy of the Estimates for the
2014 Annual Social and Economic Supplement Microdata File
Table of Contents
SOURCE OF THE DATA ............................................................................................................1
Basic CPS ............................................................................................................................1
The 2014 Annual Social and Economic Supplement ..........................................................4
Estimation Procedure ...........................................................................................................4
ACCURACY OF THE ESTIMATES ..........................................................................................5
Sampling Error.....................................................................................................................5
Nonsampling Error...............................................................................................................5
Nonresponse.........................................................................................................................6
Sufficient Partial Interview ..................................................................................................6
Coverage ..............................................................................................................................6
Comparability of Data..........................................................................................................7
A Nonsampling Error Warning............................................................................................8
Estimation of Median Incomes ............................................................................................8
Standard Errors and Their Use.............................................................................................9
Estimating Standard Errors ..................................................................................................9
Generalized Variance Parameters ......................................................................................10
Standard Errors of Estimated Numbers .............................................................................11
Standard Errors of Estimated Percentages.........................................................................12
Standard Errors of Estimated Differences .........................................................................13
Standard Errors of Estimated Ratios..................................................................................15
Standard Errors of Estimated Medians ..............................................................................17
Standard Errors of Averages for Grouped Data.................................................................19
Standard Errors of Estimated Per Capita Deficits..............................................................21
Accuracy of State Estimates ..............................................................................................22
Standard Errors of State Estimates ....................................................................................23
Standard Errors of Regional Estimates ..............................................................................24
Standard Errors of Groups of States ..................................................................................24
Standard Errors of Data for Combined Years....................................................................25
Standard Errors of Differences of 2-Year Averages..........................................................27
Standard Errors of Quarterly or Yearly Averages .............................................................28
Technical Assistance..........................................................................................................28
REFERENCES.............................................................................................................................34
Tables
Table 1. Description of the March Basic CPS and CPS ASEC Sample Cases...............................3
Table 2. CPS Coverage Ratios: March 2014 ..................................................................................7
Table 3. Estimation Groups of Interest and Generalized Variance Parameters............................11
Table 4. Parameters for Computation of Standard Errors for Labor Force Characteristics:
March 2014 ..................................................................................................................29
Table 5. Parameters for Computation of Standard Errors for People and Families:
2014 CPS ASEC ..................................................................................................30
Table 6. CPS Year Factors: 1947 to 2013 CPS ASEC .................................................................31
Table 7. CPS Year-to-Year Correlation Coefficients for Income and Health Insurance
Characteristics: 1961 to 2014.................................................................................32
Table 8. CPS Year-To-Year Correlation Coefficients for Poverty Characteristics:
1971 to 2014...........................................................................................................32
Table 9. Factors and Populations for State Standard Errors and Parameters: 2014 CPS ASEC ..33
Table 10.Factors and Populations for Regional Standard Errors and Parameters:
2014 CPS ASEC ....................................................................................................33
Attachment C
Source of the Data and Accuracy of the Estimates for the
2014 Annual Social and Economic Supplement Microdata File
SOURCE OF THE DATA
The data in this microdata file are from the 2014 Annual Social and Economic Supplement
(ASEC) of the Current Population Survey (CPS). The U.S. Census Bureau conducts the CPS
ASEC over a 3-month period in February, March, and April, with most of the data collection
occurring in the month of March. The CPS ASEC uses two sets of questions, the basic CPS and
a set of supplemental questions. The CPS, sponsored jointly by the Census Bureau and the U.S.
Bureau of Labor Statistics, is the country’s primary source of labor force statistics for the entire
population. The Census Bureau and the Bureau of Labor Statistics also jointly sponsor the CPS
ASEC.
Basic CPS. The monthly CPS collects primarily labor force data about the civilian
noninstitutionalized population living in the United States. The institutionalized population,
which is excluded from the population universe, is composed primarily of the population in
correctional institutions and nursing homes (98 percent of the 4.0 million institutionalized people
in Census 2010). Interviewers ask questions concerning labor force participation about each
member 15 years old and over in sample households. Typically, the week containing the
nineteenth of the month is the interview week. The week containing the twelfth is the reference
week (i.e., the week about which the labor force questions are asked).
The CPS uses a multistage probability sample based on the results of the decennial census, with
coverage in all 50 states and the District of Columbia. The sample is continually updated to
account for new residential construction. When files from the most recent decennial census
become available, the Census Bureau gradually introduces a new sample design for the CPS.
In April 2004, the Census Bureau began phasing out the 1990 sample1 and replacing it with the
2000 sample, creating a mixed sampling frame. Two simultaneous changes occurred during this
phase-in period. First, primary sampling units (PSUs)2 selected for only the 2000 design
gradually replaced those selected for the 1990 design. This involved 10 percent of the sample.
Second, within PSUs selected for both the 1990 and 2000 designs, sample households from the
2000 design gradually replaced sample households from the 1990 design. This involved about
90 percent of the sample. The new sample design was completely implemented by July 2005.
In the first stage of the sampling process, PSUs are selected for sample. The United States is
divided into 2,025 PSUs. The PSUs were redefined for this design to correspond to the Office of
Management and Budget definitions of Core-Based Statistical Area definitions and to improve
efficiency in field operations. These PSUs are grouped into 824 strata. Within each stratum, a
single PSU is chosen for the sample, with its probability of selection proportional to its
population as of the most recent decennial census. This PSU represents the entire stratum from
1
For detailed information on the 2000 sample redesign, please see reference [1].
2
The PSUs correspond to substate areas (i.e., counties or groups of counties) that are geographically contiguous.
2
which it was selected. In the case of strata consisting of only one PSU, the PSU is chosen with
certainty.
Approximately 72,700 housing units were selected for sample from the sampling frame for the
basic CPS. Based on eligibility criteria, 12 percent of these housing units were sent directly to
computer-assisted telephone interviewing (CATI). The remaining units were assigned to
interviewers for computer-assisted personal interviewing (CAPI).3 Of all housing units in
sample, about 59,500 were determined to be eligible for interview. Interviewers obtained
interviews at about 52,700 of these units. Noninterviews occur when the occupants are not
found at home after repeated calls or are unavailable for some other reason. Table 1 summarizes
historical changes in the CPS design.
3
For further information on CATI and CAPI and the eligibility criteria, please see reference [2].
3
Table 1. Description of the March Basic CPS and CPS ASEC Sample Cases
Number Basic CPS housing units eligible Total (CPS ASEC/ADS1 + basic
CPS) housing units eligible
of
Time period
Not
Not
sample Interviewed
Interviewed
interviewed
interviewed
PSUs
2014 Subsample 2
2014
2013
2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
2000
1999
1998
1997
1996
1995
1990 to 1994
1989
1986 to 1988
1985
1982 to 1984
1980 to 1981
1977 to 1979
1976
1973 to 1975
1972
1967 to 1971
1963 to 1966
1960 to 1962
1959
1
2
3
4
5
824
35,500
4,600
51,500
824
52,700
6,800
-824
52,900
6,400
75,500
824
53,300
5,800
75,100
824
53,400
5,300
75,900
824
54,100
4,600
77,000
824
54,100
4,600
76,200
824
53,800
5,100
75,900
824
53,700
5,600
75,500
824
54,000
5,400
76,000
754/824 3
54,400
5,700
76,500
754
55,000
5,200
77,700
754
55,500
4,500
78,300
754
55,500
4,500
78,300
754
46,800
3,200
49,600
754
46,800
3,200
51,000
754
46,800
3,200
50,800
754
46,800
3,200
50,400
754
46,800
3,200
50,300
754
46,800
3,200
49,700
792
56,700
3,300
59,200
729
57,400
2,600
59,900
729
53,600
2,500
56,100
729
57,000
2,500
59,500
629/729 4
57,000
2,500
59,500
629
59,000
2,500
61,500
629
65,500
3,000
68,000
614
55,000
3,000
58,000
624
46,500
2,500
49,000
461
46,500
2,500
49,000
449/461 5
45,000
2,000
45,000
449
48,000
2,000
48,000
357
33,400
1,200
33,400
333
33,400
1,200
33,400
330
33,400
1,200
33,400
The CPS ASEC was referred to as the Annual Demographic Survey (ADS) until 2002.
The 2014 CPS ASEC was based on a subsample of the basic CPS households which received the income
questions similar to the 2013 CPS ASEC.
The Census Bureau redesigned the CPS following the Census 2000. During phase-in of the new design,
housing units from the new and old designs were in the sample.
The Census Bureau redesigned the CPS following the 1980 Decennial Census of Population and Housing.
The Census Bureau redesigned the CPS following the 1970 Decennial Census of Population and Housing.
5,800
-7,700
7,200
6,500
5,700
5,700
6,400
7,100
7,100
7,500
7,000
6,800
6,600
4,300
3,700
4,300
5,200
3,900
4,100
3,800
3,100
3,000
3,000
3,000
3,000
3,500
3,500
3,000
3,000
2,000
2,000
1,200
1,200
1,200
4
The 2014 Annual Social and Economic Supplement. In addition to the basic CPS questions,
interviewers asked supplementary questions for the CPS ASEC. They asked these questions of
the civilian noninstitutional population and also of military personnel who live in households
with at least one other civilian adult. The additional questions covered the following topics:
•
•
•
•
•
•
•
•
•
•
Household and family characteristics
Marital status
Geographic mobility
Foreign-born population
Income from the previous calendar year
Poverty
Work status/occupation
Health insurance coverage
Program participation
Educational attainment
The 2014 CPS ASEC included redesigned questions for income and health insurance coverage.
Including the basic CPS, approximately 97,900 addresses were eligible to receive the improved
set of health insurance coverage questions. The improved income questions were implemented to
a subsample of these 97,900 addresses using a probability split panel design. Approximately
67,900 addresses were eligible to receive a set of income questions similar to those used in the
2013 CPS ASEC and the remaining 30,000 addresses were eligible to receive the redesigned
income questions. The source of data for this S&A is the portion of the CPS ASEC sample which
received the income questions consistent with the 2013 CPS ASEC. About 57,300 housing units
were determined to be eligible and we obtained interviews at 51,500 (see Table 1).
The additional sample for the CPS ASEC provides more reliable data for Hispanic households,
non-Hispanic minority households, and non-Hispanic White households with children 18 years
or younger. These households were identified for sample from previous months and the
following April. For more information about the households eligible for the CPS ASEC, please
refer to reference [2].
Estimation Procedure. This survey’s estimation procedure adjusts weighted sample results to
agree with independently derived population estimates of the civilian noninstitutionalized
population of the United States and each state (including the District of Columbia). These
population estimates, used as controls for the CPS, are prepared monthly to agree with the most
current set of population estimates that are released as part of the Census Bureau’s population
estimates and projections program.
The population controls for the nation are distributed by demographic characteristics in two
ways:
•
•
Age, sex, and race (White alone, Black alone, and all other groups combined).
Age, sex, and Hispanic origin.
5
The population controls for the states are distributed by race (Black alone and all other race
groups combined), age (0-15, 16-44, and 45 and over), and sex.
The independent estimates by age, sex, race, and Hispanic origin, and for states by selected age
groups and broad race categories, are developed using the basic demographic accounting formula
whereby the population from the 2010 Decennial Census data is updated using data on the
components of population change (births, deaths, and net international migration) with net
internal migration as an additional component in the state population estimates.
The net international migration component in the population estimates includes a combination of
the following:
•
•
•
•
•
Legal migration to the United States.
Emigration of foreign-born and native people from the United States.
Net movement between the United States and Puerto Rico.
Estimates of temporary migration.
Estimates of net residual foreign-born population, which include unauthorized
migration.
Because the latest available information on these components lags the survey date, it is necessary
to make short-term projections of these components to develop the estimate for the survey date.
ACCURACY OF THE ESTIMATES
A sample survey estimate has two types of error: sampling and nonsampling. The accuracy of an
estimate depends on both types of error. The nature of the sampling error is known given the
survey design; the full extent of the nonsampling error is unknown.
Sampling Error. Since the CPS estimates come from a sample, they may differ from figures
from an enumeration of the entire population using the same questionnaires, instructions, and
enumerators. For a given estimator, the difference between an estimate based on a sample and
the estimate that would result if the sample were to include the entire population is known as
sampling error. Standard errors, as calculated by methods described in “Standard Errors and
Their Use,” are primarily measures of the magnitude of sampling error. However, they may
include some nonsampling error.
Nonsampling Error. For a given estimator, the difference between the estimate that would
result if the sample were to include the entire population and the true population value being
estimated is known as nonsampling error. There are several sources of nonsampling error that
may occur during the development or execution of the survey. It can occur because of
circumstances created by the interviewer, the respondent, the survey instrument, or the way the
data are collected and processed. For example, errors could occur because:
•
The interviewer records the wrong answer, the respondent provides incorrect
information, the respondent estimates the requested information, or an unclear
survey question is misunderstood by the respondent (measurement error).
6
•
•
•
•
Some individuals who should have been included in the survey frame were
missed (coverage error).
Responses are not collected from all those in the sample or the respondent is
unwilling to provide information (nonresponse error).
Values are estimated imprecisely for missing data (imputation error).
Forms may be lost, data may be incorrectly keyed, coded, or recoded, etc.
(processing error).
To minimize these errors, the Census Bureau applies quality control procedures during all stages
of the production process including the design of the survey, the wording of questions, the
review of the work of interviewers and coders, and the statistical review of reports.
Two types of nonsampling error that can be examined to a limited extent are nonresponse and
undercoverage.
Nonresponse. The effect of nonresponse cannot be measured directly, but one indication of its
potential effect is the nonresponse rate. The basic CPS household-level nonresponse rate was
11.42 percent.
The basic CPS household-level nonresponse rate, based on the 67,900 addresses eligible to
receive the income questions similar to the 2013 CPS ASEC, was 11.58 percent. The householdlevel CPS ASEC nonresponse rate was an additional 10.13 percent. These two nonresponse rates
lead to a combined supplement nonresponse rate of 20.54 percent.
Sufficient Partial Interview. A sufficient partial interview is an incomplete interview in which
the household or person answered enough of the questionnaire for the supplement sponsor to
consider the interview complete. The remaining supplement questions may have been edited or
imputed to fill in missing values. Insufficient partial interviews are considered to be
nonrespondents. Refer to the supplement overview attachment in the technical documentation for
the specific questions deemed critical by the sponsor as necessary to be answered in order to be
considered a sufficient partial interview.
Coverage. The concept of coverage in the survey sampling process is the extent to which the
total population that could be selected for sample “covers” the survey’s target population.
Missed housing units and missed people within sample households create undercoverage in the
CPS. Overall CPS undercoverage for March 2014 is estimated to be about 15.0 percent. CPS
coverage varies with age, sex, and race. Generally, coverage is larger for females than for males
and larger for non-Blacks than for Blacks. This differential coverage is a general problem for
most household-based surveys.
The CPS weighting procedure partially corrects for bias from undercoverage, but biases may still
be present when people who are missed by the survey differ from those interviewed in ways
other than age, race, sex, Hispanic origin, and state of residence. How this weighting procedure
affects other variables in the survey is not precisely known. All of these considerations affect
comparisons across different surveys or data sources.
7
A common measure of survey coverage is the coverage ratio, calculated as the estimated
population before poststratification divided by the independent population control. Table 2
shows March 2014 CPS coverage ratios by age and sex for certain race and Hispanic groups.
The CPS coverage ratios can exhibit some variability from month to month.
Table 2. CPS Coverage Ratios: March 2014
Total
White only
Black only
Residual race
Hispanic
All
Age
Male Female Male Female Male Female Male Female Male Female
group people
0-15
0.85
0.85
0.86
0.88
0.90
0.78
0.75
0.72
0.75
0.83
0.84
16-19 0.84
0.83
0.84
0.85
0.87
0.75
0.80
0.80
0.70
0.82
0.84
20-24 0.72
0.71
0.73
0.75
0.76
0.62
0.66
0.57
0.67
0.74
0.81
25-34 0.81
0.79
0.83
0.82
0.86
0.66
0.76
0.70
0.72
0.76
0.84
35-44 0.86
0.83
0.88
0.85
0.91
0.76
0.84
0.71
0.76
0.75
0.87
45-54 0.87
0.85
0.88
0.86
0.89
0.81
0.82
0.83
0.79
0.78
0.87
55-64 0.89
0.88
0.90
0.89
0.92
0.84
0.79
0.80
0.86
0.82
0.83
65+
0.92
0.91
0.92
0.92
0.92
0.87
0.90
0.93
0.90
0.88
0.91
15+
0.85
0.84
0.87
0.86
0.89
0.76
0.80
0.76
0.77
0.78
0.85
0+
0.85
0.84
0.86
0.86
0.89
0.76
0.79
0.75
0.77
0.79
0.85
Notes: (1) The Residual race group includes cases indicating a single race other than White or Black,
and cases indicating two or more races.
(2) Hispanics may be any race. For a more detailed discussion on the use of parameters for
race and ethnicity, please see the “Generalized Variance Parameters” section.
Comparability of Data. Data obtained from the CPS and other sources are not entirely
comparable. This results from differences in interviewer training and experience and in differing
survey processes. This is an example of nonsampling variability not reflected in the standard
errors. Therefore, caution should be used when comparing results from different sources.
Data users should be careful when comparing estimates for 2013 in Income and Poverty in the
United States: 2013 and Health Insurance Coverage in the United States: 2013 (which reflect
Census 2010-based controls) with estimates for 1999 to 2010 (from March 2000 CPS to March
2011 CPS), which reflect 2000 census-based controls, and to 1992 to 1998 (from March 1993
CPS to March 1999 CPS), which reflect 1990 census-based controls. Ideally, the same
population controls should be used when comparing any estimates. In reality, the use of the same
population controls is not practical when comparing trend data over a period of 10 to 20 years.
Thus, when it is necessary to combine or compare data based on different controls or different
designs, data users should be aware that changes in weighting controls or weighting procedures
could create small differences between estimates. See the following discussion for information
on comparing estimates derived from different controls or different sample designs.
Data users should be aware that the redesign of CPS ASEC health insurance constitutes a “breakin-series” to the historical health insurance estimates, so data users should exercise caution when
comparing estimates from the redesigned CPS ASEC for data year 2013 to estimates from
previous years.
8
Microdata files from previous years reflect the latest available census-based controls. Although
the most recent change in population controls had relatively little impact on summary measures
such as averages, medians, and percentage distributions, it did have a significant impact on
levels. For example, use of Census 2010-based controls results in about a 0.2 percent increase
from the 2000 census-based controls in the civilian noninstitutionalized population and in the
number of families and households. Thus, estimates of levels for data collected in 2012 and later
years will differ from those for earlier years by more than what could be attributed to actual
changes in the population. These differences could be disproportionately greater for certain
population subgroups than for the total population.
Users should also exercise caution because of changes caused by the phase-in of the Census
2000 files (see “Basic CPS”). During this time period, CPS data were collected from sample
designs based on different censuses. Three features of the new CPS design have the potential of
affecting published estimates: (1) the temporary disruption of the rotation pattern from August
2004 through June 2005 for a comparatively small portion of the sample, (2) the change in
sample areas, and (3) the introduction of the new Core-Based Statistical Areas (formerly called
metropolitan areas). Most of the known effect on estimates during and after the sample redesign
was the result of changing from 1990 to 2000 geographic definitions. Research has shown that
the national-level estimates of the metropolitan and nonmetropolitan populations should not
change appreciably because of the new sample design. However, users should still exercise
caution when comparing metropolitan and nonmetropolitan estimates across years with a design
change, especially at the state level.
Caution should also be used when comparing Hispanic estimates over time. No independent
population control totals for people of Hispanic origin were used before 1985.
A Nonsampling Error Warning. Since the full extent of the nonsampling error is unknown,
one should be particularly careful when interpreting results based on small differences between
estimates. The Census Bureau recommends that data users incorporate information about
nonsampling errors into their analyses, as nonsampling error could impact the conclusions drawn
from the results. Caution should also be used when interpreting results based on a relatively
small number of cases. Summary measures (such as medians and percentage distributions)
probably do not reveal useful information when computed on a subpopulation smaller than
75,000.
For additional information on nonsampling error including the possible impact on CPS
data when known, refer to references [2] and [3].
Estimation of Median Incomes. The Census Bureau has changed the methodology for
computing median income over time. The Census Bureau has computed medians using either
Pareto interpolation or linear interpolation--depending on the size of the income interval--Pareto
for intervals larger than $2,500 in width, linear otherwise. Currently, we are using linear
interpolation to estimate all medians. Pareto interpolation assumes a decreasing density of
population within an income interval, whereas linear interpolation assumes a constant density of
population within an income interval. The Census Bureau calculated estimates of median
9
income and associated standard errors for 1979 through 1987 using Pareto interpolation if the
estimate was larger than $20,000 for people or $40,000 for families and households.
We calculated estimates of median income and associated standard errors for 1976, 1977, and
1978 using Pareto interpolation if the estimate was larger than $12,000 for people or $18,000 for
families and households. This is because the width of the income interval containing the
estimate is greater than $1,000. All other estimates of median income and associated standard
errors for 1976 through 2013 (2014 CPS ASEC) and almost all of the estimates of median
income and associated standard errors for 1975 and earlier were calculated using linear
interpolation.
Thus, use caution when comparing median incomes above $12,000 for people or $18,000 for
families and households for different years. Median incomes below those levels are more
comparable from year to year since they have always been calculated using linear interpolation.
For an indication of the comparability of medians calculated using Pareto interpolation with
medians calculated using linear interpolation, see reference [5].
Standard Errors and Their Use. The sample estimate and its standard error enable one to
construct a confidence interval. A confidence interval is a range about a given estimate that has
a specified probability of containing the average result of all possible samples. For example, if
all possible samples were surveyed under essentially the same general conditions and using the
same sample design, and if an estimate and its standard error were calculated from each sample,
then approximately 90 percent of the intervals from 1.645 standard errors below the estimate to
1.645 standard errors above the estimate would include the average result of all possible samples.
A particular confidence interval may or may not contain the average estimate derived from all
possible samples, but one can say with specified confidence that the interval includes the average
estimate calculated from all possible samples.
Standard errors may also be used to perform hypothesis testing, a procedure for distinguishing
between population parameters using sample estimates. The most common type of hypothesis is
that the population parameters are different. An example of this would be comparing the
percentage of men who were part-time workers to the percentage of women who were part-time
workers.
Tests may be performed at various levels of significance. A significance level is the probability
of concluding that the characteristics are different when, in fact, they are the same. For example,
to conclude that two characteristics are different at the 0.10 level of significance, the absolute
value of the estimated difference between characteristics must be greater than or equal to 1.645
times the standard error of the difference.
The Census Bureau uses 90-percent confidence intervals and 0.10 levels of significance to
determine statistical validity. Consult standard statistical textbooks for alternative criteria.
Estimating Standard Errors. The Census Bureau uses replication methods to estimate the
standard errors of CPS estimates. These methods primarily measure the magnitude of sampling
10
error. However, they do measure some effects of nonsampling error as well. They do not
measure systematic biases in the data associated with nonsampling error. Bias is the average
over all possible samples of the differences between the sample estimates and the true value.
There are two ways to calculate standard errors for the 2014 CPS ASEC microdata file. They
are:
Direct estimates created from replicate weighting methods;
Generalized variance estimates created from generalized variance function
parameters a and b.
While replicate weighting methods provide the most accurate variance estimates, this approach
requires more computing resources and more expertise on the part of the user. The Generalized
Variance Function (GVF) parameters provide a method of balancing accuracy with resource
usage as well as a smoothing effect on standard error estimates across time. For more
information on calculating direct estimates, see reference [6]. For more information on
generalized variance estimates refer to the “Generalized Variance Parameters” section.
Generalized Variance Parameters. While it is possible to compute and present an estimate of
the standard error based on the survey data for each estimate in a report, there are a number of
reasons why this is not done. A presentation of the individual standard errors would be of
limited use, since one could not possibly predict all of the combinations of results that may be of
interest to data users. Additionally, data users have access to CPS microdata files, and it is
impossible to compute in advance the standard error for every estimate one might obtain from
those data sets. Moreover, variance estimates are based on sample data and have variances of
their own. Therefore, some methods of stabilizing these estimates of variance, for example, by
generalizing or averaging over time, may be used to improve their reliability.
Experience has shown that certain groups of estimates have similar relationships between their
variances and expected values. Modeling or generalizing may provide more stable variance
estimates by taking advantage of these similarities. The generalized variance function is a
simple model that expresses the variance as a function of the expected value of the survey
estimate. The parameters of the generalized variance function are estimated using direct
replicate variances. These generalized variance parameters provide a relatively easy method to
obtain approximate standard errors for numerous characteristics. In this source and accuracy
statement, Table 4 provides the generalized variance parameters for labor force estimates, and
Table 5 provides generalized variance parameters for characteristics from the 2014 CPS ASEC
supplement. Also, tables are provided that allow the calculation of parameters for prior years
and parameters for states and regions. Table 6 provides factors to derive prior year parameters.
Tables 7 and 8 contain correlation coefficients for comparing estimates from consecutive years.
Tables 9 and 10 provide factors and population controls to derive state and regional parameters.
The basic CPS questionnaire records the race and ethnicity of each respondent. With respect to
race, a respondent can be White, Black, Asian, American Indian and Alaskan Native (AIAN),
Native Hawaiian and Other Pacific Islander (NHOPI), or combinations of two or more of the
preceding. A respondent’s ethnicity can be Hispanic or non-Hispanic, regardless of race.
11
The generalized variance parameters to use in computing standard errors are dependent upon the
race/ethnicity group of interest. Table 3 summarizes the relationship between the race/ethnicity
group of interest and the generalized variance parameters to use in standard error calculations.
Table 3. Estimation Groups of Interest and Generalized Variance Parameters
Race/ethnicity group of interest
Generalized variance parameters to
use in standard error calculations
Total population
Total or White
White alone, White AOIC, or White non-Hispanic population
Total or White
Black alone, Black AOIC, or Black non-Hispanic population
Black
Asian alone, Asian AOIC, or Asian non-Hispanic population
AIAN alone, AIAN AOIC, or AIAN non-Hispanic population
NHOPI alone, NHOPI AOIC, or NHOPI non-Hispanic
population
Populations from other race groups
Asian, AIAN, NHOPI
Asian, AIAN, NHOPI
Hispanic population
Hispanic
Two or more races – employment/unemployment and
educational attainment characteristics
Two or more races – all other characteristics
Black
Asian, AIAN, NHOPI
Notes: (1) AIAN is American Indian and Alaska Native and NHOPI is Native Hawaiian and Other
Pacific Islander.
(2) AOIC is an abbreviation for alone or in combination. The AOIC population for a race group
of interest includes people reporting only the race group of interest (alone) and people
reporting multiple race categories including the race group of interest (in combination).
(3) Hispanics may be any race.
(4) Two or more races refers to the group of cases self-classified as having two or more races.
Standard Errors of Estimated Numbers. The approximate standard error, sx, of an estimated
number from this microdata file can be obtained by using the formula:
s x ax 2 bx
(1)
Here x is the size of the estimate and a and b are the parameters in Table 4 or 5 associated with
the particular type of characteristic. When calculating standard errors from cross-tabulations
involving different characteristics, use the set of parameters for the characteristic that will give
the largest standard error.
12
Illustration 1
Suppose there were 4,789,000 unemployed females in the civilian labor force. Use Formula (1)
and the appropriate parameters from Table 4 to get
Illustration 1
Number of unemployed females in the
civilian labor force (x)
a parameter (a)
b parameter (b)
Standard error
90-percent confidence interval
4,789,000
-0.000031
2,782
112,000
4,605,000 to 4,973,000
The standard error is calculated as
s x 0.000031 4,789,000 2 2,782 4,789,000 112,000
and the 90-percent confidence interval is calculated as 4,789,000 ± 1.645 × 112,000.
A conclusion that the average estimate derived from all possible samples lies within a range
computed in this way would be correct for roughly 90 percent of all possible samples.
Illustration 2
Suppose there were 59,669,000 married-couple family households. Use Formula (1) and the
appropriate parameters from Table 5 to get
Illustration 2
Number of married-couple family
households (x)
a parameter (a)
b parameter (b)
Standard error
90-percent confidence interval
59,669,000
-0.000006
1,683
281,000
59,207,000 to 60,131,000
The standard error is calculated as
s x 0.000006 59,669,000 2 1,683 59,669,000 281,000
and the 90-percent confidence interval is calculated as 59,669,000 ± 1.645 × 281,000.
A conclusion that the average estimate derived from all possible samples lies within a range
computed in this way would be correct for roughly 90 percent of all possible samples.
Standard Errors of Estimated Percentages. The reliability of an estimated percentage,
computed using sample data for both numerator and denominator, depends on both the size of
the percentage and its base. Estimated percentages are relatively more reliable than the
corresponding estimates of the numerators of the percentages, particularly if the percentages are
13
50 percent or more. When the numerator and denominator of the percentage are in different
categories, use the parameter from Table 4 or 5 as indicated by the numerator.
The approximate standard error, sy,p, of an estimated percentage can be obtained by using the
formula:
s y, p
b
p100 p
y
(2)
Here y is the total number of people, families, households, or unrelated individuals in the base or
denominator of the percentage, p is the percentage 100*x/y (0 ≤ p ≤ 100), and b is the parameter
in Table 4 or 5 associated with the characteristic in the numerator of the percentage.
Illustration 3
Suppose there were 209,832,000 out of 239,341,000 adults (aged 18 and older), or 87.7 percent,
who graduated from high school. Use Formula (2) and the appropriate parameter from Table 5
to get
Illustration 3
Percentage of adults who are high school graduates (p)
Base (y)
b parameter (b)
Standard error
90-percent confidence interval
87.7
239,341,000
1,930
0.09
87.6 to 87.9
The standard error is calculated as
s y, p
1,930
87.7 (100 87.7) 0.09
239,341,000
The 90-percent confidence interval of the percentage of adults who graduated from high school
is calculated as 87.7 ± 1.645 × 0.09.
Standard Errors of Estimated Differences. The standard error of the difference between two
sample estimates is approximately equal to
2
2
s x1 x2 s x1 s x2 2rs x1 s x2
(3)
where sx1 and sx2 are the standard errors of the estimates, x1 and x2. The estimates can be
numbers, percentages, ratios, etc. Tables 7 and 8 contain the correlation coefficient, r, for CPS
year-to-year comparisons. The correlations were derived for income, poverty, and health
insurance estimates, but they can be used for other types of estimates where the year-to-year
correlation between identical households is high. For making other comparisons, assume that r
equals zero. Making this assumption will result in accurate estimates of standard errors for the
14
difference between two estimates of the same characteristic in two different areas, or for the
difference between separate and uncorrelated characteristics in the same area. However, if there
is a high positive (negative) correlation between the two characteristics, the formula will
overestimate (underestimate) the true standard error.
Illustration 4
Suppose there were 22,090,000 men over age 24 who were never married and 10,591,000 men
over age 24 who were divorced. The apparent difference is 11,499,000. Use Formulas (1) and
(3) with r = 0 and the appropriate parameters from Table 5 to get
Illustration 4
Never married (x1)
Divorced (x2)
Number of males
over age 24
a parameter (a)
b parameter (b)
Standard error
90-percent
confidence interval
Difference
22,090,000
10,591,000
11,499,000
-0.000014
4,243
295,000
21,605,000 to
22,575,000
-0.000014
4,243
208,000
10,249,000 to
10,933,000
361,000
10,905,000 to
12,093,000
The standard error of the difference is calculated as
s x1 x2 295,000 2 208,000 2 361,000
The 90-percent confidence interval around the difference is calculated as 11,499,000 ± 1.645 ×
361,000. Since this interval does not include zero, we can conclude with 90 percent confidence
that the number of never married men over age 24 was higher than the number of divorced men
over age 24.
Illustration 5
Suppose that the percentage of children in poverty in 2013 was 21.8 percent out of 73,719,000
children, and the percentage of children in poverty in 2012 was 19.9 percent out of 73,625,000
people. The apparent difference is 1.9 percent. Use Formulas (2) and (3) and the appropriate
parameter, factor, and correlation coefficient from Tables 5, 6, and 7 to get
15
Illustration 5
2012 (x1)
Percentage of children in
poverty (p)
Base
b parameter (b)
Correlation coefficient (r)
Standard error
90-percent
confidence interval
2013 (x2)
Difference
21.8
19.9
-1.9
73,719,000
4,072
0.31
73,625,000
6,515
0.38
0.45
0.37
21.3 to 22.3
19.3 to 20.5
-2.5 to -1.3
The standard error of the difference is calculated as
s x1 x2 0.312 0.38 2 2 0.45 0.31 0.38 0.37
and the 90-percent confidence interval around the difference is calculated as -1.9 ± 1.645 × 0.45.
Since this interval does not include zero, we can conclude with 90 percent confidence that the
percentage of children in poverty in 2012 is statistically different than the percentage of children
in poverty in 2013.
Standard Errors of Estimated Ratios. Certain estimates may be calculated as the ratio of two
numbers. Compute the standard error of a ratio, x/y, using
2
sx y
2
sxs y
x sx sy
2r
y x y
xy
(4)
The standard error of the numerator, sx, and that of the denominator, sy, may be calculated using
formulas described earlier. In Formula (4), r represents the correlation between the numerator
and the denominator of the estimate.
For one type of ratio, the denominator is a count of families or households and the numerator is a
count of people in those families or households with a certain characteristic. If there is at least
one person with the characteristic in every family or household, use 0.7 as an estimate of r. An
example of this type is the average number of children per family with children.
For all other types of ratios, r is assumed to be zero. Examples are the average number of
children per family and the family poverty rate. If r is actually positive (negative), then this
procedure will provide an overestimate (underestimate) of the standard error of the ratio.
Note: For estimates expressed as the ratio of x per 100 y or x per 1,000 y, multiply Formula (4)
by 100 or 1,000, respectively, to obtain the standard error.
16
Illustration 6
Suppose there were 12,171,000 males working part-time and 21,095,000 females working parttime. The ratio of males working part-time to females working part-time would be 0.577, or 57.7
percent. Use Formulas (1) and (4) with r = 0 and the appropriate parameters from Table 4 to get
Illustration 6
Males (x)
Number who work parttime
a parameter (a)
b parameter (b)
Standard error
90-percent confidence
interval
Females (y)
Ratio
12,171,000
21,095,000
0.577
-0.000032
2,971
177,000
-0.000031
2,782
212,000
11,880,000 to 12,462,000
20,746,000 to 21,444,000
0.010
0.560 to
0.594
The standard error is calculated as
2
sx y
2
12,171,000 177,000 212,000
0.010
21,095,000 12,171,000 21,095,000
and the 90-percent confidence interval is calculated as 0.577 ± 1.645 × 0.010.
Illustration 7
Suppose that the number of families below the poverty level was 9,130,000 and the total number
of families was 81,217,000. The ratio of families below the poverty level to the total number of
families would be 0.112 or 11.2 percent. Use the appropriate parameters from Table 5 and
Formulas (1) and (4) with r = 0 to get
Number of families
a parameter (a)
b parameter (b)
Standard error
90-percent confidence
Interval
Illustration 7
In poverty (x)
9,130,000
0.000083
1,989
158,000
8,870,000 to
9,390,000
Total (y)
81,217,000
-0.000006
1,683
312,000
80,704,000 to
81,730,000
Ratio (in percent)
11.2
0.20
10.9 to 11.5
The standard error is calculated as
2
sx y
2
9,130,000 158,000 312,000
0.0020 0.20%
81,217,000 9,130,000 81,217,000
and the 90-percent confidence interval of the percentage is calculated as 11.2 ± 1.645 × 0.20.
17
Standard Errors of Estimated Medians. The sampling variability of an estimated median
depends on the form of the distribution and the size of the base. One can approximate the
reliability of an estimated median by determining a confidence interval about it. (See “Standard
Errors and Their Use” for a general discussion of confidence intervals.)
Estimate the 68-percent confidence limits of a median based on sample data using the following
procedure:
1.
Using Formula (2) and the base of the distribution, calculate the standard error of 50
percent.
2.
Add to and subtract from 50 percent the standard error determined in step 1. These two
numbers are the percentage limits corresponding to the 68-percent confidence interval
about the estimated median.
3.
Using the distribution of the characteristic, determine upper and lower limits of the
68-percent confidence interval by calculating values corresponding to the two points
established in step 2.
Note: The percentage limits found in step 2 may or may not fall in the same
characteristic distribution interval.
Use the following formula to calculate the upper and lower limits:
Xp
pN N 1
( A2 A1 ) A1
N 2 N1
(5)
where
Xp =
estimated upper and lower bounds for the confidence interval
(0 ≤ p ≤ 1). For purposes of calculating the confidence interval, p
takes on the values determined in step 2. Note that Xp estimates
the median when p = 0.50.
N =
for distribution of numbers: the total number of units (people,
households, etc.) for the characteristic in the distribution.
=
p =
for distribution of percentages: the value 100.
the values obtained in Step 2.
A1, A2 =
the lower and upper bounds, respectively, of the interval
containing Xp.
N1, N2 =
for distribution of numbers: the estimated number of units
18
(people, households, etc.) with values of the characteristic less than
or equal to A1 and A2, respectively.
=
4.
for distribution of percentages: the estimated percentage of units
(people, households, etc.) having values of the characteristic less
than or equal to A1 and A2, respectively.
Divide the difference between the two points determined in step 3 by 2 to obtain the
standard error of the median.
Note: Median incomes and their standard errors calculated as below may differ from those in
published tables and reports showing income, since narrower income intervals were used
in those calculations.
Illustration 8
Suppose there were 122,952,000 households in 2014, and their income was distributed in the
following way:
Income level
Under $5,000
$5,000 to $9,999
$10,000 to $14,999
$15,000 to $24,999
$25,000 to $34,999
$35,000 to $49,999
$50,000 to $74,999
$75,000 to $99,999
$100,000 and over
Illustration 8
Number of
Cumulative number of
households
households
4,081,000
4,081,000
4,859,000
8,939,000
6,693,000
15,632,000
13,899,000
29,530,000
12,756,000
42,286,000
16,677,000
58,964,000
21,659,000
80,623,000
14,688,000
95,310,000
27,641,000
122,952,000
Cumulative percent
of households
3.32%
7.27%
12.71%
24.02%
34.39%
47.96%
65.57%
77.52%
100.00%
1.
Using Formula (2) with b = 1,824, the standard error of 50 percent on a base of
122,952,000 is about 0.19 percent.
2.
To obtain a 68-percent confidence interval on an estimated median, add to and subtract
from 50 percent the standard error found in step 1. This yields percentage limits of 49.81
and 50.19.
3.
The lower and upper limits for the interval in which the percentage limits falls are
$50,000 and $75,000, respectively.
Then the estimated numbers of households with an income less than or equal to $50,000
and $75,000 are 58,964,000 and 80,623,000, respectively.
Using Formula (5), the lower limit for the confidence interval of the median is found to
be about
19
X 0.4985
0.4981 122,952,000 58,964,000
(75,000 50,000) 50,000 52,630
80,623,000 58,964,000
Similarly, the upper limit is found to be about
X 0.5015
0.5019 122,952,000 58,964,000
(75,000 50,000) 50,000 53,170
80,623,000 58,964,000
Thus, a 68-percent confidence interval for the median income for households is from
$52,630 to $53,170.
4.
The standard error of the median is, therefore,
52,630 53,170
270
2
Standard Errors of Averages for Grouped Data. The formula used to estimate the standard
error of an average for grouped data is
b 2
S
y
sx
(6)
In this formula, y is the size of the base of the distribution and b is the parameter from Table 4 or
5. The variance, S², is given by the following formula:
c
S 2 p i x i2 x 2
(7)
i 1
where x , the average of the distribution, is estimated by
c
x pi x i
i 1
where
c
= the number of groups; i indicates a specific group, thus taking on values 1
through c.
pi =
estimated proportion of households, families, or people whose values for the
characteristic being considered fall in group i.
xi = (ZLi + ZUi)/2 where ZLi and ZUi are the lower and upper interval boundaries,
respectively, for group i. xi is assumed to be the most representative value for
(8)
20
the characteristic of households, families, or people in group i. If group c is openended, i.e., no upper interval boundary exists, use a group approximate average
value of
xc
3
Z Lc
2
(9)
Illustration 9
Suppose that there were 9,130,000 families in poverty and that the distribution of the income
deficit (the difference between their family income and poverty threshold) for all families in
poverty was
Income deficit
Under $1000
$1000 to $2,499
$2,500 to $4,999
$5,000 to $7,499
$7,500 to $9,999
$10,000 to $12,499
$12,500 to $14,999
$15,000 and over
Total
Number of
families in poverty
651,000
790,000
1,400,000
1,171,000
1,131,000
806,000
884,000
2,298,000
9,131,000*
Percentage of families in
poverty (pi)
7.1
8.7
15.3
12.8
12.4
8.8
9.7
25.2
100.0
Average income deficit
( xi )
500
1,750
3,750
6,250
8,750
11,250
13,750
22,500
*There may be a difference due to rounding
Using Formula (8),
x (0.071 500) (0.087 1,750) (0.153 3,750) (0.128 6,250) (0.124 8,750) (0.088 11,250)
(0.097 13,750) (0.252 22,500) 10,640
and Formula (7),
S 2 (0.071 500 2 ) (0.087 1,750 2 ) (0.153 3,750 2 ) (0.128 6,250 2 ) (0.124 8,750 2 )
(0.088 11,250 2 ) (0.097 13,750 2 ) (0.252 22,500 2 ) 10,640 2 60,771,000
Use the appropriate parameter from Table 5 and Formula (6) to get
Illustration 9
Average income deficit for families in
poverty (x )
Variance (S2)
Base (y)
b parameter (b)
Standard error
90-percent confidence interval
$10,640
60,771,000
9,130,000
1,989
$115
$10,451 to $10,829
21
The standard error is calculated as
sx
1,989
60,771,000 115
9,130,000
and the 90-percent confidence interval is calculated as $10,640 ± 1.645 × $115.
Standard Errors of Estimated Per Capita Deficits. Certain average values in reports
associated with the CPS ASEC data represent the per capita deficit for households of a certain
class. The average per capita deficit is approximately equal to
x
hm
p
(10)
where
h =
number of households in the class.
m=
average deficit for households in the class.
p =
number of people in households in the class.
x =
average per capita deficit of people in households in the class.
To approximate standard errors for these averages, use the formula
2
2
2
sp
hm s m s p s h
sx
2r
p m p h
p
s h
h
(11)
In Formula (11), r represents the correlation between p and h.
For one type of average, the class represents households containing a fixed number of people.
For example, h could be the number of 3-person households. In this case, there is an exact
correlation between the number of people in households and the number of households.
Therefore, r = 1 for such households. For other types of averages, the class represents
households of other demographic types, for example, households in distinct regions, households
in which the householder is of a certain age group, and owner-occupied and tenant-occupied
households. In this and other cases in which the correlation between p and h is not perfect, use
0.7 as an estimate of r.
22
Illustration 10
Suppose there were 31,530,000 people living in families in poverty, and 9,130,000 families in
poverty, with an average deficit income for families in poverty of $10,640 with a standard error
of $115 (from Illustration 9). Use Formulas (1), (10), and (11) and the appropriate parameters
from Table 5 and r = 0.7 to get
Illustration 10
Number of people
(p)
Number (h)
Value for families in
poverty
a parameter (a)
b parameter (b)
Correlation (r)
Standard Error
90-percent
confidence interval
9,130,000
+0.000083
1,989
158,000
8,870,000 to
9,390,000
Average income
deficit (m)
31,530,000
-0.000027
8,451
490,000
30,724,000 to
32,336,000
$10,640
$115
$10,451 to
$10,829
Average per capita
deficit (x)
$3,081
0.7
$52
$2,995 to $3,167
The estimate of the average per capita deficit is calculated as
x
9,130,000 10,640
3,081
31,530,000
and the standard error is calculated as
2
2
2
9,130,000 10,640 115 490,000 158,000
490,000 158,000
sx
2 0.7
52
31,530,000
10,640 31,530,000 9,130,000
31,530,000 9,130,000
The 90-percent confidence interval is calculated as $3,081 1.645 $52.
Accuracy of State Estimates. The redesign of the CPS following the 1980 census provided an
opportunity to increase efficiency and accuracy of state data. All strata are now defined within
state boundaries. The sample is allocated among the states to produce state and national
estimates with the required accuracy while keeping total sample size to a minimum. Improved
accuracy of state data was achieved with about the same sample size as in the 1970 design.
Since the CPS is designed to produce both state and national estimates, the proportion of the total
population sampled and the sampling rates differ among the states. In general, the smaller the
population of the state the larger the sampling proportion. For example, in Vermont
approximately 1 in every 250 households is sampled each month. In New York the sample is
about 1 in every 2,000 households. Nevertheless, the size of the sample in New York is four
times larger than in Vermont because New York has a larger population.
23
Note: The Census Bureau recommends the use of 3-year averages to compare estimates across
states and 2-year averages to evaluate changes in state estimates over time. See
“Standard Errors of Data for Combined Years” and “Standard Errors of Differences of 2Year Averages.” The Census Bureau also recommends the American Community Survey
microdata file as the preferred source for income and poverty state data in years 2006
(2005 estimates) to the present.
Standard Errors for State Estimates. The standard error for a state may be obtained by
determining new state-level a and b parameters and then using these adjusted parameters in the
standard error formulas mentioned previously. To determine a new state-level b parameter
(bstate), multiply the b parameter from Table 4 or 5 by the state factor from Table 9. To
determine a new state-level a parameter (astate), use the following:
(1)
If the a parameter from Table 4 or 5 is positive, multiply it by the state factor
from Table 9.
(2)
If the a parameter in Table 4 or 5 is negative, calculate the new state-level a
parameter as follows:
a state
b state
POPstate
(12)
where POPstate is the state population found in Table 9.
Illustration 11
Suppose there were 15,252,000 people living in New York state who were born in the United
States. Use Formulas (1) and (12) and the appropriate parameter, factor, and population from
Tables 5 and 9 to get
Illustration 11
Number of people in NY who were born in the U.S. (x)
b parameter (b)
New York state factor
State population
State a parameter (astate)
State b parameter (bstate)
Standard error
15,252,000
2,652
1.17
19,465,167
-0.000159
3,103
101,000
Obtain the state-level b parameter by multiplying the b parameter, 2,652, by the state factor,
1.17. This gives bstate = 2,652 × 1.17 = 3,103. Obtain the needed state-level a parameter by
a state
3,103
0.000159
19,465,167
24
The standard error of the estimate of the number of people in New York state who were born in
the United States can then be found by using Formula (1) and the new state-level a and b
parameters, -0.000159 and 3,103, respectively. The standard error is given by
s x 0.000159 15,252,000 2 3,103 15,252,000 101,000
Standard Errors of Regional Estimates. To compute standard errors for regional estimates,
follow the steps for computing standard errors for state estimates found in “Standard Errors for
State Estimates” using the regional factors and populations found in Table 10.
Illustration 12
Suppose there were 18,870,000 of 116,771,000 people, or 16.2 percent, living in poverty in the
South. Use Formulas (2) and (12) and the appropriate parameter, factor, and population from
Tables 5 and 10 to get
Illustration 12
Poverty rate in the South (p)
Base (y)
b parameter (b)
South regional factor
Regional b parameter (bregion)
Standard error
90-percent confidence interval
16.2
116,771,000
8,451
1.08
9,127
0.33
15.7 to 16.7
Obtain the region-level b parameter by multiplying the b parameter, 8,451, by the South regional
factor, 1.08. This gives bregion = 8,451 × 1.08 = 9,127.
The standard error of the estimate of the poverty rate for people living in the South can then be
found by using Formula (2) and the new region-level b parameter, 9,127. The standard error is
given by
s y, p
9,127
16.2 100 16.2 0.33
116,771,000
and the 90-percent confidence interval of the poverty rate for people living in the South is
calculated as 16.2 1.645 0.33.
Standard Errors of Groups of States. The standard error calculation for a group of states is
similar to the standard error calculation for a single state. First, calculate a new state group
factor for the group of states. Then, determine new state group a and b parameters. Finally, use
these adjusted parameters in the standard error formulas mentioned previously.
Use the following formula to determine a new state group factor:
25
n
state group factor
POP state factor
i
i 1
i
n
POP
(13)
i
i 1
where POPi and state factori are the population and factor for state i from Table 9. To obtain a
new state group b parameter (bstate group), multiply the b parameter from Table 4 or 5 by the state
factor obtained by Formula (13). To determine a new state group a parameter (astate group), use the
following:
(1)
If the a parameter from Table 4 or 5 is positive, multiply it by the state group
factor determined by Formula (13).
(2)
If the a parameter in Table 4 or 5 is negative, calculate the new state group a
parameter as follows:
a state group
b state group
n
POP
i 1
(14)
i
Illustration 13
Suppose the state group factor for the state group Illinois-Indiana-Michigan was required. The
appropriate factor would be
state group factor
12,708,052 1.13 6,495,833 1.08 9,796,854 1.09
1.11
12,708,052 6,495,833 9,796,854
Standard Errors of Data for Combined Years. Sometimes estimates for multiple years are
combined to improve precision. For example, suppose x is an average derived from n
n
x
consecutive years’ data, i.e., x i , where the xi are the estimates for the individual years.
i 1 n
Use the formulas described previously to estimate the standard error, s xi , of each year’s estimate.
Then the standard error of x is
sx
sx
n
(15)
where
sx
n
n 1
i 1
i 1
s 2xi 2r s xi s xi 1
(16)
26
and s xi are the standard errors of the estimates xi. Tables 7 and 8 contain the correlation
coefficients, r, for the correlation between consecutive years i and i+1. Correlation between
nonconsecutive years is zero. The correlations were derived for income and poverty estimates,
but they can be used for other types of estimates where the year-to-year correlation between
identical households is high.
The Census Bureau recommends the use of 3-year average estimates for certain small population
subgroups4 (see also “Accuracy of State Estimates.”) Two-year moving averages are
recommended for these small population subgroups for comparisons across adjacent years (see
“Standard Errors of Differences of 2-Year Averages.”)
Illustration 14
Suppose the 2011-2013 3-year average percentage of families with female householder, no
husband present (FFH), in poverty was 30.9. Suppose the percentages and bases for 2011, 2012,
and 2013 were 31.2, 30.9, and 30.6 percent and 15,678,000, 15,489,000, and 15,195,000
respectively. Use the appropriate parameters, factors, and correlation coefficients from Tables 5,
6, and 7 and Formulas (2), (15), and (16) to get
Illustration 14
2011
2012
Percentage of families with female
householder, no husband present
(FFH), in poverty (p)
Base (y)
b parameter (b)
Correlation (r)
Standard error
90-percent confidence interval
31.2
15,678,000
1,243
0.41
30.5 to 31.9
30.9
15,489,000
1,243
0.41
30.2 to 31.6
2013
30.6
15,195,000
1,989
0.53
29.7 to 31.5
2011-2013 avg
30.9
0.35, 0.35
0.31
30.4 to 31.4
The standard error of the 3-year average is calculated as
sx
0.94
0.31
3
where
s x 0.412 0.412 0.53 2 (2 0.35 0.41 0.41) (2 0.35 0.41 0.53) 0.94
The 90-percent confidence interval for the 3-year average percentage of the AIAN population
without health insurance is 30.9 1.645 0.31.
Estimates of characteristics of the American Indian and Alaska Native (AIAN) and Native Hawaiian and Other
Pacific Islander (NHOPI) populations based on a single-year sample would be unreliable due to the small size of the
sample that can be drawn from either population. Accordingly, such estimates are based on multiyear averages.
4
27
Standard Errors of Differences of 2-Year Averages. Comparing two non-overlapping 2-year
averages also improves precision for comparisons across years. Use the formulas described
previously to estimate the standard error, sxi, of each year’s estimate, xi, and the standard error,
s xi ,i 1 , of each average, xi ,i 1 . Then the standard error of the difference of the two nonoverlapping 2-year averages, x1, 2 x3, 4 , is
1
s x1, 2 x 3, 4 s 2x1, 2 s 2x 3, 4 rs x 2 s x 3
2
(17)
Illustration 15
Suppose that you want to calculate the standard error of the difference between the 2010, 2011
and 2012, 2013 averages of the percent of families with female householder, no husband present
(FFH), in poverty. Use the following information along with Tables 5, 6, 9 and Formula (2) to
get
2010
Percentage of families with female
householder, no husband present
(FFH), in poverty (p)
Base (y)
b parameter (b)
Standard error
31.7
15,243,000
1,243
0.42
2011
2012
31.2
15,678,000
1,243
0.41
2013
30.9
15.489,000
1,243
0.41
30.6
15,195,000
1,989
0.53
Use this information, Formulas (15), (16), and (17), and the appropriate correlation coefficient
from Table 7 to get
Illustration 15
2010, 2011
2011, 2012
2012, 2013
avg(2012, 2013) avg(2010, 2011)
-0.7
Average percent of families with female
31.5
30.8
householder, no husband present
(FFH), in poverty ( x )
Correlation coefficient (r)
0.35
0.35
0.35
Standard error
0.34*
0.39*
0.49
90-percent confidence interval
30.9 to 32.1
- 30.2 to 31.4
-1.5 to 0.1
*See “Standard Errors of Data for Combined Years” for instructions and illustrations on calculating these
standard errors.
The standard error of the difference of the two 2-year averages is calculated as
1
s x1, 2 x3, 4 0.34 2 0.39 2 0.35 0.41 0.41 0.49
2
28
and the 90-percent confidence interval around the difference of the 2-year averages is calculated
as -0.7 1.645 0.49. Since this interval includes zero, we cannot conclude with 90 percent
confidence that the 2012-2013 average percent of families with female householder, no husband
present (FFH), in poverty was higher than the 2010-2011 average percent of families with female
householder, no husband present (FFH), in poverty.
Standard Errors of Quarterly or Yearly Averages. For information on calculating standard
errors for labor force data from the CPS which involve quarterly or yearly averages, please see
the “Explanatory Notes and Estimates of Error: Household Data” section in Employment and
Earnings, a monthly report published by the U.S. Bureau of Labor Statistics.
Technical Assistance. If you require assistance or additional information, please contact the
Demographic Statistical Methods Division via e-mail at [email protected].
29
Table 4. Parameters for Computation of Standard Errors for Labor Force Characteristics:
March 2014
Characteristic
a
b
Civilian labor force, employed
Not in labor force
Unemployed
-0.000016
-0.000009
-0.000016
3,068
1,833
3,096
Civilian labor force, employed, not in labor force, and unemployed
Men
Women
Both sexes, 16 to 19 years
-0.000032
-0.000031
-0.000022
2,971
2,782
3,096
-0.000151
-0.000311
-0.000252
-0.001632
3,455
3,357
3,062
3,455
-0.000141
-0.000253
-0.000266
-0.001528
3,455
3,357
3,062
3,455
-0.000346
-0.000729
-0.000659
-0.004146
3,198
3,198
3,198
3,198
Total or White
Black
Civilian labor force, employed, not in labor force, and unemployed
Men
Women
Both sexes, 16 to 19 years
Hispanic, may be of any race
Civilian labor force, employed, not in labor force, and unemployed
Men
Women
Both sexes, 16 to 19 years
Asian, American Indian and Alaska Native, Native Hawaiian and
Other Pacific Islander
Civilian labor force, employed, not in labor force, and unemployed
Men
Women
Both sexes, 16 to 19 years
NOTES:
(1) These parameters are to be applied to basic CPS monthly labor force estimates.
(2) The Total or White, Black, and Asian, AIAN, NHOPI parameters are to be used for both alone and in
combination race group estimates.
(3) For nonmetropolitan characteristics, multiply the a and b parameters by 1.5. If the characteristic
of interest is total state population, not subtotaled by race or ethnicity, the a and b parameters are
zero.
(4) For foreign-born and noncitizen characteristics for Total and White, the a and b parameters should
be multiplied by 1.3. No adjustment is necessary for foreign-born and noncitizen characteristics
for Black, Hispanic, and Asian, AIAN, NHOPI parameters.
(5) For the groups self-classified as having two or more races, use the Asian, AIAN, NHOPI
parameters for all employment characteristics.
30
Table 5. Parameters for Computation of Standard Errors for People and Families: 2014 CPS ASEC
Characteristics
Total or White
a
PEOPLE
Educational attainment
Employment
People by family income
Income characteristics
Total
Male
Female
Age
15 to 24
25 to 44
45 to 64
65 and over
Health insurance
Marital status, household and family
Some household members
All household members
Mobility (movers)
Educational attainment, labor force,
Marital status, HH, family, and income
US, county, state, region, or MSA
Below poverty
Total
Male
Female
Age
Under 15
Under 18
15 and over
15 to 24
25 to 44
45 to 64
65 and over
Unemployment
b
Black
a
b
Asian, AIAN, &
NHOPI
a
b
Hispanic
a
b
-0.000008 1,930 -0.000042 2,182 -0.000082 1,762 -0.000034 1,475
-0.000021 4,909 -0.000109 5,528 -0.000246 5,117 -0.000149 5,528
-0.000016 3,990 -0.000086 4,568 -0.000211 4,568 -0.000107 4,568
-0.000008 1,998 -0.000043 2,288 -0.000106 2,288 -0.000053 2,288
-0.000016 1,998 -0.000094 2,288 -0.000222 2,288 -0.000106 2,288
-0.000016 1,998 -0.000082 2,288 -0.000202 2,288 -0.000107 2,288
-0.000046
-0.000024
-0.000024
-0.000046
-0.000014
1,998
1,998
1,998
1,998
4,243
-0.000200
-0.000120
-0.000144
-0.000374
-0.000090
2,288
2,288
2,288
2,288
6,094
-0.000472
-0.000270
-0.000381
-0.000974
-0.000214
2,288
2,288
2,288
2,288
6,094
-0.000165
-0.000142
-0.000237
-0.000712
-0.000115
2,288
2,288
2,288
2,288
6,094
-0.000014 4,243 -0.000090 6,094 -0.000214 6,094 -0.000115 6,094
-0.000016 5,155 -0.000131 8,987 -0.000315 8,987 -0.000170 8,987
-0.000008 2,336 -0.000034 2,336 -0.000082 2,336 -0.000043 2,336
-0.000021 6,344 -0.000093 6,344 -0.000222 6,344 -0.000120 6,344
-0.000027 8,451 -0.000123 8,451 -0.000296 8,451 -0.000158 8,451
-0.000056 8,451 -0.000261 8,451 -0.000614 8,451 -0.000315 8,451
-0.000053 8,451 -0.000234 8,451 -0.000574 8,451 -0.000320 8,451
-0.000106
-0.000080
-0.000034
-0.000074
-0.000040
-0.000038
-0.000075
-0.000021
6,515
6,515
8,451
3,197
3,197
3,197
3,197
4,954
-0.000386
-0.000299
-0.000162
-0.000278
-0.000166
-0.000202
-0.000523
-0.000109
6,515
6,515
8,451
3,197
3,197
3,197
3,197
5,528
-0.000846
-0.000691
-0.000390
-0.000659
-0.000378
-0.000533
-0.001362
-0.000246
6,515
6,515
8,451
3,197
3,197
3,197
3,197
5,117
-0.000410
-0.000333
-0.000197
-0.000230
-0.000198
-0.000330
-0.000994
-0.000149
6,515
6,515
8,451
3,197
3,197
3,197
3,197
5,528
FAMILIES, HOUSEHOLDS, OR UNRELATED INDIVIDUALS
Income
-0.000008 1,824 -0.000038 1,992 -0.000091 1,992 -0.000046 1,992
Marital status, HH and family, educational
attainment, population by age/sex
-0.000006 1,683 -0.000029 1,523 -0.000070 1,523 -0.000035 1,523
Poverty
0.000083 1,989 0.000083 1,989 0.000083 1,989 0.000083 1,989
NOTES: (1) These parameters are to be applied to the 2014 Annual Social and Economic Supplement data.
(2) AIAN, NHOPI are American Indian and Alaska Native, Native Hawaiian and Other Pacific Islander, respectively.
(3) Hispanics may be any race. For a more detailed discussion on the use of parameters for race and ethnicity,
please see the “Generalized Variance Parameters” section.
31
(4) The Total or White, Black, and Asian, AIAN, NHOPI parameters are to be used for both alone and in-combination
race group estimates.
(5) For nonmetropolitan characteristics, multiply the a and b parameters by 1.5. If the characteristic of interest is total
state population, not subtotaled by race or ancestry, the a and b parameters are zero.
(6) For foreign-born and noncitizen characteristics for Total and White, the a and b parameters should be multiplied by
1.3. No adjustment is necessary for foreign-born and noncitizen characteristics for Black, Asian, AIAN, NHOPI,
and Hispanic.
(7) For the group self-classified as having two or more races, use the Asian, AIAN, NHOPI parameters for all
characteristics except employment, unemployment, and educational attainment, in which case use Black parameters.
(8) To obtain parameters prior to 2013, multiply the parameter from this table by the appropriate year factor in
Table 6.
Table 6. CPS Year Factors: 1947 to 2013 CPS ASEC
Data Collection Period
2003 – 2013
2001 (expanded) – 2002
1996 – 2001 (basic)
1990 – 1995
1989
1985 – 1988
1982 – 1984
1973 – 1981
1967 – 1972
1957 – 1966
1947 – 1956
Total or White
a and b
a and b
Black
a*
Hispanic
a and b
1.00
1.00
1.97
1.82
2.02
1.70
1.70
1.52
1.52
2.28
3.42
1.00
1.00
1.97
1.82
2.02
1.70
1.70
1.52
1.52
2.28
3.42
1.00
1.53
3.00
2.78
3.09
2.60
2.60
2.32
2.32
3.48
5.22
1.00
1.00
1.97
1.82
2.12
1.70
2.38
2.13
3.58
5.38
8.07
NOTES: (1) Blacks have separate factors for the a and b parameter factors due to the new race
definitions and how they affected the population control totals.
(2) Use the asterisked factor to get a parameters for all estimates of the Black population
except those for Black families, households, and unrelated individuals in poverty.
(3) For races not listed, use the factor for Total or White.
(4) Hispanics may be any race. For a more detailed discussion on the use of parameters
for race and ethnicity, please see the “Generalized Variance Parameters” section.
32
Table 7. CPS Year-to-Year Correlation Coefficients for Income and
Health Insurance Characteristics: 1961 to 2014
Characteristics
Total
White
Black
Other
Hispanic
NOTES:
1961-2001 (basic)
or 2001 (expanded)-2014
2000 (basic)2001 (expanded)
People
Families
People
Families
0.30
0.30
0.30
0.30
0.45
0.35
0.35
0.35
0.35
0.55
0.19
0.20
0.15
0.15
0.36
0.22
0.23
0.18
0.17
0.28
(1) Correlation coefficients are not available for income data before 1961.
(2) Hispanics may be any race. For a more detailed discussion on the use of parameters for race and
ethnicity, please see the “Generalized Variance Parameters” section.
(3) These correlation coefficients are for comparisons of consecutive years. For comparisons of
nonconsecutive years, assume the correlation is zero.
(4) For households and unrelated individuals, use the correlation coefficient for families.
Table 8. CPS Year-to-Year Correlation Coefficients for Poverty Characteristics: 1971 to 2014
Characteristics
1973-84, 19852001 (basic)
or 2001
(expanded)-2014
2000 (basic)2001 (expanded)
1984-1985
1972-1973
1971-1972
People Families People Families People Families People Families People Families
Total
White
Black
Other
Hispanic
NOTES:
0.45
0.35
0.45
0.45
0.65
0.35
0.30
0.35
0.35
0.55
0.29
0.23
0.23
0.22
0.52
0.22
0.20
0.18
0.17
0.40
0.39
0.30
0.39
0.30
0.56
0.30
0.26
0.30
0.30
0.47
0.15
0.14
0.17
0.17
0.17
0.14
0.13
0.16
0.16
0.16
0.31
0.28
0.35
0.35
0.35
0.28
0.25
0.32
0.32
0.32
(1) Correlation coefficients are not available for income data before 1961.
(2) Hispanics may be any race. For a more detailed discussion on the use of parameters for race and
ethnicity, please see the “Generalized Variance Parameters” section.
(3) These correlation coefficients are for comparisons of consecutive years. For comparisons of
nonconsecutive years, assume the correlation is zero.
(4) For households and unrelated individuals, use the correlation coefficient for families.
33
Table 9. Factors and Populations for State Standard Errors and Parameters: 2014 CPS ASEC
State
Factor
Population
State
1.05
0.18
1.23
0.68
1.25
1.20
0.88
0.22
0.18
1.12
1.08
0.29
0.36
1.13
1.08
0.77
0.73
1.05
1.05
0.39
1.13
1.06
1.09
1.07
0.71
1.11
4,764,174
706,048
6,559,705
2,914,162
38,008,803
5,214,573
3,548,671
914,927
645,108
19,380,887
9,828,398
1,353,101
1,600,046
12,708,052
6,495,833
3,059,738
2,835,666
4,315,750
4,533,806
1,314,170
5,859,780
6,645,793
9,796,854
5,388,418
2,921,302
5,947,698
Montana
Nebraska
Nevada
New Hampshire
New Jersey
New Mexico
New York
North Carolina
North Dakota
Ohio
Oklahoma
Oregon
Pennsylvania
Rhode Island
South Carolina
South Dakota
Tennessee
Texas
Utah
Vermont
Virginia
Washington
West Virginia
Wisconsin
Wyoming
Alabama
Alaska
Arizona
Arkansas
California
Colorado
Connecticut
Delaware
District of Columbia
Florida
Georgia
Hawaii
Idaho
Illinois
Indiana
Iowa
Kansas
Kentucky
Louisiana
Maine
Maryland
Massachusetts
Michigan
Minnesota
Mississippi
Missouri
NOTES:
Factor
Population
0.24
0.46
0.67
0.34
1.12
0.58
1.17
1.11
0.16
1.09
0.91
1.01
1.09
0.30
1.06
0.17
1.08
1.28
0.54
0.18
1.08
1.15
0.39
1.10
0.15
1,005,163
1,848,487
2,771,268
1,308,537
8,821,333
2,046,762
19,465,167
9,685,857
721,323
11,418,269
3,793,051
3,909,190
12,591,901
1,036,500
4,699,050
834,011
6,418,151
26,184,423
2,901,262
620,342
8,088,055
6,904,059
1,824,558
5,681,917
576,200
(1) The state population counts in this table are for the 0+ population.
(2) For foreign-born and noncitizen characteristics for Total and White, the a and b parameters should
be multiplied by 1.3. No adjustment is necessary for foreign-born and noncitizen characteristics for
Black, Asian, AIAN, NHOPI, and Hispanic.
Table 10. Factors and Populations for Regional Standard
Errors and Parameters: 2014 CPS ASEC
Region
Midwest
Northeast
South
West
NOTES:
Factor
1.03
1.05
1.08
1.10
Population
66,736,266
55,352,414
116,771,439
73,556,180
(1) The state population counts in this table are for the 0+ population.
(2) For foreign-born and noncitizen characteristics for Total and White, the a and b parameters should
be multiplied by 1.3. No adjustment is necessary for foreign-born and noncitizen characteristics for
Black, Asian, AIAN, NHOPI, and Hispanic.
34
References
[1]
Bureau of Labor Statistics. 2004. Employment and Earnings. “Redesign of the Sample
for the Current Population Survey.” Volume 51 Number 11, May 2004. Washington,
DC: Government Printing Office. pp 4-6.
[2]
U.S. Census Bureau. 2006. Current Population Survey: Design and Methodology.
Technical Paper 66. Washington, DC: Government Printing Office.
(http://www.census.gov/prod/2006pubs/tp-66.pdf)
[3]
Brooks, C.A. and Bailar, B.A. 1978. Statistical Policy Working Paper 3 – An Error
Profile: Employment as Measured by the Current Population Survey. Subcommittee on
Nonsampling Errors, Federal Committee on Statistical Methodology, U.S. Department of
Commerce, Washington, DC. (http://fcsm.sites.usa.gov/files/2014/04/spwp3.pdf)
[4]
U.S. Census Bureau. 1993. Money Income of Households, Families, and Persons in the
United States: 1992. Current Population Reports, P60-184. Washington, DC:
Government Printing Office. (http://www2.census.gov/prod2/popscan/p60-184.pdf)
[5]
U.S. Census Bureau. 1978. Money Income in 1976 of Families and Persons in the
United States. Current Population Reports, P60-114. Washington, DC: Government
Printing Office. (http://www2.census.gov/prod2/popscan/p60-114.pdf)
[6]
U.S. Census Bureau, July 15, 2009, “Estimating ASEC Variances with Replicate Weights
Part I: Instructions for Using the ASEC Public Use Replicate Weight File to Create
ASEC Variance Estimates.”
(http://www.bls.census.gov/pub/cps/march/Use_of_the_Public_Use_Replicate_Weight_F
ile_final_PR.doc )
File Type | application/pdf |
Author | caste311 |
File Modified | 2014-12-19 |
File Created | 2014-11-13 |