Cattle - Quality Measures

Cattle Methodology and Quality
Measures
ISSN: 2167-1303

Released March 10, 2023, by the National Agricultural Statistics Service (NASS), Agricultural Statistics Board, United States Department of
Agriculture (USDA).

Scope and Purpose: The January Cattle Survey targets cattle and calf producers in the U.S. The January survey collects
data for total cattle inventory and the components of that total, including beef cows, milk cows, bulls, replacement heifers,
other heifers and steers, calves, and cattle on feed. In addition, the January survey collects calf crop (calves born from the
previous year), death loss from the previous year, slaughter for consumption, breeding animal values, and grazing fees
data. Data are also collected for total cattle grazing on small grain pastures in Kansas, Oklahoma, and Texas. A federal
program survey is conducted every five years for Cattle and Calf Predator and Non-Predator Loss and is incorporated as
part of the January Cattle Survey.
Survey Timeline: The reference date for the January Cattle Survey is January 1 with a data collection period of 15 days,
beginning one day prior to the reference date. Regional Field Offices (RFOs) may begin data collection one day prior to
the reference date. Data collection continues until a scheduled ending date and RFOs have 4 to 5 business days to
complete editing and analysis, execute the summary, and interpret the survey results. The Agricultural Statistics Board
(ASB) must perform the National review, reconcile state estimates to the National estimates, and prepare the official
estimates for release in 5 to 6 business days. The estimates are released to the public on the last business day in January.
Sampling: The target population for the January Cattle Survey is all agricultural establishments with one or more head of
cattle on the land operated. A lower boundary, such as 20 head is used in a few states to establish the list frame
population. NASS uses a dual frame approach, consisting of list frame and area frame components to provide complete
coverage of this target population. The January Cattle Survey is conducted in every state.
The list frame includes all known agricultural establishments. Livestock inventory of each establishment is maintained on
the list frame to allow NASS to define list frame sampling populations for specific surveys and to employ efficient
sampling designs. Only list frame records with positive cattle inventory are included in the list frame population for the
cattle sample. The list frame cattle population covers approximately 88 percent of January cattle inventory in the U.S.
The area frame contains all land in the United States and as such, is complete. The land is stratified according to intensity
of agriculture using satellite imagery. The land in each stratum is divided into segments of roughly one square mile.
Segments are optimally allocated and sampled to effectively measure crops and livestock. The sampled segments are fully
enumerated in June. All farms and ranches found operating tracts in these segments are checked to see if they are included
in the list frame cattle population. The farms and ranches that are not included in the list frame cattle population, called
nonoverlap tracts are sampled for the January Cattle survey so that the target population is completely represented. The
area frame component of the January Cattle survey covers approximately 12 percent of the January cattle inventory in the
U.S.
The January Cattle Survey list frame sample is selected using a hierarchical stratified sampling design with strata defined
by total cattle and calves, milk cows, and cattle on feed. The sample is designed to achieve a U.S. standard error of
1 percent of the point estimate for total cattle and calves, 2 percent for milk cows, and 2 percent for cattle on feed. The
January Cattle Survey nonoverlap sample is a subset of the June Area Survey. The sample (or subsample) uses a stratified
sample design based on the cattle data collected from the June Area Survey. Each sampling unit from the list and area
frames is assigned a sampling weight which is used to create the survey estimates.
Data Collection and Editing: For consistency across modes, the paper version is considered the master questionnaire and
the Computer Assisted Telephone Interview (CATI), Computed Assisted Self Interview (CASI), and Mobile Computer
Assisted Personal Interview (mCAPI) instruments are built to model the paper instrument. Questionnaire content and

format are evaluated annually through a specifications process where requests for changes are evaluated and approved or
disapproved. Input may vary from question wording or formatting to a program change involving the deletion or
modification of current questions or addition of new ones. If there are significant changes to either the content or format
proposed, a NASS survey methodologist will pre-test the changes for usability. Prior to the start of data collection, all
modes of instruments are reviewed and the paper, mCAPI, CASI and CATI instruments are thoroughly tested.
All federal data collections require approval by the Office of Management and Budget (OMB). NASS must document the
public need for the data, apply sound statistical practice, prove the data does not already exist elsewhere, and ensure the
public is not excessively burdened. The cattle questionnaire must display an active OMB number that gives NASS the
authority to conduct the survey, a statement of the purpose of the survey, and the use of the data being collected. Also, a
response burden statement that gives an estimate of the time required to complete the form, a confidentiality statement
that the respondent’s information will only be used for statistical purposes in combination with other producers and a
statement saying that response to the survey is voluntary and not required by law must be on the questionnaire.
In addition to asking the specific cattle items, all instruments collect information to verify the sampled unit, determine any
changes in the name or address, identify any partners to detect possible duplication, verify the farm still qualifies for the
target population, and identify any additional operations operated by the sampled operator.
Sampled farms and ranches receive a presurvey letter explaining the survey and that they will be contacted for survey
purposes only. The letter provides the questions to be asked to allow respondents to prepare in advance and also provides
a pass code they can use to complete the survey on the internet (CASI). All modes of data collection are utilized for cattle
surveys. RFOs are given the option of conducting a mail out/mail back phase. While mail is the least costly mode of
collection, the short data collection period and the uncertainty of postal delivery times limit its effectiveness. Most of the
data are collected by CATI by individual RFOs and Data Collection Centers. A program is run to determine if any
sampled farms are in multiple on-going surveys, so data collection can be coordinated.
Survey Edit: As survey data are collected and captured, they are edited for consistency and reasonableness using
automated systems. The edit logic ensures the coding of administrative data follows the methodological rules associated
with the survey design. Relationships between data items on the current survey are verified and in certain situations those
items may be compared to data from earlier surveys to make sure certain relationships are logical. The edit will determine
the status of each record to be either “dirty” or “clean”. Dirty records must be updated and reedited or certified by an
analyst to be clean. If updates are needed, they are reedited interactively. Only clean records are eligible for analysis and
summary.
Analysis Tools: Edited data are processed through an interactive analysis tool which displays data for all reports by item.
The tool provides scatter plots, tables, charts, and special tabulations that allow the analyst to compare an individual
record to other similar records within their state. Outliers and unusual data relationships become evident and RFO staff
will review them to determine if they are correct. The tool also allows comparison to previously reported data to detect
large changes in the operation. Suspect data found to be in error are corrected, while data found to be correct are kept.
Nonsampling Errors: Nonsampling errors are present in any survey process. These errors include reporting, recording,
editing, and imputation errors. Steps are taken to minimize the impact of these errors, such as questionnaire testing,
comprehensive interviewer training, validation and verification of processing systems, detailed computer edits, and the
analysis tool.
Estimators: Each farm and ranch in the sample has an initial sampling weight. This is the inverse of the sampling
fraction. For example, if a stratum has 1,000 farms in the population and 200 are sampled for this survey, each sampled
farm has a weight of 5. In other words, each sampled farm represents 5 farms. The nonoverlap tracts sampled to measure
the cattle not accounted for by the list have a weight determined by adjusting their original area frame weight by any
second stage sampling weight.
Response to the January Cattle survey is voluntary. Some producers refuse to participate in the survey. Others cannot be
located during the data collection period, and some submit incomplete reports. These nonrespondents must be accounted
for if accurate estimates of cattle are to be made. For the Cattle survey, nonrespondents are accounted for by adjusting the
2

Cattle Methodology and Quality Measures (March 2023)
USDA, National Agricultural Statistics Service

weights of the respondents. The adjustment occurs by stratum as the bounded strata represent homogeneous groupings of
similar sized farms. The adjustment is also performed for each individual item (total cattle, beef cows, calf crop) because
sometimes only a partial report is obtained. Using the previous example, if 180 of the original 200 respond, the weights of
the 180 will be adjusted to 1,000 divided by 180, or 5.56. The largest stratum is unbounded and is made up of large and,
often unique, farms. Nonrespondents in this stratum and the nonoverlap tracts must be manually imputed by RFO
statisticians, and their weights are not adjusted.
Two estimators are used to compute direct measures of the cattle items. The “reweighted” estimator and the “adjusted”
estimator are computationally identical except in how the nonresponse adjustments are made. The reweighted estimator
uses a global weight adjustment across all reported and estimated reports. The nonresponse weight adjustment for the
adjusted estimator uses an additional piece of information. When a sampled farm refuses to cooperate, interviewers will
probe to determine the presence of cattle even though the number is not known. This presence/absence indicator is used in
the weight adjustment.
Point estimates, called direct expansions, for both estimators are calculated by multiplying the reported value by the
nonresponse adjusted weight and summing to a stratum total. A variance estimate is also computed at the stratum level.
The nonoverlap tracts are treated as an additional stratum. Totals and variances are additive across strata to form a state
estimate and states are additive to a National estimate.
Ratio estimates are also computed for many items. For example, beef cows can be estimated as a percent of total
inventory. Ratio estimates use the reweighted estimator described above for the numerator and denominator. Both the
numerator and denominator must be complete for that record to be included in the ratio estimator.
Estimation: When all samples are accounted for, all responses fully edited, and the analysis material is reviewed, each
RFO executes the summary for their state. When all RFOs have run summaries, Headquarters executes the National
summary. Since all states conduct identical surveys, the samples can be pooled, and National survey results computed.
The summary results provide multiple point estimates and their standard errors for each data series being estimated. It also
provides information used to assess the performance of the current survey and evaluate the quality of the survey estimates,
such as strata level expansions, response rates, and percent of the expansion from usable reports.
RFOs are responsible for performing a detailed review of their survey results. Any irregularities revealed by the summary
must be investigated and, if necessary, resolved. Using the historical relationship of the survey estimates to the official
estimate, RFOs interpret the survey results and submit a recommended estimate to Headquarters. The data are viewed in
tabular and graphical form and a consensus estimate is established. RFOs see their survey results only and do not have
access to other states’ results. For some data series, information from other sources is also utilized in the process of
establishing estimates.
For the National estimates, NASS assembles a panel of statisticians to serve as the Agricultural Statistics Board which
reviews the National results and establishes the National estimates. Since larger sample sizes yield more precise results,
NASS employs the “top-down” approach by determining the National estimates first and reconciling the state estimates to
the National number for total cattle and the cattle classes. The ASB has the advantage of being able to examine results
across stats, compare the state recommendations, and utilize administrative data available only at the United States level.
The same estimators used in the state summaries are produced by the National summary. The ASB follows the same
approach the states do in determining the National estimate. The historical relationship of the survey estimates to the
official estimate is evaluated over time to determine accuracy and bias using tables and graphs. Every five years NASS
conducts the Census of Agriculture, which is an exhaustive data collection effort for all known farm operations across the
U.S. The information gathered from the Census of Agriculture is used to establish bench-mark levels by which the survey
estimators can be compared, and bias determined. Survey based estimators can also be impacted by outliers – individual
reports that have “excessive influence” on the results due to either improper classification or extremely unusual data for a
given operation (i.e., operation is not representative of other operations). NASS thoroughly reviews the survey data to
identify these situations and consider their impact on the survey results when establishing the official estimates.
External information (administrative data) is also utilized in the process of setting estimates. To be considered, these data
must be deemed to be reliable and come from unbiased sources. The most common administrative data is commercial
Cattle Methodology and Quality Measures (March 2023)
USDA, National Agricultural Statistics Service

3

slaughter. NASS employs a balance sheet approach whenever possible to ensure that estimates are as accurate as possible.
This approach typically is limited to National level estimates. A balance sheet and its components are reviewed when the
inventory numbers are established. Commercial slaughter is an important element of the balance sheet at the National
level since its high degree of reliability is based on a near-actual count of animals slaughtered. Live U.S. imports and
exports to other countries are also considered.
Subtracting the disposition components of the balance sheet from supply components should, theoretically, give the
current inventory. However, each component of the balance sheet has varying degrees of possible estimation error. To be
most useful as an indication of inventory, therefore, each component is estimated based on all available information. The
supply components of the U.S. balance sheet are the beginning inventory, births, and imports (inshipments for State
balance sheets). From this supply, the disposition components – commercial slaughter (marketings at State level), farm
slaughter, deaths, and exports – are subtracted. The result is the indicated number on hand at the end of the period or year.

4

Cattle Methodology and Quality Measures (March 2023)
USDA, National Agricultural Statistics Service

Quality Metrics for Cattle
Purpose and Definitions: Under the guidance of the Statistical Policy Office of the Office of Management and Budget
(OMB), the United States Department of Agriculture’s National Agricultural Statistics Service (NASS) provides data
users with quality metrics for its published data series. The metrics tables below describe the performance data for all
surveys contributing to the publication. The accuracy of data products may be evaluated through sampling and
nonsampling error. The measurement of error due to sampling in the current period is irrelevant for a fully enumerated
data series. Nonsampling error is evaluated by response rates and the weighted item response rates.
Sample size is the number of observations selected from the population to represent a characteristic of the
population. Operations that did not have the item of interest or were out of business at the time of data collection
have been excluded.
Response rate is the proportion of the above sample that completed the survey.
Weighted item response rate is a ratio of reported survey data expanded by the original sampling weight
compared to final nonresponse adjusted summary totals.
Coefficient of variation provides a measure of the size for the standard error relative to the point estimate and is
used to measure the precision of the results of a survey estimator.
Cattle Survey Sample Size and Response Rate: To assist in evaluating the performance of the estimates in the cattle
report, the sample size and response rates are displayed.

Cattle Survey Sample Size and Response Rate - United States: January 1, 2022-2023
State

Sample size

Response rate

2022

2023

2022

2023

(number)

(number)

(percent)

(percent)

United States ...........................................................................

36,840

37,063

52.8

53.9

Quality Metrics for Cattle by Class - United States: January 1, 2022-2023
Weighted item
response rate

Class

Coefficient
of variation

2022

2023

2022

2023

(percent)

(percent)

(percent)

(percent)

Cattle and calves .....................................................................

53.7

54.7

1.0

1.3

Cows and heifers that have calved ..........................................
Beef cows ..........................................................................
Milk cows ...........................................................................

50.6
53.0
42.2

51.3
52.4
47.4

1.1
1.3
1.5

1.2
1.4
2.1

Cattle on feed ..........................................................................

70.4

71.6

1.2

0.9

Calf crop ..................................................................................

50.4

51.6

1.1

1.4

Cattle Methodology and Quality Measures (March 2023)
USDA, National Agricultural Statistics Service

5

Quality Metrics for Cattle Survey - States and United States: January 1, 2022-2023
All cattle and calves
State

Sample size

Response rate

Weighted item
response rate

Coefficient
of variation

2022

2023

2022

2023

2022

2023

2022

2023

(number)

(number)

(percent)

(percent)

(percent)

(percent)

(percent)

(percent)

Alabama .......................
Alaska ...........................
Arizona .........................
Arkansas .......................
California ......................
Colorado .......................
Connecticut ...................
Delaware ......................
Florida ...........................
Georgia .........................

693
59
281
780
1,340
847
163
80
736
778

725
58
291
801
1,355
864
162
75
765
788

58.4
52.5
59.4
55.3
47.5
52.1
58.9
26.3
38.2
52.6

51.7
46.6
57.4
52.8
51.9
57.3
60.5
52.0
38.2
52.0

53.9
78.5
71.4
52.7
43.7
61.2
62.5
19.0
33.2
60.5

55.3
13.2
70.0
51.8
43.9
63.7
40.6
41.4
35.1
61.5

6.3
2.7
3.3
4.5
4.5
3.2
26.4
10.5
6.3
16.5

6.2
1.4
2.7
5.8
12.8
3.3
26.8
6.6
5.1
17.3

Hawaii ...........................
Idaho .............................
Illinois ............................
Indiana ..........................
Iowa ..............................
Kansas ..........................
Kentucky .......................
Louisiana ......................
Maine ............................
Maryland .......................

197
885
832
853
1,639
1,483
1,122
446
193
255

203
849
770
860
1,578
1,496
1,099
478
203
260

51.3
51.8
53.5
43.1
45.1
49.8
58.4
64.6
59.6
51.0

55.2
52.8
59.1
46.4
51.2
52.5
54.7
52.5
65.5
45.8

33.3
49.4
53.9
44.8
42.7
49.4
58.7
66.5
52.3
48.1

48.2
48.1
63.2
43.9
49.3
55.4
58.1
54.2
66.2
42.1

2.0
4.4
5.0
7.8
3.9
2.9
4.5
15.2
6.8
12.2

29.1
2.7
6.5
6.9
2.9
2.8
6.0
11.5
7.0
12.5

Massachusetts ..............
Michigan .......................
Minnesota .....................
Mississippi ....................
Missouri ........................
Montana ........................
Nebraska ......................
Nevada .........................
New Hampshire ............
New Jersey ...................

165
672
1,211
545
1,382
765
1,816
179
116
154

170
656
1,195
541
1,409
811
1,790
197
110
152

55.8
48.4
53.1
63.3
50.0
56.1
52.7
45.8
55.2
39.0

71.2
42.8
46.1
51.9
50.6
62.8
57.0
24.9
58.2
53.9

48.8
44.7
51.7
66.3
52.8
51.5
56.6
29.2
42.7
44.7

79.3
45.5
45.7
52.9
52.4
57.7
57.9
19.5
52.3
45.3

17.2
4.3
3.7
5.7
3.1
4.9
3.4
4.9
6.9
10.8

20.2
9.2
4.8
6.4
3.5
5.7
2.7
5.9
9.0
19.8

New Mexico ..................
New York ......................
North Carolina ...............
North Dakota .................
Ohio ..............................
Oklahoma .....................
Oregon ..........................
Pennsylvania ................
Rhode Island .................
South Carolina ..............

504
681
434
922
891
2,521
522
1,306
58
286

525
695
456
950
861
2,533
544
1,320
50
277

46.2
45.5
73.0
43.5
38.0
62.8
54.0
45.7
27.6
53.1

54.1
55.7
63.6
53.5
44.9
64.2
59.0
54.2
20.0
46.9

40.6
42.5
74.8
36.3
35.8
63.7
52.9
43.5
22.5
54.5

47.0
59.4
60.7
44.6
44.2
63.7
57.1
55.6
18.4
54.9

4.7
5.0
6.3
7.1
5.6
5.4
6.0
4.2
15.0
7.2

5.9
15.2
6.7
7.8
5.8
3.2
7.6
4.3
22.6
15.6

South Dakota ................
Tennessee ....................
Texas ............................
Utah ..............................
Vermont ........................
Virginia ..........................
Washington ...................
West Virginia .................
Wisconsin .....................
Wyoming .......................

1,145
834
1,812
424
238
780
488
331
1,276
720

1,185
781
1,838
446
235
784
475
383
1,282
732

47.9
59.1
58.5
78.8
62.2
61.7
50.2
71.3
49.8
55.0

50.5
56.0
58.7
78.9
53.2
50.6
49.5
76.0
47.2
54.1

48.5
58.7
64.6
80.4
50.3
58.4
52.3
70.9
47.2
52.9

47.9
60.7
62.9
74.1
49.9
51.0
57.5
75.4
44.8
52.2

6.1
4.3
3.7
5.8
5.5
4.3
5.7
6.0
3.1
4.7

4.4
5.5
4.3
4.3
5.0
4.7
4.5
4.3
3.3
4.2

United States ................

36,840

37,063

52.8

53.9

53.7

54.7

1.0

1.3

6

Cattle Methodology and Quality Measures (March 2023)
USDA, National Agricultural Statistics Service

Information Contacts
Process
Estimation ....................................
Data Collection ............................
Questionnaires ............................
Sampling and Editing ...................
Summary and Estimators .............
Dissemination ..............................
Media Contact and Webmaster ....

Unit
Livestock Branch
Survey Administration Branch
Data Collection Branch
Sampling Editing and Imputation Methodology Branch
Summary Estimation and Disclosure Methodology Branch
Data Dissemination Office
Public Affairs Office

Telephone
(202) 720-3570
(202) 720-3895
(202) 720-6201
(202) 690-8141
(202) 690-8141
(202) 720-3869
(202) 720-2639

Email
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]

Access to NASS Reports
For your convenience, you may access NASS reports and products the following ways:
➢ All reports are available electronically, at no cost, on the NASS web site: www.nass.usda.gov.
➢ Both national and state specific reports are available via a free e-mail subscription. To set-up this free
subscription, visit www.nass.usda.gov and click on “National” or “State” in upper right corner above “search”
box to create an account and select the reports you would like to receive.
➢ Cornell’s Mann Library has launched a new website housing NASS’s and other agency’s archived reports. The
new website, https://usda.library.cornell.edu. All email subscriptions containing reports will be sent from the new
website, https://usda.library.cornell.edu. To continue receiving the reports via e-mail, you will have to go to the
new website, create a new account and re-subscribe to the reports. If you need instructions to set up an account or
subscribe, they are located at: https://usda.library.cornell.edu/help. You should whitelist [email protected] in your email client to avoid the emails going into spam/junk folders.
For more information on NASS surveys and reports, call the NASS Agricultural Statistics Hotline at (800) 727-9540,
7:30 a.m. to 4:00 p.m. ET, or e-mail: [email protected].
The U.S. Department of Agriculture (USDA) prohibits discrimination against its customers, employees, and applicants for
employment on the basis of race, color, national origin, age, disability, sex, gender identity, religion, reprisal, and where
applicable, political beliefs, marital status, familial or parental status, sexual orientation, or all or part of an individual's
income is derived from any public assistance program, or protected genetic information in employment or in any program
or activity conducted or funded by the Department. (Not all prohibited bases will apply to all programs and/or
employment activities.)
If you wish to file a Civil Rights program complaint of discrimination, complete the USDA Program Discrimination
Complaint Form (PDF), found online at www.ascr.usda.gov/filing-program-discrimination-complaint-usda-customer, or
at any USDA office, or call (866) 632-9992 to request the form. You may also write a letter containing all of the
information requested in the form. Send your completed complaint form or letter to us by mail at U.S. Department of
Agriculture, Director, Office of Adjudication, 1400 Independence Avenue, S.W., Washington, D.C. 20250-9410, by fax
(202) 690-7442 or email at [email protected].