National Hemp Report Methodology and Quality Measures

National Hemp Report Methodology
and Quality Measures
ISSN: 2831-8692
Released May 16, 2024, by the National Agricultural Statistics Service (NASS), Agricultural Statistics Board, United States Department of
Agriculture (USDA).

Scope and Purpose: The Hemp Production and Disposition Inquiry (PDI) is a survey conducted under an agreement
with the Agricultural Marketing Service (AMS) and collects information on the total planted and harvested area, yield,
production, and value of hemp by utilization in the United States. The survey provides critical data about the hemp
industry to assist producers, regulatory agencies, state governments, processors, and other key industry entities. As
defined in the Agricultural Improvement Act of 2018 (2018 Farm Bill), the term “hemp” means the plant species
Cannabis sativa L. and any part of the plant such as the seeds, all derivatives, and extracts, whether growing or not,
with a delta-9 tetrahydrocannabinol (THC) concentration of not more than 0.3% on a dry weight basis. The Domestic
Hemp Production Program, established in the 2018 Farm Bill and administered by AMS, allows for the cultivation of
hemp under certain conditions. As of 2022, all 50 states operated under the regulations of the 2018 Farm Bill. The target
population for the Hemp PDI survey is all growers in the United States who are licensed to grow hemp in 2023 under
the 2018 Farm Bill. The survey is administered in all 50 States.
Timeline: For the 2023 crop year, data collection began with the mailing of questionnaires in January of 2024.
Telephone follow up with nonrespondents began in February and concluded in March. Analysis, summarization, and
the establishment of estimates were completed from mid-March to mid-April. The publication was released on
April 17, 2024.
Sampling: The sampling frame is all farm operations potentially growing hemp on the NASS list frame and was
updated using lists from AMS and other USDA agencies. For the 2023 survey, the resulting sample of 8,037 operations
is a census of all known hemp growers.
Data Collection: NASS in cooperation with AMS and other USDA agencies developed the Hemp Production and
Disposition Inquiry questionnaire. During questionnaire development, NASS survey methodologists conduct cognitive
interviews, and updates are made based on cognitive testing results. Mail, web, and telephone interview modes of data
collection are utilized for the survey. All sampled operations are mailed a questionnaire and instructions to complete
the survey on the internet. A postcard reminder is mailed after the first week of data collection to those who have not
responded, and then telephone follow up begins with any remaining nonrespondents. NASS promotes the survey online
and emphasizes the importance of survey response.
All federal data collections require approval by the Office of Management and Budget (OMB). NASS must document
the public need for the data, apply sound statistical practice, prove the data does not already exist elsewhere, and
ensure the public is not excessively burdened. The questionnaires must display an active OMB number that gives
NASS the authority to conduct the survey, a statement of the purpose of the survey and the use of the data being
collected, a response burden statement that gives an estimate of the time required to complete the form, a
confidentiality statement that the respondent’s information will be protected from disclosure, and a statement saying
that response to the survey is voluntary and not required by law.
Survey Edit: As survey data are collected and captured, they are edited for consistency and reasonableness using
automated systems. The edit logic also ensures administrative coding follows the methodological rules associated with
the survey design. Relationships between data items (i.e., responses to individual questions) on the current survey are
verified. Records that do not pass the edit logic are either updated or certified by an analyst as accurate. In some cases,
respondents are re-contacted to verify unusual survey responses.
Analysis Tools: Edited data are analyzed through a standard interactive analysis tool which displays data for all

reports by item. The tool provides scatter plots, tables, charts, and special tabulations that allow the analyst to compare
record level data of similar records. Atypical responses, unusual data relationships, and statistical outliers for all items
are revealed by the analysis tool. RFO and Headquarters staff review such relationships to determine if they are correct.
Data found to be in error are corrected, while accepted data are retained.
Nonsampling Errors: Nonsampling error is present in any survey process. This error includes reporting, recording,
and editing errors, as well as nonresponse error. Steps are taken to minimize the impact of these errors, such as
questionnaire testing, comprehensive interviewer training, validation and verification of the processing systems,
application of detailed computer edits, and evaluation of the data via the analysis tool.
Estimators: Response to the Hemp PDI Survey is voluntary. Some producers refuse to participate in the survey.
Others cannot be located during the data collection period, and some submit incomplete reports. These nonrespondents
must be accounted for if accurate estimates of acreage and production are to be made.
Nonresponse weighting groups or strata are created in each state based on historical and administrative data.
Nonrespondents are accounted for by adjusting the weights of the complete responses in each stratum. The adjustment
is also performed for each individual item because sometimes only a partial report is obtained. The adjustment is
calculated by taking the total number of operations in the stratum and dividing by the number of complete responses in
the stratum. This ratio is applied to the sampling weights of the complete records. This adjustment assumes that the
data of the nonrespondents are like the data of the respondents. The sampling frame is assumed to be complete, so
weights are not adjusted for undercoverage.
Two kinds of estimators are used in the Hemp PDI survey: direct expansions and ratio estimators. Direct expansions
are used to estimate totals such as total planted and harvested acres and production. Direct expansions are calculated
by summing the reported values multiplied by the nonresponse adjusted sampling weights. Variances and coefficients
of variation (CVs) are calculated for the direct expansions to measure the precision of the estimates.
The ratio estimator takes the form of a ratio of two direct expansions which are calculated using the method described
above. The ratio estimator is used for all within survey ratios (e.g., Yields and Prices). If either the numerator or
denominator of the ratio is not complete, the sampling unit is excluded from the estimate and the weights of the
complete records are adjusted accordingly. CVs are also calculated for any ratio estimates in the summary. One
advantage of the ratio estimator is that the CVs tend to be smaller than those for the direct expansions.
Estimation: When all samples are accounted for, all responses fully edited, and the analysis material is reviewed, State
and National summaries are executed in Headquarters. The summary results provide multiple point estimates and
corresponding standard errors for each data series being estimated. It also provides information used to assess the
performance of the current survey and evaluate the quality of the survey results, such as strata level expansions,
response rates, and percent of the expansion from complete reports.
Information obtained from the survey along with Federal and State administrative data is used to establish estimates of
total planted and harvested acres, yield, production, price, and value by utilization. These National and State level
estimates are reviewed by the Agricultural Statistics Board (ASB) for errors, reasonableness, and consistency. To be
considered, the administrative data must be deemed reliable and come from an unbiased source.
All hemp estimates are subject to revision the following year based on a thorough review of all available data. Estimates
will also be reviewed following the 5-year Census of Agriculture, which is an exhaustive data collection effort of all
known farm operations across the United States. The information gathered from the Census of Agriculture provides the
last chance for revision.

Quality Metrics for National Hemp Report
Purpose and Definitions: Under the guidance of the Statistical Policy Office of the Office of Management and Budget
(OMB), the United States Department of Agriculture’s National Agricultural Statistics Service (NASS) provides data
2

National Hemp Report Methodology and Quality Measures (May 2024)
USDA, National Agricultural Statistics Service

users with quality metrics for its published data series. The metrics tables below describe the performance data for all
surveys contributing to the publication. The accuracy of data products may be evaluated through sampling and
nonsampling error. The Hemp PDI Survey CVs measure the error due to sampling as well as some nonsampling error.
Nonsampling error is also evaluated by examining survey response rates and the weighted item response rates.
Sample size is the number of observations selected from the population to represent a characteristic of the
population.
Response rate is the proportion of the above sample that completed the survey, excluding those operations
that did not have the item of interest or were out of business at the time of data collection. This calculation
follows Guideline 3.2.2 of the OMB Standards and Guidelines for Statistical Surveys (September 2006).
Weighted item response rate is a ratio of reported survey data expanded by the original sampling weight
compared to final nonresponse adjusted summary totals.
Coefficient of variation provides a measure of the size for the standard error relative to the point estimate and
is used to measure the precision of the results of a survey estimator.

National Hemp Report Methodology and Quality Measures (May 2024)
USDA, National Agricultural Statistics Service

3

Hemp PDI Survey Sample Size and Response Rate - States and United States: 2022 and 2023
State

Sample Size
2022

Response Rate
2023

(number)

2022

(number)

2023

(percent)

(percent)

Alabama .......................................
Alaska ...........................................
Arizona .........................................
Arkansas .......................................
California ......................................
Colorado .......................................
Connecticut ...................................
Delaware ......................................
Florida ...........................................
Georgia .........................................

124
(D)
54
42
164
267
83
(D)
1,062
224

127
(D)
42
(D)
133
204
(D)
(D)
1,126
196

73.5
(D)
76.4
44.7
57.0
64.2
78.0
(D)
42.8
64.1

43.3
(D)
83.7
(D)
48.8
52.5
(D)
(D)
34.3
39.4

Hawaii ...........................................
Idaho .............................................
Illinois ............................................
Indiana ..........................................
Iowa ..............................................
Kansas ..........................................
Kentucky .......................................
Louisiana ......................................
Maine ............................................
Maryland .......................................

(D)
20
382
(D)
46
125
304
108
23
60

(D)
25
242
(D)
39
123
280
87
31
55

(D)
90.6
70.1
(D)
81.7
79.0
64.2
60.2
83.5
81.2

(D)
91.1
66.8
(D)
71.0
70.1
71.4
54.4
86.3
74.1

Massachusetts ..............................
Michigan .......................................
Minnesota .....................................
Mississippi ....................................
Missouri ........................................
Montana ........................................
Nebraska ......................................
Nevada .........................................
New Hampshire ............................
New Jersey ...................................

69
164
477
427
157
97
64
(D)
(D)
79

52
(D)
483
125
103
90
39
(D)
(D)
64

82.9
67.1
65.5
52.3
75.6
71.7
65.6
(D)
(D)
87.7

87.0
(D)
44.9
56.1
70.7
71.9
89.9
(D)
(D)
65.1

New Mexico ..................................
New York ......................................
North Carolina ...............................
North Dakota .................................
Ohio ..............................................
Oklahoma .....................................
Oregon ..........................................
Pennsylvania ................................
Rhode Island .................................
South Carolina ..............................

48
266
541
73
162
(D)
294
331
(D)
216

(D)
294
665
68
95
73
242
256
(D)
172

76.4
76.4
76.2
85.0
63.3
(D)
79.7
76.6
(D)
67.9

(D)
64.1
64.9
85.6
83.8
62.9
75.9
76.4
(D)
56.1

South Dakota ................................
Tennessee ....................................
Texas ............................................
Utah ..............................................
Vermont ........................................
Virginia ..........................................
Washington ...................................
West Virginia .................................
Wisconsin .....................................
Wyoming .......................................

47
307
713
60
94
355
106
121
352
(D)

57
309
415
52
335
287
86
86
371
(D)

93.3
71.1
62.3
81.6
81.3
76.0
67.2
82.3
84.3
(D)

93.6
71.6
65.5
86.3
48.1
67.9
72.6
76.6
68.4
(D)

Other States 1 ...............................

402

508

69.7

76.8

United States ................................

9,110

8,037

69.1

63.1

(D) Withheld to avoid disclosing data for individual operations.
1
Includes data withheld above.

4

National Hemp Report Methodology and Quality Measures (May 2024)
USDA, National Agricultural Statistics Service

Quality Metrics for Hemp Grown in the Open Area Planted - States and United States: 2022 and 2023
State

Weighted Item Response Rate

Coefficient of Variation

2022

2023

2022

2023

(percent)

(percent)

(percent)

(percent)

Alabama ........................................
Alaska ...........................................
Arizona ..........................................
Arkansas .......................................
California .......................................
Colorado ........................................
Connecticut ...................................
Delaware .......................................
Florida ...........................................
Georgia .........................................

68.0
(D)
(D)
52.4
56.1
68.7
72.9
(D)
55.7
67.3

50.8
(D)
(D)
(D)
60.8
58.4
(D)
(D)
49.8
54.5

41.5
(D)
(D)
66.2
69.0
51.2
27.5
(D)
31.0
36.4

62.6
(D)
(D)
(D)
47.9
46.9
(D)
(D)
42.1
76.3

Hawaii ...........................................
Idaho .............................................
Illinois ............................................
Indiana ..........................................
Iowa ...............................................
Kansas ..........................................
Kentucky ........................................
Louisiana .......................................
Maine ............................................
Maryland ........................................

(D)
80.0
71.7
(D)
68.6
79.0
73.5
(D)
69.6
63.5

(D)
95.2
65.7
(D)
48.9
71.5
59.7
(D)
(D)
57.9

(D)
64.9
30.7
(D)
61.9
35.8
32.1
(D)
62.2
27.1

(D)
44.5
33.3
(D)
50.2
40.8
24.1
(D)
(D)
71.2

Massachusetts ...............................
Michigan ........................................
Minnesota ......................................
Mississippi .....................................
Missouri .........................................
Montana ........................................
Nebraska .......................................
Nevada ..........................................
New Hampshire .............................
New Jersey ....................................

76.8
72.9
73.7
73.2
84.1
77.9
65.3
(D)
(D)
85.7

82.3
(D)
58.4
(D)
44.2
81.1
97.7
(D)
(D)
51.7

42.0
41.9
39.6
59.9
36.2
33.1
80.2
(D)
(D)
61.7

40.2
(D)
35.6
(D)
50.9
29.4
83.7
(D)
(D)
59.5

New Mexico ...................................
New York .......................................
North Carolina ...............................
North Dakota .................................
Ohio ...............................................
Oklahoma ......................................
Oregon ..........................................
Pennsylvania .................................
Rhode Island .................................
South Carolina ...............................

72.9
73.0
82.7
92.7
63.6
(D)
73.8
73.1
(D)
62.7

(D)
77.2
56.9
90.2
73.4
56.3
70.2
64.7
(D)
55.7

60.4
55.0
34.7
54.5
30.4
(D)
45.3
25.0
(D)
52.4

(D)
41.3
52.5
79.4
70.1
50.7
42.1
56.3
(D)
35.8

South Dakota .................................
Tennessee .....................................
Texas ............................................
Utah ...............................................
Vermont .........................................
Virginia ..........................................
Washington ...................................
West Virginia .................................
Wisconsin ......................................
Wyoming .......................................

87.2
73.4
(D)
73.3
78.7
59.9
71.7
81.0
77.7
(D)

77.9
60.0
62.6
94.1
66.6
42.3
60.0
67.0
(D)
(D)

51.5
60.8
(D)
54.3
54.8
37.8
51.7
33.6
23.9
(D)

30.6
61.1
49.6
40.9
33.7
53.7
51.8
31.1
(D)
(D)

Other States 1 ................................

58.7

90.5

34.9

50.9

United States .................................

72.9

68.9

11.7

10.9

(D) Withheld to avoid disclosing data for individual operations.
1
Includes data withheld above.

National Hemp Report Methodology and Quality Measures (May 2024)
USDA, National Agricultural Statistics Service

5

Quality Metrics for Industrial Hemp Grown Under Protection Area in Production - States and
United States: 2022 and 2023
State

Weighted Item Response Rate
2022

Coefficient of Variation

2023

(percent)

2022

(percent)

2023

(percent)

(percent)

Alabama .......................................
Alaska ...........................................
Arizona .........................................
Arkansas .......................................
California ......................................
Colorado .......................................
Connecticut ...................................
Delaware ......................................
Florida ...........................................
Georgia .........................................

63.7
(D)
70.4
(D)
56.0
59.8
71.5
(D)
55.5
66.6

55.6
(D)
82.6
(D)
66.8
54.8
(D)
(D)
44.3
(D)

33.2
(D)
58.8
(D)
38.5
61.4
76.2
(D)
51.5
36.8

49.9
(D)
52.4
(D)
70.7
37.6
(D)
(D)
58.1
(D)

Hawaii ...........................................
Idaho .............................................
Illinois ............................................
Indiana ..........................................
Iowa ..............................................
Kansas ..........................................
Kentucky .......................................
Louisiana ......................................
Maine ............................................
Maryland .......................................

(D)
(D)
66.4
(D)
(D)
67.1
73.1
70.4
(D)
69.7

(D)
100.0
82.7
(D)
(D)
71.7
73.1
60.3
84.8
58.2

(D)
(D)
39.7
(D)
(D)
35.5
38.3
48.8
(D)
77.1

(D)
53.7
28.0
(D)
(D)
50.7
35.3
60.1
65.7
63.0

Massachusetts ..............................
Michigan .......................................
Minnesota .....................................
Mississippi ....................................
Missouri ........................................
Montana ........................................
Nebraska ......................................
Nevada .........................................
New Hampshire ............................
New Jersey ...................................

76.8
66.0
63.6
74.2
74.0
(D)
(D)
(D)
(D)
85.9

84.7
(D)
39.7
65.0
72.6
(D)
79.8
(D)
(D)
(D)

72.9
65.9
44.5
45.5
42.0
(D)
(D)
(D)
(D)
58.3

56.0
(D)
81.2
49.8
80.3
(D)
52.9
(D)
(D)
(D)

New Mexico ..................................
New York ......................................
North Carolina ...............................
North Dakota .................................
Ohio ..............................................
Oklahoma .....................................
Oregon ..........................................
Pennsylvania ................................
Rhode Island .................................
South Carolina ..............................

72.9
75.6
80.1
81.5
63.4
(D)
73.6
72.9
(D)
62.8

(D)
(D)
66.9
87.5
67.0
68.4
69.7
68.0
(D)
62.9

82.5
34.2
30.6
59.0
39.9
(D)
61.0
51.5
(D)
30.5

(D)
(D)
32.6
58.7
66.1
69.7
35.7
38.2
(D)
49.1

South Dakota ................................
Tennessee ....................................
Texas ............................................
Utah ..............................................
Vermont ........................................
Virginia ..........................................
Washington ...................................
West Virginia .................................
Wisconsin .....................................
Wyoming .......................................

(D)
74.3
64.5
73.3
(D)
71.8
71.7
80.1
78.4
(D)

(D)
63.7
68.6
(D)
(D)
56.1
68.6
64.9
76.8
(D)

(D)
39.3
49.3
57.1
(D)
33.1
46.0
47.4
34.8
(D)

(D)
52.9
24.5
(D)
(D)
37.6
56.9
40.0
42.1
(D)

Other States 1 ...............................

68.4

75.2

78.5

40.0

United States ................................

66.1

64.0

18.8

13.1

(D) Withheld to avoid disclosing data for individual operations.
1
Includes data withheld above.

6

National Hemp Report Methodology and Quality Measures (May 2024)
USDA, National Agricultural Statistics Service

Information Contacts
Process
Estimation .....................................
Data Collection .............................
Questionnaires .............................
Sampling and Editing ....................
Analysis and Estimators ................
Dissemination ...............................
Media Contact and Webmaster .....

Unit
Crops Branch
Survey Administration Branch
Data Collection Branch
Sampling, Editing, and Imputation Methodology Branch
Summary, Estimation, and Disclosure Methodology Branch
Data Dissemination Office
Public Affairs Office

Telephone
(202) 720-2127
(202) 690-4847
(202) 720-6201
(202) 690-8141
(202) 690-8141
(202) 720-3869
(202) 720-2639

Email
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]

Access to NASS Reports
For your convenience, you may access NASS reports and products the following ways:
➢ All reports are available electronically, at no cost, on the NASS web site: www.nass.usda.gov
➢ Both national and state specific reports are available via a free e-mail subscription. To set-up this free
subscription, visit www.nass.usda.gov and click on “National” or “State” in upper right corner above “search”
box to create an account and select the reports you would like to receive.
➢ Cornell’s Mann Library has launched a new website housing NASS’s and other agency’s archived reports. The
new website, https://usda.library.cornell.edu. All email subscriptions containing reports will be sent from the new
website, https://usda.library.cornell.edu. To continue receiving the reports via e-mail, you will have to go to the
new website, create a new account and re-subscribe to the reports. If you need instructions to set up an account or
subscribe, they are located at: https://usda.library.cornell.edu/help. You should whitelist [email protected] in your email client to avoid the emails going into spam/junk folders.
For more information on NASS surveys and reports, call the NASS Agricultural Statistics Hotline at (800) 727-9540,
7:30 a.m. to 4:00 p.m. ET, or e-mail: [email protected].
The U.S. Department of Agriculture (USDA) prohibits discrimination against its customers, employees, and applicants for
employment on the basis of race, color, national origin, age, disability, sex, gender identity, religion, reprisal, and where
applicable, political beliefs, marital status, familial or parental status, sexual orientation, or all or part of an individual's
income is derived from any public assistance program, or protected genetic information in employment or in any program
or activity conducted or funded by the Department. (Not all prohibited bases will apply to all programs and/or
employment activities.)
If you wish to file a Civil Rights program complaint of discrimination, complete the USDA Program Discrimination
Complaint Form (PDF), found online at www.ascr.usda.gov/filing-program-discrimination-complaint-usda-customer, or
at any USDA office, or call (866) 632-9992 to request the form. You may also write a letter containing all of the
information requested in the form. Send your completed complaint form or letter to us by mail at U.S. Department of
Agriculture, Director, Office of Adjudication, 1400 Independence Avenue, S.W., Washington, D.C. 20250-9410, by fax
(202) 690-7442 or email at [email protected].