BRFSS Summary Data Quality Report with Response Rates

BRFSS Attachment 9 - BRFSS 2023 Summary Data Quality Report with Response Rates_2025-2027 Cycle.pdf

[NCCDPHP] Behavioral Risk Factor Surveillance System (BRFSS)

BRFSS Summary Data Quality Report with Response Rates

OMB: 0920-1061

Document [pdf]
Download: pdf | pdf
Behavioral Risk Factor Surveillance System
2023 Summary Data Quality Report
August 6, 2024

Page 1 of 25

Table of Contents
Introduction ..........................................................................................................................3
Interpretation of BRFSS Response Rates ............................................................................4
BRFSS 2023 Call Outcome Measures and Response Rate Formulae .................................5
Tables of Outcomes and Rates by State ...............................................................................9
References ..........................................................................................................................25

Page 2 of 25

Introduction
The Behavioral Risk Factor Surveillance System (BRFSS) is a state-based, CDC-assisted healthdata collection project and partnership of state health departments, CDC’s Division of Population
Health, and other CDC programs and offices. It comprises telephone surveys conducted by the
health departments of all 50 states, the District of Columbia, Puerto Rico, the US Virgin Islands,
and Guam.
This Summary Data Quality Report presents detailed descriptions of the 2023 BRFSS calling
outcomes and call summary information for each of the participating states and territories. All
BRFSS public-use data are collected by landline telephone and cellular telephone to produce a
single data set aggregated from the 2023 BRFSS territorial- and state-level data sets. The
variables and outcomes provided in this document are applicable to a combined data set of
responses from participants using landline telephones and cellular telephones within each of the
states and territories.
The inclusion of data from cellular telephone interviews in the BRFSS public release data set has
been standard protocol since 2011. In many respects, 2011 was a year of change—both in
BRFSS’s approach and methodology. As the results of cellular telephone interviews were added
in 2011, so were new weighting procedures that could accommodate the inclusion of new
weighting variables. Data users should note that weighting procedures are likely to affect trend
lines when comparing BRFSS data collected before and after 2011. Because of these changes,
users are advised NOT to make direct comparisons with pre-2011 data, and instead, should begin
new trend lines with that year. Details of changes beginning with the 2011 BRFSS are provided
in the Morbidity and Mortality Weekly Report (MMWR), which highlights weighting and
coverage effects on trend lines.1 Each year of data collection since 2011 has included a larger
percentage of calls from the cell phone sample. In 2023, a majority of the BRFSS interviews
were conducted by cell phone. The annual code books provide information on the number and
percentage of calls conducted by landline and cell phone by year.
The measures presented in this document are designed to summarize the quality of the 2023
BRFSS survey data. Response rates, cooperation rates, and refusal rates for BRFSS are
calculated using standards set by the American Association for Public Opinion Research
(AAPOR). The BRFSS has calculated 2023 response rates using AAPOR Response Rate #4.2
Based on the AAPOR guidelines, response rate calculations include assumptions of eligibility
among potential respondents or households that are not interviewed. Changes in the geographic
distribution of cellular telephone numbers by telephone companies and the portability of landline
telephone numbers are likely to make it more difficult than in the past to determine which
telephone numbers are out-of-sample and which telephone numbers represent likely households.
The BRFSS calculates likely households and eligible persons using the proportions of eligible
households/persons among all phone numbers where eligibility has been determined. This
eligibility factor appears in calculations of response, cooperation, resolution, and refusal rates.
Page 3 of 25

Interpretation of BRFSS Response Rates
Because this report reflects the inclusion of BRFSS cellular telephone interviews, contextual
information on cellular telephone response rates is provided below. Although cellular telephone
response rates are generally lower than landline telephone response rates across most surveys,
the BRFSS has achieved a cellular telephone response rate that compares favorably with other
similar surveys (Table 1). Moreover, since the initial inclusion of cell phone respondents, the
proportion of the sample that is interviewed by cell phone has increased. In many states, cell
phone respondents represent the majority of the sample. Since 2012, median BRFSS cell phone
response rates have risen slightly. Overall, BRFSS response rates have leveled off in the past few
years, with landline rates declining and cell phone rates improving. In 2023, the screening of
eligible landline phone numbers has improved—which may account for a slight improvement in
the proportion of numbers identified as working phone numbers in the landline sample. This
change would not necessarily increase response rates. The leveling-off of telephone survey
response rates is noted for other federal surveys as well—although in one report, authors noted
that the accelerated declines in response rates seen in 6 other surveys were not seen in BRFSS
and one other survey.3
Table 1.
Examples of Survey Response Rates

Survey

Year(s)

Overall Response
Rates

2021–22

9.2%

a

California Health Interview Survey (CHIS)

b

National Health Interview Survey

2023

48.8%

c

Am Time Use Survey

2023

36.9%

BRFSS d,e
2023
44.7%
a
California Health Interview Survey. CHIS 2021–2022 Methodology Series: Report 4—
Response Rates. Los Angeles, CA: UCLA Center for Health Policy Research, 2023. Tables 69. https://healthpolicy.ucla.edu/sites/default/files/202309/chis_2021_2022_methodologyreport4_responserates_final_09112023.pdf
Accessed 14 August 2024
b
National Center for Health Statistics. National Health Interview Survey, 2023. Public-use
data file and documentation.
https://ftp.cdc.gov/pub/Health_Statistics/NCHS/Dataset_Documentation/NHIS/2023/srvydesc508.pdf. Table 4. Accessed 20 August 2024.
c

Am Time Use Survey
Bureau of Labor Statistics (sponsor)/by the U.S. Census Bureau. American Time Use Survey
User’s Guide, 2023 Understanding ATUS 2003 to 2023. https://www.bls.gov/tus/atususersguide.pdf
Table 3.3. Accessed 14 August 2024.
d
BRFSS response rates are presented here as median rates for all participating states and territories.
e Response

rate (RR) formulae may differ by survey:
CHIS—AAPOR RR#4 (like BRFSS)
NHIS—AAPOR RR#2
ATUS—AAPOR RR#2

Page 4 of 25

The following tables present landline telephone and cellular telephone calling outcomes and
rates. The BRFSS cellular telephone survey was collected in a manner similar to that of the
BRFSS landline telephone survey. One important difference, however, is that interviews
conducted by landline telephones include random selection among adults within households,
while cellular telephone interviews are conducted with adults who are contacted on personal
(nonbusiness) cellular telephones. The report presents data on three general types of measure by
state:
1. Call outcome measures, including response rates, which are based on landline telephone
disposition codes.
2. Call outcome measures, including response rates, which are based on cellular telephone
disposition codes.
3. A weighted response rate, based on a combination of the landline telephone response rate
with the cellular telephone response rate proportional to the total sample used to collect the
data for a state.
For clarity, BRFSS recommends that authors and researchers referencing BRFSS data quality
include the following language, below. Note the places where authors should include information
specific to their projects.
Response rates for BRFSS are calculated using standards set by the American Association for Public Opinion
Research (AAPOR) Response Rate Formula #4 Standards-Definitions-10th-edition.pdf (aapor.org) (p86).
Response rate is the number of respondents who completed the survey as a proportion of all eligible and likelyeligible people. The median survey response rate for all participating states, territories and Washington, DC, in
2023 was 44.7 and ranged from 21.7 to 63.1.a Response rates for states and territories included in this analysis
had a median of [provide median] and ranged from [provide range],b For detailed information see the BRFSS
Summary Data Quality Report c
Response rates and ranges should reflect the year(s) included in the analyses.
Response rates for states selected for analysis should be included here. This sentence may be omitted if all states
are used in the analysis.
c
See the Summary Data Quality Report for the year(s) included in the analyses. The 2023 document is available
at: https://www.cdc.gov/brfss/annual_data/2023/pdf/2023-sdqr-508.pdf.
a

b

BRFSS 2023 Call Outcome Measures and Response Rate Formulae
The calculations of calling-outcome rates are based on final disposition codes that are assigned
after all calling attempts have been exhausted. The BRFSS may make up to 15 attempts to reach
a respondent before assigning a final disposition code. In 2023, the BRFSS used a single set of
disposition codes for both landline and cell phones, adapted from standardized AAPOR
disposition codes for telephone surveys. A few disposition codes apply only to landline
telephone or to cellular telephone sample numbers. For example, answering-device messages
may confirm household eligibility for landline telephone numbers but are not used to determine
eligibility of cellular telephone numbers. Disposition codes reflect whether interviewers have
Page 5 of 25

completed or partially completed an interview (1000 level codes), determined that the household
was eligible without completing an interview (2000 level codes), determined that a household or
respondent was ineligible (4000 level codes), or was unable to determine the eligibility of a
household or respondent (3000 level codes). Partially completed interviews are those that have
collected all information needed to weight responses (about 12 minutes into the survey
questionnaire, not including time for eligibility screening). The table below illustrates the codes
used by the BRFSS in 2023, and it notes the instances where codes are used only for landline
telephone or cellular telephone sample numbers.
The Disposition Code Table below uses terms to define and categorize outcomes, which include
the following:
•
•

•
•
•

•

Respondent: A person who is contacted by an interviewer and who may be eligible for
interview.
Private residence: Persons residing in private residences or college housing are eligible.
Persons living in group homes, military barracks or other living arrangements are not
eligible. Persons living in vacation homes for 30 days or more are eligible. Eligibility is
ascertained by asking each potential respondent whether they live in a private residence. If
the respondent is unsure whether their residence qualifies, additional definitions of residences
are provided.
Landline telephone: A telephone that is used within a specific location, including traditional
household telephones, Voice Over Internet Protocol (VOIP), and Internet phones connected
to computers in a household.
Cellular telephone: A mobile device that is not tied to a specific location for use.
Selected respondent: A person who is eligible for interview. For the cellular telephone
sample, a selected respondent is an adult associated with the phone number who lives in a
private residence or college housing within the United States or territories covered by the
BRFSS. For the landline telephone sample, a selected respondent is the person chosen for
interview during the household enumeration section of the screening questions.
Personal cellular telephone: A cellular telephone that is used for personal calls. Cellular
telephones that are used for both personal and business calls may be categorized as personal
telephones and persons contacted on these phones are eligible for interview. Persons using
telephones that are exclusively for business use are not eligible for interview.

Table 2.
2023 Disposition Codes for Landline Telephones and Cellular Telephones
Category

Interviewed
(1000-level codes)

Code

Description

1100

Completed interview

1200

Partially completed interview

Page 6 of 25

Table 2.
2023 Disposition Codes for Landline Telephones and Cellular Telephones
Category

Eligible, Non-Interview
(2000 level codes)

Unknown Eligibility

Not Eligible

Code

Description

2111

Household level refusal (used for landline only)

2112

Selected respondent refusal

2120

Break off/termination within questionnaire

2210

Selected respondent never available

2320

Selected respondent physically or mentally unable to
complete interview

2330

Language barrier of selected respondent

3100

Unknown if housing unit

3130

No answer

3140

Answering device, unknown whether eligible

3150

Telecommunication barrier (i.e. call blocking)

3200

Household, not known if respondent eligible

3322

Physical or mental impairment (household level)

3330

Language barrier (household level)

3700

On never-call list

4100

Out of sample

4200

Fax/data/modem

4300

Nonworking/disconnected number

4400

Technological barrier
(i.e., fast busy, phone circuit barriers)

4430

Call forwarding/pager

4460

Landline telephone number
(used for cellular telephone only)

4500

Non-residence/business

4900

Miscellaneous, non-eligible

Factors affecting the distribution of disposition codes by state include differences in telephone
systems, sample designs, surveyed populations, and data collection processes. Table 3 defines
the categories of disposition codes used to calculate outcome and response rates illustrated in
Tables 4A through 6.

Page 7 of 25

Table 3.
Categories of 2023 Landline and Cellular Telephone Disposition Codes

Category

Disposition Code
Definitions

Formulae
Abbreviation

Completed
Interviews

1100+1200

COIN

Eligible

1100+1200+2111+2112+2120+2210+2320+2330

ELIG

Contacted Eligible

1100+1200+2111+2112+2120+2210+2320+2330

CONELIG

Terminations and
Refusals

2111+2112+2120

TERE

Ineligible Phone
Numbers

All 4000 level disposition codes

INELIG

Unknown Whether
Eligible

All 3000 level disposition codes

UNKELIG

Eligibility Factor

ELIG/(ELIG + INELIG)

E

The disposition codes are categorized according to the groups illustrated in Table 3 to produce
rates of resolution, cooperation, completion, refusal, and response. In accordance with population
surveillance standards, the proportions of people who may have been eligible for interview, but
who were not able to be interviewed, are accounted for in the formulae.
Eligibility Factor
E = ELIG/ (ELIG + INELIG)
The Eligibility Factor is the proportion of eligible phone numbers from among all sample
numbers for which eligibility has been determined. The eligibility factor, therefore, provides a
measure of eligibility that can be applied to sample numbers with unknown eligibility. The
purpose of the eligibility factor is to estimate the proportion of the sample that is likely to be
eligible. The eligibility factor is used in the calculations of refusal and response rates. Separate
eligibility factors are calculated for landline telephones and cellular telephone samples for each
state and territory.
Resolution Rate
((ELIG + INELIG) / (ELIG+INELIG+UNKELIG))*100
The Resolution Rate is the percentage of numbers in the total sample for which eligibility has
been determined. The total number of eligible and ineligible sample phone numbers is divided by
the total number of phone numbers in the entire sample. The result is multiplied by 100 to
calculate the percentage of the sample for which eligibility is determined. Separate resolution
rates are calculated for landline telephone and cellular telephone samples for each state and
territory.
Page 8 of 25

Interview Completion Rate
(COIN / (COIN + TERE)) * 100
The Interview Completion Rate is the rate of completed interviews among all respondents who
have been determined to be eligible and selected for interviewing. The numerator is the number
of complete and partially completed interviews. This number is divided by the number of
completed interviews, partially completed interviews, and all break offs, refusals, and
terminations. The result is multiplied by 100 to provide the percentage of completed interviews
among eligible respondents who are contacted by interviewers. Separate interview completion
rates are calculated for landline telephone and cellular telephone samples for each state and
territory.
Cooperation Rate
(COIN / CONELIG) *100
The AAPOR Cooperation Rate is the number of complete and partial complete interviews
divided by the number of contacted and eligible respondents. The BRFSS Cooperation Rate
follows the guidelines of AAPOR Cooperation Rate #2. Separate cooperation rates are calculated
for landline telephone and cellular telephone samples for each state and territory.
Refusal Rate
(TERE / (ELIG + (E * UNKELIG))) * 100
The BRFSS Refusal Rate is the proportion of all eligible respondents who refused to complete an
interview or terminated an interview prior to the threshold required to be considered a partial
interview. Refusals and terminations (TERE) are in the numerator, and the denominator includes
all eligible numbers and a proportion of the numbers with unknown eligibility. The proportion of
numbers with unknown eligibility is determined by the eligibility factor (E as described above).
The result is then multiplied by 100 to provide a percentage of refusals among all eligible and
likely to be eligible numbers in the sample. Separate refusal rates are calculated for landline
telephone and cellular telephone samples for each state and territory.
Response Rate
(COIN / ((ELIG + (E * UNKELIG))) * 100
A Response Rate is an outcome rate with the number of complete and partial interviews in the
numerator and an estimate of the number of eligible units in the sample in the denominator. The
BRFSS Response Rate calculation assumes that the unresolved numbers contain the same
percentage of eligible households or eligible personal cell phones as the records whose eligibility
or ineligibility are determined. The BRFSS Response Rate follows the guidelines for AAPOR
Response Rate #4. It also is similar to the BRFSS CASRO Rates reported prior to 2011. Separate
eligibility factors are calculated for landline telephone and cellular telephone samples for each
state and territory and a combined Response Rate for landline telephone and cellular telephone
also is calculated. The combined landline telephone and cellular telephone response rate is
generated by weighting to the respective size of the two samples. The total sample equals the
landline telephone sample plus cellular telephone sample. The proportion of each sample is
Page 9 of 25

calculated using the total sample as the denominator. The formulae for the proportions of the
sample are found below:
P1 = TOTAL LANDLINE SAMPLE /
(TOTAL LANDLINE SAMPLE + TOTAL CELL PHONE SAMPLE);
P2 = TOTAL CELL PHONE SAMPLE /
(TOTAL LANDLINE SAMPLE + TOTAL CELL PHONE SAMPLE);
The formula for the Combined Landline Telephone and Cellular Telephone Weighted Response
Rate, therefore, is described below:
COMBINED RESPONSE RATE=
(P1 * LANDLINE RESPONSE RATE) + (P2 * CELL PHONE RESPONSE RATE).

Tables of Outcomes and Rates by State
The tables on the following pages illustrate calling outcomes in categories of eligibility, rates of
cooperation, refusal, resolution, and response by landline telephone and cellular telephone
samples.
 Tables 4A and 4B provide information on the size of the sample and the numbers and
percentages of completed interviews, cooperation rates, terminations and refusals, and
contacts with eligible households by state and territory.
 Tables 5A and 5B provide information on the number and percentage of landline telephone
and cellular telephone sample numbers that are eligible, ineligible, and of unknown
eligibility.
 Table 6 provides response rates for landline telephone samples, cellular telephone samples,
and combined samples.

Page 10 of 25

Table 4A. Landline Sample.
Completions, Terminations and Refusals, Contacted Eligible Households and Total Sample by State
COIN

TERE

CONELIG

COOP

State*

N

%

N

%

N

%

%

Total
Sample

AL

959

2.1

339

0.7

1,304

2.9

73.5

45,209

AK

1,048

1.2

713

0.8

1,799

2.1

58.3

84,750

AZ

2,251

1.8

1,320

1.1

3,662

3.0

61.5

121,740

AR

1,421

2.8

733

1.4

2,219

4.3

64.0

51,090

CA

2,684

0.2

1,226

0.1

4,108

0.3

65.3

1,294,110

CO

900

2.1

565

1.3

1,523

3.6

59.1

42,481

CT

1,000

2.8

691

1.9

1,719

4.7

58.2

36,330

DE

959

0.5

475

0.2

1,502

0.8

63.8

194,850

DC

800

2.1

537

1.4

1,380

3.7

58.0

37,320

FL

3,480

1.8

2,926

1.5

6,561

3.4

53.0

195,360

GA

2,409

1.7

2,463

1.7

5,012

3.4

48.1

145,350

HI

1,583

1.5

666

0.6

2,400

2.2

66.0

108,270

ID

980

2.3

252

0.6

1,266

2.9

77.4

43,350

IL

502

1.0

201

0.4

725

1.5

69.2

48,150

IN

2,176

1.8

1,684

1.4

3,959

3.3

55.0

121,140

IA

1,474

3.5

556

1.3

2,137

5.1

69.0

42,300

KS

1,855

1.5

787

0.6

2,730

2.2

67.9

122,095

LA

581

1.0

341

0.6

932

1.7

62.3

56,310

ME

4,323

0.7

1,019

0.2

5,411

0.9

79.9

576,843

MD

4,550

2.2

3,638

1.7

8,356

4.0

54.5

209,490

MA

1,136

1.0

282

0.2

1,436

1.2

79.1

116,362

MI

2,709

3.1

1,360

1.6

4,133

4.7

65.5

87,180

MN

2,610

0.7

998

0.3

3,713

1.0

70.3

354,300

MS

408

1.3

84

0.3

494

1.6

82.6

31,546

MO

1,592

2.1

531

0.7

2,172

2.9

73.3

75,009

MT

1,945

1.5

675

0.5

2,660

2.1

73.1

129,240

11 of 25

Table 4A. Landline Sample.
Completions, Terminations and Refusals, Contacted Eligible Households and Total Sample by State
COIN

TERE

CONELIG

COOP

State*

N

%

N

%

N

%

%

Total
Sample

NE

2,349

2.2

843

0.8

3,231

3.0

72.7

108,990

NV

480

1.2

231

0.6

721

1.8

66.6

41,091

NH

3,556

4.3

1,170

1.4

4,778

5.8

74.4

82,260

NJ

1,707

1.6

1,526

1.4

3,312

3.1

51.5

106,350

NM

831

2.0

393

0.9

1,256

3.0

66.2

41,910

NY

2,121

1.7

2,052

1.6

4,222

3.3

50.2

126,870

NC

485

1.3

102

0.3

596

1.6

81.4

38,040

ND

1,200

3.7

836

2.6

2,074

6.4

57.9

32,482

OH

2,770

1.9

2,299

1.6

5,239

3.6

52.9

147,030

OK

1,085

2.0

310

0.6

1,463

2.8

74.2

53,015

OR

504

0.9

104

0.2

613

1.1

82.2

55,217

RI

627

2.0

449

1.4

1,105

3.6

56.7

31,020

SC

2,575

2.1

2,246

1.8

4,974

4.0

51.8

123,060

SD

1,060

0.5

156

0.1

1,230

0.6

86.2

213,759

TN

652

1.4

293

0.6

959

2.0

68.0

47,160

TX

1,872

0.7

1,624

0.6

3,640

1.4

51.4

261,180

UT

1,769

2.7

688

1.0

2,516

3.8

70.3

66,268

VT

1,146

2.9

620

1.5

1,789

4.5

64.1

40,050

VA

2,661

0.6

847

0.2

3,648

0.8

72.9

457,950

WA

3,962

4.5

1,789

2.0

5,802

6.5

68.3

88,800

WV

1,243

3.0

492

1.2

1,766

4.3

70.4

41,400

WI

4,861

0.6

1,826

0.2

6,903

0.9

70.4

770,370

WY

1,702

0.7

535

0.2

2,303

0.9

73.9

251,370

GU

308

1.4

217

1.0

566

2.6

54.4

22,050

PR

189

1.3

74

0.5

295

2.1

64.1

14,070

VI

299

0.5

133

0.2

439

0.8

68.1

57,960

12 of 25

Table 4A. Landline Sample.
Completions, Terminations and Refusals, Contacted Eligible Households and Total Sample by State
COIN

TERE

CONELIG

COOP

State*

N

%

N

%

N

%

%

Total
Sample

Minimum

408

0.2

84

0.1

494

0.3

48.1

14,070

Maximum

4,861

4.5

3,638

2.6

8,356

6.5

86.2

1,294,110

Mean

1,787

1.8

949

0.9

2,712

2.7

66.2

155,017

Median

1,583

1.6

688

0.8

2,172

2.8

66.5

87,810

*States listed in order by FIPS code. During 2023, Kentucky and Pennsylvania were unable to collect enough data
to meet the minimum requirements to be included in this public data set.

13 of 25

Table 4B. Cell Phone Sample.
Completions, Terminations and Refusals, Contacted Eligible Households and Total Sample by State
COIN

TERE

CONELIG

COOP

State*

N

%

N

%

N

%

%

Total
Sample

AL

3,246

3.4

617

0.7

3,886

4.1

83.5

94,172

AK

4,355

2.0

836

0.4

5,295

2.5

82.2

214,620

AZ

9,756

3.3

2,156

0.7

12,275

4.1

79.5

300,000

AR

3,930

3.5

1,010

0.9

5,103

4.5

77.0

112,350

CA

8,525

0.8

1,956

0.2

10,811

1.0

78.9

1,104,060

CO

7,832

4.1

1,742

0.9

9,807

5.1

79.9

191,070

CT

9,002

2.7

2,435

0.7

11,946

3.6

75.4

328,673

DE

3,468

1.2

799

0.3

4,337

1.5

80.0

289,770

DC

2,203

2.5

508

0.6

2,815

3.2

78.3

87,480

FL

8,856

2.2

2,814

0.7

12,165

3.1

72.8

395,550

GA

5,601

2.2

1,917

0.8

7,868

3.1

71.2

254,430

HI

6,120

5.5

1,205

1.1

7,516

6.8

81.4

111,330

ID

6,136

3.9

904

0.6

7,286

4.6

84.2

157,272

IL

4,512

2.3

992

0.5

5,646

2.9

79.9

197,100

IN

8,964

3.5

2,410

1.0

11,813

4.7

75.9

253,320

IA

7,675

6.5

1,092

0.9

8,907

7.5

86.2

118,830

KS

8,281

3.0

1,263

0.5

9,777

3.6

84.7

273,286

LA

4,919

1.8

1,725

0.6

6,703

2.5

73.4

269,707

ME

8,196

2.6

795

0.2

9,420

2.9

87.0

320,767

MD

13,530

3.3

3,536

0.9

17,526

4.3

77.2

408,390

MA

8,473

1.6

982

0.2

10,389

2.0

81.6

525,323

MI

7,362

3.1

1,799

0.8

9,598

4.1

76.7

234,780

MN

13,130

1.0

2,795

0.2

16,229

1.3

80.9

1,254,210

MS

3,652

2.0

549

0.3

4,233

2.3

86.3

185,306

MO

5,582

4.7

1,039

0.9

6,926

5.8

80.6

119,334

MT

5,296

3.6

574

0.4

5,913

4.0

89.6

147,870

14 of 25

Table 4B. Cell Phone Sample.
Completions, Terminations and Refusals, Contacted Eligible Households and Total Sample by State
COIN

TERE

CONELIG

COOP

State*

N

%

N

%

N

%

%

Total
Sample

NE

10,841

3.5

1,816

0.6

12,857

4.1

84.3

311,185

NV

2,126

2.6

342

0.4

2,534

3.1

83.9

81,735

NH

3,441

5.9

464

0.8

3,961

6.8

86.9

58,020

NJ

7,870

2.0

2,835

0.7

11,152

2.8

70.6

392,100

NM

2,309

3.4

556

0.8

2,905

4.2

79.5

68,746

NY

15,653

2.2

6,007

0.8

22,665

3.2

69.1

718,770

NC

3,037

3.8

343

0.4

3,403

4.3

89.2

79,798

ND

4,801

5.3

1,145

1.3

6,070

6.6

79.1

91,320

OH

10,747

2.7

3,038

0.8

14,388

3.7

74.7

391,980

OK

5,603

3.8

1,064

0.7

6,719

4.5

83.4

147,957

OR

5,502

2.8

583

0.3

6,537

3.4

84.2

194,971

RI

5,401

4.1

1,311

1.0

6,954

5.2

77.7

133,290

SC

7,544

3.1

1,836

0.8

9,990

4.1

75.5

243,780

SD

5,022

1.7

315

0.1

5,842

2.0

86.0

290,435

TN

4,914

1.9

1,505

0.6

6,480

2.5

75.8

264,084

TX

7,420

2.4

2,182

0.7

10,142

3.3

73.2

311,460

UT

9,633

5.2

1,467

0.8

11,948

6.4

80.6

186,421

VT

6,396

4.2

1,224

0.8

7,760

5.1

82.4

151,230

VA

3,939

1.4

619

0.2

4,609

1.7

85.5

272,850

WA

22,978

7.1

4,025

1.2

27,438

8.5

83.7

323,550

WV

3,156

3.1

362

0.4

3,534

3.4

89.3

102,690

WI

8,151

0.9

1,546

0.2

9,837

1.1

82.9

866,910

WY

2,888

1.1

473

0.2

3,397

1.2

85.0

274,890

GU

1,253

3.0

353

0.8

1,692

4.1

74.1

41,748

PR

4,510

8.7

244

0.5

4,777

9.2

94.4

52,117

VI

2,017

2.6

427

0.6

2,472

3.2

81.6

76,740

15 of 25

Table 4B. Cell Phone Sample.
Completions, Terminations and Refusals, Contacted Eligible Households and Total Sample by State
COIN

TERE

CONELIG

COOP

State*

N

%

N

%

N

%

%

Total
Sample

Minimum

2,126

0.8

315

0.1

2,534

1.0

69.1

58,020

Maximum

22,978

13.2

6,007

1.3

27,438

13.2

89.6

1,254,210

Mean

6,897

3.4

1,500

0.6

8,680

4.1

80.5

283,820

Median

6,120

3.0

1,205

0.7

7,516

3.8

80.6

243,780

*States listed in order by FIPS code. During 2023, Kentucky and Pennsylvania were unable to collect enough data
to meet the minimum requirements to be included in this public data set.

16 of 25

Table 5A. Landline Sample.
Categories of Eligibility by State (Landline Only).
ELIG

INELIG

UNKELIG

State*

N

%

N

%

N

%

AL

1,304

2.9

34,307

75.9

9,598

21.2

AK

1,799

2.1

75,249

88.8

7,702

9.1

AZ

3,662

3.0

97,987

80.5

20,091

16.5

AR

2,219

4.3

42,332

82.9

6,539

12.8

CA

4,108

0.3

1,097,058

84.8

192,944

14.9

CO

1,523

3.6

32,953

77.6

8,005

18.8

CT

1,719

4.7

26,006

71.6

8,605

23.7

DE

1,502

0.8

139,596

71.6

53,752

27.6

DC

1,380

3.7

29,228

78.3

6,712

18.0

FL

6,561

3.4

155,108

79.4

33,691

17.2

GA

5,012

3.4

115,006

79.1

25,332

17.4

HI

2,400

2.2

82,339

76.0

23,531

21.7

ID

1,266

2.9

35,990

83.0

6,094

14.1

IL

725

1.5

38,143

79.2

9,282

19.3

IN

3,959

3.3

97,990

80.9

19,191

15.8

IA

2,137

5.1

31,953

75.5

8,210

19.4

KS

2,730

2.2

103,332

84.6

16,033

13.1

LA

932

1.7

43,497

77.2

11,881

21.1

ME

5,411

0.9

443,231

76.8

128,201

22.2

MD

8,356

4.0

156,144

74.5

44,990

21.5

MA

1,436

1.2

70,617

60.7

44,309

38.1

MI

4,133

4.7

68,116

78.1

14,931

17.1

MN

3,713

1.0

278,894

78.7

71,693

20.2

MS

494

1.6

25,926

82.2

5,126

16.2

MO

2,172

2.9

62,352

83.1

10,485

14.0

MT

2,660

2.1

96,760

74.9

29,820

23.1

NE

3,231

3.0

83,793

76.9

21,966

20.2
17 of 25

Table 5A. Landline Sample.
Categories of Eligibility by State (Landline Only).
ELIG

INELIG

UNKELIG

State*

N

%

N

%

N

%

NV

721

1.8

32,134

78.2

8,236

20.0

NH

4,778

5.8

58,907

71.6

18,575

22.6

NJ

3,312

3.1

78,300

73.6

24,738

23.3

NM

1,256

3.0

33,088

79.0

7,566

18.1

NY

4,222

3.3

89,202

70.3

33,446

26.4

NC

596

1.6

30,121

79.2

7,323

19.3

ND

2,074

6.4

24,159

74.4

6,249

19.2

OH

5,239

3.6

114,478

77.9

27,313

18.6

OK

1,463

2.8

44,593

84.1

6,959

13.1

OR

613

1.1

40,616

73.6

13,988

25.3

RI

1,105

3.6

23,498

75.8

6,417

20.7

SC

4,974

4.0

97,003

78.8

21,083

17.1

SD

1,230

0.6

174,966

81.9

37,563

17.6

TN

959

2.0

34,698

73.6

11,503

24.4

TX

3,640

1.4

214,866

82.3

42,674

16.3

UT

2,516

3.8

53,077

80.1

10,675

16.1

VT

1,789

4.5

32,859

82.0

5,402

13.5

VA

3,648

0.8

393,748

86.0

60,554

13.2

WA

5,802

6.5

67,158

75.6

15,840

17.8

WV

1,766

4.3

29,188

70.5

10,446

25.2

WI

6,903

0.9

563,016

73.1

200,451

26.0

WY

2,303

0.9

208,838

83.1

40,229

16.0

GU

566

2.6

11,766

53.4

9,718

44.1

PR

295

2.1

11,979

85.1

1,796

12.8

VI

439

0.8

54,537

94.1

2,984

5.1

Minimum

494

0.3

23,498

60.7

5,126

9.1

Maximum

8,356

6.5

1,097,058

88.8

200,451

38.1
18 of 25

Table 5A. Landline Sample.
Categories of Eligibility by State (Landline Only).
ELIG

INELIG

UNKELIG

State*

N

%

N

%

N

%

Mean

2,805

2.7

122,498

78.3

29,713

19.0

Median

2,219

2.8

68,116

78.5

15,840

18.3

*States listed in order by FIPS code. During 2023, Kentucky and Pennsylvania were unable to collect enough data
to meet the minimum requirements to be included in this public data set.

19 of 25

Table 5B. Cell Phone Sample.
Categories of Eligibility by State (Cell Phone Only).
ELIG

INELIG

UNKELIG

State*

N

%

N

%

N

%

AL

3,886

4.1

26,946

28.6

63,340

67.3

AK

5,295

2.5

169,702

79.1

39,623

18.5

AZ

12,275

4.1

164,154

54.7

123,571

41.2

AR

5,103

4.5

62,415

55.6

44,832

39.9

CA

10,811

1.0

356,719

32.3

736,530

66.7

CO

9,807

5.1

86,055

45.0

95,208

49.8

CT

11,946

3.6

145,702

44.3

171,025

52.0

DE

4,337

1.5

94,258

32.5

191,175

66.0

DC

2,815

3.2

45,606

52.1

39,059

44.6

FL

12,165

3.1

189,135

47.8

194,250

49.1

GA

7,868

3.1

125,724

49.4

120,838

47.5

HI

7,516

6.8

36,259

32.6

67,555

60.7

ID

7,286

4.6

83,026

52.8

66,960

42.6

IL

5,646

2.9

96,307

48.9

95,147

48.3

IN

11,813

4.7

122,158

48.2

119,349

47.1

IA

8,907

7.5

54,763

46.1

55,160

46.4

KS

9,777

3.6

161,170

59.0

102,339

37.4

LA

6,703

2.5

108,654

40.3

154,350

57.2

ME

9,420

2.9

106,738

33.3

204,609

63.8

MD

17,526

4.3

196,060

48.0

194,804

47.7

MA

10,389

2.0

250,459

47.7

264,475

50.3

MI

9,598

4.1

126,957

54.1

98,225

41.8

MN

16,229

1.3

368,042

29.3

869,939

69.4

MS

4,233

2.3

84,534

45.6

96,539

52.1

MO

6,926

5.8

62,787

52.6

49,621

41.6

MT

5,913

4.0

57,796

39.1

84,161

56.9

NE

12,857

4.1

167,394

53.8

130,934

42.1
20 of 25

Table 5B. Cell Phone Sample.
Categories of Eligibility by State (Cell Phone Only).
ELIG

INELIG

UNKELIG

State*

N

%

N

%

N

%

NV

2,534

3.1

34,324

42.0

44,877

54.9

NH

3,961

6.8

27,493

47.4

26,566

45.8

NJ

11,152

2.8

172,875

44.1

208,073

53.1

NM

2,905

4.2

35,234

51.3

30,607

44.5

NY

22,665

3.2

338,115

47.0

357,990

49.8

NC

3,403

4.3

32,317

40.5

44,078

55.2

ND

6,070

6.6

44,614

48.9

40,636

44.5

OH

14,388

3.7

196,505

50.1

181,087

46.2

OK

6,719

4.5

78,886

53.3

62,352

42.1

OR

6,537

3.4

66,722

34.2

121,712

62.4

RI

6,954

5.2

56,553

42.4

69,783

52.4

SC

9,990

4.1

104,984

43.1

128,806

52.8

SD

5,842

2.0

158,097

54.4

126,496

43.6

TN

6,480

2.5

88,826

33.6

168,778

63.9

TX

10,142

3.3

150,082

48.2

151,236

48.6

UT

11,948

6.4

91,104

48.9

83,369

44.7

VT

7,760

5.1

76,880

50.8

66,590

44.0

VA

4,609

1.7

100,469

36.8

167,772

61.5

WA

27,438

8.5

134,434

41.5

161,678

50.0

WV

3,534

3.4

62,795

61.2

36,361

35.4

WI

9,837

1.1

260,075

30.0

596,998

68.9

WY

3,397

1.2

166,183

60.5

105,310

38.3

GU

1,692

4.1

7,931

19.0

32,125

76.9

PR

4,777

9.2

26,556

51.0

20,784

39.9

VI

2,472

3.2

54,414

70.9

19,854

25.9

Minimum

2,534

1.0

26,946

28.6

26,566

18.5

Maximum

27,438

8.5

368,042

79.1

869,939

69.4
21 of 25

Table 5B. Cell Phone Sample.
Categories of Eligibility by State (Cell Phone Only).
ELIG

INELIG

UNKELIG

State*

N

%

N

%

N

%

Mean

8,680

4.1

123,002

47.0

152,138

48.9

Median

7,516

3.8

100,469

47.7

105,310

48.4

*States listed in order by FIPS code. During 2023, Kentucky and Pennsylvania were unable to collect enough data
to meet the minimum requirements to be included in this public data set.

22 of 25

Table 6. Response Rates for Landline and Cell Phone Samples

State*

Landline Response
Rate

Cell Phone
Response Rate

Combined Response
Rate

AL

57.9

27.3

37.3

AK

53.0

67.1

63.1

AZ

51.3

46.7

48.1

AR

55.8

46.3

49.3

CA

55.6

26.2

42.1

CO

48.0

40.1

41.5

CT

44.4

36.1

37.0

DE

46.2

27.2

34.9

DC

47.5

43.3

44.6

FL

43.9

37.0

39.3

GA

39.7

37.4

38.2

HI

51.6

32.0

41.7

ID

66.5

48.4

52.3

IL

55.9

41.3

44.2

IN

46.3

40.1

42.1

IA

55.6

46.2

48.6

KS

59.0

53.0

54.8

LA

49.2

31.4

34.5

ME

62.1

31.5

51.2

MD

42.8

40.4

41.2

MA

49.0

40.5

42.0

MI

54.3

44.6

47.2

MN

56.1

24.8

31.7

MS

69.2

41.3

45.4

MO

63.1

47.1

53.2

MT

56.2

38.6

46.8

23 of 25

Table 6. Response Rates for Landline and Cell Phone Samples

State*

Landline Response
Rate

Cell Phone
Response Rate

Combined Response
Rate

NE

58.0

48.8

51.2

NV

53.2

37.8

43.0

NH

57.6

47.1

53.3

NJ

39.6

33.1

34.5

NM

54.2

44.1

47.9

NY

37.0

34.7

35.0

NC

65.7

39.9

48.3

ND

46.7

43.9

44.6

OH

43.1

40.2

41.0

OK

64.4

48.2

52.5

OR

61.4

31.6

38.2

RI

45.0

37.0

38.5

SC

42.9

35.6

38.1

SD

71.0

48.5

58.1

TN

51.4

27.4

31.0

TX

43.0

37.6

40.1

UT

59.0

44.6

48.3

VT

55.4

46.1

48.1

VA

63.3

32.9

52.0

WA

56.1

41.9

45.0

WV

52.6

57.7

56.2

WI

52.1

25.8

38.2

WY

62.1

52.4

57.0

GU

30.4

17.1

21.7

PR

55.9

56.8

56.6

VI

64.6

60.5

62.3

24 of 25

Table 6. Response Rates for Landline and Cell Phone Samples

State*

Landline Response
Rate

Cell Phone
Response Rate

Combined Response
Rate

Minimum

30.4

17.1

21.7

Maximum

71.0

67.1

63.1

Mean

53.2

40.5

44.9

Median

54.3

40.3

44.6

*States listed in order by FIPS code. During 2023, Kentucky and Pennsylvania were unable to collect enough data
to meet the minimum requirements to be included in this public data set.

References
1. Pierannunzi C, Town M, Garvin W, Shaw F, Balluz L. Methodologic changes in the Behavioral Risk
Factor Surveillance System in 2011 and potential effects on prevalence estimates. MMWR.2012;
61(22):410-413. http://www.cdc.gov/mmwr/preview/mmwrhtml/mm6122a3.htm. Accessed 14 August
2024.
2. The American Association for Public Opinion Research. Standard Definitions: Final Dispositions of
Case Codes and Outcome Rates for Surveys (Revised 2023)
Standards-Definitions-10th-edition.pdf (aapor.org) pp 86, 87. Accessed 14 August 2024.
3. Czajka JL, Beyler A. Declining Response Rates in Federal Surveys: Trends and Implications (2016).
https://aspe.hhs.gov/system/files/pdf/255531/Decliningresponserates.pdf. p. viii. Accessed 13 August
2024.

25 of 25


File Typeapplication/pdf
File TitleBehavioral Risk Factor Surveillance System (BRFSS) 2023 Summary Data Quality Report August 6, 2024
SubjectBehavioral Risk Factor Surveillance System (BRFSS) 2023 Summary Data Quality Report August 6, 2024
AuthorCDC
File Modified2024-08-30
File Created2024-08-30

© 2024 OMB.report | Privacy Policy