B-3 Round 2 Cognitive Testing Findings (6/7/21)

2022 CPS CIUS Cognitive Test:
Round 2 Preliminary Findings
Rodney L. Terry, Alda Rivas, Shaun Genter,
Jasmine Luck, and Betsari Otero Class
CBSM
06/7/21
Any views expressed are those of the authors and not necessarily those of the U.S. Census Bureau.
This presentation has been reviewed for disclosure avoidance and approved under CBDRB-FY21-CBSM001-015

1

Purpose
• Test all questions, including new and revised content of the Computer
and Internet Use Supplement (CIUS).
• Test changes to CIUS made after Round 1.

• Specific issues
• Reporting affordability as a reason for not accessing internet or cable TV at
home
• Underreporting of cyberbullying
• Knowledge of dial-up internet access

2

Method – Respondent Characteristics (n = 15)
Characteristic

Quantity

Race

Characteristic

Quantity

Age

White

9

20-30

4

Black

2

31-40

2

Middle Eastern or
North African

1

41-50

2

61 and over

7

Asian

2

Other

1

High School or
less

5

Yes, Hispanic

3

8

Proxy respondents

8

Some College
/Bachelor’s

No internet at home

2

Post-Grad

2

Hispanic Origin

Education

Sex
Male

5

Female

10

3

Findings
• General impressions
• Like in Round 1, respondents said most questions were clear and not difficult
to answer for themselves and others.
• Inability to answer for others was due to lack of knowledge of the other person’s usage.

• Respondents understood most technology terms, unless they did not use
such technology.

4

Findings on Specific Items
3. LAPTOP
Round 1 Wording
What about a laptop or notebook? [Do you/Does
anyone in this household] use a laptop or notebook
computer? (If needed) A laptop, sometimes known as
a notebook, is a personal computer that is portable
and includes a built-in keyboard and screen. (If yes & is
multi-person household) Who is that?

Round 2 Wording
What about a laptop? [Do you/Does anyone in this
household] use a laptop computer? (If needed) A
laptop is a personal computer that is portable and
includes a built-in keyboard and screen. (If yes & is
multi-person household) Who is that?

• Round 1 Finding
• Eight respondents did not understand
the meaning of “notebook.”
• Described the characteristics of a tablet

• Round 1 Recommendation
• Remove the term “notebook” and
continue to probe on the term
“laptop” in Round 2.

• Round 2 Finding
• Respondents understood meaning of
“laptop.”

• Round 2 Recommendation
• Keep wording used in Round 2.

5

Findings on Specific Items
8. DEVQUA

• Round 1 Finding

Round 1 Wording
Thinking about all the different devices we just
discussed, how well do the computers and other
Internet-connected devices [you use/used by this
household] work overall? [If R is unsure, ask for an
average]

• Round 1 Recommendation

Round 2 Wording
Thinking about all the different devices we just
discussed, how well do the computers and other
Internet-connected devices [you use/used by this
household] work overall? Please do not include
home Wi-Fi routers or similar equipment. [If R is
unsure, ask for an average].

• One respondent considered the quality
of the Wi-Fi connection in their
response.
• Add an instruction stating that Wi-Fi is
not in scope for this question.

• Round 2 Finding
• Two respondents still considered quality
of Wi-Fi.
• Most understand meaning of “Wi-Fi.”

• Round 2 Recommendation
• Keep wording used in Round 2.

6

Findings on Specific Items
49. MEDDOC
[Do you/Does anyone in this household,
including you,] communicate with a
doctor or other health professional
using the Internet?

50. MEDREC
What about accessing health records or
health insurance records online? (If
needed) [Do you/Does anyone in this
household] access health records or
health insurance records online?

• Round 2 Finding
• One respondent reported “yes, only to
check lab results” in response to
MEDDOC, and “yes” to MEDREC.
• Checking lab results may be more in
scope with MEDREC than MEDDOC.

• Round 2 Recommendation
• Confirm with NTIA whether checking lab
results is more in scope with MEDREC
than with MEDDOC.
• If only in scope for MEDREC, reverse the
order of these questions so the
possibility of checking medical records
without interacting with a professional
is covered first.
7

Findings on Specific Items
55. PSCON
Overall, what concerns [you/members of this household]
the most when it comes to online privacy and security
risks?
Do not read; select all that apply and/or enter verbatim
response if other
Identity theft

Credit card or banking fraud
Data collection or tracking by online services
Data collection or tracking by government
Loss of control over personal data such as email or social
network profiles

Threats to personal safety, such as online harassment,
stalking, or cyber-bullying
No concerns
Other: ___________________________

• Round 1 Finding
• One respondent named “unwanted
solicitation” as a reason.

• Round 1 Recommendation
• Follow up with NTIA on how often this
response is reported and whether it
should be included as a response
option.

• Round 2 Finding
• No respondents named “unwanted
solicitation” as a reason.

• Round 2 Recommendation
• Keep current wording as is.

8

Findings on Specific Issues
• Reporting affordability as a reason for not accessing internet/access to TV
channels at home
• Round 1
• NOTV (Non-TV channel subscriber item) – Closed-ended format produced more data
• Two of five closed-ended cases mentioned cost.
• One of three open-ended cases mentioned cost.

• Round 2
• NOTV – Closed-ended format produced more data as well
• Two of two closed-ended cases mentioned cost.
• One of four open-ended cases mentioned cost.

• Recommendation: Use the closed-ended format that has the interviewer read the response
options.

9

Findings on Specific Issues
• Underreporting of cyberbullying
• Round 1 and Round 2

• No one reported cyberbullying towards themselves or others.
• Respondents were confident in their knowledge of the others’ experience.
• Limitation: we have no way to validate reports for people under 15

• No reasons of underreporting were found in this test
• Underreporting in CIUS could be because children under 15 are not asked directly about their
cyberbullying experiences.

• Knowledge of dial-up
• Like for Round 1, most respondents did not know the definition of “dial-up,”
but they did not confuse it with their type of internet access.
10

Thank you!
2022 CPS CIUS Cognitive Test:
Round 2 Preliminary Findings
Rodney L. Terry, Alda Rivas, Shaun Genter
Jasmine Luck, and Betsari Otero Class
CBSM
06/7/21

11