Pretest Study Updated Memo

MEMORANDUM OMB # 1850-0803 v. 169

DATE: September 6, 2016

TO: Kashka Kubzdela

National Center for Education Statistics

FROM: Patricia Etienne

National Center for Education Statistics

SUBJECT: Computer-delivered National Assessment of Educational Progress (eNAEP) Pretesting Study 2016 Updated [Revision to a previously approved package (1850-0803 v.159)]

The eNAEP Pretesting Study 2016 was approved on May 20, 2016 (OMB #1850-0803, v. 159). After completing the first two pretesting events and reviewing the debriefing responses, we feel that modifications need to be made to improve the students’ experience and gain better feedback on the eNAEP system.

Originally we planned to conduct three pretesting events, each having students complete two 100-minute sessions with a 30-minute break in between. It was estimated that 30 students would participate in each event. Events 1 and 2 have been concluded, and the revised plan adds a 4^th and 5^th event, with each student participating in only one 100 minute session in events 3, 4, and 5. In addition, the sample will be increased to have 50 students participate in each event, for events 3, 4, and 5.

Volume I and II, and Appendixes A-L have been revised to reflect these changes. Following are the original and the revised budget and burden tables.

Original Estimates of Hourly Burden and Costs to Federal Government for eNAEP Pretesting Activities (from May 2016, approved ICR package submission)

Table 1. Hourly Burden

Respondent	Number of respondents	Number of responses	Hours per respondent	Total hours
Parent or Legal Guardian for Student Recruitment
Initial contact	400	400	0.05	20
Follow-up via phone	200*	200	0.15	30
Consent & confirmation	100*	100	0.15	15
Participation (Pretesting)
Students	90**	90	3.83	345
Total	490	790		410

* Subset of initial contact group

** Estimated number of actual participants will be somewhat less than confirmed numbers.

Table 2. Estimate of Costs

Activity	Provider	Estimated Cost
Recruiting students and providing facilities for the study	EurekaFacts	$60,000
Administering the study	Westat	$8,250
Assisting with administering the study; analyzing the results	Fulcrum	$10,125
Total		$78,375

Revised Estimates of Hourly Burden and Costs to Federal Government for Updated eNAEP Pretesting Activities (includes revised Events 3-5 pretesting activities)

Table 1. Revised Hourly Burden

Respondent	Number of respondents	Number of responses	Hours per respondent	Total hours
Parent or Legal Guardian for Student Recruitment
Initial contact	932	932	0.05	47
Follow-up via phone	466*	466	0.15	70
Consent & confirmation	233*	233	0.15	35
Participation (Pretesting)
Students in Events 1 & 2	60*a	60	3.83	230
Students in Events 3, 4, & 5	150*a	150	1.67	251
Total	932	1,841		633

* Subset of initial contact group

^a Estimated number of actual participants is expected to be approximately 90% of the confirmed cases.

Table 2. Revised Estimate of Costs

Activity	Provider	Estimated Cost
Recruiting students and providing facilities for the study	EurekaFacts	$105,299
Administering the study	Westat	$13,750
Assisting with administering the study; analyzing the results	Fulcrum	$16,875
Total		$135,924