NAEP Summary of Changes Memo

U NITED STATES DEPARTMENT OF EDUCATION

National Center for Education Statistics

April 5, 2017

revised May 11, 2017

MEMORANDUM

To: Robert Sivinski and E. Ann Carson, OMB

From: Linda Hamilton, NCES

Through: Kashka Kubzdela, NCES

Re: National Assessment of Educational Progress (NAEP) 2018 and 2019 Changes to Materials (OMB# 1850-0928 v.5)

This request updates the scope, sampling, procedures, and materials to be used in NAEP in 2018 and 2019, including operational assessments, pilot tests, and special studies from those originally approved in August 2016, with change requests approved in September 2016, for NAEP 2017-2019 (OMB# 1850-0928 v.1-3).

Please note that Appendix F of this submission provides the library of possible items to be used in the NAEP 2018 and 2019 questionnaires, and Appendix D provides the full, draft set of possible communication and recruitment materials to be used in NAEP 2018 and 2019. Non-substantive wording changes to the questionnaire items (based on cognitive and pilot testing results), if any are made; the final selection of which items will be used in the final versions of the NAEP 2018 and 2019 questionnaires (future Appendix I); and the final versions of the communication and recruitment materials that will be used in NAEP 2018 and 2019 (future Appendix J) will be submitted to OMB for approval as a non-substantive change request by October 2017 for NAEP 2018 and by October 2018 for NAEP 2019.

The table below details the changes that were made to each of the approved documents.

Document	Changes
Part A	Removed all references and content specific information pertaining to 2017 Added special studies for 2018: Oral Reading Fluency Study, Reading Scenario-Based Task Study, NAEP-NTPS (National Teacher and Principal Survey) Study Added special studies for 2019: KaSA and PBA Bridge studies Adjusted operational and pilot sample sizes for 2018 and 2019 (see summary of changes on page 2 of this document) Updated the confidentiality pledge and section A.10 in general to reflect the addition of the Cybersecurity Enhancement Act of 2015 provision and provide a more complete list of all applicable laws and regulations
Part B	In B.2.b, replaced “Submit Current Roster” with “Update Student List” to reflect current procedure Updated response rate information in B.3.b
Part C	Science Issue Papers 2009 version replaced with new 2016 version
Appendix A - External Advisory Committees	Updated committee members list to be current
2017 Appendix B – Sample Data Security Agreement	The 2017 version of Appendix B has been removed as it is no longer applicable for 2018 and 2019. Rather than using the previously included Sample Data Security Agreement in 2018 and 2019 states will provide their own customized security agreements.
2018-2019 Appendix B- NAEP 2011 Weighting Procedures	No changes to content Moved from Appendix H to Appendix B for 2018 and 2019
Appendix C - 2018 Sampling Memo	Appendix C: Replaced sampling memo with 2018 draft sampling memo
Appendix D - Draft Communications and Recruitment Materials for 2018 and 2019	Draft versions of recruitment and communications materials updated to include the most current versions (from NAEP 2017)
Appendix E - Assessment Feedback Forms	No changes
Appendix F - Item Library for NAEP 2018 & 2019 Survey Questionnaires	Library of Student, Teacher, and School Administrator questionnaires updated to include the most current content
Appendix G - NAEP 2011 Sampling Design	No changes

Summary of changes to sample sizes for 2018 and 2019

2018

• Added sample for the 2018 special studies that have been added (ORF, NTPS, Reading SBT);

• Increased grade 4 and 8 pilot sample sizes;

• Decreased operational sample sizes;

• Increased P&P-DBA bridge study sample size;

• Decreased grade 12 pilot sample sizes;

• As such, grade 4 student sample increased from 15,000 to 20,300, while grade 8 student sample decreased from 89,000 to 86,1000, and grade 12 from 37,000 to 34,700; and

• The burden calculations for teachers and schools remain the same.

2019

• Added P&P-DBA bridge studies to grades 4, 8, and 12;

• Added KaSA (US and Puerto Rico) to grades 4 and 8;

• Increased grade 12 operational sample sizes;

• Decreased grade 12 pilot sample sizes;

• As such, grade 4 student sample increased from 406,500 to 427,500, grade 8 from 406,500 to 427,500, and grade 12 from 70, 000 to 119,000; and

• The burden calculations for teachers and schools remain the same.

550 12^th Street, S.W., Washington, DC 20202

Our mission is to ensure equal access to education and to promote educational excellence throughout the Nation.