NCES Cognitive, Pilot, and Field Test Studies System

Forms and Documents

Document	Type	Status	Availability
2013-14 and 2014-15 School-Level Finance Survey (SLFS:2014 & SLFS:2015) Pilot Study	Form and Instruction	New	Available
NCES Cognitive Pilot Field Test Studies System Clearance Change Memo.docx	Supplementary Document	Uploaded 2014-06-19	Available
NCES Cognitive Pilot Field Test Studies System Clearance Change Sheet 2014-06-19.pdf	Justification for No Material/Nonsubstantive Change	Uploaded 2014-06-19	Available
Part B System Clearance Cognitive Pilot and Field Studies 2010-13.docx	Supporting Statement B	Uploaded 2013-05-16	Repair queued
30D_FRN_1850-0803.pdf	Supplementary Document	Uploaded 2013-07-22	Available
60D_FRN_1850-0803.pdf	Supplementary Document	Uploaded 2013-05-23	Available
Appendix A NCES Authorization Legislation.docx	Supplementary Document	Uploaded 2013-05-16	Available
Part A System Clearance Cognitive Pilot and Field Studies 2010-13.docx	Supporting Statement A	Uploaded 2013-05-16	Repair queued

IC Document Collections

IC ID	Collection	Type	Status	Form
222240	2017 School Crime Supplement to the National Crime Victimization Survey (SCS:17/NCVS) Cognitive Interviews - update	Other-Attachment I-III NCVS SCS 2017 Cog Lab Screeners Communica	New
221853	ED School Climate Surveys (EDSCLS) Additional Item Cognitive Interviews - Set 2 Round 1	Other-Vol II - EDSCLS 2016 Additional Items Cog Lab Protocols -s	New
221595	Computer-delivered National Assessment of Educational Progress (eNAEP) Pretesting Study 2016	Other-Protocol & Questionnaires	New
221548	2015-16 Civil Rights Data Collection (CRDC) Research & Evaluation	Other-Recruitment, protocols, & data collection tool	New
221532	2017 National Household Education Surveys Program (NHES) Usability Testing	Other-Screener and Protocols	New
221121	National Assessment of Educational Progress (NAEP) Science Scenario-Based Tasks Cognitive Interviews	Other-Screeners and Consent Forms	New
221116	National Assessment of Educational Progress (NAEP) Pretesting of Survey and Cognitive Items for Pilot in 2017 and 2018 Updated	Other-screeners and consent forms	New
221027	2017 School Crime Supplement to the National Crime Victimization Survey (SCS:17/NCVS) Cognitive Interviews	Other-Screeners	New
220670	Beginning Postsecondary Students Longitudinal Study (BPS:12) Student Records Qualitative Evaluation	Other-Attachments I-III BPS 2012-2017 Student Records Qualitativ	New
220056	National Assessment of Educational Progress (NAEP) Survey Assessments Innovations Lab (SAIL) Science Playtesting and Cognitive Interviews	Other-Protocols	New
220021	2017 National Household Education Surveys Program (NHES) Adult Training and Education Survey (ATES) Preparation for Certifications and Licenses Cognitive Interviews and Focus Groups	Other-screener and protocols	New
219925	2012/17 Beginning Postsecondary Students Longitudinal Study (BPS:12/17) Pilot Test	Other-pilot test survey	New
219094	Middle Grades Longitudinal Study of 2017-18 (MGLS:2017) Eye-tracking Cognitive Laboratory	Other-Vol 2 MGLS 2017 Eye-tracking Cog Labs 2016 - Student Surve	New
218835	2017-2018 National Teacher and Principal Survey (NTPS) Cognitive Interviews	Other-screeners	New
218678	National Assessment of Educational Progress (NAEP) Pretesting of Survey and Cognitive Items for Pilot in 2017 and 2018	Other-Screeners and Consents	New
218582	ED School Climate Surveys (EDSCLS) Additional Item Cognitive Interviews	Other-Protocols	New
218356	Fast Response Survey System (FRSS) 108: Career and Technical Education (CTE) Programs in Public School Districts – Feasibility Calls	Other-Feasibility Calls	New
218151	2012/17 Beginning Postsecondary Students Longitudinal Study (BPS:12/17) Cognitive and Usability Testing – Second Round	Other-cog and usability testing	New
217854	National Assessment of Educational Progress (NAEP) Digitally Based Assessments (DBA) Tools and Item Types Usability Study 2015-16	Other-usability study	New
217810	2016 National Household Education Surveys Program (NHES) Usability Testing	Other-Screener	New
217791	National Assessment of Educational Progress (NAEP) Mathematics and Reading Pretesting 2015	Other-NAEP Mathematics and Reading Cog Lab and Tryouts Protocols	New
217477	2017 National Household Education Surveys Program (NHES) Adult Training and Education Survey (ATES) Work-Related Education and Training Concept Interviews	Other-Attachment 2 NHES 2017 ATES Concept Interview Recruitment	New
216946	National Assessment of Educational Progress (NAEP) Social Studies Pretesting	Other-Volume 2 NAEP Social Studies Pretesting	New
216652	2015-16 National Postsecondary Student Aid Study (NPSAS:16) Student Survey and Student Records Qualitative Evaluation	Other-Screeners	New
216584	High School Longitudinal Study of 2009 (HSLS:09) Second Follow-up Cognitive and Usability Testing	Other-Screeners and Protocl	New
216525	2016 National Household Education Surveys Program (NHES) Phase 3 Cognitive Interviews for English and Spanish Recruitment Materials	Other-Recruitment screener	New
216394	2012/17 Beginning Postsecondary Students Longitudinal Study (BPS:12/17) Cognitive Testing – First Round	Other-Screener and Cog Lab	New
216335	2013-14 and 2014-15 School-Level Finance Survey (SLFS:2014 & SLFS:2015) Pilot Study	Form and Instruction	New
215907	Fast Response Survey System (FRSS) 107: High School English Language Learner (ELL) Programs - Pretest	Other-questionnaire	New
215888	2016 National Household Education Surveys Program (NHES) Spanish Language Cognitive Interviews Phase 2	Other-Recruitment Screener	New
215690	Employment and Earnings Survey 2nd Round of Cognitive Interviews	Other-2nd Round Items	New
215682	School Climate Surveys (SCLS) Pilot Test 2015 update	Other-Attachment 1 SCLS Pilot Test 2015 - Questionnaires	New
215122	2016 National Household Education Surveys Program (NHES) Spanish Language Cognitive Interviews Phase I	Other-Screener	New
215001	2016 National Household Education Surveys Program (NHES) Adult Training and Education Survey (ATES) Cognitive Interviews	Other-Attachment 2 NHES 2016 ATES Cog Labs Recruitment Screener	New
214801	Employment and Earnings Survey Recruitment for 2nd Round of Cognitive Interviews	Other-Screener	New
214722	National Assessment of Educational Progress (NAEP) Writing Tasks Cognitive Interviews	Other-Interview	New
214663	Employment and Earnings Survey 1st Round Cognitive Testing	Other-Attachment V Employment and Earnings Survey Cog Labs Scree	New
214288	2016 National Household Education Surveys Program (NHES) Parent and Family Involvement Survey (PFI) and Early Childhood Program Participation Survey (ECPP) Cognitive Interviews	Other-Screener	New
214246	NTPS 2015-16 Pilot Test Instruction Placement Experiment Change Request	Other-null	New
214085	School Climate Surveys (SCLS) Pilot Test 2015	Other-questionnaire	New
213809	2nd Follow-up Field Test of High School Longitudinal Study of 2009 (HSLS:09) Cognitive Interviews	Other-Interviews	New
213767	NAEP Assessment of Educaitonal Progress (NAEP) Questionnaire Items for Core, Reading, Writing, and Mathematics - Cognitive Interviews	Other-Questionnaire	New
213725	School Survey on Crime and Safety Cognitive Interviews 2014	Other-Protocol	New
213672	NTPS Pilot Test 2014-15 Experiment and Respondent Materials	Other-Questionnaires	New
213544	Second Follow-up Field Test of the High School Longitudinal Study of 2009 (HSLS:09) – Recruitment and Screening for Cognitive Interviews	Other-Screener and Recruitment	New
213063	NAEP High School Electronic Transcript Data Collection Feasibility Study	Other-Transcript Data Collection	New
212886	NAEP Technology Based Assessments (TBA) Tools and Item Types Usability Study	Other-Volume II - NAEP TBA Tools and Item Types Usability Study	New
212716	2013-14 Civil Rights Data Collection (CRDC) Improvement Study Pilot Test	Other-pilot test content	New
212665	School Climate Surveys (SCLS) Cognitive Interviews & Usability Testing Revisions to Questions about Safety	Other-Revised Safety Definitions & Items - School Climate Survey	New
212566	Fast Response Survey System (FRSS) 107: Older Adolescent and Young Adult English Language Learner (ELL) Programs Feasibility Calls	Other-Attachment 3 FRSS 107 Young Adults ELL Programs Feasibilit	New
212517	National Household Education Survey (NHES) Adult Training and Education Survey (ATES) Spanish Version Cognitive Interviews	Other-ATES 2015 Spanish Cog Labs Recruitment & Screener	New
212379	2015-16 National Postsecondary Student Aid Study (NPSAS:2016) Graduate Student Cognitive Testing	Other-Attachment III IV V - NPSAS16 Graduate Students Cog Labs S	New
212219	NAEP SAIL2: Virtual World for English Language Arts Assessment Development 2014-15	Other-testing protocols	New
212049	National Teacher and Principal Survey (NTPS) Pilot Test 2014-15	Other-Vol 2 NTPS Pilot Test 2014-15 Teacher Listing Form with em	New
211706	Middle Grades Longitudinal Study of 2016-2017 (MGLS:2017) Cognitive Interviews Reading and Accommodations	Other-Volume 2 MGLS 2017 Cog Labs 2014 Reading & Disability - In	Unchanged
211651	School Climate Surveys Cognitive Interviews and Usability Testing	Other-Volume 2 School Climate Surveys Cog Labs & Usability Testi	Unchanged
211596	The National Teacher and Principal Survey (NTPS) Pilot Test 2014-15 Special Districts Approval	Other-Vol 2 NTPS Pilot Test Special Districts Approval 2014-15	Unchanged
211516	NAEP SAIL Science Development 2014-15	Other-Vol 2 NAEP SAIL Science Development 2014-15	Unchanged
211320	2013-14 Civil Rights Data Collection (CRDC) Improvement Study Cognitive Interviews	Other-CRDC 2013-14 Part I Draft Table Layout	Unchanged
211184	2015-16 National Postsecondary Student Aid Study (NPSAS) Focus Groups	Other-Screener questions	Unchanged
210621	Middle Grades Longitudinal Study (MGLS:2017) Cognitive Interviews and Focus Groups	Other-MGLS 2017 Cog Labs 2014 Vol 2 Items	Unchanged
210393	NAEP Reading and Math Technology Based Assessment Survey Focus Groups 2014	Other-Volume 2 NAEP Reading and Math Technology Based Assessment	Unchanged
210295	ECLS-K:2011 Spring 4th Grade Cognitive Interviews and Timing Tests	Other-Appendix B ECLS-K-2011 Spring 4th Grade Cog Lab - Parent I	Unchanged
209968	2015-16 NTPS Cog Labs Consent Form Change Request	Other-Revised Attachment III 2015-16 NTPS Cog Labs Consent Form	Unchanged
209718	NHES After-School Programs and Activities Survey (ASPA) and Adult Training and Education Survey (ATES) Feasibility Test Change Request	Other-NHES 2014 FS ATES Survey - revised	Unchanged
209715	2015 National Household Education Survey (NHES) Adult Training and Education Survey (ATES) Cognitive Interviews and Concept Interviews	Other-NHES 2015 ATES Cog Labs Protocol	Unchanged
209644	NAEP Science Interactive Computer Task and Hands-on Task Tablet Study	Other-Volume II NAEP 2015 Science Tablet Study	Unchanged
209507	2013-14 Civil Rights Data Collection (CRDC) Data Submission System Process Improvement and Feasibility Study	Other-Interview protocol	Unchanged
209496	2015-16 Schools and Staffing Survey (SASS) / National Teacher and Principal Survey (NTPS) Cognitive Interviews	Other-Attachment IV 2015-16 NTPS Cog Labs Protocol	Unchanged
209350	NAEP Mathematics, Reading, and Science Hands-on Tasks and National Indian Education Study (NIES) Survey Pretesting	Other-NAEP & NIES Pretesting 2014 Volume II	Unchanged
209173	NAEP Touch-Screen Tablets Usability Study 2013	Other-NAEP Tablet Usability Study 2013 Volume II	Unchanged
208968	Trends in International mathematics and science study (TIMSS 2015) Cognitive Interviews	Other-Protocols	Unchanged
208898	2014 National Household Education Survey (NHES) Feasibility Study	Other-Screener	Unchanged

ICR Details

OMB Control No: 1850-0803	ICR Reference No: 201406-1850-002
Status: Historical Active	Previous ICR Reference No: 201309-1850-002
Agency/Subagency: ED/IES	Agency Tracking No: 1560.121
Title: NCES Cognitive, Pilot, and Field Test Studies System
Type of Information Collection: No material or nonsubstantive change to a currently approved collection	Common Form ICR:  No
Type of Review Request: Regular
OIRA Conclusion Action: Approved without change	Conclusion Date: 06/23/2014
	Date Received in OIRA: 06/19/2014
Terms of Clearance: Previous terms of clearance remain in effect.

	Inventory as of this Action	Requested	Previously Approved
Expiration Date	09/30/2016	09/30/2016	09/30/2016
Responses	405,000	0	135,000
Time Burden (Hours)	81,000	0	27,000
Cost Burden (Dollars)	0	0	0

---

Abstract: This is a request for a 3-year renewal of the generic clearance to allow the National Center for Education Statistics (NCES) to continue to develop, test, and improve its survey and assessment instruments and methodologies. The procedures utilized to this effect include but are not limited to experiments with levels of incentives for various types of survey operations, focus groups, cognitive laboratory activities, pilot testing, exploratory interviews, experiments with questionnaire design, and usability testing of electronic data collection instruments.

---

Authorizing Statute(s): US Code: 20 USC 9543 Name of Law: Education Sciences Reform Act (ESRA 2002)
  

Citations for New Statutory Requirements: None

---

Associated Rulemaking Information
RIN:	Stage of Rulemaking:	Federal Register Citation:	Date:
	Not associated with rulemaking

---

Federal Register Notices & Comments
60-day Notice:	Federal Register Citation:	Citation Date:
	78 FR 30899	05/23/2013
30-day Notice:	Federal Register Citation:	Citation Date:
	78 FR 43869	07/22/2013
Did the Agency receive public comments on this ICR? No

---

Number of Information Collection (IC) in this ICR: 73

IC Title	Form No.	Form Name
Fast Response Survey System (FRSS) 107: High School English Language Learner (ELL) Programs - Pretest
NAEP Reading and Math Technology Based Assessment Survey Focus Groups 2014
2nd Follow-up Field Test of High School Longitudinal Study of 2009 (HSLS:09) Cognitive Interviews
2015 National Household Education Survey (NHES) Adult Training and Education Survey (ATES) Cognitive Interviews and Concept Interviews
NAEP Touch-Screen Tablets Usability Study 2013
Middle Grades Longitudinal Study (MGLS:2017) Cognitive Interviews and Focus Groups
NAEP Science Interactive Computer Task and Hands-on Task Tablet Study
2015-16 National Postsecondary Student Aid Study (NPSAS) Focus Groups
2013-14 Civil Rights Data Collection (CRDC) Improvement Study Cognitive Interviews
2016 National Household Education Surveys Program (NHES) Adult Training and Education Survey (ATES) Cognitive Interviews
School Climate Surveys (SCLS) Cognitive Interviews & Usability Testing Revisions to Questions about Safety
2013-14 Civil Rights Data Collection (CRDC) Improvement Study Pilot Test
NTPS Pilot Test 2014-15 Experiment and Respondent Materials
2017-2018 National Teacher and Principal Survey (NTPS) Cognitive Interviews
National Assessment of Educational Progress (NAEP) Science Scenario-Based Tasks Cognitive Interviews
Employment and Earnings Survey 1st Round Cognitive Testing
NAEP Technology Based Assessments (TBA) Tools and Item Types Usability Study
NTPS 2015-16 Pilot Test Instruction Placement Experiment Change Request
Fast Response Survey System (FRSS) 108: Career and Technical Education (CTE) Programs in Public School Districts – Feasibility Calls
2017 School Crime Supplement to the National Crime Victimization Survey (SCS:17/NCVS) Cognitive Interviews - update
National Assessment of Educational Progress (NAEP) Survey Assessments Innovations Lab (SAIL) Science Playtesting and Cognitive Interviews
National Assessment of Educational Progress (NAEP) Pretesting of Survey and Cognitive Items for Pilot in 2017 and 2018 Updated
School Climate Surveys (SCLS) Pilot Test 2015 update
The National Teacher and Principal Survey (NTPS) Pilot Test 2014-15 Special Districts Approval
Employment and Earnings Survey 2nd Round of Cognitive Interviews
ECLS-K:2011 Spring 4th Grade Cognitive Interviews and Timing Tests
School Survey on Crime and Safety Cognitive Interviews 2014
2013-14 Civil Rights Data Collection (CRDC) Data Submission System Process Improvement and Feasibility Study
NAEP Mathematics, Reading, and Science Hands-on Tasks and National Indian Education Study (NIES) Survey Pretesting
NAEP SAIL Science Development 2014-15
2016 National Household Education Surveys Program (NHES) Usability Testing
National Teacher and Principal Survey (NTPS) Pilot Test 2014-15
National Assessment of Educational Progress (NAEP) Social Studies Pretesting
2017 National Household Education Surveys Program (NHES) Adult Training and Education Survey (ATES) Work-Related Education and Training Concept Interviews
2012/17 Beginning Postsecondary Students Longitudinal Study (BPS:12/17) Pilot Test
Beginning Postsecondary Students Longitudinal Study (BPS:12) Student Records Qualitative Evaluation
Employment and Earnings Survey Recruitment for 2nd Round of Cognitive Interviews
ED School Climate Surveys (EDSCLS) Additional Item Cognitive Interviews
School Climate Surveys Cognitive Interviews and Usability Testing
2016 National Household Education Surveys Program (NHES) Spanish Language Cognitive Interviews Phase 2
2015-16 National Postsecondary Student Aid Study (NPSAS:16) Student Survey and Student Records Qualitative Evaluation
2015-16 Civil Rights Data Collection (CRDC) Research & Evaluation	NA, NA	NA ,   NA
National Assessment of Educational Progress (NAEP) Writing Tasks Cognitive Interviews
School Climate Surveys (SCLS) Pilot Test 2015
Second Follow-up Field Test of the High School Longitudinal Study of 2009 (HSLS:09) – Recruitment and Screening for Cognitive Interviews
National Assessment of Educational Progress (NAEP) Pretesting of Survey and Cognitive Items for Pilot in 2017 and 2018
2017 School Crime Supplement to the National Crime Victimization Survey (SCS:17/NCVS) Cognitive Interviews
Middle Grades Longitudinal Study of 2016-2017 (MGLS:2017) Cognitive Interviews Reading and Accommodations
High School Longitudinal Study of 2009 (HSLS:09) Second Follow-up Cognitive and Usability Testing
ED School Climate Surveys (EDSCLS) Additional Item Cognitive Interviews - Set 2 Round 1
2016 National Household Education Surveys Program (NHES) Spanish Language Cognitive Interviews Phase I
2016 National Household Education Surveys Program (NHES) Parent and Family Involvement Survey (PFI) and Early Childhood Program Participation Survey (ECPP) Cognitive Interviews
Middle Grades Longitudinal Study of 2017-18 (MGLS:2017) Eye-tracking Cognitive Laboratory
Computer-delivered National Assessment of Educational Progress (eNAEP) Pretesting Study 2016
2013-14 and 2014-15 School-Level Finance Survey (SLFS:2014 & SLFS:2015) Pilot Study	NA	NA
National Household Education Survey (NHES) Adult Training and Education Survey (ATES) Spanish Version Cognitive Interviews
2015-16 NTPS Cog Labs Consent Form Change Request
2014 National Household Education Survey (NHES) Feasibility Study
2015-16 Schools and Staffing Survey (SASS) / National Teacher and Principal Survey (NTPS) Cognitive Interviews
Trends in International mathematics and science study (TIMSS 2015) Cognitive Interviews
2017 National Household Education Surveys Program (NHES) Adult Training and Education Survey (ATES) Preparation for Certifications and Licenses Cognitive Interviews and Focus Groups
Fast Response Survey System (FRSS) 107: Older Adolescent and Young Adult English Language Learner (ELL) Programs Feasibility Calls
NAEP SAIL2: Virtual World for English Language Arts Assessment Development 2014-15
2015-16 National Postsecondary Student Aid Study (NPSAS:2016) Graduate Student Cognitive Testing
National Assessment of Educational Progress (NAEP) Mathematics and Reading Pretesting 2015
National Assessment of Educational Progress (NAEP) Digitally Based Assessments (DBA) Tools and Item Types Usability Study 2015-16
NAEP Assessment of Educaitonal Progress (NAEP) Questionnaire Items for Core, Reading, Writing, and Mathematics - Cognitive Interviews
NAEP High School Electronic Transcript Data Collection Feasibility Study
NHES After-School Programs and Activities Survey (ASPA) and Adult Training and Education Survey (ATES) Feasibility Test Change Request
2012/17 Beginning Postsecondary Students Longitudinal Study (BPS:12/17) Cognitive Testing – First Round
2016 National Household Education Surveys Program (NHES) Phase 3 Cognitive Interviews for English and Spanish Recruitment Materials
2012/17 Beginning Postsecondary Students Longitudinal Study (BPS:12/17) Cognitive and Usability Testing – Second Round
2017 National Household Education Surveys Program (NHES) Usability Testing

---

ICR Summary of Burden

	Total Approved	Previously Approved	Change Due to New Statute	Change Due to Agency Discretion	Change Due to Adjustment in Estimate	Change Due to Potential Violation of the PRA
Annual Number of Responses	405,000	135,000	0	0	270,000	0
Annual Time Burden (Hours)	81,000	27,000	0	0	54,000	0
Annual Cost Burden (Dollars)	0	0	0	0	0	0

Burden increases because of Program Change due to Agency Discretion: No

Burden Increase Due to:

Burden decreases because of Program Change due to Agency Discretion: No

Burden Reduction Due to:

Short Statement:

---

Annual Cost to Federal Government: $0

Does this IC contain surveys, censuses, or employ statistical methods? Yes Part B of Supporting Statement

Is the Supporting Statement intended to be a Privacy Impact Assessment required by the E-Government Act of 2002? No

Is this ICR related to the Affordable Care Act [Pub. L. 111-148 & 111-152]? No

Is this ICR related to the Dodd-Frank Wall Street Reform and Consumer Protection Act, [Pub. L. 111-203]? No

Is this ICR related to the American Recovery and Reinvestment Act of 2009 (ARRA)? No

Is this ICR related to the Pandemic Response? Uncollected

---

Common Form ICR:  No

---

On behalf of this Federal agency, I certify that the collection of information encompassed by this request complies with 5 CFR 1320.9 and the related provisions of 5 CFR 1320.8(b)(3).

The following is a summary of the topics, regarding the proposed collection of information, that the certification covers:

(a) It is necessary for the proper performance of agency functions;

(b) It avoids unnecessary duplication;

(c) It reduces burden on small entities;

(d) It uses plain, coherent, and unambiguous language that is understandable to respondents;

(e) Its implementation will be consistent and compatible with current reporting and recordkeeping practices;

(f) It indicates the retention periods for recordkeeping requirements;

(g) It informs respondents of the information called for under 5 CFR 1320.8 (b)(3) about:

(i) Why the information is being collected;

(ii) Use of information;

(iii) Burden estimate;

(iv) Nature of response (voluntary, required for a benefit, or mandatory);

(v) Nature and extent of confidentiality; and

(vi) Need to display currently valid OMB control number;

(h) It was developed by an office that has planned and allocated resources for the efficient and effective management and use of the information to be collected.

(i) It uses effective and efficient statistical survey methodology (if applicable); and

(j) It makes appropriate use of information technology.

If you are unable to certify compliance with any of these provisions, identify the item by leaving the box unchecked and explain the reason in the Supporting Statement.

Certification Date: 06/19/2014

---