Similarities Classification Validation Research Study for 1998 Civics NAEP

Forms and Documents

Document Name	Status

No forms / supporting documents in this ICR. Check IC Document Collections.

IC Document Collections

IC ID	Document Title	Status
32582	Similarities Classification Validation Research Study for 1998 Civics NAEP	Migrated

ICR Details

OMB Control No: 3098-0003	ICR Reference No: 199903-3098-001
Status: Historical Active	Previous ICR Reference No:
Agency/Subagency: NAGB	Agency Tracking No:
Title: Similarities Classification Validation Research Study for 1998 Civics NAEP
Type of Information Collection: New collection (Request for a new OMB Control Number)	Common Form ICR:  No
Type of Review Request: Regular
OIRA Conclusion Action: Approved without change	Conclusion Date: 05/11/1999
	Date Received in OIRA: 03/08/1999
Terms of Clearance: Approved consistent with NAGB's memos and submissions of 4/23/99 and 5/5/99. In addition, the following terms apply: (1) OMB notes that the research design of this study is such that it answers only the following question: *Can highly trained teachers that participated in the process of developing achievement levels use the descriptions of basic, proficient, and advanced to appropriately interpret the performance of their own students?* The purpose of this study is to analyze and draw conclusions about only those teachers that participated in the achievement level- setting process. The research design does not permit generalization to teachers not specifically chosen to participate in the level-setting process. (2) OMB notes that approval was granted because NAGB eventually provided sufficient evidence of the utility of this study. Specifically, the study will have some utility in assessing whether the level-setting process the teachers went through was appropriate in terms of cognitive complexity and on whether these teachers can make an appropriate transition from the theoretical process of developing achievement levels to the real world practice of applying those levels in the classroom. (3) Significant delay in the approval of this package was caused because the package initially submitted by NAGB did not sufficiently lay out the rationale for the research design chosen, (including the support in the literature for this approach). Further, the package did not appropriately present the research question to be answered so that it was clear that the study was limited to only those teachers involved in the process - the original justification for the sampling method chosen was to obtain teachers for participation in the level-setting process, not to obtain teachers for this specific validation study. NAGB packages must be more thorough in the future if delays are to be avoided and OMB approval is to be obtained.

	Inventory as of this Action	Requested	Previously Approved
Expiration Date	05/31/2000	05/31/2000
Responses	1,500	0	0
Time Burden (Hours)	2,898	0	0
Cost Burden (Dollars)	0	0	0

---

Abstract: The student classification study involves teachers' estimates of the academic ability of their students and of their students' performance on the NAEP relative to each achievement level. Teachers will also classify performance of "anonymous" students represented in assessment booklets. These estimates are made with respect to the assessment framework and achievement levels descriptions. Teachers will not know how individual students performed on the assessment. The correspondence between classifications by teachers and classifications based on student performances will be measured.

---

Authorizing Statute(s): None

Citations for New Statutory Requirements: None

---

Associated Rulemaking Information
RIN:	Stage of Rulemaking:	Federal Register Citation:	Date:

---

Federal Register Notices & Comments

Did the Agency receive public comments on this ICR? No

---

Number of Information Collection (IC) in this ICR: 1

IC Title	Form No.	Form Name
Similarities Classification Validation Research Study for 1998 Civics NAEP

---

ICR Summary of Burden

	Total Approved	Previously Approved	Change Due to New Statute	Change Due to Agency Discretion	Change Due to Adjustment in Estimate	Change Due to Potential Violation of the PRA
Annual Number of Responses	1,500	0	0	1,500	0	0
Annual Time Burden (Hours)	2,898	0	0	2,898	0	0
Annual Cost Burden (Dollars)	0	0	0	0	0	0

Burden increases because of Program Change due to Agency Discretion: Yes

Burden Increase Due to:

Burden decreases because of Program Change due to Agency Discretion: No

Burden Reduction Due to:

Short Statement:

---

Annual Cost to Federal Government: $0

Does this IC contain surveys, censuses, or employ statistical methods? Yes Part B of Supporting Statement

Is the Supporting Statement intended to be a Privacy Impact Assessment required by the E-Government Act of 2002? No

Is this ICR related to the Affordable Care Act [Pub. L. 111-148 & 111-152]? Uncollected

Is this ICR related to the Dodd-Frank Wall Street Reform and Consumer Protection Act, [Pub. L. 111-203]? Uncollected

Is this ICR related to the American Recovery and Reinvestment Act of 2009 (ARRA)? Uncollected

Is this ICR related to the Pandemic Response? Uncollected

---

Common Form ICR:  No

---

On behalf of this Federal agency, I certify that the collection of information encompassed by this request complies with 5 CFR 1320.9 and the related provisions of 5 CFR 1320.8(b)(3).

The following is a summary of the topics, regarding the proposed collection of information, that the certification covers:

(a) It is necessary for the proper performance of agency functions;

(b) It avoids unnecessary duplication;

(c) It reduces burden on small entities;

(d) It uses plain, coherent, and unambiguous language that is understandable to respondents;

(e) Its implementation will be consistent and compatible with current reporting and recordkeeping practices;

(f) It indicates the retention periods for recordkeeping requirements;

(g) It informs respondents of the information called for under 5 CFR 1320.8 (b)(3) about:

(i) Why the information is being collected;

(ii) Use of information;

(iii) Burden estimate;

(iv) Nature of response (voluntary, required for a benefit, or mandatory);

(v) Nature and extent of confidentiality; and

(vi) Need to display currently valid OMB control number;

(h) It was developed by an office that has planned and allocated resources for the efficient and effective management and use of the information to be collected.

(i) It uses effective and efficient statistical survey methodology (if applicable); and

(j) It makes appropriate use of information technology.

If you are unable to certify compliance with any of these provisions, identify the item by leaving the box unchecked and explain the reason in the Supporting Statement.

Certification Date: 03/08/1999

---