Passback Q and A

MEMORANDUM February 21, 2012

To: Shelly Martinez, OMB

From: Freddie Cross, NCES

Through: Kashka Kubzdela, NCES

Re: Response to OMB Passback on TFS:13 Cognitive Testing (OMB# 1850-0803 v.65)

Passback of February 10^th, 2012:

1. It isn’t clear without a detailed crosswalk precisely which parts of the questions included in the submission are new, revised, etc.  In any case, there is no rationale provided for such additions or changes.  We will need much more detail on why new or changed items are being proposed, the literature behind such changes, etc. This is especially important for items that appear quite subjective.  Think about the way the new content for NPSAS/B&B were explained to OMB for an example.  Without such information, we cannot assess whether these are the right items to include in what presumably is the only set of cog labs prior to the next round of the TFS.

We have provided a spreadsheet with items crosswalk and justification. Please note that the spreadsheet has two tabs.

2. The memo seems unclear on whether Macro or Census is doing the cog labs, though the materials suggest is it Macro.  Please fix to clarify who is doing what.

We have clarified in the memo who is conducting the cog labs.

Passback of February 15^th, 2012:

3. Thanks for this additional material.  It is helpful in understanding what is new.  However, the “justification” seemed more about justifying why an item was being tested rather than why it was being included in the first place. Therefore, we’d like to hear more about the rationale and evidence behind some of the new items under questions 4 and 7 (numbering of current teacher questionnaire) and 11 (former teacher questionnaire).  We also believe that there are some areas missing that likely of higher priority policy interest in those three question sets. Can key folks be available for a call on Friday sometime between 9:45 and 11:45?

We held a call on February 17th and have revised the following documents:

• TFS Cog Lab Crosswalk-Item justification 02172012 and Current Teacher Interview Protocol 021712 – item regarding teacher support was added to question 4.

• Former Teacher Interview Protocol 021712 – repeated item removed from question 11.

1