National Assessment of Educational Progress (NAEP) 2019 Science Items Pretesting
NCES Cognitive, Pilot, and Field Test Studies System
Appendices V-AA - NAEP 2019 Science Items Pretesting Instruments
National Assessment of Educational Progress (NAEP) 2019 Science Items Pretesting
OMB: 1850-0803
National Center for Education Statistics
National Assessment of Educational Progress
Appendices V-AA
Cognitive Interviews and Tryouts Communication Materials
OMB# 1850-0803 v. 164
National Assessment of Educational Progress (NAEP) 2019
Science Items Pretesting
August 2016
Table of Contents
Appendix V: Recruitment Phone Script for Schools of Potential Student Participants: Science Cognitive Interviews and Tryouts
Hello. May I please speak to <NAME OF CONTACT AT SCHOOL>?
Good morning/afternoon/evening. My name is <CONTACT NAME>, and I am contacting you from <Educational Testing Service (ETS) or EurekaFacts>. We are carrying out an important study for the National Center for Education Statistics (NCES), part of the U.S. Department of Education. We are recruiting students who are currently in grades 4, 8 or 12 - we will also consider 5th, 9th, & 11th graders - to participate in research interviews supporting the development of new science test questions for the National Assessment of Educational Progress (NAEP). The research interviews will explore how students work through items on a <tablet computer or computer> to ensure that the items are clear and understandable to a broad range of students. NCES simply wants to know how students would respond to the items if they were on an actual test and would like to hear students’ thoughts to improve the items and make them easier to understand.
The voluntary research <interviews or sessions> will last no more than <60 or 90> minutes. Students will be asked to respond to science questions. <ETS or EurekaFacts> research staff will record audio and screen activity for analysis and take notes of students’ reactions to these test questions and will subsequently use students’ feedback to revise and refine the test content. <For cog labs: We will observe and ask about the students’ level of interest in, and understanding of, the questions. Students will also be asked whether they have any suggestions about how to enhance the questions. For tryouts: NCES simply wants to know how students would answer the questions if they were to be included on an actual NAEP assessment.>
Student responses will be used only for research purposes and will not be disclosed or used, in identifiable form, for any other purpose except as required by law. [Recruiter note: If asked what law is being referenced, please provide its name: Education Sciences Reform Act of 2002 (ESRA 2002) 20 U.S.C., § 9573.]
We would like your help in distributing and posting informational flyers. We will follow up directly with those who contact us. We will hold some sessions at <LOCATION>, <ADDRESS>; however, if the parents/guardians of students cannot provide transportation to <LOCATION>, <ADDRESS> we would like to set up sessions at your school.
Each participating student will receive a $25 gift card (from a major credit card company) in appreciation of the participants’ time. In addition, if transportation to the site is involved, a parent/guardian of each student will also receive a $25 gift card as appreciation for bringing the child to and from the interview site.
These <interviews or sessions> are an important stage of the NAEP test development process. The comments of students attending your school will help NCES improve test questions.
Would your school be interested in participating in or helping us to recruit students for this research study?
If NO: Thank you for your time. Have a wonderful day/evening. [END CALL]
If YES: Good, thank you very much. To ensure that we interview a broad mix of students and determine the best interview location, I have a few brief screening questions to ask you. It should take only a few minutes.
Screener
[Recruiter: Determine recruitment needs in advance. Look in public documents and school website to find what grades a school includes, the size of each grade, the SES, and racial/ethnic makeup of the student body. Record all responses to Screener questions. End Screener at whatever point the school staff member gives a response that confirms that their group has already been sampled adequately. End Screener Script: “Based on the requirements of this study, we are not able to include your school in the interviews at this time. Thank you for your time. Have a good day/evening.” [Interviewer: End call]]
Are you at a school with a population that includes:
Grade 4 and 5 students
Grade 8 and 9 students
Grade 11 and 12 students
How many students are enrolled in your school?
299 students or fewer
300-599 students
600 students or more
Eligible Participant Script
Thank you for taking the time to answer the screening questions. Your school is generally eligible to participate in the research interviews.
Would you be able to distribute and post flyers regarding this study? After receiving a contact of interest, an ETS staff member would follow up with the parent/legal guardian by phone and ask them some screening questions to ensure that a diverse sample of students is included in this study.
If NO: Thank you for your time. Have a good day/evening. [Interviewer: End call]
If YES: Would you be able to make a room at your school available where ETS could conduct some <60- or 90-> minute research sessions?
If YES: That’s great, we will contact you to schedule sessions at your school after we have some students signed up. (Interviewer: go to Closing)
If NO: (Interviewer: go to Closing)
(Closing)
Thank you for agreeing to disseminate information about this important research study. We will send you an email with the informational flyers attached.
We may need to reach you by telephone. Is the number I called the best number to use?
Do you have any questions at this time?
[Recruiter: Answer any questions.]
If you have any (additional) questions, please call <PHONE NUMBER>.
Thank you again for agreeing to be part of this important research project. Have a wonderful day/evening.
Appendix W: Recruitment Phone Script for Parents/Legal Guardians of Student Participants (Under Age 18): Science Cognitive Interviews and Tryouts
Script when calling parents from previously compiled list:
Hello. May I please speak to <NAME OF Parent/Legal Guardian>? (INTERVIEWER: THANK AND END CALL IF NOT AVAILABLE)
Good morning/afternoon/evening. Is this the <NAME FROM CALL LIST> household? My name is <NAME>, and I am calling from <Educational Testing Service (ETS) or EurekaFacts, a local research company> carrying out a study on behalf of the National Center for Education Statistics (NCES), part of the U.S. Department of Education.
Are there any students in your household?
Yes: (Great! Let me give you some additional information about the study.)
No: (Thank you, have a good day/evening.)
We are recruiting students to sign up to participate in a research study supporting the development of new items in science for the National Assessment of Educational Progress, or NAEP. [If parent asks what this is: This national assessment is administered to students in elementary, middle, and high schools throughout the United States.]
We are carrying out <research interviews or question tryout sessions> to explore how students work through sample science test questions to ensure that they are clear and understandable to a broad range of students. <ETS or Eureka Facts> staff will record audio and screen activity for analysis and take notes about students’ reactions to these questions to revise and refine test content. <For cog labs: We will observe and ask about the students’ level of interest in, and understanding of, the questions. Students will also be asked whether they have any suggestions about how to enhance the questions. For tryouts: NCES simply wants to know how students would answer the questions if they were to be included on an actual NAEP assessment.>
If selected to participate, your child will receive a $25 gift card (from a major credit card company). You will also receive a $25 gift card to thank you for your time in bringing your child to and from the session site.
The <research interview or question tryout session> will take place at <LOCATION>. It will last no more than <60 or 90> minutes and can be scheduled at your convenience.
These <research interviews or question tryout sessions> are an important stage of the NAEP test development process. The feedback students provide can help NCES evaluate the test questions to create the best test possible. Do you believe your child would be interested in participating?
Yes: (Great! To ensure that we conduct this research with a broad mix of students, I have a few brief questions to ask about you and your child. It should only take a few minutes of your time. First, I want to collect some additional information about your child to identify if <HE/SHE> meets the participation requirements.
(Skip to Screener, on following page.)
No: (Thank you, have a good day/evening. END CALL.)
Script when calling a parent who responded to email, advertisement, or invitation
Good morning/afternoon/evening. Is this <NAME OF STUDENT>? My name is <NAME>. I’m calling from <Educational Testing Service (ETS) or EurekaFacts> on behalf of the National Center for Education Statistics (NCES), part of the U.S. Department of Education.
Thank you for contacting us about the possibility of your child participating in a tryout session to help develop test questions for the National Assessment of Educational Progress, or NAEP. To ensure that we conduct research with a broad mix of students, I have a few brief questions to ask about you and your child. It should only take a few minutes of your time. First, I want to collect some additional information about your child to identify if <HE/SHE> meets the participation requirements.
Screener
(INTERVIEWER: Determine recruitment needs in advance. Record all responses. End Screener at whatever point the parent/legal guardian gives a response that confirms that their group has already been sampled adequately. End Screener script: “Thank you for answering my questions. Based on the requirements of this study, we are not able to include your child in the interviews at this time. Thank you for your time. Have a good day/evening. [Interviewer: End call]”)
What is your child’s name?
What grade is your child currently in? (INTERVIEWER: DO NOT READ LIST)
K – 3rd (Unfortunately, we are only interviewing students currently in grades 4 or 5, grades 8 or 9, and grades 11 or 12 for this study. Thank you for your time. Have a good day/evening.)
4th – 5th - Good
6th – 7th (Unfortunately, we are only interviewing students currently in grades 4 or 5, grades 8 or 9, and grades 11 or 12 for this study. Thank you for your time. Have a good day/evening.)
8th - 9th - Good
10th (Unfortunately, we are only interviewing students currently in grades 4 or 5, grades 8 or 9, and grades 11 or 12 for this study. Thank you for your time. Have a good day/evening.)
11th - 12th - Good
What school does your child attend? (INTERVIEWER: Note if homeschooled)
____________________________
What school district does he/she attend? (INTERVIEWER: Note if charter, parochial, private, homeschooled)
____________________________
Is your child currently enrolled in any of the following types of courses (select all that apply)
Advanced placement (e.g., AP, IB, or other college-level courses)
Honor courses
Remedial courses
Other courses
What is your child’s ethnicity and race? (INTERVIEWER: Read list only if respondent doesn’t immediately reply. “Is your child…?” If the respondent indicates they prefer not to disclose this information, say: “That’s fine,” and move on to the next question.)
Ethnicity:
Hispanic or Latino Not Hispanic or Latino
Race (one or more of the categories below):
American Indian or Alaska Native
Asian
Black or African American
Hispanic or Latino
Native Hawaiian or other Pacific Islander
White or Caucasian
Which language did your child learn when he/she first began to talk? ______________________________
Which language does your child most frequently speak at home? _________________________________
Which language do you (the parents/legal guardians) most frequently use when speaking with your child? ______________________________________________________________________________________
Just to be sure we're interviewing a broad range of students for this study…
What is your total annual household income range based on the following ranges? (INTERVIEWER: If the respondent indicates they prefer not to disclose this information, say: “That’s fine,” and move on to the next question.)
Less than $20,000
$20,000 to $49,999
$50,000 to $99,999
$100,000 or more
Does your child participate in the National School Lunch program? [INTERVIEWER: If the respondent indicates they prefer not to disclose this information, say “That’s fine,” and move on to the next question.]
Yes
No
Would you consider the area you live in to be …
Urban
Suburban
Rural
Ok. Thank you and what is the zip code of the area that you live in?
_________________
Thank you. We would like to speak with your child to confirm if he/she is interested in participating in the research interview. It will take only a couple of minutes and then I will ask to speak with you again for another moment. Is your child available to speak with us now or should we call him/her back at another time?
Yes, the child is available for screening questions (SKIP TO SCRIPTS FOR 4th, 8th, or 12th GRADE STUDENTS)
No, please call back.
Is the phone number you gave me earlier the best number to call?
Other phone numbers: _________________________________
Is there a good time for me to call? When would be best for you?
___________________________________________________
INTERVIEWER: IF CHILD NEEDS TO RECEIVE A CALL BACK, RECORD NAME, PHONE NUMBER, DATE/TIME
Parent/Legal Guardian Name ___________________________________________________________
Child Name ____________________________________________________________________
Parent/Legal Guardian Phone ______________________________________________________________
Date ____________________
Time ____________________
SCRIPT FOR 8th or 12th GRADE STUDENTS
Good morning/afternoon/evening. Is this <NAME OF STUDENT>? My name is <NAME>, and I’m calling from <Educational Testing Service (ETS) or EurekaFacts>. We are carrying out an important study for the National Center for Education Statistics, part of the U.S. Department of Education.
We have spoken to your parent/legal guardian and we are pleased that you may be interested in helping us test questions in science for a nationwide student assessment, the National Assessment of Educational Progress, or NAEP. Before I tell you more about what you would be asked to do, I need to ask you one question:
What grade are you currently in? (RECRUITER: DO NOT READ LIST)
K – 7th (Unfortunately, we are interviewing only students currently in grades 8 or 9 and grades 11 or 12 for this study. Thank you for your time. Have a good day/evening.)
8th – 9th - Good.
10th (Unfortunately, we are interviewing only students currently in grades 8 or 9 and grades 11 or 12 for this study. Thank you for your time. Have a good day/evening.)
11th - 12th – Good.
Thank you. For the research <interview or session>, you will be asked to visit <LOCATION>, <ADDRESS> and respond to sample science items on a tablet computer. Your responses will not be graded. The National Center for Education Statistics simply wants to know how you would respond to each question if it were to be included in the National Assessment of Educational Progress. The items focus on science and are interesting and fun to do. Your input will help evaluate the test that will be given to students throughout the nation. To thank you for participating, you will receive a $25 gift card (from a major credit card company) and your parent or guardian will also receive $25 if they bring you to and from the <interview or session> site. The <interview or session> will last no more than 90 minutes and will be recorded. Your participation is totally voluntary. If you participate, no one but the study’s researchers will see your responses and all other <interview or session> materials, and we will not use your name to identify you.
Would you like to participate?
Yes
No Thank you for your time. I will need to let your parent/legal guardian know that you would not like to participate. Is he/she available?
If NO:
TO PARENT/LEGAL GUARDIAN: Your child has decided not to participate, but I would like to thank you very much for taking the time to speak with us about this opportunity.
If YES: Thank you for agreeing to participate in this important research study. I will need to speak to your parent/legal guardian to talk about the date/time of the interview. Could you please pass the phone back to your parent/legal guardian?
INTERVIEWER: IF CALLING PARENT/LEGAL GUARDIAN BACK, RECORD NAME, PHONE NUMBER, DATE/TIME
Parent/Legal Guardian Name: _______________________________________________________
Child Name: _____________________________________________________________________
Parent/Legal Guardian Phone: ______________________________________________________
Date: __________________________________________________________________________
Time: __________________________________________________________________________
SCRIPT FOR GRADE 4 STUDENTS
Hello. Is this <NAME OF STUDENT>?
Good morning/afternoon/evening. My name is <NAME>, and I’m calling from <Educational Testing Service (ETS) or EurekaFacts>. We are carrying out an important educational study.
We have spoken to your parent/legal guardian and are pleased that you might like to help us develop <SUBJECT> test questions for a test for students across the country, called the National Assessment of Educational Progress, or NAEP. Before I tell you more about what you would be asked to do, I need to ask you one question:
What grade are you currently in? (RECRUITER: DO NOT READ LIST)
K – 3rd (Unfortunately, we are interviewing only students currently in grades 4 or 5 for this study. Thank you for your time. Have a good day/evening.)
4th - 5th – Good.
6th – 12th (Unfortunately, we are interviewing only students currently in grades 4 or 5 for this study. Thank you for your time. Have a good day/evening.)
Thank you. For the research <interview or session>, you will be asked to visit <LOCATION>, <ADDRESS> and we’ll ask you to respond to some <SUBJECT> test questions on a <tablet computer or computer>. You will not be graded and this has nothing to do with your classes in school. Our study simply wants to know how you would answer the questions if it were to be included in the National Assessment of Educational Progress. The questions focus on <SUBJECT> and are really interesting and fun to do. You will be asked to answer questions on a computer. Your input will help improve the test that will be given to students throughout the nation. To thank you for participating, you will receive a $25 gift card (from a major credit card company) when you finish the research <interview or session>. The interview will last no more than 60 minutes and will be recorded. You may choose not to participate; it is up to you. If you decide to participate, no one but the study’s researchers will see your answers and all other research <interview or session> materials, and we will not use your name to identify you.
Would you like to participate?
Yes
No (THANK AND END CALL)
If NO: Thank you for your time. I will need to let your parent/legal guardian know that you would not like to participate. Is he/she available?
TO PARENT/LEGAL GUARDIAN: Your child has decided not to participate, but I would like to thank you very much for taking the time to speak with us about this opportunity.
If YES: Thank you for agreeing to participate in this important research study. I will need to speak to your parent/legal guardian to talk about the date/time of the interview. Is your parent/legal guardian available?
Yes
No
INTERVIEWER: IF CALLING PARENT/LEGAL GUARDIAN BACK, RECORD NAME, PHONE NUMBER, DATE/TIME
Parent/Legal Guardian Name: _______________________________________________________
Child Name: _____________________________________________________________________
Parent/Legal Guardian Phone: ______________________________________________________
Date: __________________________________________________________________________
Time: __________________________________________________________________________
IF PARENT/LEGAL GUARDIAN AVAILABLE AND CURRENTLY SCHEDULING INTERVIEWS
Thank you again for allowing your child to participate in the NAEP research interviews. We will be holding our current interviews from <DATE> to <DATE>. What would be the best date/time to schedule the interview?
Date ____________________
Time ____________________
Thank you. We will follow up with a confirmation email/letter and a consent form. What is your email or postal address for us to send these to? ________________________________________________________________
IF PARENT/LEGAL GUARDIAN AVAILABLE AND NOT CURRENTLY SCHEDULING INTERVIEWS
Thank you again for allowing your child to participate in the NAEP research interviews. We are in between interview sessions and will need to call you back when we are actively scheduling the interviews to determine the date and time that will work best. What are your scheduling preferences? (SELECT ALL THAT APPLY)
Morning
Afternoon
After School
Weekends
Thank you so much for talking with us today. We look forward to communicating with you soon.
Appendix X: Recruitment Phone Script for Students (Age 18 or Over): Science Cognitive Interviews and Tryouts
Script when calling students from previously compiled list:
Good morning/afternoon/evening. Is this <NAME FROM CALL LIST>? My name is <NAME>, and I am calling from <Educational Testing Service (ETS) or EurekaFacts, a local research company> carrying out a study on behalf of the National Center for Education Statistics (NCES), part of the U.S. Department of Education.
Are you a student over the age of 18?
Yes: (Great! Let me give you some additional information about the study.)
No: (Thank you, have a good day/evening.)
We are recruiting students to sign up to participate in a research study supporting the development of new science test questions for the National Assessment of Educational Progress, or NAEP. [If student asks what this is: This national assessment is administered to students in elementary, middle, and high schools throughout the United States.]
We are carrying out research <interviews or question tryout sessions> to explore how students work through sample science test questions to ensure that they are clear and understandable to a broad range of students. <For cog labs: We will observe and ask about your level of interest in, and understanding of, the questions. Students will also be asked whether they have any suggestions about how to enhance the questions. For tryouts: NCES simply wants to know how students would answer the questions if they were to be included on an actual NAEP assessment.>
If selected to participate, you will receive a $25 gift card (from a major credit card company). If your parent/guardian accompanies you they will also receive a $25 gift card to thank them for their time in bringing you to and from the session site.
The <research interview or question tryout session> will take place at <LOCATION>. It will last no more than 90 minutes and will be recorded. Sessions can be scheduled at your convenience. During the session, you will be asked to respond to test questions on a tablet computer.
These research <interviews or question tryout sessions> are an important stage of the NAEP test development process. By sharing your feedback with us, students can help NCES evaluate the test questions to create the best test possible. Would you be interested in participating?
Yes: (Great! To ensure that we conduct this research with a broad mix of students, I have a few brief questions to ask about you. It should only take a few minutes of your time. First, I want to collect some additional information to identify if you meet the participation requirements.
(Skip to Screener, on following page.)
No: (Thank you, have a good day/evening. END CALL.)
Script when calling students who responded to email, advertisement, or invitation
Good morning/afternoon/evening. Is this <NAME OF STUDENT>? My name is <NAME>. I’m calling from <Educational Testing Service (ETS) or EurekaFacts> on behalf of the National Center for Education Statistics (NCES), part of the U.S. Department of Education.
Thank you for contacting us about the possibility of you participating in a research <interview or tryout session> to help develop test questions for the National Assessment of Educational Progress, or NAEP. To ensure that we conduct research with a broad mix of students, I have a few brief questions to ask you. It should only take a few minutes of your time. First, I want to collect some additional information to identify if you meet the participation requirements.
Screener
(INTERVIEWER: Determine recruitment needs in advance. Record all responses. End Screener at whatever point the response confirms that this group has already been sampled adequately. End Screener script: “Thank you for answering my questions. Based on the requirements of this study, we are not able to include you in the interviews at this time. Thank you for your time. Have a good day/evening. [Interviewer: End call]”)
What is your name?
What grade are you currently in? (INTERVIEWER: DO NOT READ LIST)
K-10th (Unfortunately, we are only interviewing students currently in grade 11 or grade 12 for this study. Thank you for your time. Have a good day/evening.)
11th - 12th - Good
What school do you attend? (INTERVIEWER: Note if homeschooled)
____________________________
What school district do you attend? (INTERVIEWER: Note if charter, parochial, private, homeschooled)
____________________________
Are you taking any of the following types of courses (select all that apply)
Advanced placement (e.g., AP, IB, or other college-level courses)
Honor courses
Remedial courses
Other courses
What is your ethnicity and race? (INTERVIEWER: Only read list if student doesn’t immediately reply. Are you…? If the respondent indicates they prefer not to disclose this information, say: “That’s fine,” and move on to the next question.)
Ethnicity:
Hispanic or Latino Not Hispanic or Latino
Race (one or more of the categories below):
American Indian or Alaska Native
Asian
Black or African American
Hispanic or Latino
Native Hawaiian or other Pacific Islander
White or Caucasian
Which language did you learn when you first began to talk? _________________________________
Which language do you most frequently speak at home? ____________________________________
Which language do your parents/legal guardians most frequently use when speaking with you? ______________________________________________________________________________________
Just to be sure we're interviewing a broad range of students for this study…
What is your family’s total annual household income range based on the following ranges? (INTERVIEWER: If the respondent indicates they prefer not to disclose this information, say: “That’s fine,” and move on to the next question.)
Less than $20,000
$20,000 to $49,999
$50,000 to $99,999
$100,000 or more
Do you participate in the National School Lunch program? [INTERVIEWER: If the respondent indicates they prefer not to disclose this information, say “That’s fine,” and move on to the next question.]
Yes
No
Would you consider the area you live in to be …
Urban
Suburban
Rural
OK. Thank you and what is the zip code of the area that you live in?
_________________
Would you like to participate?
Yes
No (THANK AND END CALL)
IF CURRENTLY SCHEDULING INTERVIEWS
Thank you again for agreeing to participate in the NAEP research <interviews or tryout sessions>. We will be holding our current <interviews or sessions> from <DATE> to <DATE>. What would be the best date/time to schedule the interview?
Date ____________________
Time ____________________
IF NOT CURRENTLY SCHEDULING INTERVIEWS
Thank you again for agreeing to participate in the NAEP research interviews. We are in between interview sessions and will need to call you back when we are actively scheduling the interviews to determine the date and time that will work best. What are your scheduling preferences? (SELECT ALL THAT APPLY)
Morning
Afternoon
After School
Weekends
Is the phone number you gave me earlier the best number to call?
Other phone numbers: ____________________________
Is there a good time for me to call? When would be best for you?
Participant Name _______________________________
Date _________________________________________
Time _________________________________________
Thank you so much for talking with us today. We look forward to communicating with you soon.
Appendix Y: ETS Recruitment Web-surveyor Intake Form - Link provided in Emails/Letters and Flyers to Parents/Legal Guardians or Students (Age 18 or over) Interested in Participating in Study: Science Cognitive Interviews
Educational Testing Service (ETS)
Research Study Opportunity: Cognitive Interview for NAEP Science
Educational Testing Service (ETS) is carrying out an important research study in science for the National Center for Education Statistics (NCES), part of the U.S. Department of Education.
We are recruiting students currently in grades 4, 8, and 12 (5th, 9th, & 11th graders will also be considered) to participate in voluntary research interviews supporting the development of new computer-delivered science tasks for the National Assessment of Educational Progress (NAEP). The interviews will explore how students work through the tasks to ensure that the tasks are clear and understandable to a broad range of students. During the interview, your child would be asked to respond to science tasks on a tablet computer. NCES simply wants to know what your child thinks about each task and how your child might do the tasks on a test. These interviews are an important stage of the NAEP test development process. By sharing their feedback with us, students can directly guide the future of this national assessment by helping NCES evaluate the tasks to create the best tasks possible.
The interview for your child would take place at <LOCATION> and will last no more than <60 or 90> minutes. The interview can be scheduled at your and your child’s convenience. Students will receive a $25 gift card (from a major credit card company) for participation in the study. In addition, if transportation to the site is involved, the parent/guardian will also receive a $25 gift card to thank him/ her for the time in bringing participant(s) to and from the interview site. The responses to questions and taking part in this study may be used only for statistical purposes and may not be disclosed, or used, in identifiable form for any other purpose except as required by law [ESRA, 20 U.S.C §9573]. Participation is voluntary and the student may withdraw from the study at any time.
We would like to have a balanced group of students take part in the study. To that end, we’d like you to give us some information about your child by filling out the form on the following pages. We will let you know within <TIME> whether your child has been selected to take part in this research study. If your child is not selected for this study, we hope you will consider letting him/her be a part of other studies in the future.
If you have any questions, please contact Pretesting Coordinator at (609) 734-1882 or email [email protected].
Thanks for your interest in this study!
Name of Researcher
Title of Researcher
Department Name
Educational Testing Service
660 Rosedale Rd
Princeton, NJ 08541
(* Indicates that the question is voluntary.)
Student Name (Last, First):
Parent Name (Last, First):
Parent Phone Number:
Student (Age 18 or over) Phone Number:
Parent Email Address:
Student (Age 18 or over) Email Address:
Student’s grade: ____4th ____5th ____8th____9th ____11th____ 12th
Student’s school/district:
Student’s Age:
Student’s Gender:
Student’s Ethnicity/Race:
Ethnicity:
Hispanic or Latino Not Hispanic or Latino
Race (one or more of the categories below):
American Indian or Alaska Native
Asian
Black or African American
Native Hawaiian or other Pacific Islander
White or Caucasian
Is Student currently enrolled in any of the following types of courses? (select all that apply)
Advanced placement (e.g., AP, IB, or other college-level courses)
Honor courses
Remedial courses
Other courses
*Does student participate in the National School Lunch program?
Yes
No
*What is the total annual household income range based on the following ranges?
Less than $20,000
$20,000 to $49,999
$50,000 to $99,999
$100,000 or more
Would you consider the area you live in to be …
Urban
Suburban
Rural
What is the zip code of the area that you live in? _______________
Possible time for <60 or 90>-minute session: Please mark all the sessions that would work for your child(ren)
(Not all these times will be used. We are trying to schedule students in a few convenient sessions)
(DATE) |
(TIME) |
(TIME) |
(TIME) |
(DATE) |
(TIME) |
(TIME) |
(TIME) |
(DATE) |
(TIME) |
(TIME) |
(TIME) |
(DATE) |
(TIME) |
(TIME) |
(TIME) |
If some other time during these weeks would be better, what <60 or 90>-minute time frame would that be?
To complete submission of this form, please click the “Submit” button. You will be contacted within <TIME> to let you know whether or not your child has been selected to participate in this study.
(SUBMIT BUTTON)
Appendix Z: Consent Form for Parents/Legal Guardians of Student Participants (Under Age 18): Science Cognitive Interviews and Tryouts
PARENTAL CONSENT FORM
FOR PARTICIPATION IN RESEARCH
<Educational Testing Service (ETS) or EurekaFacts, LLC>
Title of Research Study: <Cognitive Laboratory Interviews or Tryouts> for NAEP Science
Thank you for your interest in having your child participate in the research study described below. This consent form explains the research study. Please read it carefully, and feel free to ask questions about anything you do not understand. If you do not have questions now, you may ask them later as they occur to you.
What is this study about?
The National Center for Education Statistics (NCES), part of the U.S. Department of Education, is conducting research interviews with students currently in grades 4, 8, and 12 (5th, 9th, and 11th graders will also be considered) about new test questions for the National Assessment of Educational Progress (NAEP). The questions we are testing focus on science and will be part of a digitally based test. NCES needs to know whether the questions on the test are clear. Students’ input will help NCES improve the test so that future students will understand it.
What will happen during the research <interview or session>?
[For Cognitive Interviews: Each participant will work through an early version of new NAEP science questions on a tablet computer. An interviewer will ask what your child was thinking as he/she completed the questions, and whether he/she believes the questions are clear and understandable. <ETS or EurekaFacts> staff will record audio and screen activity for analysis and take notes about your child’s reactions to these questions to revise and refine test content. No personally identifying information will be recorded or retained. Science-specific knowledge is not required, and your child’s responses will not be graded.]
[For Tryouts: Each participant will take an early version of a new NAEP science test on a tablet computer. Participants will be asked to answer the questions as if it were an actual test. Science-specific knowledge is not required, and participants will not be graded.]
There will be more than one adult present.
Where will the research <interview or session> take place?
The interview will take place at <NAME OF INTERVIEW/SESSION LOCATION>, located at <ADDRESS><, near <NEARBY LANDMARK OR METRO STATION>.
[(Insert if INTERVIEW takes place at a school) For research activities conducted in schools, NAEP will not conduct pretesting interviews during school hours. If any pretesting interviews are conducted at schools, after regular school hours, we do not anticipate any disruption in school services to students.]
How long will the research <interview or session> last?
The interview will last no more than <60 or 90> minutes. The interview requires only one visit to the interview site.
Will information be kept confidential?
Each participant will be assigned a unique student identifier (ID), and at no time will his/her name be linked to any of his/her answers. Your child’s responses will be used only for research purposes and will not be disclosed or used, in identifiable form, for any other purpose except as required by law [Education Sciences Reform Act of 2002, 20 U.S.C §9573]. Audio and screen activity will be recorded for analysis, but no personally identifying information will be recorded or retained.
Will the results go to my child’s school?
Your child’s answers will not be disclosed to his/her school and will not be linked to any personally identifiable information such as the school’s name.
What are the possible risks of being in the study?
There are no known risks to participating in this study.
Can participation end early?
Participation in this study is completely voluntary. Your child has the right to refuse to answer particular questions. Your child may elect to withdraw from this study at any time and can end early if he/she wishes. Your child will still receive a gift card if he/she refuses to answer particular questions or elects to end the <interview or session> early.
Whom can I contact with questions or for further information?
<CONTACT NAME> is coordinating this study at <ETS or EurekaFacts> on behalf of NCES. If you have any questions, please call <CONTACT PHONE> or email <CONTACT EMAIL>. [ETS: Additionally, you can fill out an intake form for your child at https://www.surveyresearchonline.com/.]
____ Yes, I agree to allow my child to participate in this study
____ No, I do not want my child to participate in this study
-------------------------------------------------------------------------------------------------------------------------------------------------------
By signing below, you agree that your child, _______________________________, may participate in this study. Your child will receive a $25 gift card (from a major credit card company) at the conclusion of the interview.
In addition, if transportation to the interview site is involved, you will also receive a $25 gift card as appreciation for the time bringing your child to and from the site.
Your signature below will indicate that your questions have been answered satisfactorily, and that you have read and understood the information provided above.
Print Name: ________________________________________________________________________________
Signature: ______________________________________________________Date: _______________________
Email address: ______________________________________________________________________________
School student attends: _______________________________________________________________________
To be completed by <ETS or EurekaFacts> staff:
Student Payment Card Transaction Number: ________________________________________________________
Parent/Guardian Payment Card Transaction Number: _________________________________________________
Appendix AA: Consent Form for Student Participants (Age 18 or Over): Science Cognitive Interviews and Tryouts
CONSENT FORM
FOR PARTICIPATION IN RESEARCH
<Educational Testing Service (ETS) or EurekaFacts, LLC>
Title of Research Study: <Cognitive Laboratory Interviews or Tryouts> for NAEP Science
Thank you for your interest in participating in the research study described below. This consent form explains the research study. Please read it carefully, and feel free to ask questions about anything you do not understand. If you do not have questions now, you may ask them later as they occur to you.
What is this study about?
The National Center for Education Statistics (NCES), part of the U.S. Department of Education, is conducting research interviews with students currently in grades 4, 8, and 12 (5th, 9th, and 11th graders will also be considered) about new test questions for the National Assessment of Educational Progress (NAEP). The questions we are testing focus on science and will be part of a digitally based test. NCES needs to know whether the questions on the test are clear. Students’ input will help NCES improve the test so that future students will understand it.
What will happen during the research <interview or session>?
[For Cognitive Interviews: Each participant will work through an early version of new NAEP science questions on a tablet computer. An interviewer will ask what you were as thinking as you completed the questions, and whether you believe the questions are clear and understandable. <ETS or EurekaFacts> staff will record audio and screen activity for analysis and take notes about your reactions to these questions to revise and refine test content. No personally identifying information will be recorded or retained. Science-specific knowledge is not required, and your responses will not be graded.]
[For Tryouts: Each participant will take an early version of a new NAEP science test on a tablet computer. You will be asked to answer the questions as if it were an actual test. Science-specific knowledge is not required, and you will not be graded.]
There will be more than one adult present.
Where will the research <interview or session> take place?
The interview will take place at <NAME OF INTERVIEW/SESSION LOCATION>, located at <ADDRESS>, near <NEARBY LANDMARK OR METRO STATION>.
[(Insert if INTERVIEW takes place at a school) For research activities conducted in schools, NAEP will not conduct pretesting interviews during school hours. If any pretesting interviews are conducted at schools, after regular school hours, we do not anticipate any disruption in school services to students.]
How long will the research <interview or session> last?
The interview will last no more than 90 minutes. The interview requires only one visit to the interview site.
Will information be kept confidential?
You will be assigned a unique student identifier (ID), and at no time will your name be linked to any of your answers. Your responses will be used only for research purposes and will not be disclosed or used, in identifiable form, for any other purpose except as required by law [Education Sciences Reform Act of 2002, 20 U.S.C §9573]. Audio and screen activity will be recorded for analysis, but no personally identifying information will be recorded or retained.
Will the results go to my school?
Your answers will not be disclosed to your school and will not be linked to any personally identifiable information such as the school’s name.
What are the possible risks of being in the study?
There are no known risks to participating in this study.
Can participation end early?
Your participation in this study is completely voluntary. You have the right to refuse to answer particular questions. You may elect to withdraw from this study at any time. You will still receive a gift card if you refuse to answer particular questions or elect to end the <interview or session> early.
Whom can I contact with questions or for further information?
<CONTACT NAME> is coordinating this study at <ETS or EurekaFacts> on behalf of NCES. If you have any questions, please call <CONTACT PHONE> or email <CONTACT EMAIL>. [ETS: Additionally, you can fill out an intake form at https://www.surveyresearchonline.com/.]
____ Yes, I agree to participate in this study.
____ No, I do not wish to participate in this study.
-------------------------------------------------------------------------------------------------------------------------------------------------------
By signing below, you agree that you will participate in this research study. You will receive a $25 gift card (from a major credit card company) at the conclusion of the interview. In addition, if transportation to the site is involved, your parent/guardian will also receive a $25 gift card in appreciation for the time bringing you to and from the interview site. Your signature below will indicate that your questions have been answered satisfactorily, and that you have read and understood the information provided above.
Print Name: ________________________________________________________________________________
Signature: ______________________________________________________Date: _______________________
Email address: ______________________________________________________________________________
School you attend: ___________________________________________________________________
To be completed by <ETS or EurekaFacts> staff:
Student Payment Card Transaction Number: ________________________________________________________
Parent/Guardian Payment Card Transaction Number: _________________________________________________
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| File Title | NATIONAL CENTER FOR EDUCATION STATISTICS |
| Author | joc |
| File Modified | 0000-00-00 |
| File Created | 2021-01-23 |
© 2024 OMB.report | Privacy Policy