Validity checks

Attachment 11

Description of Additional Validity Checks for Study-developed Questions

Questions from existing questionnaires were used as is or with minor adaptation whenever possible. There were instances where an appropriate question was not found to address a key outcome of interest and therefore study-developed questions were created. There are 15 such questions in the questionnaire and they are listed in the table below. Although these questions are face-valid, were reviewed by expert evaluation team members, CDC scientists, and piloted within the evaluation team, they were not tested with a high school youth population. Our plan to carefully monitor the responses received on these items is described below.

Questions 10-12 have response options of “Yes,” “No,” or “I don’t know.” We do not anticipate youth would have any comprehension concerns while answering these questions as they are factual in nature and a time period is referenced. In data analyses, we will examine these and all responses for aberrant or unexpected patterns in response to these items. We do not expect this to occur but we will examine for this possibility.

Questions 16a-19b have response options of “Yes,” “No,” or “I don’t know.” We do not anticipate youth would have any comprehension concerns while answering these questions as they are factual in nature and are only answered by youth who report receiving a referral (separately for four types of services) from a school staff member. In data analyses, we will examine these and all responses for aberrant or unexpected patterns in response to these items. We do not expect this to occur but we will examine for this possibility.

Questions 28 and 38 have response options of the number of days or the number of times provided in clear segments that are discreet and non-overlapping. We do not anticipate youth would have any comprehension concerns while answering these questions as they are factual in nature and clear response categories are referenced. In data analyses, we will examine these and all responses for aberrant or unexpected patterns in response to these items. We do not expect this to occur but we will examine for this possibility.

Question 45 is a “mark all that apply question” and the responses were adapted from an existing youth questionnaire on the school climate. The existing questionnaire, developed by the Gay, Lesbian and Straight Education Network, has been conducted for many years with youth of this age group. We do not anticipate youth would have any comprehension concerns while answering this question, however, in data analyses we will examine these and all responses for aberrant or unexpected patterns in response to these items.

Question 46 asks about transgender status. CDC program partners strongly advocated that this question be included in the questionnaire. It was adapted from previous versions of similar questions used on other questionnaires administered to youth. Although this adaption of the question has not been tested with youth of this age group, the definition of transgender is provided in the question. We do not anticipate youth would have any comprehension concerns while answering this question, however, in data analyses we will examine these and all responses for aberrant or unexpected patterns in response to these items.

Question Number on the Youth Health & School Climate Survey	Question
10	Have you seen any posters or messages related to HIV or STD prevention education in your school in the last 30 days?
11	Have you seen any posters or messages related to HIV or STD testing in your school in the last 30 days?
12	Have you seen any posters or messages related to HIV or STD testing in your community in the last 30 days?
16a	Did you receive HIV testing because of the referral?
16b	Did that person check to see that you received HIV testing?
17a	Did you receive STD testing because of the referral?
17b	Did that person check to see that you received STD testing?
18a	Did you receive sexual health services because of the referral?
18b	Did that person check to see that you received sexual health services?
19a	Did you receive counseling, psychological, or social services because of the referral?
19b	Did that person check to see that you received counseling, psychological, or social services?
28	During the past 30 days, on how many days did you not go to school?
38	How many times have you seen or heard of students being bullied?
45	Do you think you were harassed or bullied during the past 3 months because of any of the following reasons? Please mark all that apply.
46	A transgender person is someone whose biological sex at birth does not match the way they think or feel about themselves. Are you transgender?