OMB_supp_statement_Parents Media Campaign

OMB_supp_statement_Parents Media Campaign.doc

Evaluation of the Natinal Abstinence Media Campaign

OMB: 0990-0311

Document [doc]
Download: doc | pdf

REVISED

12/18/2006



December 2006


SUPPORTING STATEMENT FOR PAPERWORK REDUCTION ACT SUBMISSION


for


Evaluation of the Parents Speak Up National Campaign


(Formerly Entitled Evaluation of the National Abstinence Media Campaign)


Prepared for


Leslie Raneri

Office of Population Affairs/DHHS

1101 Wotton Parkway, Suite 700

Rockville, Maryland 20852

(240) 453-2813


Prepared by


RTI International*

3040 Cornwallis Road

Research Triangle Park, NC 27709


RTI Project Number 0208490.025








___________________

*RTI International is a trade name of Research Triangle Institute.

Table of Contents


Section Page


A. Justification 2

1. Need and Legal Basis 2

2. Information Users 2

3. Use of Information Technology 2

4. Duplication of Similar Information 2

5. Small Businesses 2

6. Less Frequent Collection 2

7. Special Circumstances 2

8. Federal Register Notice/Outside Consultation 2

9. Payment/Gift to Respondents 2

10. Confidentiality 2

11. Sensitive Questions 2

12. Burden Estimate (Total Hours & Wages) 2

12A. Estimated Annualized Burden Hours 2

12B. Estimated Annualized Cost to Respondents 2

13. Capital Costs (Maintenance of Capital Costs) 2

14. Cost to Federal Government 2

15. Program or Burden Changes……………………………………………………..13

16. Publication & Tabulation Dates………………………………………………….13

17. Expiration Date…………………………………………………………………..18

18. Certification Statement…………………………………………………………..18

B. Collection of Information Employing Statistical Methods 2

1. Respondent Universe and Sampling Methods 2

2. Procedures for the Collection of Information 2

3. Methods to Maximize Response Rates and Deal with Nonresponse 2

4. Tests of Procedures or Methods to be Undertaken 2

5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data 2



Appendices

A. Public Law 108-447/ HR 4818-326, Consolidated Appropriations Act, 2005 27

B. Efficacy Evaluation Data Collection Materials 30

C. Federal Register Notice to the Public……………………………………………………78

D. RTI Institutional Reivew Board Approval Notice 81

E. Assurances of Confidentiality and Study Descriptions Provided to Respondents 83

F. Knowledge Networks Privacy and Confidentiality Procedures 87

G. E-mail Notifications 90

H. Knowledge Networks Panel Recreuitment Methodology 95





























List of Exhibits


Number Page


1. Evaluation Research Questions……………………………………………………2


2. Parents Speak Up National Campaign Evaluation Stakeholders………………….7


3. RTI/Knowledge Networks Studies Involving Adult Respondents Receiving Incentives and Corresponding Response Rates…………………………………...8


4. Description of Sensitive Questions, Justification for Inclusion, and Use of Data...9


5. Total Burden Hours………………………………………………………………10


5a. Total Burden Wages……………………………………………………………..11


6. Annualized Burden Hours, Year 1……………………………………………….11


6a. Annualized Burden Hours, Year 2……………………………………………….12


7. Annualized Cost, Year 1…………………………………………………………12


7a. Annualized Cost, Year 2…………………………………………………………13


8. Logic Model for the Parents Speak Up National Campaign…………………….14


9. Study Hypotheses…………………………………………...……………………15


10. Parents Speak Up National Campaign Evaluation Analyses…………………….16


11. Time Schedule for the Entire Project ……………………………………………17


12. Numbers of Parents………………………………………………………………20


13. Study Design and Experimental Conditions……………………………………..23


14. Pilot Test Responses to Questions About Survey Instrument…………………...24




This document provides a Supporting Statement to accompany a request for approval of collection of information for the Evaluation of the Parents Speak Up National Campaign (PSUNC). This collection was originally entitled the Evaluation of the National Abstinence Media Campaign (NAMC).

A. Justification

This section provides detailed justification for the request for approval of collection of information for the Evaluation of the Parents Speak Up National Campaign.

1. Need and Legal Basis

This program is authorized by Section 301(a) of the Public Health Service Act (42 U.S.C. 241(a), as amended). The Parents Speak Up National Campaign is a $10 million effort to encourage and help parents talk early and often to their pre-teens and teens about waiting to have sex. Funds for the Parents Speak Up National Campaign were made available under the authority provided in Public Law 108-447/ HR 4818-326, Consolidated Appropriations Act, (Appendix A). The campaign will include public service announcement (PSA)-type spots and print advertisements, as well as guide parents to a Web site, 4parents.gov. This Web site provides information to parents of pre-teens and teens on sex, sexual development, and parenting. The campaign’s primary target audience is parents of pre-adolescent and adolescent children.


The evaluation is designed to determine the efficacy of the Parents Speak Up National Campaign’s (PSUNC) public service announcements and their messages. In partnership with Knowledge Networks, an online panel based on a nationally representative sample of the full United States population, a probability sample will be selected of parents (mothers and fathers) of children aged 10 to 14. This statistically representative panel will self-administer the questionnaire at home on personal computers. Parents will be randomly assigned to treatment and control conditions. Specifically, for mothers, the conditions will consist of: (1) no message exposure, (2) exposure to core PSUNC messages, and (3) exposure to an additional set of PSUNC messages. For fathers, there will be a control condition and one treatment condition that will include exposure to all Parents Speak Up National Campaign messages. The research will include 5 data collections using 2 instruments: (1) a baseline self-administered survey of parents of children aged 10 to 14, and (2) a follow-up survey of parents who completed the baseline survey at 4 weeks, 6 months, 12 months, and 18 months post intervention. This submission requests approval for both surveys.


Numerous studies have found that parent-child communication about reproductive health issues is associated with delayed sexual initiation and reduced sexual activity among teens (Clawson & Reese-Weber, 2003; DiIorio, Kelley, & Hockenberry-Eaton, 1999; Dutra, Miller, & Forehand, 1999; Guzman et al., 2003; Holtzman & Robinson, 1995; Hutchinson, Jemmott, Braverman, & Fong, 2003; Jaccard & Dittus, 1991; Jaccard, Dodge, & Dittus, 2002; Karofsky, Zeng, % Kosorok, 2000; Rose, Koo, Bhaskar, Anderson, White & Jenkins, 2005). The Parents Speak Up National Campaign presents a unique opportunity to evaluate the efficacy of a media intervention to promote parent-child communication about waiting to have sex. Indeed, the potential effectiveness of media campaigns in promoting protective factors against health risk behavior is supported by evaluation results from other media campaigns (Bauman, LaPrelle, Brown, Koch, & Padgett, 191; Davis, Nonnemaker, & Farrelly, 2006; DuRant, Wolfson, LaFrance, Balkrishnan, & Altman, 2006; Farrelly, David, Haviland, Messeri, & Healton, 2005; Farrelly, Healton, Davis, Messeri, Hersey, & Haviland, 2002; Flynn et al., 1994; Hornik, 1997; Hornik et al., 2003; Huhman, Potter, Wong, Banspach, Duke, & Heitzler, 2005; Siegal & Biener, 2000; Snyder, Diop-Sidibe, & Badiane, 2003).


2. Information Users

The purpose of the data collection and evaluation is to determine the efficacy of Parents Speak Up National Campaign public service announcements and their messages in achieving desired outcomes, including main effects of exposure to campaign messages on parent-child communication about waiting to have sex; mediating effects of parent characteristics on parent-child communication about sex; and moderating effects of parent and child characteristics on parent-child communication about sex. Changes in the following outcomes will be examined: perceived risks from teen sexual activity, perceived susceptibility, attitudes towards teen sexual activity, self-efficacy to talk to their child, outcome efficacy, perceived value of delayed sexual activity, and parent-child communication about sex. Key research questions for evaluation are presented in Exhibit 1. A copy of the evaluation data collection instrument is attached in Appendix B.

The information obtained from the proposed data collection activities will be used to inform the Office of Population Affairs (OPA), policy makers, parents, prevention practitioners, and researchers about the effects of the campaign messages in a controlled setting to encourage and help parents talk to their pre-teens and teens early and often about waiting to have sex. This information will enable the OPA to more effectively address abstinence education among children. Finally, the data provided from the proposed evaluation may be used for an understanding of the appropriateness for continued or expanded funding and dissemination of the campaign.

Exhibit 1. Evaluation Research Questions

1. What are parents’ knowledge, attitudes, and beliefs (i.e., social cognitions) and behaviors prior to exposure to Parents Speak Up National Campaign messages?

2. What is the change in social cognitions and parent-child communication from one time point to another in absence of exposure to Parents Speak Up National Campaign messages?

3. Does exposure to Parents Speak Up National Campaign messages increase parent-child communication?

4. Does increased exposure to Parents Speak Up National Campaign messages increase parent-child communication?

5. Were the Parents Speak Up National Campaign messages efficacious in producing the desired outcomes on the targeted parent mediator variables, including:

a. Increased perceived risks from teen sexual activity

b. Increased perceived susceptibility

c. Changes in attitudes towards teen sexual activity

d. Increased parent self-efficacy to talk to their child

e. Increased outcome efficacy

f. Increased perceived value of delayed sexual activity

g. Parents Speak Up National Campaign message awareness and receptivity

6. Did the efficacy of the Parents Speak Up National Campaign messages vary based on moderator variables? Potential moderator variables include:

a. Other abstinence promotion activities

b. Social influences (parent-child relationship and interactions, family religiosity, parent perceptions of sexual activity

c. Parents’ other media influences (TV, radio, Internet, magazines)

d. Demographic characteristics (child gender, parent gender, parent education, parent race/ethnicity, parent acculturation, family structure, family income, county type, child age, child puberty status

e. Parent perceptions of child’s participation in school-based sex education

f. Parental involvement

g. Parental monitoring

h. Parent readiness to change

7. Did the campaign messages achieve their effects on parent-child communication about sex by altering the mediating variables listed in #5?



3. Use of Information Technology

The Parents Speak Up National Campaign’s public service announcement efficacy evaluation will rely on Web surveys to be self-administered at home on personal computers. We anticipate a higher response rate using this technology relative to a telephone or mail survey, particularly because our sample of parents enrolled through Knowledge Networks have already agreed to participate in research studies if contacted. Utilization of the Worldwide Web has the advantages of being able to expose treatment condition respondents to Parents Speak Up National Campaign video or audio messages, allowing respondents to complete as much of the survey as desired in one sitting and to continue the survey at another time, minimizing the possibility of respondent error by electronically skipping questions that re not applicable to a particular respondent, and creating the least burden to the respondent. One alternative method considered was to conduct telephone surveys. However, telephone surveys are generally limited to a maximum of about 15 minutes so respondents do not feel imposed upon. The longer a telephone survey continues, the more likely it is that respondents will “drop out” and not fully answer all the questions. In addition, response rates for telephone surveys are decreasing as new technology (answering machines, voice mail, caller identification) becomes available (O’Rourke et al., 1998), and non-locate rates in later waves of longitudinal telephone surveys are increasing, likely due to increased use of cellular phones and frequent switching of carrier companies. We also considered mail surveys. Many mailed surveys are never returned, making the sample self-selective and less random, since there is little control over who completes and returns the survey and who does not. In sum, because of the disadvantages of alternate modes of administration and because our research objectives could not be fully met without a high response rate among selected respondents, we determined that the study design of collecting data via Web surveys was the best methodology.

4. Duplication of Similar Information

The Parents Speak Up National Campaign is a new media campaign. The evaluation is also new and therefore, does not duplicate previous efforts. In designing the proposed data collection activities, we have taken several steps to ensure that this effort does not duplicate ongoing efforts and that no existing data sets would address the proposed study questions. To ensure that this study is forging new ground in our understanding of the efficacy of the Parents Speak Up National Campaign public service announcements, we conducted an extensive review of the literature by examining several large periodical journal databases. We identified published articles or books containing the keywords, “adolescent,” “youth,” “abstinence,” and “parent-child communication.” In addition, to reviewing published information, we searched for “gray” literature by contacting well-known researchers in the field and by exploring the Internet. Searches were performed on several Internet search engines, including Google, Yahoo, AltaVista, Medline, and Science Direct, suing search terms “adolescent,” “youth,” “abstinence,” and “parent-child communication.”

The results of the literature search and consultation with experts in the field revealed that although a fair amount of research has been conducted on parent-child communication about sex, little has been done to evaluate the efficacy of a media campaign like the Parents Speak Up National Campaign. One study evaluated a state-level media campaign to promote parent-child communication about sex, but only post-intervention data were collected, preventing conclusions that the campaign caused increases in parent-child communication (DuRant et al., 2006); the researchers noted that high levels of parent-child communication before the campaign may have contributed to increased campaign awareness among some parents and explained associations between campaign awareness and high levels of parent-child communication after campaign exposure. To date, no duplication of the proposed effort has been identified.

We have carefully reviewed existing data sets to determine whether any of them are sufficiently similar or could be modified to address OPA’s need for information on the efficacy of the Parents Speak Up National Campaign public service announcements with respect to parent-child communication about waiting to have sex. Efforts to avoid duplication include a review of OPA’s administrative agency reporting requirement and of existing studies of OPA’s programs. We investigated the possibility of using existing data to examine our research questions, such as data collected as part of the ongoing evaluation of Title V, Section 510 abstinence education programs (Maynard et al., 2005); evaluations of current and past Prevention program grantees delivering abstinence education programs using OPA funding; state-level and local evaluations of abstinence education efforts; surveys by the National Campaign to Prevent Teen Pregnancy (2003); and the National Survey on Family Growth (Abma, Martinez, Mosher, & Dawson, 2004; Albert et al., 2005). However, none of these existing data included pre-and post-test data in a randomized design to test messages like the ones employed in the Parents Speak Up National Campaign.

5. Small Businesses

No small business will be directly involved in the collection of data in this study.

6. Less Frequent Collection

If this evaluation were not conducted, it would be difficult to determine the value or impact of Parents Speak Up National Campaign public service announcement messages on the lives of the people they are intended to serve. Failure to collect these data could reduce effective use of program resources to benefit parents and children.

The efficacy evaluation involves five data collection points—a baseline and four follow-up surveys. Serious consideration has been given to the issue of how frequently to interview and re-interview parents for the efficacy evaluation. After consulting with OPA and the media contractor, it was determined that the data collection strategy selected would need to be sufficient in number to track and document changes in outcomes between and across individuals before exposure to a time point late enough for campaign message effects to be observed. In addition, parents of children aged 10 to 14 may observe many developmental changes in their children as children enter puberty, begin noticing the opposite sex, experience peer pressure, and begin experiencing opportunities to engage in sexual activity. Thus, it is important to measure parent-child communication about waiting to have sex and related variables at several time points in order to account for changes that may occur because of children’s developmental progression. A measure of potential changes in attitudes, beliefs, or behaviors among parents is necessary within 4 weeks of exposure to initial campaign messages to measure immediate reactions. A subset of treatment group mothers will then be exposed to additional campaign messages in order to detect possible differences between parents with different levels of exposure. Follow-up data collection at 6 months will provide data about subsequent changes in or maintenance of attitudes, beliefs, or behaviors. Continued follow-up data collection at 12 months and 18 months is important to detect possible long-term effects of campaign messages and to assess how effects change or persist as children develop. Less frequent data collection would not allow for measurement of immediate reactions to the campaign messages, differences between parents with different levels of exposure, and long-term effects. Because of concerns about respondent attrition due to possible dropping out of the Knowledge Networks panel, RTI staff determined that the follow-up intervals would need to be narrow enough to enable completion of survey cycles with a given individual over a reasonably short period of time. For these reasons, RTI and OPA agreed to conduct the efficacy evaluation data collection with parents at baseline and at 4 weeks, 6 months, 12 months, and 18 months.

7. Special Circumstances

As described in section A6, respondents will report information more often than quarterly between baseline and the first follow-up assessment (at 4 weeks). A measure of potential changes in attitudes, beliefs, or behaviors among parents is necessary within 4 weeks of exposure to initial campaign messages to measure immediate reactions. Less frequent data collection would not allow for measurement of immediate reactions to the campaign messages. There are no other special circumstances that require data collection to be conducted in a manner inconsistent with 5 CRF 1320.5 (d)(2).


8. Federal Register Notice/Outside Consultation

A 60-day Federal Register Notice was published in the Federal Register on September 6, 2006, in volume 71, number 172, pp. 52545-52546 and provided a 60-day period for public comments (See Appendix C). There were no public comments.

Key Stakeholders were consulted in 2006 regarding the direction of the PSUNC evaluation, including representatives from national organizations in the field of teen pregnancy prevention and abstinence education, as well as researchers from universities and other organizations. RTI staff met with OPA representatives and the media contractor to learn about formative research involving parents, how the Parents Speak Up National Campaign will work in the field, the content and strategy of Parents Speak Up National Campaign messages, and the feasibility of conducting an efficacy evaluation. The information provided from these discussions was extremely helpful in informing RTI staff about the expected reactions among parents who will participate in the study. RTI also received considerable input from OPA and Rosenberg Communications (RCI, the media contractor) and key stakeholders regarding issues they would like addressed as part of the efficacy evaluation. Finally, OPA and RCI staff provided useful information on logistics of campaign message development and expected date of availability for use in the study. This information helped guide the development of both the Parents Speak Up National Campaign public service announcement efficacy evaluation instrument and study design. OPA and RCI reviewed the survey plans, and key stakeholders were consulted throughout the survey design process by telephone. Input and recommendations were incorporated into the survey and questionnaire design to the extent possible. Contact information for the key stakeholders interviewed for this project and the media contractor is provided in Exhibit 2.

RTI staff consulted with respondent surrogates in connection with pre-tests of the survey instruments (as described in Section B.4). Eight Web-based self-administered baseline questionnaires were completed by parents of children aged 10 to 14 to test the feasibility of using our instrument over the Web and to ensure that these surveys could be completed in approximately 20 minutes. Questions were added at the end of each questionnaire to elicit comments on the burden associated with completing the interview, the overall instruments, and specific instrument questions. Refinements to the baseline and follow-up evaluation surveys were made as a direct result of these pretests.

9 Payment/Gift to Respondents

Upon agreeing to be a Knowledge Networks panel member, respondents are given free hardware, free Web access, free e-mail accounts for each panel member, and ongoing technical support. While these products/services are provided to facilitate the data collection methodology, respondents are given free usage of the products for personal use, and these benefits are used as an incentive for recruiting potential panel members. In addition, a 20,000 Knowledge Networks bonus point incentive (equivalent to $20 cash) will be offered to participants who complete the baseline survey and 4-week and 6-month follow-up surveys. An additional 10,000 Knowledge Networks bonus point incentive (equivalent to $10 cash) will be offered to participants who complete the 12-month and 18-month follow-up surveys. Parents are difficult to engage in a survey about this sensitive topic without the use of a small incentive. The incentives are intended to recognize the time burden placed on parents, encourage their cooperation, and to convey appreciation for contributing to this important study. Numerous empirical studies have shown that incentives can significantly increase response rates (e.g., Abreu & Winters, 1999; Shettle & Mooney, 1999). The decision to use incentives for this study is based on several projects conducted by RTI and Knowledge Networks, which found that use of $10 to $20 incentives increased response rates among adults. Exhibit 3 summarizes several such studies and the response rates achieved. Although these studies differ in other respects that could account for some variability in response rates, overall, incentives of at least $5 were generally associated with higher response rates compared with no incentive.













Exhibit 2. Contact Information for Parties Contacted for Outside Consultation

Parents Speak Up National Campaign Evaluation Stakeholders

Sarah Brown Kristin Moore

Director President & Senior Scholar

National Campaign to Prevent Teen Pregnancy Child Trends

(202) 478-8578 (202) 572-6002

[email protected] [email protected]


Angela Griffiths Patricia Sulak

Executive Director Professor, OB/Gyn

Await & Find Scott and White Hospital

(510) 690-0137 (254) 724-4034

[email protected] [email protected]

Stacy Ladd Jeff Tanner

Former Director of an Abstinence Associate Dean, Professor of Marketing

Education Program Baylor University

(254) 724-7359 (254) 710-3485

[email protected] [email protected]

Bruce LongFox Leslee Unruh

Executive Director Founder & President

Rural America Initiatives National Abstinence Clearinghouse

(605) 341-3339 (605) 335-3643

[email protected] [email protected]

Rebecca Maynard Stan Weed

Professor, Graduate School of Education Director

University of Pennsylvania Institute for Research and Evaluation

(215) 898-3558 (801) 966-5644

[email protected] [email protected]

Parents Speak Up National Campaign Media Contractor Staff

Jeff Rosenberg

President

Rosenberg Communications

(301) 545-1141

[email protected]












Exhibit 3. RTI/Knowledge Networks Studies Involving Adult Respondents Receiving Incentives and Corresponding Response Rates

Study

Population

Incentive Provided

Response Rate Achieved

National Longitudinal Transition Study 2

Parents and teens aged 13 to 16, in at least 7th grade, and receiving special education as of December 1, 2000 (Wave 1)

Teens aged 15 to 18 (Wave 2)

Teens aged 17 to 20 (Wave 3)

$20 for parents for each wave

$20 for teens for each wave

70% (Waves 1-3):

Overall “family” response rate (meaning that an interview was completed with either a parent or a youth within 70% of the households)

Evaluation of Media Campaign Survey

California residents aged 18-55

$5 to $25

78%

The University of California Irving Stress and Trauma Study (2001-2004)

Adult panelists and teens (13-17 with parental approval)

$10 initial incentive Pool A, $10 initial incentive + $10 completion incentive Pool B

83%: Pool A

79%: Pool B



The use of modest incentives is expected to enhance survey response rates without biasing responses or coercing respondents to participate. A smaller incentive would not appear sufficiently attractive to parents. We also believe that the incentives will result in higher data validity as parents become more engaged in the survey process. The amount of the incentives was determined through discussions with RTI staff with expertise in conducting parent surveys about parent-child communication. All respondents are given free hardware, free Web access, free e-mail accounts, and ongoing technical support as pre-incentives by Knowledge Networks. Because all selected individuals may not be eligible for the study, we want to assure sufficient project spending and only provide bonus point incentives to respondents after they are determined to be eligible.

10 Confidentiality

All procedures have been developed, in accordance with federal, state, and local guidelines, to ensure that the rights, privacy, and confidentiality of parents are protected and maintained. The RTI Institutional Review Board (IRB) reviewed all instruments, informed consent materials, and procedures to ensure that the rights of individuals participating in the study are safeguarded. A copy of the RTI IRB approval notice is included as Appendix D. A pilot test of these procedures was conducted, and no problems were identified (see Section B.4 for a summary of the pilot test).

All respondents will be assured that the information they provide is confidential and will be used only for the purpose of this research. A copy of the assurance of confidentiality provided in writing to respondents is provided in Appendix E. Respondents will be assured that their answers will not be shared with family members and that their names will not be reported with responses provided. Respondents will be told that the information obtained from all of the surveys will be combined into a summary report so that details of individual questionnaires cannot be linked to a specific participant.

To ensure data security, all RTI and Knowledge Networks project staff are required to adhere to strict standards and to sign an oath of confidentiality as a condition of employment on this project. RTI maintains restricted access to all data preparation areas (i.e., receipt and coding). All data files on multi-user systems will be under the control of a database manager, with access limited to project staff on a “need-to-know” basis only. Knowledge Networks has developed a secure transmission and collection protocol, including the use of system passwords, and two separate sets of firewalls to prevent unauthorized access to the system. Neither questionnaires nor survey responses are stored onto the WebTV box; questionnaires are administered dynamically over the Internet. Survey responses are written in real-time directly to Knowledge Networks’ server and are then stored in a local Oracle database. The database is protected primarily through firewall restrictions, password protection, and 128-bit encryption technology. Individual identifying information will be maintained separately from completed questionnaires and from computerized data files used for analysis. A detailed description of additional Knowledge Networks privacy and confidentiality procedures is attached in Appendix F. No respondent identifiers will be contained in reports to the OPA and results will only present data in aggregate.



11. Sensitive Questions

The major focus of the Parents Speak Up National Campaign is to promote parent-child communication about waiting to have sex. Campaign advertisements and other materials cover issues around adolescent sexual activity and the benefits of waiting to have sex. Thus, some questions included in the efficacy evaluation instrument might be considered sensitive by some respondents. Exhibit 4 identifies the sensitive questions, explains the justification for their inclusion in the surveys, and describes how the data will be used. The informed consent protocol apprises respondents that these topics will be covered during the interview. These questions are included in the surveys because of their importance in understanding parent attitudes about teen sexual activity and the potential moderating effect of parents’ perceptions of their children’s prior sexual activity on the main effect of the Parents Speak Up National Campaign on parent- child communication about waiting to have sex. As with all information collected, these data will be presented with all identifiers removed.

Exhibit 4. Description of Sensitive Questions, Justification for Inclusion, and Use of Data

Description of Questions

Justification for Inclusion

Use of Data

How parents define sex

Necessary to accurately measure parent attitudes about teen sexual activity as potential mediators of the effect of the Parents Speak Up National Campaign on parent-child communication about waiting to have sex

Used to test possible moderated mediation for multivariate analysis comparing parents in control and treatment conditions (do parent attitudes about teen sexual activity mediate main effects of the Parents Speak Up National Campaign, and do parent definitions of sex moderate this mediating effect?)

Parent perception of child’s previous sexual activity

Necessary to determine whether parents with children perceived as already sexually active are equally or less likely to benefit from the Parents Speak Up National Campaign than those with children perceived as not sexually active

Used as moderating variable for multivariate analysis to assess interaction between exposure to the Parents Speak Up National Campaign and parent perceptions of child’s previous sexual activity as a significant predictor of parent-child communication about waiting to have sex

* To protect the identity of the child who has not consented to participate in the survey, RTI will not receive identifying information about parents and will only ask for the child’s first name. No information about parent names, addresses, or phone numbers, or children’s last names, will be collected.


12. Estimated Annualized Burden Hours

The average annual response burden is estimated at 1,746.75 hours. Exhibit 5 provides details about how this estimate was calculated. Year 1 response burden is estimated at 3094 hours. Year 2 response burden is estimated at 399.5 hours. The average annual response burden was calculated by summing these two annual estimates and dividing by two [(3094+399.5)/2]. PSUNC survey respondents will be comprised of a nationally representative panel of parents of children aged 10 to 14. The Web self-administered surveys will be designed to maximize ease of response (at home on personal computers) and thus decrease respondent burden.

Exhibit 5. Total Estimated Annualized Burden Hours: Years 1 & 2

Form Name

Number of Respondents

Responses/ Respondent

Hours/
Response

Total Response Burden (Hours)

Baseline parent survey

1,895*

1

.5

947.5

4-week parent follow-up survey

1,806*

1

.5

903

6-month parent follow-up survey

1,421*

1

.5

710.5

12-month parent follow-up survey

1,066*

1

.5

533

18-month parent follow-up survey

799*

1

.5

399.5

TOTAL

6,987



3493.5

*A subset of the original 1,895 baseline respondents.

12B. Estimated Annualized Cost to Respondents

The estimated annualized cost burden to respondents is $10,480.50. Respondents participate on a purely voluntary basis and, therefore, are subject to no direct costs other than time to participate; there are no start-up or maintenance costs.

Timings were conducted during our pilot test procedures to determine the overall burden per respondent. Web data collection is expected to take 30 minutes per respondent. We will complete 6,188 questionnaires (3,094 hours total) in year 1 and 799 questionnaires (399.5 hours total) in year 2. Because it is not known what the wage rate category will be for these selected parents (or even whether they will be employed at all), the figure of $6.00 per hour was used as an estimate of average minimum wage across the country. The estimated annual cost to parents for the hour burdens for collections of information will be $18,564 for Year 1 and $2397 for year 2. The average annual response burden was calculated by summing these two annual estimated and dividing by two. [($18,564+$2397)/2]. (See Exhibit 6).

Exhibit 6. Total Cost to Respondents: Years 1 & 2

Type of Respondent

Total Burden Hours

Hourly Wage Rate

Total Respondent Costs

Knowledge Networks panel member; Parent (or parent surrogate)

3493.5

$6.00**

$20,961

**Estimates of average hourly living allowance for participants



13. Capital Costs (Maintenance of Capital Costs)

There are no capital costs associated with this study.

14. Cost to Federal Government

With the expected extended period of performance, the cost estimate for the completion of this contract will be $1,328,289 over 2 years. This total cost covers all PSUNC evaluation activities and includes information collection and other evaluation tasks not included in this OMB application. This is the cost estimated by the contractor, RTI International, and includes the estimated cost of coordination with the OPA and the media contractor; evaluation plan development; collecting and reviewing relevant documents, existing data, and information from key stakeholders; instrument development and testing; RTI IRB and OMB applications; data collection; analysis; reporting; and progress reporting. Annual cost to the federal government is estimated to be $664,144.50 ($1,328,289/2).


15. Program or Burden Changes


There are no changes in burden requested, as this is a new information collection.


16. Publication and Tabulation Dates


Our analyses will consist of two phases: (1) preliminary analyses of baseline data and (2) longitudinal analyses that include multiple waves of survey data. The preliminary analyses will begin once baseline data are available and will consist of descriptive statistics (frequencies, crosstabs, t-tests, and Chi-squares) to examine the sample characteristics, explore the potential for inferential analyses, and test for potential between-group differences. This will include single time point tests of association between hypothesized independent, mediating, moderating, and dependent variables (as conceptualized in Exhibit 8). These analyses will also be conducted for the purposes of examining the psychometric properties of the data, with the intention of developing reliable scales that accurately capture precursor social cognitions that we presume to be influenced by the campaign. Structural equation modeling (SEM) will be used to test for differences between treatment and control groups at baseline on demographics, mediators, and parent-child communication. We will also use SEM to evaluate the multivariate relationships of baseline demographics, mediators, and parent-child communication to attrition from baseline to follow-up. Variables found to differ between follow-up survey responders and nonresponders will be addressed by controlling through multivariate analysis for variables contributing to attrition.



Exhibit 8. Logic Model for the Evaluation of the Parents Speak Up National Campaign




Once baseline and first follow-up data are available, we will begin to develop preliminary models that assess the association between exposure conditions and downstream mediators (social cognitions) and outcomes (parent-child communication). These models will include repeated measurements (merged baseline and first follow-up data) on respondents within each experimental condition and will be estimated using a combination of linear and logistic regression methods. For example, our hypothesis that exposure to the Parents Speak Up National Campaign increases parents’ knowledge of the campaign message (see Exhibit 9) will be tested in a regression model where a measure of the campaign message is specified as the dependent variable and the exposure condition is specified as the primary independent variable. The results of these types of models will also provide information on measures that should be included as covariates (controls) in the fuller models that incorporate all three waves of survey data. In addition to multivariable regressions, analyses of baseline and first follow-up data will include the use of structural equation models (SEM) to calculate the pathways among Parents Speak Up National Campaign exposure conditions, mediating variables, moderating variables, and parent outcomes.


Once data collection is complete (baseline and follow-ups 1-4), we will develop a multiple group longitudinal growth model (LGM) that will allow us to explicitly test the effects of each exposure condition on primary outcome variables. This modeling technique represents the state-of-the-art in the modeling of longitudinal data (Muthen & Curran, 1997; Willett & Sayer, 1994) and will allow us to model changes in social cognitions (attitudes, beliefs, intentions) and behaviors. The key feature of LGM is the estimation of variability in the trajectories of these variables, allowing us to answer a number of important questions derived from our study hypotheses presented in Exhibit 9.



Exhibit 9. Study Hypotheses

The primary study hypotheses concern the effects of the campaign on short-term, attitudinal outcomes and on parent-child communication:


  • Exposure to the campaign messages increases parents’ knowledge of the message that they should talk early and often to their children about waiting to have sexual activity;

  • Parents will have positive message receptivity to the campaign messages, including positive reactions to specific messages and advertising executions, and will adopt the Parents Speak Up National Campaign brand;

  • Parents exposed to a higher “dose” of campaign messages will experience greater effects on knowledge, attitudes, beliefs and parent-child communication behavior than those with a lower dose, or no dose of the campaign;

  • Exposure to campaign messages improves parents’ knowledge, attitudes, and beliefs related to talking early and often to their pre-adolescent children about waiting to initiate sexual activity, including self-efficacy and outcome efficacy;

  • Exposure to campaign messages is associated with increased parent-child communication about sexual activity;

  • Exposure to campaign messages is associated with increased parental use of the 4parents.gov Website;


Additionally, Exhibit 8 identifies several secondary hypotheses, which represent relationships between mediating and moderating variables in the model, and the interaction between these variables, PSUNC exposure, and parent-child communication:


  • Increased knowledge and improved attitudes and beliefs are associated with increased parent-child communication about sexual activity;

  • Knowledge, attitudes and beliefs about parent-child communication mediate the relationship between campaign exposure and parent-child communication;

  • Social environmental, child, and parental characteristics moderate the relationship between campaign exposure and parent-child communication.


The overall goal of these models is therefore to determine the extent to which changes in social cognitions and parent-child communication differ by campaign exposure conditions. Intervention effects will be tested as deviations from the normative trend over time (i.e., the change among parents in the non-exposure condition) in beliefs, attitudes, and behaviors that may be affected by exposure to the Parents Speak Up National Campaign. Exhibit 10 summarizes each of our planned analyses using baseline, follow-up data.

Exhibit 10. PSUNC Evaluation Analyses

Time

Research Question/Hypothesis

Methods

Baseline

What are the sample characteristics of study participants?

Frequencies

How are mediating/moderating variables associated with presumed outcomes?

Crosstabulations


How are mediating and moderating variables correlated?

What are the psychometric properties of the survey data?

Exploratory and confirmatory factor analyses

What are the differences between treatment and control groups at baseline?

Structural equation models (SEM)




Baseline & Follow-up 1

What is the relationship between exposure conditions and mediating variables (social cognitions)?

Multivariable regressions



What is the relationship between mediating variables and parent-child communication?

What is the relationship between exposure conditions and parent-child communication, controlling for moderating variables?

What are the pathways among exposure conditions, mediators, and outcomes

Structural Equation Models (SEM)

What variables are linked to attrition?




Baseline through Time 4

What is the change in social cognitions and parent-child communication from one time point to another in the absence of exposure to Parents Speak Up National Campaign messages?

Longitudinal Growth Model (LGM)



Does exposure to Parents Speak Up National Campaign messages increase parent-child communication?

Does increased exposure to Parents Speak Up National Campaign messages increase parent-child communication?

What variables are linked to attrition?



As the evaluation questions and hypotheses are addressed, the findings will be summarized and shared with OPA and OPA-identified stakeholders for comment and interpretation. For this study, we expect the findings to be disseminated to a number of audiences. Therefore, the evaluation reports will be written in a way that emphasizes scientific rigor for more technical audiences but are also intuitive, easily understood, and relevant to less technical audiences. The reporting and dissemination mechanism will consist of three primary components: (1) a brief mid-study report that includes preliminary analyses, (2) a final evaluation report, and (3) peer-reviewed journal articles. RTI will prepare a brief mid-study report. This report will include summary data from the baseline and follow-up data collections, with preliminary findings from cross-tabulations, multivariable regression models, and exploratory and confirmatory factor analyses. This report will also include preliminary data on parents’ cognitive reactions to specific Parents Speak Up National Campaign public service announcement messages. The final evaluation report will be the central focus of dissemination efforts and will be written in clear language that is understandable by a wide range of audiences (parent, practitioners, policy makers, researchers). This evaluation report will include a 10-page summary, a report of less than 100 pages (including an overview of background literature to provide contextual information about the purpose of the campaign and evaluation approach, a detailed summary of evaluation methods and activities; the evaluation results; discussion of findings in comparison with those of other relevant program evaluations; strengths and limitations of the evaluation; and recommendations for future evaluations of this scope for practitioners, evaluators, and policy makers), and appendices. The results of our study also will be used to develop at least one peer-reviewed journal article (e.g., American Journal of Public Health, Perspectives on Sexual and Reproductive Health, or Journal of Health Communication) that summarizes findings on the overall efficacy of the Parents Speak Up National Campaign public service announcements.


The key events and reports to be prepared are listed Exhibit 11.

Exhibit 11. Time Schedule for the Entire Project

Project Activity

Date*

Start date

September 30, 2005

Develop project plan and schedule

November, 2005

Design instruments

May 2006

Pilot test instruments

August 2006

Main study data collection preparation activities

February 2007

Baseline survey

April 2007

4-week follow-up survey

May 2007

6-month follow-up survey

October 2007

Analysis of initial data set

February 2008

Submit mid-study report

April 2008

12-month follow-up survey

April 2008

18-month follow-up survey

October 2008

Analysis of final data set

February 2009

Submit final report

April 2009

Submit at least one manuscript

April 2009


*Dates are based on the expected 3-year period of performance



17. Expiration Date


The OMB expiration date will be displayed on all data collection instruments.


18. Certification Statement


There are no exceptions to the certification.


B. Collection of Information Employing Statistical Methods

1. Respondent Universe and Sampling Methods

This study will include approximately 1,895 adult parents in the national Knowledge Networks panel. Parents of children aged of 10 and 14 were chosen as the target audience for the campaign and evaluation because focus groups conducted by the media contractor indicated that both parents and teens felt that the teen years were too late for parents to begin communicating with their children about waiting to have sex.


The current Knowledge Networks panel consists of approximately 40,000 adults actively participating in research. The Web-enabled panel tracks closely to the U.S. population in terms of age, race, Hispanic ethnicity, geographical region, employment status, and other demographic elements. The differences that do exist are small and are corrected statistically in survey data (i.e., by non-response adjustments). The Knowledge Networks panel is recruited through random-digit-dialing (RDD) and is comprised of both Internet and non-Internet households. The Knowledge Networks Web-enabled panel is also the only available method for conducting Internet-based survey research with a nationally representative probability sample (Couper, 2000; Krotki and Dennis, 2001). From the overall Knowledge Networks panel, we will select the sample of 1,895 participants for our study using probability methods that will include appropriate sample design weights, based on specific parameters of sample composition. To further reduce the effects of non-sampling error, non-response and post-stratification weighting adjustments are applied to the sample. A total off 1,137 of the participants will be mothers, and 758 will be fathers.


Mothers will be randomly assigned to one of three experimental conditions: high exposure to Parents Speak Up National Campaign (PSUNC) public service announcement messages, normal exposure, and no exposure. Fathers will be randomly assigned to one of two experimental conditions: high exposure or no exposure. Parent gender has received considerable attention as a predictor of parent-child communication about sex; although there are some exceptions, studies have tended to find that mothers are more likely than fathers to engage in discussions about sex with their children (for example, Jaccard & Dittus, 1991; DiIorio, Kelley, & Hockenberry-Eaton, 1999; Fisher, 1993; Raffaelli, Bogenschneider, & Flood, 1998; Rosenthal & Feldman, 1999). Thus, we are interested in exploring a potential dose-response relationship between no exposure and normal exposure and between normal exposure and high exposure conditions among mothers. However, there is evidence that father-based variables account for unique variance in teen behavior independent of mother-based variables (Dittus, Jaccard, & Gordon, 1997), although there is no literature that reports specific intervention effects on father-child communication. Thus, we will include fathers in the efficacy evaluation of the Parents Speak Up National Campaign public service announcements, but consider this an exploratory analysis, comparing fathers with high levels of exposure to campaign messages to those with no exposure in order to maximize the chances of detecting differences in parent-child communication among these two groups.


We conducted power analyses to determine the optimal sample size for detecting statistically significant differences between treatment and control groups. Since fathers and mothers are expected to behave differently in terms of parent-child communication and possibly in terms of response rates to the surveys, they will be assessed separately. Because no published data are available about expected baseline and follow-up rates of father-child communication or survey response, power calculations are based on data to be collected from mothers. The frequency with which parents report they have spoken to their children about sex serves as the primary outcome measure, and responses will be dichotomized as “often” versus “not often” (“sometimes,” “seldom,” or “never”) for the purposes of power calculations. Power calculations were based on the comparison between the high exposure and no exposure groups. Several assumptions were made concerning population parameters for power analyses. First, we assumed a 0.7 correlation coefficient between outcomes measured at baseline and 18-month follow-up for the same respondent. Although there is little definitive information about the true correlation over 18 months, there is some evidence from studies of parent involvement n other teen risk behaviors that such correlation is no stronger than we assume here (Wills, Sandy, Yeager, & Shinar, 2001). Second, because mothers will be sampled separately from fathers, we assume that all outcomes between different respondents will be uncorrelated. Third, it was assumed that 16% of mothers will report communicating often with their child about waiting to have sex at baseline and that 22% of mothers will report this at 18-month follow-up, as reported by Klein et al. (2005). Each of these assumptions is very conservative, resulting in increased sample sizes for our evaluation. Our assumption of a change from 16% of mothers communicating often to 22% of mothers doing so at 18-month follow up safeguards for the possibility that the Parents Speak Up National Campaign public service announcement messages may produce very small effects at either 4 weeks, 6 months, or 12 months.


In contrast, Klein et al. (2005) produced much larger effects at 10 weeks. However, our assumption allows us to include enough subjects in our evaluation to detect small effects, and making a less conservative assumption would create the possibility that the Parents Speak Up National Campaign public service announcement messages are efficacious but that our sample sizes were not large enough to detect this. All decisions about assumptions that guided our power analysis were intended to err in favor of a larger sample size to safeguard for the possibility of a worst case scenario in terms of difficulty detecting effects. These assumptions increased out confidence that smaller effects produced by the messages than those found by previous prevention programs would be reasonably detected using the sample sizes we identified.


To achieve 0.80 power, we will need a total of 1,500 mothers (500 high exposure group, 500 normal exposure group, and 500 control group) and 1,000 fathers (500 high exposure group and 500 control group). The numbers of parents in the respondent universe and in each sample are shown in Exhibit 12. The expected response rates at the 18-month follow-up include parents who may refuse to participate in the follow-up data collection.


Exhibit 12. Numbers of Parents

Numbers and Response Rates

High Exposure Mothers

Normal Exposure Mothers

Control Mothers

High Exposure Fathers

Control Fathers

Total

Number of subjects to be contacted at baseline

500

500

500

500

500

2,500

Expected response rate at baseline

76%

76%

76%

76%

76%


Number of completed baseline surveys

379

379

379

379

379

1,895

Expected response rate at 4-week follow-up

95%

95%

95%

95%

95%


Number of completed r-week follow-up surveys

362

362

362

362

362

1,810*

Expected response rate at 6-month follow-up

79%

79%

79%

79%

79%


Number of completed 6-month follow-up surveys

285

285

285

285

285

1,425*

Expected 12-month follow-up

75%

75%

75%

75%

75%


Number of completed 12-month follow-up

214

214

214

214

214

1,070*

Expected response rate at 18-month follow-up

75%

75%

75%

75%

75%


Number of completed 18-month follow-up surveys

160

160

160

160

160

800*

*A subset of the original 1,895 baseline respondents.


2. Procedures for the Collection of Information

In partnership with Knowledge Networks, a probability sample will be selected of 1,895 parents or parent surrogates (e.g., stepmother, grandfather, foster parent, etc.) (1,137 mothers and 758 fathers) of children aged 10-14. When the efficacy study is assigned to the sampled panel members, they will receive notice in their password-protected e-mail account that the survey is available for completion. Nonrespondents will receive two e-mail reminders from Knowledge Networks requesting their participation in the survey. Copies of the e-mail notifications are in Appendix G. The surveys will be self-administered and accessible any time of day for a designated period. Participants can complete the survey only once. Mothers and fathers will be selected separately to avoid biasing the sample, and male and female participant screeners will be used to determine study eligibility. Eligible participants include English-speaking parents or parent surrogates of children aged 10-14. Informed consent will be sought from parents for participation in the Web survey. A copy of the consent form is in Appendix E. Parents will consent by selecting the appropriate link on the Web screen. Members may leave the panel at any time, and receipt of the Web TV and Internet service is not contingent on completion of the study.

Parents will self-administer a 24-minute questionnaire at home on personal computers. Subsequent to the baseline data collection, mothers participating in the study will initially be randomly assigned to 2 conditions: (1) mo media exposure; and (2) exposure to core Parents Speak Up National Campaign messages. Following this random assignment, participants that were assigned to the exposure condition will log into the Knowledge Networks system and view campaign stimuli via multimedia components. A 20,000 Knowledge Networks bonus point incentive (equivalent to $20 cash) will be offered to participants who complete the baseline survey and 4-week follow-up survey. Following the 4-week follow-up assessment, mothers assigned to campaign exposure will be further assigned at random to either exposure to an additional set of Parents Speak Up National Campaign messages or to receive no additional exposure, effectively creating three conditions of high, normal, and no exposure among mothers over the course of the study. Data collection and exposure for fathers participating in the study will accomplished in a similar manner, except that fathers participating in the study will be assigned to two conditions: (1) no media exposure; and (2) exposure to all Parents Speak Up National Campaign messages.


Knowledge Networks’ technology will allow us to track the number of times each participant views the assigned stimuli during specific time periods, allowing us to validate the fidelity of experimental implementation. Three additional follow-up data collections will be conducted approximately 6, 12, and 18 months after baseline (as shown in Exhibit 13). A 20,000 Knowledge Networks bonus point incentive (equivalent to $20 cash) will be offered to participants who complete the 6-month follow-up survey and an additional 10,000 Knowledge Networks bonus point incentive (equivalent to $10 cash) will be offered to participants who complete the 12-month and 18-month surveys. Parents are difficult to engage in a survey about this sensitive topic without the use of a small incentive. The incentive is intended to recognize the time burden placed on them, encourage their cooperation, and to convey appreciation for contributing to this important study over five data collection periods. A detailed description of Knowledge Networks’ panel recruitment methodology is in Appendix H.



3. Methods to Maximize Response Rates and Deal with Nonresponse

The following procedures were used to maximize cooperation and to achieve the desired high response rates:

  • Recruitment through Knowledge Networks for some respondents averaging 70-75% response rate for the web-enabled panel.

  • Knowledge Networks bonus point incentive in the amount of 20,000 (equivalent to $20 cash) will be offered to participants who complete the baseline survey and 4-week and 6-month follow-up surveys. An additional 10,000 Knowledge Networks bonus point incentive (equivalent to $10 cash) will be offered to participants who complete the 12-month and 18-month surveys.

  • An attempt will be made to locate participants who leave the Knowledge Networks panel before the end of the efficacy study. Location efforts will include mailings of refusal conversion materials designed to persuade participants to complete the study. In addition to using mailed refusal conversion materials, Knowledge Networks will also conduct telephone-based refusal conversion, contacting each attriting participant via telephone.

  • Knowledge Networks will provide a toll-free telephone number to all sampled individuals and invite them to call with any questions or concerns about any aspect of the study.

  • Knowledge Networks data collection staff will work with RTI project staff to address concerns that may arise.


Exhibit 13. Study Design and Experimental Conditions

4. Tests of Procedures or Methods to be Undertaken

Knowledge Networks implemented an 8-case pilot test of the survey instrument prior to administration of the baseline survey. The purpose of the pilot test was twofold: (1) to assess technical aspects and functionality of the survey instrument and (2) to identify areas of the survey that were either unclear or difficult to understand.

Pilot test data collection was conducted during July 2006. Eligible participants came from a convenience sample of Knowledge Networks panel members who are parents or parent surrogates (e.g., stepmother, grandfather, foster parent, etc.) of children aged 10 to 12. This nationally representative panel of parents self-administered the baseline Web survey at home on personal computers. To obtain 8 completed questionnaires, Knowledge Networks invited a total of 14 panelists to participate in the pilot test. Parents selected for the study received an e-mail message from Knowledge Networks alerting them that they had a survey assignment. Nonrespondents received two e-mail reminders from Knowledge Networks requesting their participation in the survey. Mothers and fathers were selected separately and participant screeners were used to determine study eligibility. Participants were administered the core efficacy study survey instrument, including questions regarding parent-child communication, attitudes and beliefs, perceptions of child sexual activity, parental involvement and monitoring, and demographics.

Nine parents were contacted by e-mail. After two e-mail reminders from Knowledge Networks, a new parent was included in the sample, resulting in a total of 14 parents contacted. Among those invited, 1 parent was found to be ineligible and 8 parent surveys were completed for a 57% response rate.

In addition to the core questionnaire items from the Parents Speak Up National Campaign public service announcement survey, the pilot test instrument included additional items to assess the participants comfort level in answering the questions, the level of seriousness of their answers, their honesty level, length of the survey, the overall instrument, and specific instrument questions regarding their responses to the main survey items. Responses to these questions generally suggest that pilot test participants were comfortable answering each question, understood the survey, and were honest in providing their answers. A summary of findings from these questionnaire items is provided in Exhibit 14.

Exhibit 14. Pilot Test Responses to Questions About Survey Instrument

Pilot Test Item

Frequency

Response

Were there any questions that you did not feel comfortable answering?

8

No

How seriously did you answer the questions on this survey?

8

Very Seriously

How honestly did you answer the questions on this survey?

8

Very Honestly

What did you think about the length of the survey?

8

About right

Were there any questions that you didn’t understand?

1

7

Yes

No

How comfortable did you feel answering questions on this survey?

5

1

2

Very uncomfortable

Somewhat uncomfortable

Somewhat comfortable



Analyses of the pilot test data also indicated there were no significant technical problems with the survey instrument. No questions had unexplained missing data, there were no outlier values, all response options were labeled correctly, and all skip patterns appeared to function correctly. Our findings suggest that there were no logic or non-response problems with the survey, respondents were routed appropriately through the survey based on answers given to each question, and the data were accurately recorded. We also separately analyzed each question that included options for verbatim responses as a check for whether the specified list of response options in the survey adequately covered all of the potential responses that a participant could give. Analysis of verbatim response data indicated that verbatim response were generally not necessary as participants provided responses already available in the pre-coded list specified in the survey.

The pilot test also included a respondent debriefing of two participants, aimed at illuminating participants’ though processes and further identifying areas of the survey that were either unclear or difficult to understand. Debriefings were conducted in August 2006. A copy of the debriefing form is attached in Appendix I. Two participant debriefings were conducted via telephone after completion of the pilot test. The pilot test instrument contained two questions to assess whether participants would be willing to participate in a follow-up telephone debriefing. Pilot participants who indicated willingness to participate in the telephone follow-up were also asked to indicate days and times that they preferred to conduct the telephone debriefing. Knowledge Networks then contacted these participants, via telephone, to arrange an appointment for conducting the telephone debriefing. Two eligible participants were identified and interviewed for the telephone follow-up. The telephone debriefing consisted of a brief series of questions about the participants’ impressions of the survey in terms of its ease of use, the sensitivity of the questions, its length, and any aspects of the survey that were difficult to understand.

The post-survey participant debriefings also indicated relatively few problems with the survey. Both debrief participants indicated that the survey was easily understood and did not contain any words or phrases that were unfamiliar to them. Each respondent also indicated that the survey instructions were always clear and there were never doubts about what to do in order to proceed through the survey. Neither of the debrief participants had any pre-formed thoughts about what type of organization or group was funding the survey. Each respondent also indicated that the survey was not overly long or burdensome and neither participant felt uncomfortable answering any of the questions (i.e., none of the survey questions were too sensitive for them).

Based on the findings of the pilot test, the survey appears to function as intended and is not overly burdensome, sensitive, or difficult to understand. Therefore, no substantive revisions were made to the survey instrument as a result of pilot testing.

5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data

The agency official responsible for receiving and approving contract deliverables is:

Leslie Raneri

240-453-2813

[email protected]

Office of Population Affairs/DHHS

1101 Wotton Parkway, Suite 700

Rockville, MD 20852


The person who designed the data collection is:

W. Douglas Evans, Ph.D.

202-728-2058

[email protected]

RTI International

701 13th Street NW, Suite 750

Washington, DC 20015


The person who will collect the data is:

J. Michael Dennis, Ph.D.

650-289-2000

[email protected]

Knowledge Networks, Inc.

1350 Willow Road, Suite 102

Menlo Park, CA 94025


The person who will analyze the data is:

Jeremy Aldworth, Ph.D.

919-541-6626

[email protected]

RTI International

3040 Cornwallis Road

Research Triangle Park, NC 27709



Appendix A


Public Law 108-447/ HR 4818-326, Consolidated Appropriations Act, 2005

PL 108-447/ H. R. 4818—326


CHILDREN AND FAMILIES SERVICES PROGRAMS


For carrying out, except as otherwise provided, the Runaway and Homeless Youth Act, the Developmental Disabilities Assistance and Bill of Rights Act, the Head Start Act, the Child Abuse Prevention and Treatment Act, sections 310 and 316 of the Family Violence Prevention and Services Act, as amended, the Native American Programs Act of 1974, title II of Public Law 95–266 (adoption opportunities), the Adoption and Safe Families Act of 1997 (Public Law 105–89), sections 1201 and 1211 of the Children’s Health Act of 2000, the Abandoned Infants Assistance Act of 1988, sections 261 and 291 of the Help America Vote Act of 2002, the Early Learning Opportunities Act, part B(1) of title IV and sections 413, 429A, 1110, and 1115 of the Social Security Act, and sections 40155, 40211, and 40241 of Public Law 103–322; for making payments under the Community Services Block Grant Act, sections 439(h), 473A, and 477(i) of the Social Security Act, and title IV of Public Law 105–285, and for necessary administrative expenses to carry out said Acts and titles I, IV, V, X, XI, XIV, XVI, and XX of the Social Security Act, the Act of July 5, 1960 (24 U.S.C. ch. 9), the Omnibus Budget Reconciliation Act of 1981, title IV of the Immigration and Nationality Act, section 501 of the Refugee Education Assistance Act of 1980, sections 40155, 40211, and 40241 of Public Law 103–322, and section 126 and titles IV and V of Public Law 100–485, $9,069,853,000, of which $32,103,000, to remain available until September 30, 2006, shall be for grants to States for adoption incentive payments, as authorized by section 473A of title IV of the Social Security Act (42 U.S.C. 670–679) and may be made for adoptions completed before September 30, 2005: Provided further, That $6,898,580,000 shall be for making payments under the Head Start Act, of which $1,400,000,000 shall become available October 1, 2005 and remain available through September 30, 2006: Provided further, That $732,385,000 shall be for making payments under the Community Services Block Grant Act: Provided further, That not less than $7,300,000 shall be for section 680(3)(B) of the Community Services Block Grant Act, Provided further, That within amounts provided herein for abstinence education for adolescents, up to $10,000,000 may be available for a national abstinence education campaign: Provided further, That in addition to amounts provided herein, $6,000,000 shall be available from amounts available under section 241 of the Public Health Service Act to carry out the provisions of section 1110 of the Social Security Act: Provided further, That to the extent Community Services Block Grant funds are distributed as grant funds by a State to an eligible entity as provided under the Act, and have not been expended by such entity, they shall remain with such entity for carryover into the next fiscal year for expenditure by such entity consistent with program purposes: Provided further, That the Secretary shall establish procedures regarding the disposition of intangible property which permits grant funds, or intangible assets acquired with funds authorized under section 680 of the Community Services Block Grant Act, as amended, to become the sole property of such grantees after a period of not more than 12 years after the end of the grant for purposes and uses consistent with the original grant: Provided further, That funds appropriated for section 680(a)(2) of the Community Services Block Grant Act, as amended, shall be available for financing construction and rehabilitation and loans or investments in private business enterprises owned by community development corporations: Provided further, That $55,000,000 is for a compassion capital fund to provide grants to charitable organizations to emulate model social service programs and to encourage research on the best practices of social service organizations: Provided further, That $15,000,000 shall be for activities authorized by the Help America Vote Act of 2002, of which $10,000,000 shall be for payments to States to promote access for voters with disabilities, and of which $5,000,000 shall be for payments to States for protection and advocacy systems for voters with disabilities: Provided further, That $100,000,000 shall be for making competitive grants to provide abstinence education (as defined by section 510(b)(2) of the Social Security Act) to adolescents, and for Federal costs of administering the grant: Provided further, That grants under the immediately preceding proviso shall be made only to public and private entities which agree that, with respect to an adolescent to whom the entities provide abstinence education under such grant, the entities will not provide to that adolescent any other education regarding sexual conduct, except that, in the case of an entity expressly required by law to provide health information or services the adolescent shall not be precluded from seeking health information or services from the entity in a different setting than the setting in which abstinence education was provided: Provided further, That in addition to amounts provided herein for abstinence education for adolescents, $4,500,000 shall be available from amounts available under section 241 of the Public Health Services Act to carry out evaluations (including longitudinal evaluations) of adolescent pregnancy prevention approaches: Provided further, That $2,000,000 shall be for improving the Public Assistance Reporting Information System, including grants to States to support data collection for a study of the system’s effectiveness.

Appendix B


Efficacy Evaluation Data Collection Materials







































Consent Form

Consent to Participate in Research


Title of Research: Study About Family Communication


Introduction

You are being asked to participate in a research study. Before you decide whether you want to take part in this study, you need to read this Informed Consent form so that you understand what the study is about and what you will be asked to do. This form also tells you who can be in the study, the risks and benefits of the study, how we will protect your information, and who you can call if you have questions. Please call Dr. Doug Evans, the researcher responsible for this study, at 1-800-334-8571 ext. 2058 (a toll-free number) about anything you don’t understand before you make your decision.


Purpose

This study about family communication, paid for by the Office of Population Affairs (OPA), Department of Health and Human Services (DHHS), is being conducted by RTI International, a research organization located in North Carolina, and its subcontractor, Knowledge Networks, located in California. The purpose of this study is to learn about parents’ attitudes, beliefs, and communication with their pre-teens and young teens about sex.


Procedures

If you agree to participate, you will be asked to complete a Web questionnaire at home on a personal computer.


You will be asked questions about things like your attitudes and beliefs about teen sex and family communication about this topic. Your pre-teen or young teen doesn’t have to be sexually active for you to be in the study. You can skip any question you like. Your participation is entirely voluntary, and you can stop at anytime.


Study Duration


Your participation in the Web survey will take about 24 minutes of your time. There will be 4 additional surveys conducted 4 weeks, 6 months, 12 months, and 18 months after the initial survey. Each additional survey will take about the same amount of time to complete.


Possible Risks or Discomforts


It is possible that some of the survey questions may make you uncomfortable or upset. You can refuse to answer any question. There is a risk that your answers to the questionnaire could be seen by someone other than the project staff, but we promise to do our best to keep this from happening. It is also possible that a family member could view your questionnaire answers on your personal computer while the survey is in progress, which could create family problems. Your name will be replaced with a number for the purposes of this study. After all surveys are completed, a summary will be written that contains information from all participants, but no names. The staff conducting this study will not use your name in the report and will keep your answers private.


In addition to the risks and discomforts listed here, there may be uncommon or previously unknown risks. You should report any problems to Dr. Evans at 1-800-334-8571 ext. 2058 (a toll-free number).


Benefits


Your Benefits


There are no direct benefits to you from participating in this study.


Benefits for Other People


We hope that this research will help us understand more about family communication and improve related programs designed for families.


Payment for Participation

You will receive a total of 20,000 Knowledge Networks bonus points for your participation in this survey and the 4-week and 6-month follow-up surveys. You will receive an additional 10,000 Knowledge Networks bonus point incentive for completion of the 12-month and 18-month follow-up surveys.


Confidentiality

Many precautions have been taken to protect your information. Your name will be replaced with a number. Other personal information like your address and telephone number will be stored by Knowledge Networks separately from the answers you provide on the questionnaire. Your name, address, and phone number will not be shared with RTI.


The Institutional Review Board (IRB) at RTI has reviewed this research. An IRB is a group of people who are responsible for assuring that the rights of participants in research are protected. The IRB may review the records of your participation in this research to assure that proper procedures were followed. A representative of the IRB may contact you for information about your experience with this research. This representative will be given your name, but will not be given any of your confidential study data. If you wish, you may refuse to answer any questions this person may ask. In addition, all project staff have signed confidentiality agreements.


Future Contacts


If you choose to participate in this survey, we will contact you to participate in the follow up surveys 4 weeks, 6 months, 12 months, and 18 months from now. If you choose not to participate, we will not contact you in the future.


Your Rights


Your decision to take part in this research study is completely voluntary. You can refuse any part of the study, and you can stop participating at any time. You can refuse to answer any question. If you decide to participate and later change your mind, you will not be contacted again or asked for further information.



Your Questions

If you have any questions about the study, you may call Dr. Doug Evans at RTI at 1-800-334-8571 ext. 2058 (a toll-free number). If you have any questions about your rights as a study participant, you may call RTI’s Office of Research Protection at 1-866-214-2043 (a toll-free number).



PLEASE PRINT A COPY OF THIS CONSENT FORM TO KEEP.



Selecting the consent to participate link below indicates that you have read the information provided above, have received answers to your questions, and have freely decided to participate in this research. By agreeing to participate in this research, you are not giving up any of your legal rights.


Please select the appropriate link below.


I consent to participate in the study


I DO NOT consent to participate in the study

Self-Administered Web Survey

(Baseline and Follow-Up Versions)

Parents Speak Up National Campaign

Parent Baseline Survey


Web screen:


[NOTE: Consent form will precede the questions below, and contains introductory text about purpose of the survey, as well as providing information for informed consent. Consent form is included in the OMB supporting statement appendices.]


According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is ----. The time required to complete this information collection is estimated to average 24 minutes per response, including the time to review instructions and complete the information collection. If you have comments concerning the accuracy of the time estimate or suggestions for improving this form, please write to:

U.S. Department of Health & Human Services; OS/OCIO/PRA;

OMB NO.: 200 Independence Ave., S.W., Suite 531-H; Washington D.C. 20201;

EXPIRATION DATE: Attention: PRA Reports Clearance Officer



Q1. Let’s begin the interview now. Once again, your answers will be kept private, and your name will be replaced with an ID number to protect your privacy.


We are interested in your opinion about the parent-child communication and teen sexual activity. If you're not sure, choose an answer that comes closest to what you think might be true for each activity.


Before we start, are you the only one who can see the questions and your answers?


  1. Yes

  2. No (GO TO EXIT SCREEN TO ALLOW PARENT TO CONTINUE ANOTHER TIME)

99 SKIPPED


Q2. Is {CHILD NAME} a boy or girl? [Already asked in screening, Knowledge Networks will confirm whether this info can be delivered from screening or needs to be asked again. Same with age of child]


1. Boy

2. Girl

99 SKIPPED


A. PARENT-CHILD RELATIONSHIP


The first questions are about your relationship with {CHILD NAME}.


Q3. In the past 30 days, how many times have you done the following things with {CHILD NAME}?


At least At least

Once once Less

a week a month Often Never SKIPPED

  1. Gone shopping

  2. Gone to a movie,

sport event,

concert, play,

or museum

  1. Watched an

entire television

show together


Q4. For the following list of activities, indicate whether this is something you and {CHILD NAME} do together at least once a week, at least once a month, less often, or never. How often do you. . .

At least At least

Once once Less

a week a month Often Never SKIPPED

a. Go to religious services or

other religious

activities together 1 2 3 4 99


b. Do homework or school

projects when school

is in session 1 2 3 4 99


c. Attend a party or a family

gathering together 1 2 3 4 99


d. Do volunteer work together

to help other people or

improve your

neighborhood 1 2 3 4 99


e. Play a game or sport

together 1 2 3 4 99


Q5. How often do you feel you miss events or activities that are important to {CHILD NAME}? Is it a lot, sometimes, or almost never?


  1. A lot

  2. Sometimes

  3. Almost never

99. SKIPPED


Q6. About how many close friends does {CHILD NAME} have? By close friends, I mean friends that he/she spends a lot of his/her free time with.


  1. None (SKIP TO Q7)

  2. One

  3. Two to four

  4. Five to eight

  5. Nine to fifteen

  6. Sixteen to twenty-five

  7. Twenty-six or more

99. SKIPPED


Q6a. Do you know (this friend/all of these friends) by sight and by first and last name?


  1. Yes (SKIP TO Q7)

  2. No

99. SKIPPED


Q6b. About how many of these close friends do you know by sight and by first and last name? Is it. . .


  1. All of them

  2. Most of them

  3. Some of them

  4. None of them

99. SKIPPED


Q7. About how often do you know who {CHILD NAME} is with when (he/she) is not at home or in school? Would you say you know who {CHILD NAME} is with. . . .


  1. All the time

  2. Most of the time

  3. Some of the time

  4. Only rarely

99. SKIPPED


Q8. About how often do you know what {CHILD NAME} is doing when (he/she) is not at home or in school? Would you say you know what he/she is doing. . . .


  1. All the time

  2. Most of the time

  3. Some of the time

  4. Only rarely

99. SKIPPED


Q9. How often do you monitor what {CHILD NAME} watches on TV?


  1. Often

  2. Sometimes

  3. Rarely

  4. Never

  5. SKIPPED


Q10. How often do you put restrictions on the music, CDs, or videogames {CHILD NAME} can play?


  1. Often

  2. Sometimes

  3. Rarely

  4. Never

  1. SKIPPED


Q11. Which of the following does {CHILD NAME} have in his/her bedroom?


Yes No SKIPPED

  1. Television

  2. Cable TV connection

  3. Computer

  4. Internet connection

  5. CD player/stereo

  6. iPod

  7. Video games

  8. Other media (specify)_____


Q11. How often would it be true for you to make each of the following statements about {CHILD NAME}?


Always Often Sometimes Seldom Never SKIPPED

  1. You get along well

with him/her 1 2 3 4 5 99

  1. {CHILD NAME} and you

make decisions

about his/her life

together 1 2 3 4 5 99

  1. You just do not

understand him/her 1 2 3 4 5 99

  1. You feel you can

really trust him/her

  1. He/she interferes

with your activities 1 2 3 4 5 99


Q12. How do you think you and {CHILD NAME} communicate with each other?


    1. When {CHILD NAME} asks questions, he/she gets honest answers from you.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


    1. You help {CHILD NAME} to understand himself/herself better.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q13. During the past 12 months, how many times have you argued or had a fight with {CHILD NAME}?


  1. 0 times

  2. 1 or 2 times

  3. 3 to 5 times

  4. 6 to 9 times

  5. 10 or more times

  1. SKIPPED

B. PARENT ATTITUDES, BELIEFS AND PERCEPTIONS OF TEEN NORMS & OUTCOME EFFICACY


The next questions ask about your opinions about sexual activity and teens. For each of the following, please indicate how much you agree or disagree with the statement:


Q14a. Sexual activity is likely to have harmful psychological effects for teens.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly Disagree

99 SKIPPED


Q14b. Sexual activity is likely to have harmful physical effects for teens.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly Disagree

    1. SKIPPED


Q15. When it comes to teens’ decisions about sexual activity, which of the following influences them the most?


  1. Parents

  2. Morals, values, and/or religious beliefs

  3. Friends

  4. The media

  5. Teachers and sex educators

  6. Worries about pregnancy

  7. Worries about STDs

99. SKIPPED


Q16. Waiting to have sex is the most effective way to prevent health risks like unwanted pregnancy or HIV/STDs. Do you. . .


1. Strongly agree

2. Agree

  1. Disagree

  2. Strongly disagree

    1. SKIPPED


Q17. It would be much easier for teens to postpone sexual activity and avoid teen pregnancy if they were able to have more open, honest conversations about these topics with their parents.


1. Strongly agree

  1. Agree

  2. Disagree

  3. Strongly disagree

99 SKIPPED


Q18. Earlier you answered a question about waiting to have sex as the most effective way to prevent health risks like unwanted pregnancy or HIV/STDs. How were you defining sex? Do you include:


Yes No SKIPPED

1. Vaginal sex (sexual intercourse) 1 2 99

2. Oral sex 1 2 99

3. Anal sex 1 2 99

4. Intimate touching (skin-to-skin contact) 1 2 99


Q19. To what age do you think boys should wait before being sexually active—until they are 12, 14, 16, 18, 21, or until they are married?


  1. Until they are 12

  2. Until they are 14

  3. Until they are 16

  4. Until they are 18

  5. Until they are 21

  6. Until they are married

99. SKIPPED


Q20. Do you think most boys will actually wait that long or will most be sexually active earlier?


  1. Will wait

  2. Will have intercourse earlier

99. SKIPPED


Q21. To what age do you think girls should wait before being sexually active—until they are 12, 14, 16, 18, 21, or until they are married?


  1. Until they are 12

  2. Until they are 14

  3. Until they are 16

  4. Until they are 18

  5. Until they are 21

  6. Until they are married

99 SKIPPED


Q22. Do you think most girls will actually wait that long or will most be sexually active earlier?


  1. Will wait

  2. Will have intercourse earlier

99 SKIPPED.


The next questions are about certain topics you may discuss with {CHILD NAME}. Please indicate how sure or unsure you are about this statement.


Q23. How sure are you that you can always explain to {CHILD NAME}. . .


a. . . .why he/she should wait until he/she is older to be sexually active?


  1. Completely sure

  2. Very sure

  3. Somewhat sure

  4. Neither sure nor unsure

  5. Somewhat unsure

  6. Very unsure

  7. Not sure at all

  1. SKIPPED


b. . . .how to make a boy/girl (OPPOSITE SEX OF CHILD) wait until he/she (CHILD’S SEX) is ready to be sexually active?


  1. Completely sure

  2. Very sure

  3. Somewhat sure

  4. Neither sure nor unsure

  5. Somewhat unsure

  6. Very unsure

  7. Not sure at all

  1. SKIPPED


c. . . .how to tell a boy/girl no if he/she does not want to be sexually active?


  1. Completely sure

  2. Very sure

  3. Somewhat sure

  4. Neither sure nor unsure

  5. Somewhat unsure

  6. Very unsure

  7. Not sure at all

    1. SKIPPED


d. . . .ways to have fun with a boy/girl without being sexually active?


1 Completely sure

2 Very sure

3 Somewhat sure

4 Neither sure nor unsure

5 Somewhat unsure

6 Very unsure

7 Not sure at all

99 SKIPPED


Q24. How likely do you think {CHILD NAME} would be to be sexually active if asked by someone he/she was dating as a young teen? Would you say. . . .


  1. Very likely

  2. Somewhat likely

  3. Not very likely

  4. Not at all likely

99 SKIPPED


Q25. What are your expectations about talking with {CHILD NAME}? If you talk early and often with {CHILD NAME} about sexual topics (such as waiting to be sexually active until he/she is older). . . .


  1. . . .{CHILD NAME} will be less likely to be sexually active as a young teen. Do you. . . .


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


b. . . .{CHILD NAME} will not listen to what you say.


1 Strongly agree

2 Agree

3 Disagree

4 Strongly disagree

99 SKIPPED


c. . . . {CHILD NAME} will not think you are judgmental.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


d. . . .you will be a hypocrite.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


e. . . . {CHILD NAME} would understand the benefits of waiting to become sexually active.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


f. . . .{CHILD NAME} would rebel and want to engage in sexual activity even more. Do you. . . .


1. Strongly agree

2. Agree

  1. Disagree

  2. Strongly disagree

99 SKIPPED


How much do you agree or disagree with each of the following statements?


Q26. By effectively talking with {CHILD NAME] about delaying sexual activity, you will be able to positively impact {CHILD NAME}’s future success and happiness.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED



Q27. If you can convince {CHILD NAME} to wait to have sex, he/she will have a better chance to succeed as an adult.


    1. Strongly agree

    2. Agree

    3. Disagree

    4. Strongly disagree

  1. SKIPPED


Q28. You have heard that you should talk early and often to {CHILD NAME} about waiting to have sex.


    1. Strongly agree

    2. Agree

    3. Disagree

    4. Strongly disagree

    1. SKIPPED


Q29. You really don't know enough about sexual activity or waiting to have sex to talk about them with {CHILD NAME}.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q30. It is not too late for you to start talking with {CHILD NAME} about sexual activity or waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q31. You are sure this is the right developmental time to talk with {CHILD NAME} about sexual activity and waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q32. Education about sexual activity and waiting to have sex is best handled by the schools or medical professionals, not parents.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q33. It is easy for you to find time to talk with {CHILD NAME} about sexual activity and waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q34. It would be difficult for you to explain things if you talked with {CHILD NAME} about sexual activity or waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q35. You disapprove of {CHILD NAME}’s being sexually active as a teenager. Do you…


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q36. You feel trapped by your responsibilities as a parent. Do you. . .

1 Strongly agree

2 Somewhat agree

3 Somewhat disagree

4 Strongly disagree

99 SKIPPED


Q37. You find that taking care of your child(ren) is much more work than pleasure. Do you. . .


1 Strongly agree

2 Somewhat agree

3 Somewhat disagree

5 Strongly disagree

99 SKIPPED


C. CHILD CHARACTERISTICS


Now there are a few questions about {CHILD NAME}.


Q38. How advanced is {CHILD NAME}’s physical development compared with other boys/girls his/her age?


  1. He/she looks younger than most

  2. He/she looks younger than some

  3. He/she looks about average

  4. He/she looks older than some

  5. He/she looks older than most

99. SKIPPED


Q39. Your child shows physical signs of puberty, such as changing voice for boys or beginning of menstrual cycle for girls.

 1. Strongly agree

 2. Agree

 3. Disagree

 4. Strongly disagree

 99. Skipped


Q40 Has {CHILD NAME} completed or is he/she currently participating in a sex education course at school?


  1. Yes

  2. No

99 SKIPPED


Q41. Do you think that {CHILD NAME} has ever been sexually active? By sexually active, we mean not as a result of abuse or coercion.


  1. Yes

  2. No (SKIP TO Q42)

    1. SKIPPED


Q41a. How old do you think {CHILD NAME} was when (he/she) first became sexually active?


  1. Younger than 8 years old

  2. 8 years old

  3. 9 years old

  4. 10 years old

  5. 11 years old

  6. 12 years old

  7. 13 years old

  8. 14 years old (DO NOT ALLOW ANSWERS OLDER THAN CHILD’S CURRENT AGE)

99 SKIPPED


D. PARENTAL BEHAVIOR


Q42. How often have you initiated conversations with {CHILD NAME} about sexual activity or waiting to have sex?


  1. Often

  2. Sometimes

  3. Seldom

  4. Never

  1. SKIPPED


Q43. How much have you talked to {CHILD NAME} about being sexually active?

  1. A great deal

  2. A moderate amount

  3. Somewhat

  4. Not at all (SKIP TO Q44)

99 SKIPPED


Q43a. (ONLY ASK IF Q41=YES AND Q43<4): When did you talk with {CHILD NAME} about being sexually active? Was it. . .

1. Before you found out he/she was sexually active

2. After you found out he/she was sexually active

3. Both before and after you found out he/she was sexually active

99. SKIPPED


Q44. How much have you and {CHILD NAME} talked about (his/her) being sexually active and. . .

A A Somewhat Not at all SKIPPED great moderate

Deal amount

a. The biology of sex

and pregnancy 1 2 3 4 99


  1. Issues about dating

and relationships 1 2 3 4 99


  1. Whether to wait to

be sexually active

until you are married 1 2 3 4 99


  1. The negative or bad

things that would

happen if (he got

someone/she got)

pregnant? 1 2 3 4 99


e. The dangers of getting

a sexually transmitted

disease? 1 2 3 4 99


f. The negative or bad

impact on (his/her)

social life because

(he/she) would lose

the respect of others? 1 2 3 4 99


g. The moral issues of

not having sexual

intercourse? 1 2 3 4 99


Q45. Have you asked (recommended) that {CHILD NAME} wait to have sex?


  1. Yes

  2. No

99 SKIPPED


Q46. How often do you and {CHILD NAME} talk about media messages and images that promote or glamorize teen sexual activity?


  1. Every Day

  2. Weekly

  3. Monthly

  4. Every few months

  5. Never

  1. SKIPPED

E. RELIGIOSITY AND EXPOSURE TO OTHER PREVENTION


The next few questions ask about you!


Q47. These questions are about the role that religious beliefs may play in your life. For each statement, please indicate whether you strongly disagree, disagree, agree, or strongly agree.


a. Your religious beliefs are a very important part of your life.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

    1. SKIPPED


b. Your religious beliefs influence how you make decisions in your life.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

    1. SKIPPED




Q48. In the past 12 months, have you seen or heard about any programs or activities in your community aimed at helping children delay sexual activity?


  1. Yes

  2. No (SKIP TO Q50)

98. DON’T KNOW (SKIP TO Q50)

99. REFUSED (SKIP TO Q50)


Q49. Which of the following best describes the kinds of programs or activities in your community aimed at helping children delay sexual activity?


  1. Educational program during school time at{CHILD NAME}’s school

  2. After-school program at a community center

  3. Youth-organized group

  4. Program at a local church or other place of worship

  5. Other (specify): ______________

98. DON’T KNOW (CONTINUE WITH Q50)

99. REFUSED (SKIP TO Q50)


G. MODERATOR VARIABLES


There are just a few more questions. They are about your media use and background.


Q50. Please answer the following questions about the “www.4parents.gov” website:

a. Have you ever visited the website “www.4parents.gov”?

  1. Yes (CONTINUE WITH Q50b)

  2. No (SKIP TO Q51)

8. Don’t know (SKIP TO Q51)

99 SKIPPED


    1. Please indicate which of the following actions you took when you visited the “4parents.gov” website (Check all that apply)

YES NO SKIPPED

  1. Read the overview information on the home page of the site

  2. Visited the “The Basic Facts” section that provide information about puberty, reproductive health and pregnancy, and risky

  3. Visited the “Talking with Your Pre-Teen or Teen about Waiting” section that discuss how to have a good relationship with your child and why and how to talk with your teen about waiting to have sex

  4. Visited the “What Every Parent Needs to Know” section that provide information and conversation starters on what parents should know when communicating with their child about sex

  5. Visited the “WISE way to Raise Kids” page that discuss how to initiate conversations with your child

  6. Visited the “Power of Parents” page that discusses the influence of parents in the decisions of their children

  7. Looked at or downloaded the Parents Speak Up or Teen Chat booklets



Q51. During the past 7 days, on average, how many hours a day did you:


ENTER TIME TO NEAREST HALF-HOUR


1. Watch TV _______________?

2. Listen to the radio _______________?

3. Browse or surf the Internet _______________?

4. Read magazines _______________?


Q52. How far did you go in school?

  1. 8th grade or less

  2. More than 8th grade, but did not graduate from high school

  3. Went to a business, trade, or vocational school instead of high school

  4. High school graduate

  5. Completed a GED

  6. Went to a business, trade, or vocational school after high school

  7. Went to college, but did not graduate

  8. Graduated from a college or university

  9. Professional training beyond a 4-year college or university

  10. Never went to school

99 SKIPPED


Q53. What is your current marital status?


  1. Currently married

  2. Widowed

  3. Divorced

  4. Separated

  5. Never been married

8. Don’t know

99 SKIPPED


Q54. What is your relationship with {CHILD NAME}?


  1. Biological mother/father

  2. Stepmother/father

  3. Adoptive mother/father

  4. Foster mother/father

  5. Other: ___________

99 SKIPPED


Q55. Does {CHILD NAME}’s father/mother or a person like a father/mother to {CHILD NAME} live in the home?


  1. Yes

  2. No (SKIP TO Q57)

99 SKIPPED (SKIP TO Q57)


Q56. What is his/her relationship to {CHILD NAME}?


  1. Biological father/mother

  2. Stepfather/mother

  3. Adoptive father/mother

  4. Foster father/mother

  5. Other: ___________

99 SKIPPED


Q57. Are you currently employed full-time, part-time, or not employed?


  1. Full-time

  2. Part-time

  3. Not employed

8. DON’T KNOW

99 SKIPPED


Q58. The next question is about the total family income from all sources during 2006. We would like you to combine everyone’s income. Before taxes and other deductions, was the total combined family income during 2006 . . . .


  1. Less than $25,000

  2. $25,000-$49,999

  3. $50,000-$74,999

  4. $75,000-$99,999

  5. $100,000-$124,999

  6. $125,000-$149,999

  7. $150,000 or more

  8. DON’T KNOW

99 SKIPPED


Q59. Are you Hispanic or Latino

  1. Yes

  2. No (SKIP TO Q61)

99 SKIPPED


Q60. How would you describe your Hispanic origin or descent?

  1. Mexican

  2. Puerto Rican

  3. Cuban

  4. Central American

  5. South American

  6. Other [specify]

99. SKIPPED


Q61. How do you describe yourself? You can choose more than one of the following categories.

  1. American Indian or Alaska Native

  2. Asian

  3. Black or African American

  4. Native Hawaiian or Other Pacific Islander

  5. White

  6. Other (specify):___________________________

  1. SKIPPED


Q62. (ASK ONLY IF MORE THAN ONE ANSWER SELECTED FOR Q61): Which one of these groups best describes you? Choose only one of the following.

(PRESENT ONLY OPTIONS MENTIONED IN Q61)

  1. American Indian or Alaska Native

  2. Asian

  3. Black or African American

  4. Native Hawaiian or Other Pacific Islander

  5. White

  6. Other, specify

99. SKIPPED


Q63. [IF Q59=1 (HISPANIC):] How much do you watch Spanish and English television? Would you say…

  1. Only Spanish

  2. Spanish more than English

  3. Spanish and English equally

  4. English more than Spanish

  5. English only

99 SKIPPED

Q64. In what country were you born?

  1. U.S.

  2. Other, specify___________________________

99 SKIPPED

Parents Speak Up National Campaign

Parent Follow-Up Survey


Web screen:


[NOTE: Consent form will precede the questions below, and contains introductory text about purpose of the survey, as well as providing information for informed consent. Consent form is included in the OMB supporting statement appendices.]


According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is ----. The time required to complete this information collection is estimated to average 24 minutes per response, including the time to review instructions and complete the information collection. If you have comments concerning the accuracy of the time estimate(s) or suggestions for improving this form, please write to:

U.S. Department of Health & Human Services; OS/OCIO/PRA;

OMB NO.: 200 Independence Ave., S.W., Suite 531-H; Washington D.C. 20201;

EXPIRATION DATE: Attention: PRA Reports Clearance Officer



Q1. Let’s begin the interview now. Once again, your answers will be kept private, and your name will be replaced with an ID number to protect your privacy.


We are interested in your opinion about parent-child communication and teen sexual activity. If you're not sure, choose an answer that comes closest to what you think might be true for each activity.


Before we start, are you the only one who can see the questions and your answers?


  1. Yes

  2. No (GO TO EXIT SCREEN TO ALLOW PARENT TO CONTINUE ANOTHER TIME)

99 SKIPPED


Q2. Is {CHILD NAME} a boy or girl? [Already asked in screening, Knowledge Networks will confirm whether this info can be delivered from screening or needs to be asked again. Same with age of child]


1. Boy

2. Girl

99 SKIPPED


A. PARENT-CHILD RELATIONSHIP


The first questions are about your relationship with {CHILD NAME}.


Q3. In the past 30 days, how many times have you done the following things with {CHILD NAME}?


At least At least

Once once Less

a week a month Often Never SKIPPED

  1. Gone shopping

  2. Gone to a movie,

sport event,

concert, play,

or museum

  1. Watched an

entire television

show together


Q4. For the following list of activities, indicate whether this is something you and {CHILD NAME} do together at least once a week, at least once a month, less often, or never. How often do you. . .

At least At least

Once once Less

a week a month Often Never SKIPPED

a. Go to religious services or

other religious

activities together 1 2 3 4 99


b. Do homework or school

projects when school

is in session 1 2 3 4 99


c. Attend a party or a family

gathering together 1 2 3 4 99


d. Do volunteer work together

to help other people or

improve your

neighborhood 1 2 3 4 99


e. Play a game or sport

together 1 2 3 4 99


Q5. How often do you feel you miss events or activities that are important to {CHILD NAME}? Is it a lot, sometimes, or almost never?


  1. A lot

  2. Sometimes

  3. Almost never

99. SKIPPED


Q6. About how many close friends does {CHILD NAME} have? By close friends, I mean friends that he/she spends a lot of his/her free time with.


  1. None (SKIP TO Q7)

  2. One

  3. Two to four

  4. Five to eight

  5. Nine to fifteen

  6. Sixteen to twenty-five

  7. Twenty-six or more

99. SKIPPED


Q6a. Do you know (this friend/all of these friends) by sight and by first and last name?


  1. Yes (SKIP TO Q7)

  2. No

99. SKIPPED


Q6b. About how many of these close friends do you know by sight and by first and last name? Is it. . .


  1. All of them

  2. Most of them

  3. Some of them

  4. None of them

99. SKIPPED


Q7. About how often do you know who {CHILD NAME} is with when (he/she) is not at home or in school? Would you say you know who {CHILD NAME} is with. . . .


  1. All the time

  2. Most of the time

  3. Some of the time

  4. Only rarely

99. SKIPPED


Q8. About how often do you know what {CHILD NAME} is doing when (he/she) is not at home or in school? Would you say you know what he/she is doing. . . .


  1. All the time

  2. Most of the time

  3. Some of the time

  4. Only rarely

99. SKIPPED


Q9. How often do you monitor what {CHILD NAME} watches on TV?


  1. Often

  2. Sometimes

  3. Rarely

  4. Never

  5. SKIPPED


Q10. How often do you put restrictions on the music, CDs, or videogames {CHILD NAME} can play?


  1. Often

  2. Sometimes

  3. Rarely

  4. Never

  1. SKIPPED


Q11. Which of the following does {CHILD NAME} have in his/her bedroom?


Yes No SKIPPED

  1. Television

  2. Cable TV connection

  3. Computer

  4. Internet connection

  5. CD player/stereo

  6. iPod

  7. Video games

  8. Other media (specify)_____


Q11. How often would it be true for you to make each of the following statements about {CHILD NAME}?


Always Often Sometimes Seldom Never SKIPPED

  1. You get along well

with him/her 1 2 3 4 5 99

  1. {CHILD NAME} and you

make decisions

about his/her life

together 1 2 3 4 5 99

  1. You just do not

understand him/her 1 2 3 4 5 99

  1. You feel you can

really trust him/her

  1. He/she interferes

with your activities 1 2 3 4 5 99


Q12. How do you think you and {CHILD NAME} communicate with each other?


    1. When {CHILD NAME} asks questions, he/she gets honest answers from you.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


    1. You help {CHILD NAME} to understand himself/herself better.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q13. During the past 12 months, how many times have you argued or had a fight with {CHILD NAME}?


  1. 0 times

  2. 1 or 2 times

  3. 3 to 5 times

  4. 6 to 9 times

  5. 10 or more times

  1. SKIPPED

B. PARENT ATTITUDES, BELIEFS AND PERCEPTIONS OF TEEN NORMS & OUTCOME EFFICACY


The next questions ask about your opinions about sexual activity and teens. For each of the following, please indicate how much you agree or disagree with the statement:


Q14a. Sexual activity is likely to have harmful psychological effects for teens.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly Disagree

99 SKIPPED


Q14b. Sexual activity is likely to have harmful physical effects for teens.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly Disagree

    1. SKIPPED


Q15. When it comes to teens’ decisions about sexual activity, which of the following influences them the most?


  1. Parents

  2. Morals, values, and/or religious beliefs

  3. Friends

  4. The media

  5. Teachers and sex educators

  6. Worries about pregnancy

  7. Worries about STDs

99. SKIPPED


Q16. Waiting to have sex is the most effective way to prevent health risks like unwanted pregnancy or HIV/STDs. Do you. . .


1. Strongly agree

2. Agree

  1. Disagree

  2. Strongly disagree

    1. SKIPPED


Q17. It would be much easier for teens to postpone sexual activity and avoid teen pregnancy if they were able to have more open, honest conversations about these topics with their parents.


1. Strongly agree

  1. Agree

  2. Disagree

  3. Strongly disagree

99 SKIPPED


Q18. Earlier you answered a question about waiting to have sex as the most effective way to prevent health risks like unwanted pregnancy or HIV/STDs. How were you defining sex? Do you include:

Yes No SKIPPED

1. Vaginal sex (sexual intercourse) 1 2 99

2. Oral sex 1 2 99

3. Anal sex 1 2 99

4. Intimate touching (skin-to-skin contact) 1 2 99


Q19. To what age do you think boys should wait before being sexually active—until they are 12, 14, 16, 18, 21, or until they are married?


  1. Until they are 12

  2. Until they are 14

  3. Until they are 16

  4. Until they are 18

  5. Until they are 21

  6. Until they are married

99. SKIPPED


Q20. Do you think most boys will actually wait that long or will most be sexually active earlier?


  1. Will wait

  2. Will have intercourse earlier

99. SKIPPED


Q21. To what age do you think girls should wait before being sexually active—until they are 12, 14, 16, 18, 21, or until they are married?


  1. Until they are 12

  2. Until they are 14

  3. Until they are 16

  4. Until they are 18

  5. Until they are 21

  6. Until they are married

99 SKIPPED


Q22. Do you think most girls will actually wait that long or will most be sexually active earlier?


  1. Will wait

  2. Will have intercourse earlier

99 SKIPPED.


The next questions are about certain topics you may discuss with {CHILD NAME}. Please indicate how sure or unsure you are about this statement.


Q23. How sure are you that you can always explain to {CHILD NAME}. . .


a. . . .why he/she should wait until he/she is older to be sexually active?


  1. Completely sure

  2. Very sure

  3. Somewhat sure

  4. Neither sure nor unsure

  5. Somewhat unsure

  6. Very unsure

  7. Not sure at all

  1. SKIPPED


b. . . .how to make a boy/girl (OPPOSITE SEX OF CHILD) wait until he/she (CHILD’S SEX) is ready to be sexually active?


  1. Completely sure

  2. Very sure

  3. Somewhat sure

  4. Neither sure nor unsure

  5. Somewhat unsure

  6. Very unsure

  7. Not sure at all

  1. SKIPPED


c. . . .how to tell a boy/girl no if he/she does not want to be sexually active?


  1. Completely sure

  2. Very sure

  3. Somewhat sure

  4. Neither sure nor unsure

  5. Somewhat unsure

  6. Very unsure

  7. Not sure at all

    1. SKIPPED


d. . . .ways to have fun with a boy/girl without being sexually active?


1 Completely sure

2 Very sure

3 Somewhat sure

4 Neither sure nor unsure

5 Somewhat unsure

6 Very unsure

7 Not sure at all

99 SKIPPED


Q24. How likely do you think {CHILD NAME} would be to be sexually active if asked by someone he/she was dating as a young teen? Would you say. . . .


  1. Very likely

  2. Somewhat likely

  3. Not very likely

  4. Not at all likely

99 SKIPPED


Q25. What are your expectations about talking with {CHILD NAME}? If you talk early and often with {CHILD NAME} about sexual topics (such as waiting to be sexually active until he/she is older). . . .


  1. . . .{CHIlD NAME} will be less likely to be sexually active as a young teen. Do you. . . .


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


b. . . .{CHILD NAME} will not listen to what you say.


1 Strongly agree

2 Agree

3 Disagree

4 Strongly disagree

99 SKIPPED


c. . . . {CHILD NAME} will not think you are judgmental.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


d. . . .you will be a hypocrite.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


e. . . . {CHILD NAME} would understand the benefits of waiting to become sexually active.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


f. . . .{CHILD NAME} would rebel and want to engage in sexual activity even more. Do you. . . .


1. Strongly agree

2. Agree

  1. Disagree

  2. Strongly disagree

99 SKIPPED


How much do you agree or disagree with each of the following statements?


Q26. By effectively talking with {CHILD NAME] about delaying sexual activity, you will be able to positively impact {CHILD NAME}’s future success and happiness.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED



Q27. If you can convince {CHILD NAME} to wait to have sex, he/she will have a better chance to succeed as an adult.


    1. Strongly agree

    2. Agree

    3. Disagree

    4. Strongly disagree

  1. SKIPPED


Q28. You have heard that you should talk early and often to {CHILD NAME} about waiting to have sex.


    1. Strongly agree

    2. Agree

    3. Disagree

    4. Strongly disagree

    1. SKIPPED


Q29. You really don't know enough about sexual activity or waiting to have sex to talk about them with {CHILD NAME}.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q30. It is not too late for you to start talking with {CHILD NAME} about sexual activity or waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q31. You are sure this is the right developmental time to talk with {CHILD NAME} about sexual activity and waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q32. Education about sexual activity and waiting to have sex is best handled by the schools or medical professionals, not parents.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q33. It is easy for you to find time to talk with {CHILD NAME} about sexual activity and waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q34. It would be difficult for you to explain things if you talked with {CHILD NAME} about sexual activity or waiting to have sex.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q35. You disapprove of {CHILD NAME}’s being sexually active as a teenager. Do you…


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

99 SKIPPED


Q36. You feel trapped by your responsibilities as a parent. Do you. . .

1 Strongly agree

2 Somewhat agree

3 Somewhat disagree

4 Strongly disagree

99 SKIPPED


Q37. You find that taking care of your child(ren) is much more work than pleasure. Do you. . .

1 Strongly agree

2 Somewhat agree

3 Somewhat disagree

5 Strongly disagree

99 SKIPPED


C. CHILD CHARACTERISTICS


Now there are a few questions about {CHILD NAME}.


Q38. How advanced is {CHILD NAME}’s physical development compared with other boys/girls his/her age?


  1. He/she looks younger than most

  2. He/she looks younger than some

  3. He/she looks about average

  4. He/she looks older than some

  5. He/she looks older than most

99. SKIPPED


Q39. Your child shows physical signs of puberty, such as changing voice or hair growth for boys, or beginning of menstrual cycle or breast growth for girls.


 1. Strongly agree

 2. Agree

 3. Disagree

 4. Strongly disagree

 99. Skipped


Q40. Has {CHILD NAME} completed or is he/she currently participating in a sex education course at school?


  1. Yes

  2. No

99 SKIPPED


Q41. Do you think that {CHILD NAME} has ever been sexually active? By sexually active, we mean not as a result of abuse or coercion.


  1. Yes

  2. No (SKIP TO Q42)

99 SKIPPED

Q41a. How old do you think {CHILD NAME} was when (he/she) first became sexually active?


1. Younger than 8 years old

2. 8 years old

3. 9 years old

4. 10 years old

5. 11 years old

  1. 12 years old

  2. 13 years old

  3. 14 years old

  4. 15 years old

  5. 16 years old (DO NOT ALLOW ANSWERS OLDER THAN CHILD’S CURRENT AGE)

99 SKIPPED


D. PARENTAL BEHAVIOR


Q42. How often have you initiated conversations with {CHILD NAME} about sexual activity or waiting to have sex?


  1. Often

  2. Sometimes

  3. Seldom

  4. Never

  1. SKIPPED


Q43. How much have you talked to {CHILD NAME} about being sexually active?

  1. A great deal

  2. A moderate amount

  3. Somewhat

  4. Not at all (SKIP TO Q44)

99 SKIPPED


Q43a. (ONLY ASK IF Q41=YES AND Q43<4): When did you talk with {CHILD NAME} about being sexually active? Was it. . .

1. Before you found out he/she was sexually active

2. After you found out he/she was sexually active

3. Both before and after you found out he/she was sexually active

99. SKIPPED


Q44. How much have you and {CHILD NAME} talked about (his/her) being sexually active and. . .

A A Somewhat Not at all SKIPPED great moderate

Deal amount

a. The biology of sex

and pregnancy 1 2 3 4 99


  1. Issues about dating

and relationships 1 2 3 4 99


  1. Whether to wait to

be sexually active

until you are married 1 2 3 4 99


  1. The negative or bad

things that would

happen if (he got

someone/she got)

pregnant? 1 2 3 4 99


e. The dangers of getting

a sexually transmitted

disease? 1 2 3 4 99


f. The negative or bad

impact on (his/her)

social life because

(he/she) would lose

the respect of others? 1 2 3 4 99


g. The moral issues of

not having sexual

intercourse? 1 2 3 4 99


Q45. Have you asked (recommended) that {CHILD NAME} wait to have sex?


  1. Yes

  2. No

99 SKIPPED


Q46. How often do you and {CHILD NAME} talk about media messages and images that promote or glamorize teen sexual activity?


  1. Every Day

  2. Weekly

  3. Monthly

  4. Every few months

  5. Never

  1. SKIPPED

E. RELIGIOSITY AND EXPOSURE TO OTHER PREVENTION


The next few questions ask about you!


Q47. These questions are about the role that religious beliefs may play in your life. For each statement, please indicate whether you strongly disagree, disagree, agree, or strongly agree.


a. Your religious beliefs are a very important part of your life.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

    1. SKIPPED


b. Your religious beliefs influence how you make decisions in your life.


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

    1. SKIPPED


Q48. In the past 12 months, have you seen or heard about any programs or activities in your community aimed at helping children delay sexual activity?

  1. Yes

  2. No (SKIP TO Q50)

98. DON’T KNOW (SKIP TO Q50)

99. REFUSED (SKIP TO Q50)


Q49. Which of the following best describes the kinds of programs or activities in your community aimed at helping children delay sexual activity?


  1. Educational program during school time at{CHILD NAME}’s school

  2. After-school program at a community center

  3. Youth-organized group

  4. Program at a local church or other place of worship

  5. Other (specify): ______________

98. DON’T KNOW (CONTINUE WITH Q50)

99. REFUSED (SKIP TO Q50)

[TREATMENT CONDITION RESPONDENTS ON POST-BASELINE SURVEYS WILL COMPLETE SECTION F. FOR THOSE SURVEYS ONLY, SECTION F BELOW WILL BE INCLUDED. ALL OTHER RESPONDENTS/CONDITIONS WILL PROCEED DIRECTLY TO SECTION G.]


F. TREATMENT CONDITION (HIGH AND LOW) MODULE: PSUNC CAMPAIGN EXPOSURE, PARENT AWARENESS, AND PARENT REACTIONS


Q50. Overall Campaign Theme Awareness

a. What is the primary theme/slogan of the ads you just viewed or heard?

  1. Children should wait before engaging in sexual activity

  2. Children should wait until marriage before engaging in sexual activity

  3. Abstinence

  4. Abstinence until marriage

  5. Talk to your children about waiting to engage in sexual activity

  6. Talk early and often to your children about waiting to engage in sexual activity

  7. Other (specify): _________________

98. DON’T KNOW (CONTINUE WITH Q51)

99. REFUSED (CONTINUE WITH Q51)



The following questions are about the ad you viewed earlier, entitled “_________.” [FILL IN NAME OF AD.] This was the ad that showed parents talking to their kids about waiting, and then showed the kids when they were grown up.


Q51. Parent message reactions/receptivity (cognitive and affective – likeability, believability)

a. Indicate how much you agree or disagree with the following statement: This ad is convincing.

Would you say you:

  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

  5. Have no opinion

  6. 99 SKIPPED


b. Would you say the ad grabbed your attention?

  1. Yes

  2. No

8. Don’t know

99 SKIPPED


c. Would you say the ad gave you good reasons to talk to your kids about sexual activity?

  1. Yes

  2. No

8. Don’t know

99 SKIPPED


d. Did you talk to your friends or other adult family members (not your child[ren]) about this ad?

  1. Yes

  2. No

8. Don’t Know

99 SKIPPED


e. Did you talk to your child(ren) about the ad?


  1. Yes

  2. No

8. Don’t Know

99 SKIPPED


Q52. Would you say this ad said something important to you?


  1. Yes

  2. No

8. Don’t Know

  1. SKIPPED


[REPEAT PRECEDING INSTRUCTION AND Q51-52 FOR EACH AD SHOWN IN THE TREATMENT CONDITIONS, FOLLOWED BY THE FOLLOWING 4 QUESTIONS.]


The following questions ask about the messages, logos, and other material in these ads overall


Q53. When you think of these ads you think…

Strongly agree; agree; disagree; strongly disagree; no opinion; SKIPPED

a.) I can successfully talk to{CHILD NAME} about waiting before becoming sexually active

b.) {CHILD NAME} wants me to talk to him/her about waiting before becoming sexual active

c.) Talking to {CHILD NAME} about sexual activity will help him/her be successful in life

d.) Talking to {CHILD NAME} about sexual activity can reduce negative effects of the media and other influences in society


Q54. Please indicate your agreement with each of the following statements:


a. The parents in the PSUNC ads are just like me. Would you say you:


  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

  5. No opinion

99 SKIPPED

b. The kids in these ads are just like my kids. Would you say you:

  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

  5. No opinion

99 SKIPPED

c. If I had a chance, I would tell other parents with teen or pre-teen children to watch these ads.

  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

  5. No opinion

  1. SKIPPED

d. These ads would be helpful to other parents like myself.

  1. Strongly agree

  2. Agree

  3. Disagree

  4. Strongly disagree

  5. No opinion

  1. SKIPPED


G. MODERATOR VARIABLES


There are just a few more questions. They are about your media use and background.


Q55. Please answer the following questions about the “www.4parents.gov” website:

a. Have you ever visited the website “www.4parents.gov”?

  1. Yes (CONTINUE WITH Q55b)

  2. No (SKIP TO Q56)

8. Don’t know (SKIP TO Q56)

99 SKIPPED


    1. Please indicate which of the following actions you took when you visited the “www.4parents.gov” website (Check all that apply)

YES NO SKIPPED

        1. Read the overview information on the home page of the site

        2. Visited the “The Basic Facts” section that provide information about puberty, reproductive health and pregnancy, and risky

        3. Visited the “Talking with Your Pre-Teen or Teen about Waiting” section that discuss how to have a good relationship with your child and why and how to talk with your teen about waiting to have sex

        4. Visited the “What Every Parent Needs to Know” section that provide information and conversation starters on what parents should know when communicating with their child about sex

        5. Visited the “WISE way to Raise Kids” page that discuss how to initiate conversations with your child

        6. Visited the “Power of Parents” page that discusses the influence of parents in the decisions of their children

        7. Looked at or downloaded the Parents Speak Up or Teen Chat booklets


Q56. During the past 7 days, on average, how many hours a day did you:


ENTER TIME TO NEAREST HALF-HOUR


1. Watch TV _______________?

2. Listen to the radio _______________?

3. Browse or surf the Internet _______________?

4. Read magazines _______________?


Q57. What is your current marital status?


  1. Currently married

  2. Widowed

  3. Divorced

  4. Separated

  5. Never been married

8. Don’t know

99 SKIPPED


Q58. Does {CHILD NAME}’s father/mother or a person like a father/mother to {CHILD NAME} live in the home?


  1. Yes

  2. No (SKIP TO Q60)

99 SKIPPED (SKIP TO Q60)


Q59. What is his/her relationship to {CHILD NAME}?


  1. Biological father/mother

  2. Stepfather/mother

  3. Adoptive father/mother

  4. Foster father/mother

  5. Other: ___________

99 SKIPPED


Q60. Are you currently employed full-time, part-time, or not employed?


  1. Full-time

  2. Part-time

  3. Not employed

8. DON’T KNOW

99 SKIPPED










Appendix C


Federal Register Notice to the Public

Appendix D


RTI Institutional Review Board Approval Notice

IRB ID Number: 11587

Office of Research Protection and Ethics
Institutional Review Board Notice of Approval

Federalwide Assurance No. 3331

Title of Study: National Abstinence Media Campaign (NAMC) Evaluation

RTI Project Number 0208490.025 RTI Proposal Number (if no Project Number)

Project Leader: Doug Evans

Project Team Member Contact (if different from Project Leader): Olivia Ashley

Source of Funding for this Study: Office of Population Affairs, DHHS

Date Submitted to IRB: June 1, 2006

Level of Review (check one):

Full , IRB Meeting Date:

Expedited , category: 7: Behavioral - surveys, focus groups, etc.

Type of Review (check one):

P reliminary review (Do not involve human subjects or data until pretest or full study is approved.)

Pretest/Pilot Test

Full Implementation

Amendment, describe:

Add study site(s):

Renewal

Study Closure


IRB Approval of Special Conditions (check all that apply):

W aiver of Signed Informed Consent/Parental Permission

Participation of Pregnant Women (Worksheet B submitted by project team)

Participation of Prisoners (Worksheet C submitted by project team)

Participation of Minors (Worksheet D submitted by project team)

IRB Agreement of Nonsignificant Risk Device Study Determination


Please note the following requirements:

  • If unexpected problems or adverse events occur, the project team must notify the IRB.

  • If there are changes in study procedures or protocol or any data collection materials (brochures, letters, questionnaires, etc.) the project team must notify the IRB before they are implemented.

  • The project team is required to apply for continuing review as long as the study is active, which includes participation of human subjects or possession of human data or specimens.


Expiration Date of IRB Approval: June 5, 2007                   

(No human subjects research can occur after this date without continuing review and approval.)

_ ____________________________ June 5, 2006              

Signature - IRB Member or Chair Date of IRB Approval

Juesta M. Caddell, PhD                                   

Name - IRB Member or Chair (print or type)

C opy sent to project leader on: June 6, 2006

Entered into MIS

Office of Research Protection and Ethics, Institutional Review Board

3040 Cornwallis Road, Research Triangle Park, NC 27709-2194, USA

Telephone: 919-316-3358 Fax: 919-316-3897 [email protected]

Appendix E


Assurances of Confidentiality and Study Descriptions
Provided to Respondents

[display]



In this survey, we will ask you questions about you and your child. Some of the questions are about sensitive matters and may make some people feel uncomfortable. Before we show you the survey questions, we’d like give you a little more background on the study.


[display]


Title of Research: Study About Family Communication


Introduction

You are being asked to participate in a research study. Before you decide whether you want to take part in this study, you need to read this Informed Consent form so that you understand what the study is about and what you will be asked to do. This form also tells you who can be in the study, the risks and benefits of the study, how we will protect your information, and who you can call if you have questions. If you have anything you don’t understand before you make your decision, please call Panel Relations at (800) 782-6899 and someone will direct your questions to the appropriate researchers Research Triangle Institute.


[display]


Purpose

This study about family communication, paid for by the Office of Population Affairs (OPA), Department of Health and Human Services (DHHS), is being conducted by RTI International, a research organization located in North Carolina, and its subcontractor, Knowledge Networks, located in California. The purpose of this study is to learn about parents’ attitudes, beliefs, and communication with their pre-teens about sex. We are conducting a study that will last for approximately 18 months. There will be an initial survey to be followed by 4 additional surveys conducted 4 weeks, 6 months, 12 months, and 18 months after the initial survey. We are inviting you to participate in each of these surveys.


[display]


Procedures

If you agree to participate, you will be asked to complete a Web questionnaire at home on a personal computer.


You will be asked questions about things like your attitudes and beliefs about teen sex and family communication about this topic. Your pre-teen doesn’t have to be sexually active for you to be in the study. You can skip any question you like. Your participation is entirely voluntary, and you can stop at anytime.




Study Duration


Your participation in the Web survey will take about 24 minutes of your time. There will be 4 additional surveys conducted 4 weeks, 6 months, 12 months, and 18 months after the initial survey. Each additional survey will take about the same amount of time to complete.


[display]


Possible Risks or Discomforts

It is possible that some of the survey questions may make you uncomfortable or upset. You can refuse to answer any question. There is a risk that your answers to the questionnaire could be seen by someone other than the project staff, but we promise to do our best to keep this from happening. It is also possible that a family member could view your questionnaire answers on your personal computer while the survey is in progress, which could create family problems. Your name will be replaced with a number for the purposes of this study. After each round of surveys is completed, a summary will be written that contains information from all participants, but no names. The staff conducting this study will not use your name in the report and will keep your answers private.


In addition to the risks and discomforts listed here, there may be uncommon or previously unknown risks. You should report any problems to Panel Relations at (800) 782-6899.


[display]


Benefits


Your Benefits


There are no direct benefits to you from participating in this study.


Benefits for Other People


We hope that this research will help us understand more about family communication and improve related programs designed for families.


[display]


Payment for Participation

You will receive a total of 20,000 Knowledge Networks bonus points for your participation in this survey and the 4-week and 6-month follow-up surveys. You will receive an additional 10,000 Knowledge Networks bonus point incentive for completion of the 12-month and 18-month follow-up surveys.


[display]


Confidentiality

Many precautions have been taken to protect your information. Your name will be replaced with *a number. Other personal information like your address and telephone number will be stored by Knowledge Networks separately from the answers you provide on the questionnaire. Your name, address, and phone number will not be shared with RTI.


The Institutional Review Board (IRB) at RTI has reviewed this research. An IRB is a group of people who are responsible for assuring that the rights of participants in research are protected. The IRB may review the records of your participation in this research to assure that proper procedures were followed. A representative of the IRB may contact you for information about your experience with this research. This representative will be given your name, but will not be given any of your confidential study data. If you wish, you may refuse to answer any questions this person may ask. In addition, all project staff have signed confidentiality agreements.


[display]

Future Contacts


If you choose to participate in this survey, we will contact you to participate in the follow up surveys 4 weeks, 6 months, 12 months, and 18 months from now. If you choose not to participate, we will not contact you in the future.


Your Rights


Your decision to take part in this research study is completely voluntary. You can refuse any part of the study, and you can stop participating at any time. You can refuse to answer any question. If you decide to participate and later change your mind, you will not be contacted again or asked for further information.



[display]


Your Questions

If you have any questions about the study, you may call Panel Relations at (800) 782-6899 and someone will direct your questions to the appropriate researchers RTI. If you have any questions about your rights as a survey participant, you may wish to contact the Research Triangle Institute Office of Research Protection and Ethics. If you contact Panel Relations at (800) 782-6899 and indicate that you would like to contact the RTI Office of Research Protection and Ethics, someone will provide you with the appropriate contact information.


Click here if you would like to see the consent form in its entirety. You may also choose to print it out for your reference later.



[radio]

[prompt if skip]


Selecting the consent to participate link below indicates that you have read the information provided above, have received answers to your questions, and have freely decided to participate in this research. By agreeing to participate in this research, you are not giving up any of your legal rights.


Please select the appropriate link below.


I consent to participate in the study


I DO NOT consent to participate in the study


Appendix F


Knowledge Networks Privacy and Confidentiality Procedures

Knowledge Networks Participant Privacy and Confidentiality

All survey responses will be confidential, with identifying information never revealed without respondent approval. All Knowledge Networks panels who participate in the study will be given a copy of the Privacy and Term of Use Policy. In the privacy terms, there is a section entitled the “Panel Member Bill of Rights” which summarizes the confidentiality and privacy protections for panelists and explains that participants can decide whether to participate in the panel or to answer any survey questions. The Bill of Rights is also available electronically at all times to panelists via the panel member website. The “Bill of Rights” includes the following text:

  • We are researchers, not telemarketers. Here’s what we can promise you:


  • We operate under the standards set by the Council of American Research Organizations (CASRO) [www.casro.org] and our website is approved by TRUSTe.


  • Your survey responses and information are provided to our clients in an anonymous form, unless you have given your express permission.


  • Occasionally, we may contact you to validate responses. We will never misrepresent ourselves, nor what we are doing.


  • Your decision about participating in the Knowledge Networks Panel or responding to specific questions will be respected without question.


The privacy terms also explain data security employed by Knowledge Networks. Knowledge Networks uses advanced security measures to protect against the loss, misuse, and alteration of information provided to Knowledge Networks. To enhance data security, Knowledge Networks web server supports SSL (Secure Socket Layer) Encryption security technology and access to the Knowledge Networks database is restricted to portals that only Knowledge Networks controls. In addition, all panel members are required to use passwords and usernames.

Knowledge Networks warrants that all employees are bound to protect the privacy and confidentiality of all personal information provided by respondents, and very few employees actually have access to any confidential data. The only staff members who have access to this information—personally identifying information about panel members—are those with a direct need to know. Therefore, the only persons with access are the following:


  • Database and IT administrators with access to computer servers for the purpose of maintaining the computers systems at Knowledge Networks;


  • Staff members in the Panel Relations department that have direct contact with panel members as part of the inbound and outbound call center operations. These staff members are responsible for troubleshooting any problems panelists might be having with their equipment or software related to survey administration, incentive fulfillment, and panel management.


  • Staff members of the Statistics department have access to personally identifying information in order to draw samples for the various surveys we conduct at Knowledge Networks.


All personally identifying records are kept secured in a separate office in the Informational Technology section of the main offices in Menlo Park, CA, and all data transfers from WebTV units and personal computers (both used for survey administration) to the main servers pass through a firewall. Knowledge Networks never provides any respondent personal identifiers to any client or agency without the explicit and informed consent provided by the sampled Panel Members. Unless explicitly permitted as documented in a consent form, no personally identifying information will be provided to any parties outside Knowledge Networks in combination with the survey response data.


All electronic survey data records are stored in a secured database that does not contain personally identifying information. The staff members in the Panel Relations and Statistics departments, who have access to the personally identifying information, do not have access to the survey response data. Meanwhile, the staff members with access to the survey response data, with the exception of the aforementioned database and IT administrators who must have access to maintain the computer systems, do not have access to the personally identifying information. The secured database contains field-specific permissions that restrict access to the data by type of user, as described above, preventing unauthorized access.


The survey response data are identified only by an incremented ID number. The personally identifying information is stored in a separate database that is accessible only to persons with a need to know, as described above. The survey data extraction system exports only anonymized survey data identified only by the Panel Member ID number. The data analysts with access to the survey data extraction system, as they do not have access to personally identifying information, cannot join survey data to personally identifying data. Panel Relations and Statistics staff do not have access to the survey data extraction system, and therefore cannot join survey data to personally identifying data.


As part of its prior work with RTI, Knowledge Networks has implemented Good Clinical Practice guidelines to assure compliance with requirements for systems documentation and privacy of stored survey data. Consequently, a system of standard operating procedures have been put in place for documenting all processes relating to maintaining confidentiality and privacy of the identities of panel members. Knowledge Networks retains the survey response data in its secure database after the completion of a project. These data are retained for purposes of operational research, such as studies of response rates and for the security of our customers who might request at a later time additional analyses, statistical adjustments, or statistical surveys that would require re-surveying research subjects as part of validation or longitudinal surveys.


Appendix G


Email Notifications

E-mail notification

E-mail Notification


Subject Line: Study About Family Communication


We would like to obtain information about your attitudes and beliefs toward family communication. You are being asked to participate in a research study sponsored by the Office of Population Affairs, Department of Health and Human Services. Your participation in the study is voluntary. The questionnaire will take about 24 minutes to complete. If you choose to participate, please click on the button below.


If you have questions about the study, you may call Dr. Doug Evans at 1-800-334-8571 ext. 2058 (a toll-free number). If you have any questions about your rights as a study participant, you may call RTI’s Office of Research Protection at 1-866-214-2043 (a toll-free number). If you have questions about your rights as a Knowledge Networks respondent, you may call 1-800-782-6899 (a toll-free number) or e-mail [email protected]



E-mail Reminders

1st E-mail Reminder (3-6 days)


We recently sent you a request to participate in a study about family communication. We'd appreciate your agreement to participate at your earliest convenience by clicking the button below. If you have already responded to this request, thank you and please discard this email.


2nd E-mail Prompt - Custom (7 – 10 days)


We recently sent you a request to participate in a study about family communication. The survey is sponsored by the Office of Population Affairs, Department of Health and Human Services, and the information collected will be used to evaluate family communication programs.


If you have already responded to this request, please accept our sincere thanks and discard this e-mail. If not, we would appreciate your agreement to participate at your earliest convenience by clicking the button below.


If you have questions about the study about family communication, you may call Dr. Doug Evans toll free at 1-800-334-8571 ext. 2058.



Appendix H


Knowledge Networks Panel Recruitment Methodology

Knowledge Networks Panel Recruitment Methodology


Participants in the Knowledge Networks panel are first selected using list-assisted random-digit-dialing (RDD) telephone methodology, providing a probability-based starting sample of U.S. telephone households. The panel sample is then adjusted to match U.S. Census demographic benchmarks to reduce error due to non-coverage of non-telephone households and to reduce bias due to non-response and other non-sampling errors. Knowledge Networks excludes only those banks of telephone numbers (consisting of 100 telephone numbers) that have zero directory- listed phone numbers. Knowledge Networks’ telephone numbers are selected from the 1 or more banks with equal probability of selection for each number. The sampling is done without replacement to ensure that numbers already fielded by Knowledge Networks do not get fielded again. Having generated the initial list of telephone numbers, the sample preparation system excludes confirmed disconnected and non-residential telephone numbers. Next, the sample is screened to exclude numbers that are not in the WebTV Internet Service Provider network. This process results in the exclusion of approximately 6% to 8% of the United States population. This percentage is diminishing steadily, and as of July 2001, Knowledge Networks will begin to include a small sample from out of the WebTV Internet Service Provider network in the panel to represent these areas and reduce coverage error. The sample frame is updated quarterly. Telephone numbers for which Knowledge Networks is able to recover a valid postal address (about 50%) are sent an advance mailing informing them that they have been selected to participate in the Knowledge Networks Panel. In addition to information about the Knowledge Networks Panel, the advance mailing also contains a monetary incentive to encourage cooperation when the interviewer calls. Following the mailing, the telephone recruitment

process begins. The numbers called by experienced interviewers consist of all numbers sent an advance mailing, as well as 50% of the numbers not sent an advance mailing. The resulting cost efficiency more than offsets the decrease in precision caused by the need for sample weights. Cases sent to telephone interviewers are dialed up to 90 days, with at least 15 dial attempts on cases where no one answers the phone, and 25 dial attempts on phone numbers known to be associated with households. Extensive refusal conversion is also performed. An interview, which typically requires about 10 minutes, begins with the interviewer informing the household member that they have been selected to join the Knowledge Networks Panel. Household members are told that in return for completing a short survey weekly, the household will be given a WebTV set-top box and free monthly Internet access. All members in the household are then enumerated, and some initial demographic variables and background information of prior computer and Internet usage are collected. Once participants are recruited into the panel, they can be contacted by e-mail (instead of by phone or mail) to participate in any number of studies.


Households already having Internet access are permitted to use their own Internet-connected computers for self-administration of interviews. In contrast, each non-Internet household is provided with identical hardware for survey administration. Microsoft’s WebTV is the hardware platform currently used by the Knowledge Networks panel. The device consists of a set-top box that connects to a TV and the telephone. It also includes a remote keyboard and pointing device. WebTV has a built-in 56K modem that provides the household with a connection to the Internet. The base unit also has a small hard drive to accommodate large file downloads, including video files. File downloads do not require any user intervention and usually occur during off hours. Prior to shipment, each unit is custom configured with individual e-mail accounts, so that it is ready for immediate use by the household. Most households are able to install the hardware without additional assistance, though Knowledge Networks maintains a telephone technical support line and will, when needed, provide on-site installation. The Knowledge Networks Call Center also contacts household members who do not respond to e-mail and attempts to restore contact and cooperation.


All new panel members are sent an initial survey to confirm equipment installation and familiarize them with the WebTV unit. Demographics such as gender, age, race, income, and education are collected for each participant to create a member profile. This information can be used to determine eligibility for specific studies and need not be gathered with each survey. Starting in August 2002, Knowledge Networks began oversampling households that have pre-existing, home-based Internet access, allowing these households to participate in the Web-enabled panel using their own equipment and Internet access. These panel members are enrolled into a panel loyalty program intended to encourage long-term participation in the research panel. The above Knowledge Network’s procedures are in place prior to this information collection and are not part of the public burden associated with this collection. This approach also reduces burden placed on participants, since e-mail notification is less obtrusive than telephone calls, and most respondents find answering Internet questionnaires to be more interesting and engaging than being questioned by a telephone interviewer.


File Typeapplication/msword
File Modified0000-00-00
File Created0000-00-00

© 2024 OMB.report | Privacy Policy