Supplemental and Part B

Supplemental Questions for DOC/NOAA Customer Survey Clearance

(OMB Control Number 0648-0342)

1. Explain who will be conducting this survey. What program office will be conducting the survey? What services does this program provide? Who are the customers? How are these services provided to the customer?
   
   The survey will be distributed electronically by the U.S. Global Change Research Program National Coordination Office (USGCRP NCO), the entity charged with coordinating climate change research across 13 Federal agencies. The customers will be participants in USGCRP activities such as the National Climate Assessment and interagency working groups. The survey will be delivered via electronic means including email and a voluntary mechanism on USGCRP website GlobalChange.gov and subsites.
   
   
   

2. Explain how this survey was developed. With whom did you consult during the development of this survey on content? statistics? What suggestions did you get about improving the survey?
   
   The survey is a synthesis of several surveys previously administered to measure satisfaction and effectiveness in the development of National Climate Assessment products. Additionally, a number of longstanding questions from USGCRP staff and member agencies regarding the utilization of USGCRP products were incorporated.
   
   
   

3. Explain how the survey will be conducted. How will the customers be sampled (if fewer than all customers will be surveyed)? What percentage of customers asked to take the survey will respond? What actions are planned to increase the response rate?
   
   Initially the survey will be targeted toward authors of and other contributors to the National Climate Assessment. They will be asked to take the survey at two milestones through the development process: currently and at completion in 2019. We anticipate responses from ~2/3 (~67%) of those asked to respond. We will use email and, where appropriate, telephone calls and other means of communication to increase the response rate. Gradually participants in a more diverse range of USGCRP activities will be asked to respond. The survey will be also be made available on an opt-in basis on USGCRP websites GlobalChange.gov and subsites, with an expected response rate of 10%.
   
   
   

4. Describe how the results of this survey will be analyzed and used. If the customer population is sampled, what statistical techniques will be used to generalize the results to the entire customer population? Is this survey intended to measure a GPRA performance measure? (If so, please include an excerpt from the appropriate document.)
   
   Response options in the survey will correspond to a numerical survey instrument. Beyond the use of averaged score, survey responses will also be analyzed to determine trends among customer subgroups, as determined by collected demographic information. Satisfaction, use, and distribution among customer subgroups will be used to better tailor USGCRP products and activities. This survey is not intended to measure a GPRA performance measure.

B. COLLECTIONS OF INFORMATION EMPLOYING STATISTICAL METHODS

1. Describe (including a numerical estimate) the potential respondent universe and any sampling or other respondent selection method to be used. Data on the number of entities (e.g. establishments, State and local governmental units, households, or persons) in the universe and the corresponding sample are to be provided in tabular form. The tabulation must also include expected response rates for the collection as a whole. If the collection has been conducted before, provide the actual response rate achieved.
   
   Initial collection will contain approximately 300 potential respondents, equally distributed between Federal government employees and other individuals with an expected response rate of 75%. Subsequent collections could reach a potential universe of up to 450,000 respondents annually, based on website analytics. The breakdown of entities is not known at this time and will be derived from continued data collection. Expected response rate for this broader collection is 10%.
   
   
   

2. Describe the procedures for the collection, including: the statistical methodology for stratification and sample selection; the estimation procedure; the degree of accuracy needed for the purpose described in the justification; any unusual problems requiring specialized sampling procedures; and any use of periodic (less frequent than annual) data collection cycles to reduce burden.
   
   Respondent pool for initial collection is an audience targeted based on their involvement in the National Climate Assessment. Subsequent collections will be similarly targeted or continuous and opt-in with a self-selecting sample.
   
   
   

3. Describe the methods used to maximize response rates and to deal with nonresponse. The accuracy and reliability of the information collected must be shown to be adequate for the intended uses. For collections based on sampling, a special justification must be provided if they will not yield "reliable" data that can be generalized to the universe studied.
   
   As a voluntary collection, response rates will be driven by the desire of respondents to improve USGCRP products and processes. Standard methods such as reminders will be used to maximize response rate. Because the primary, initial purpose of the collection is evaluation of a USGCRP product, nonresponse poses a challenge to the identification of trends but does not create a data gap which jeopardizes the reliability of the data gathered.
   
   
   

4. Describe any tests of procedures or methods to be undertaken. Tests are encouraged as effective means to refine collections, but if ten or more test respondents are involved OMB must give prior approval.
   
   No procedure or method testing to be undertaken.
   
   
   

5. Provide the name and telephone number of individuals consulted on the statistical aspects of the design, and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.
   
   Collection and analysis to be performed by:
   
   David Reidmiller, USGCRP
   Katie Reeves, ICF on behalf of USGCRP
   Bradley Akamine, ICF on behalf of USGCRP
   Chris Avery, ICF on behalf of USGCRP
   Kristin Lewis, Straughan Environmental on behalf of USGCRP