Weatherization Assistance Program ARRA-Period Evaluation

OMB Control Number: XXXX-XXXX

Expiration Date: MM/DD/YYYY

S1: ALL STATES PROGRAM INFORMATION SURVEY

This data is being collected to conduct a process evaluation of the Weatherization Assistance Program at the state level. The data you supply will be used to characterize program activities during the ARRA Period generally and for Program Year 2010 specifically.

Public reporting burden for this collection of information is estimated to average twenty-four hours per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information.  Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Office of the Chief Information Officer, Records Management Division, IM-11, Paperwork Reduction Project ( ), U.S. Department of Energy, 1000 Independence Ave SW, Washington, DC, 20585-1290; and to the Office of Management and Budget (OMB), OIRA, Paperwork Reduction Project ( ), Washington, DC  20503.

All of the information obtained from this survey will be protected and will remain confidential. The data will be analyzed in such a way that the information provided cannot be associated back to your state, your agencies, or the housing units and clients that your state served. Again, please note that some questions refer to PY 2010 specifically and others to the ARRA period from PY09 –PY11; please be aware of the distinction.

PROGRAM CHARACTERIZATION

1. Please identify your state: __________________________________

2. It is important to collect information about the weatherization of homes beyond the standard single family homes that are heated with natural gas or electricity. Please review the following information for accuracy about each of the local agencies (subgrantees) that you fund to provide weatherization services in your state. Please add any additional grantees and funding amount in the extra space at the bottom of the table:

Local Agency (Subgrantee) Name	Active Subgrantee (Y/N)	Amount of DOE Funds Received by Agency in Program Year 2010	Correct Amount (Y/N) If NO, Please Insert Correct Amount

3. During Program Year 2010, was the director of your State’s Weatherization Program (Check best answer):

_____ a civil servant

_____ political appointee

_____ elected official

4. During Program Year 2010, did the director of your State’s Weatherization Program report to a (Check best answer):

_____ civil servant,

_____ political appointee

_____ elected official

5. For how many years had the current director of your State’s Weatherization Program served in that capacity prior to PY 2010? _____

6. Did your State’s Weatherization Program set annual performance goals for PY 2010?

_____ Yes

_____ No (go to Question 7)

6a. What agency, office, or department was responsible for reviewing the annual performance goals and achievement of goals of your State’s Weatherization Program? _____

7. Please list other important housing and/or energy-related programs for low-income residents that were administered by the same office that is in charge of your state’s Weatherization Assistance Program.

____________________________________________________________________________________________________________________________________________________________

8. What weatherization program data did your state require its weatherization agencies to provide in PY2010? (Check all that apply)

_____ Number of homes weatherized

_____ Number of homes weatherized for high priority categories

_____ DOE weatherization funds expended

_____ Non-DOE weatherization funds expended

_____ Descriptive statistics on demographics of households weatherized

_____ Descriptive statistics on weatherization measures installed in households weatherized

_____ Descriptive statistics on energy use/savings of households weatherized

_____ Copy of audits performed on the households weatherized

_____ Results of certain diagnostic tests

_____ Number of homes deferred for weatherization

_____ Other ___________________

9. Does your state maintain an electronic state weatherization program data base?

a. Yes

b. No (Go to Q13)

10. If yes, what does this database contain? (check all that apply)

a. number of homes weatherized

b. number of homes weatherized by type

c. costs of installed measures

d. billing records for weatherized homes

e. audit records

f. measures installed by unit

g. other _____________________________

11. Does your database also contain these types of information? (check all that apply)

a. Low Income Home Energy Assistance Program (LIHEAP) records

b. leveraged funds invested in DOE homes

c. other _______________________

12. Who has access to this database? (check all that apply)

a. state weatherization office staff

b. other state employees

c. local weatherization agency staff

d. other ______________________

13. Please indicate the number of staff that supported your State’s Weatherization Program and their work effort in Program Year 2010. In considering the number of staff, please include everyone who worked full- or part-time or who worked with the weatherization program as well as other state programs. Also include any non-agency staff supporting the state program that work under contract to the state.

Type of Administrative Function	Number of Staff (# persons)	Total Staff Work Effort (# of FTE)
Management/administration
Agency monitoring
Training and Technical Assistance
Other (specify)
TOTAL

14. For the in-house staff working on your state’s weatherization program in each of the following functional areas in Program Year 2010, please indicate their collective level of experience with the weatherization program:

	Very High	High	Medium	Low	Very Low
Management/administration
Field monitoring/auditing
Training and Technical Assistance
Other (specify)

15. For the in-house staff working in your state’s weatherization program in each of the functional areas listed below, please indicate the amount of turnover in staff from the beginning of PY 2009 to the end of PY 2010. (Please check appropriate box representing the level of turnover for each functional area.)

	No Turnover (all staff in this functional area at the beginning of PY 2009 were in the same functional area by the end of PY 2010)	Some turnover (some of the staff in this functional area at the beginning of PY 2009 did not remain in the same functional area by the end of PY 2010)	Complete turnover (none of the staff in this functional area at the beginning of PY 2009 remained in the same functional area at the end of PY 2010)
Management/ administration
Field monitoring/ Auditing
Training and Technical Assistance
Other (specify) ____________________

16. The Federal Regulations governing the Weatherization Assistance Program define children as “dependents not exceeding 19 years or a lesser age set forth in the State plan.” What age did your state use in your state’s definition of children in PY 2010? _____

17. Did your state use a high energy burden category to prioritize the provision of weatherization services in PY 2010?

_____ Yes

_____ No (go to Question 18)

17a. How was ‘high energy burden’ defined? ______________________________

18. Did your state use a high energy expenditure category to prioritize the provision of weatherization services in PY 2010?

_____ Yes

_____ No (go to Question 19)

18a. How was ‘high energy expenditure’ defined? ____________________________

19. What were the income guidelines for households to be eligible for your state’s weatherization program in PY 2010? (Check all that apply)

_____ 150% of Federal Poverty Guidelines

_____ 200% of Federal Poverty Guidelines

_____ More than 200% of Federal Poverty Guidelines

_____ 60% of state median income

_____ Other: ________________________

LEVERAGING RELATIONSHIPS

1. Please list weatherization funding received during PY 2010 by completing the table below.

Column A lists potential sources of weatherization funding. As a reference, Column B lists the amount of PY 2008 funding reported by your state in the retrospective evaluation S1 survey. If the PY 2008 funding amount is incorrect, please list the correct amount in Column B. In Column C, please indicate whether your state administered each funding source in PY 2010. In Column D, enter the total funding amount administered in PY 2010 from each source received. Please allocate the total funding amount listed in Column D to the sub-categories listed in Columns E through I.

A	B	C	D	E	F		G		H		I
Funding Source	Funds administered from this source in PY 2008	Did state administer weatherization funds from this source in PY 2010	Total funds administered from this source in PY 2010	Funds retained and spent by state			Funds passed on to subgrantees
				Grantee administration and leveraging		Grantee training and technical assistance (T&TA)	Subgrantee funding for program operations2	Subgrantee administration and leveraging		Subgrantee training and technical assistance (T&TA)
Department of Energy1	Pre-populated	Yes  No 	 Selecting	“no” will		gray out all	columns to the	right in		online survey
Low Income Home Energy Assistance Program	Pre-populated	Yes  No 	 Selecting	“yes” will		drive skip	patterns in	Q1b-13
Petroleum Violation Escrow (PVE)	Pre-populated	Yes  No 
Other Federal Programs	Pre-populated	Yes  No 
State Public Benefit Funds	Pre-populated	Yes  No 
Other State Programs	Pre-populated	Yes  No 
Utilities	Pre-populated	Yes  No 
Program Income	Pre-populated	Yes  No 
In-Kind	Pre-populated	Yes  No 
Non-Profits	Pre-populated	Yes  No 
Third Party (e.g., Foundations, Lenders)	Pre-populated	Yes  No 
All other (Please specify) ______________	Pre-populated	Yes  No 
TOTAL	Pre-populated
Include WAP and ARRA funds in this row. List all funding for weatherization program operations that was passed on to subgrantees, including amounts spent on health and safety, financial audits, liability insurance, vehicles and equipment.

1a. Of the Program Year 2010 funds retained by your state’s weatherization program for management functions, how much was used for each function listed below?

Type of Management Function	Total
Administration*
Agency monitoring
Other (specify)
TOTAL

* Includes planning, finance and accounting, clerical support, outreach, and evaluation.

[1b will be activated by ‘yes’ responses in the associated funding categories of Question 1 and skipped for any ‘no’ responses in those categories].

1b. In the categories below, please specify the name of each funder and the total amount of weatherization funding provided in PY 2010.

	Funding entity (please enter names)	Total weatherization funding administered in PY 2010 (please enter amounts)
Utilities
Utility 1
Utility 2
Utility 3
All other utilities
In-kind contributions
In-kind 1
In-kind 2
In-kind 3
All other in-kind
Nonprofits
Nonprofit 1
Nonprofit 2
Nonprofit 3
All other nonprofits
Other
Other 1
Other 2
Other 3
All others

[Q2 will be activated by ‘yes’ responses in the LIHEAP category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

2a. When did you first receive weatherization funds from LIHEAP? _________

2b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

2c. Please describe the change in the leveraging relationship between your state’s low-income weatherization program and LIHEAP during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely negative

2d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

2e. If leveraged funding from LIHEAP in PY 2010 decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

2f. Did you require local agencies to follow DOE rules when spending weatherization funds from LIHEAP in PY 2010?

_____ Yes

_____ No

[2g will appear if respondent answered ‘no’ in 2f]

2g. What were the major differences in the rules governing the expenditure of LIHEAP funds in comparison to the rules governing the expenditure of DOE funds?____________

________________________________________________________________________

[Q3 will be activated by ‘yes’ responses in the PVE category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

3a. When did state first receive weatherization funds from Petroleum Violation Escrow (PVE)? _________

3b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

3c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and PVE during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

3d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

3e. If leveraged funding from PVE in PY 2010 decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

3f. Did you require local agencies to follow DOE rules when spending weatherization funds from PVE in PY 2010?

_____ Yes

_____ No

[3g will appear if respondent answered ‘no’ in 3f]

3g. What were the major differences in the rules governing the expenditure of PVE funds in comparison to the rules governing the expenditure of DOE funds? _____________________________________________________________

________________________________________________________________________

[Q4 will be activated by ‘yes’ responses in the Other Federal Programs category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

4a. When did state first receive weatherization funds from Other Federal Programs? _________

4b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

4c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and Other Federal Programs during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

4d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

4e. If leveraged funding from Other Federal Programs decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

4f. Did you require local agencies to follow DOE rules when spending weatherization funds from Other Federal Programs in PY 2010?

_____ Yes

_____ No

[4g will appear if respondent answered ‘no’ in 4f]

4g. What were the major differences in the rules governing the expenditure of Other Federal Programs funds in comparison to the rules governing the expenditure of DOE funds? __________________________________________________________________

________________________________________________________________________

[Q5 will be activated by ‘yes’ responses in the State Public Benefit Funds category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

5a. When did state first receive weatherization funds from State Public Benefit Funds? _________

5b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

5c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and State Public Benefit Funds during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

5d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

5e. If leveraged funding from State Public Benefit Funds decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

5f. Did you require local agencies to follow DOE rules when spending weatherization funds from State Public Benefit Funds in PY 2010?

_____ Yes

_____ No

[5g will appear if respondent answered ‘no’ in 5f]

5g. What were the major differences in the rules governing the expenditure of State Public Benefit Funds in comparison to the rules governing the expenditure of DOE funds? __________________________________________________________________

________________________________________________________________________

[Q6 will be activated by ‘yes’ responses in the Other State Programs category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

6a. When did state first receive weatherization funds from Other State Programs? _________

6b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

6c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and Other State Programs during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

6d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

6e. If leveraged funding from Other State Programs decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

6f. Did you require local agencies to follow DOE rules when spending weatherization funds from Other State Programs in PY 2010?

_____ Yes

_____ No

[6g will appear if respondent answered ‘no’ in 6f]

6g. What were the major differences in the rules governing the expenditure of Other State Programs funds in comparison to the rules governing the expenditure of DOE funds?

________________________________________________________________________

________________________________________________________________________

[Q7 will be activated by ‘yes’ responses in the Utilities category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

7a. When did state first receive weatherization funds from Utilities? _________

7b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

7c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and Utilities during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

7d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

7e. If leveraged funding from Utilities decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

7f. Did you require local agencies to follow DOE rules when spending weatherization funds from Utilities in PY 2010?

_____ Yes

_____ No

[7g will appear if respondent answered ‘no’ in 7f]

7g. What were the major differences in the rules governing the expenditure of Utilities funds in comparison to the rules governing the expenditure of DOE funds?

________________________________________________________________________

________________________________________________________________________

[Q8 will be activated by ‘yes’ responses in the Program Income category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

8a. When did state first receive weatherization funds from Program Income? _________

8b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

8c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and Program Income during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

8d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

8e. If leveraged funding from Program Income decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

8f. Did you require local agencies to follow DOE rules when spending weatherization funds from Program Income in PY 2010?

_____ Yes

_____ No

[8g will appear if respondent answered ‘no’ in 8f]

8g. What were the major differences in the rules governing the expenditure of Program Income funds in comparison to the rules governing the expenditure of DOE funds?

________________________________________________________________________

________________________________________________________________________

[Q9 will be activated by ‘yes’ responses in the In-Kind Contributions category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

9a. When did state first receive weatherization funds from In-Kind Contributions? _________

9b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

9c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and In-Kind Contributions during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

9d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

9e. If leveraged funding from In-Kind Contributions decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

9f. Did you require local agencies to follow DOE rules when spending weatherization funds from In-Kind Contributions in PY 2010?

_____ Yes

_____ No

[9g will appear if respondent answered ‘no’ in 9f]

9g. What were the major differences in the rules governing the expenditure of In-Kind Contributions in comparison to the rules governing the expenditure of DOE funds?__________________________________________________________________

________________________________________________________________________

[Q10 will be activated by ‘yes’ responses in the Non-profits category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

10a. When did state first receive weatherization funds from Non-profits? _________

10b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

10c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and Non-profits during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

10d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

10e. If leveraged funding from Non-Profits decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

10f. Did you require local agencies to follow DOE rules when spending weatherization funds from Non-Profits in PY 2010?

_____ Yes

_____ No

[10g will appear if respondent answered ‘no’ in 10f]

10g. What were the major differences in the rules governing the expenditure of Non-Profits funds in comparison to the rules governing the expenditure of DOE funds? __________________________________________________________________

________________________________________________________________________

[Q11 will be activated by ‘yes’ responses in the Third Party category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

11a. When did state first receive weatherization funds from Third Parties (foundations, lenders)? _________

11b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

11c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and Third Parties during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

11d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

11e. If leveraged funding from Third Parties decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

11f. Did you require local agencies to follow DOE rules when spending weatherization funds from Third Parties in PY 2010?

_____ Yes

_____ No

[11g will appear if respondent answered ‘no’ in 11f]

11g. What were the major differences in the rules governing the expenditure of Third Party funds in comparison to the rules governing the expenditure of DOE funds?

________________________________________________________________________

________________________________________________________________________

[Q12 will be activated by ‘yes’ responses in All Other, Specify category of Question 1 and deactivated (skipped) for ‘no’ responses in that category.]

12a. When did state first receive weatherization funds from [insert text from ‘All Other, Specify’]?

12b. If known, number of years that state worked to achieve this leveraging relationship (leave blank if unknown): _________

12c. Please describe the change in leveraging relationships between your state’s low-income weatherization program and [insert text from ‘All Other, Specify’] during the ARRA period.

____ Extremely positive

____ Positive

____ No change

____ Negative

____ Extremely Negative

12d. How do you expect leveraged funding from this source to change from PY 2010 to the post-ARRA period in PY 2012?

____ increase

____ decrease

____ stay the same

12e. If leveraged funding from [insert text from ‘All Other, Specify’] decreased from PY 2008, was the change attributable to increased ARRA funding?

_____ Yes

_____ No

_____ Not applicable

12f. Did you require local agencies to follow DOE rules when spending weatherization funds from [insert text from ‘All Other, Specify’] in PY 2010?

_____ Yes

_____ No

[12g will appear if respondent answered ‘no’ in 12f]

12g. What were the major differences in the rules governing the expenditure of [insert text from ‘All Other, Specify’] funds in comparison to the rules governing the expenditure of DOE funds?

________________________________________________________________________

________________________________________________________________________

13. You indicated your state did not administer leveraged funding from the sources listed below during PY 2010. For each funding source, please indicate your expectations for funding during the post-ARRA period beginning in PY 2012.

Funding Source	Expectations for funding in the post-ARRA period beginning in PY 2012
	No change	Funding will increase	Funding will increase greatly	Uncertain
Populate from ‘no’ response in Q1
Populate from ‘no’ response in Q1
Populate from ‘no’ response in Q1
Populate from ‘no’ response in Q1

14. How important were leveraged funds for your State’s Weatherization Program in PY 2010 compared to program years without additional ARRA funding? (Check best answer)

_____Very important

_____ Important

_____ Not very important

_____ Not important at all

15. Did your state set aside funding to advocate for leveraged resources in PY 2010?

_____ Yes

_____ No (Go to Question 9)

16. What organizations advocated for leveraged resources in PY 2010? (Check all that apply)

_____ Your state office

_____ Your state’s agencies

_____ Non-profit organizations funded by your state

_____ Other

17. How successful would you rate your state’s efforts to acquire leveraged funds in PY 2010? (Check best answer)

_____ Very successful

_____ Successful

_____ Not very successful

_____ Not successful at all

_____ State does not seek leveraged funds

18. What factors limited the success of your state’s efforts to acquire leveraged funding in PY 2010? _______________________

19. Have you modified your state’s weatherization program practices or regulations since PY 2008 to facilitate spending and reporting on leveraged resources?

_____Yes

_____ No

20. Overall, how has the influx of ARRA funding impacted previously existing leveraging relationships?

a. Extremely positive impact

b. Positive impact

c. No Impact

d. Negative impact

e. Extremely negative impact

21. Can leveraging relationships damaged or lost during ARRA be re-built post-ARRA?

a. Yes, absolutely

b. Yes, probably

c. Uncertain

d. No, probably not

e. No, definitely not

22. Do you see state-level Renewable Portfolio Standards programs benefitting low-income weatherization? If so, how? If not, why not? ____________________________________

23. What aspects about your state’s low-income weatherization program are most misunderstood by actual and potential leveraging partners? __________________

24. How has your program worked to overcome these misunderstandings? _________________

25. What information would your state’s weatherization program like to have that could be used to overcome these misunderstandings?

26. What other information would your state’s weatherization program like to have that could be used to promote the adoption of leveraging relationships? __________________________

27. Overall, what is your expectation for total state leveraged funding for low-income weatherization funding post ARRA in PY 2012 (post- ARRA) compared to PY 2008 (pre-ARRA)?

a. Greatly increased

b. Increased

c. Same level

d. Decreased

e. Greatly decreased

28. On balance, how beneficial do you think ARRA funding will prove to be over the longer-term on your state’s ability to leverage DOE WAP-program funding for low-income weatherization?

a. Extremely beneficial

b. Beneficial

c. No long-term impact

d. Unbeneficial

e. Extremely unbeneficial

PROGRAM OPERATIONS AND IMPLEMENTATION

1. Using the following scale, how adequate was the Program Year 2010 funding received by your state from ALL funding sources for weatherizing the stock of eligible low-income dwelling units in your state in a timely fashion? (Check all that apply)

_____ Very Adequate

_____ Adequate

_____ Inadequate

_____ Very Inadequate

2. What was the quality of the management support that your state received from DOE and its contractors in Program Year 2010? (Check all that apply)

_____ very high quality

_____ high quality

_____ moderate quality

_____ low quality

_____ very low quality

_____ not applicable

3. What was the quality of the training that your state received from DOE and its contractors in Program Year 2010? (Check all that apply)

_____ very high quality

_____ high quality

_____ moderate quality

_____ low quality

_____ very low quality

_____ not applicable

4. What was the quality of the support and assistance on client education that your state received from DOE and its contractors in Program Year 2010? (Check all that apply)

_____ very high quality

_____ high quality

_____ moderate quality

_____ low quality

_____ very low quality

_____ not applicable

4a. If appropriate, why did you rate the quality very low or low? ______________

5. What was the quality of the support and assistance on leveraging the Weatherization Assistance Program funding provided by DOE with other funding sources in Program Year 2010? (Check all that apply)

_____ very high quality

_____ high quality

_____ moderate quality

_____ low quality

_____ very low quality

_____ not applicable

5a. If appropriate, why did you rate the quality very low or low? ______________

6. What was the quality of the technical support (e.g., measure selection and installation) that your state received from DOE and its contractors in Program Year 2010? (Check all that apply)

_____ very high quality

_____ high quality

_____ moderate quality

_____ low quality

_____ very low quality

_____ not applicable

6a. If appropriate, why did you rate the quality very low or low? ______________

7. How flexible did you find the DOE program rules that governed the weatherization program in Program Year 2010? In other words, did the program rules allow your state to tailor your program to your needs (very flexible) or proscribe your program to only one way of operation (very inflexible)? (Check all that apply)

_____ Very Flexible

_____ Flexible

_____ Inflexible

_____ Very Inflexible

7a. Using PY 2010 as the reference point, how should the program rules change? (One)

_____ Become much more flexible

_____ Become more flexible

_____ Stay about the same

_____ Become more inflexible

_____ Become much more inflexible

7b. In what areas should the program rules become more flexible? ________________________

7c. In what areas should the program rules become less flexible? _________________________

8. Please describe any important political issues faced by your state’s weatherization program in Program Year 2010. ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

9. Please rank, for your state, the importance of the following additions or improvements (1 being most important and 7 being least important):

_____Additional administrative support and assistance from DOE

_____Improved training from DOE and its contractors

_____Additional assistance from DOE and its contractors with leveraging resources

_____Improved technical support from DOE and its contractors

_____Additional funding for the delivery of weatherization services

_____Improved data and information systems for the delivery of weatherization services

_____ Additional assistance to develop and administer client education programs

PROGRAM IMPLEMENTATION DURING THE ARRA PERIOD

1. During the ARRA period, has your state added any new local weatherization agencies (i.e., sub-grantees) to its low-income weatherization program?

a. Yes

b. No (Skip to Question 4)

2. How many new local weatherization agencies were added? ____________

3.Why were these agencies added? (check all that apply)

a. To meet increased production targets

b. To replace non-performing subgrantees

c. To build synergies between the state weatherization program and other community service programs in community action agencies that did not provide weatherization services

d. Other _______________________

4. For many years, the national weatherization network and the state-level national weatherization networks had been relatively stable. During the ARRA period, beyond sub-grantees, did the composition of your state-level weatherization network change?

a. Yes

b. No (Skip to Question 8)

5. How would you characterize the magnitude of this change?

a. Greatly increased

b. Increased

c. Same level

d. Decreased

e. Greatly decreased

6. Using the table below, please list the names and contributions of up to ten major new stakeholders.

Name	Description of Weatherization Related Contributions (e.g., provides training, sells energy efficient products )

7. Please rate the quality of services and products provided by the new major stakeholders:

a. very high quality

b. high quality

c. moderate quality

d. low quality

e. very low quality

f. not applicable

8. Please provide your best estimate for how many new low-income weatherization-related businesses were created in your state during the ARRA period:

a. none

b. 1-10

c. 11-20

d. 21-30

e. 30+

f. don’t know

9. How have private companies new to the weatherization network tried to change state and local weatherization procedures during the ARRA period? ___________________________________

10. On balance, how beneficial have these new stakeholders been to your state’s weatherization program?

a. Extremely beneficial

b. Beneficial

c. Neither beneficial nor unbeneficial

d. Unbeneficial

e. Extremely unbeneficial

Please Explain _____________________

11. During the ARRA period, did organizational responsibilities for your state’s weatherization program (e.g., reporting lines, organizational home) change?

a. Yes

b. No (Skip to Question 13)

12. How did the organizational responsibilities change during the ARRA period PY 2010? Please Explain _______________

13. How have relationships changed in general between your state weatherization office and local weatherization agencies during ARRA?

a. become much more positive

b. become more positive

c. no changes

d. become more negative

e. become much more negative

14. Which statement best describes how the existing local weatherization agencies (i.e., subgrantees) dealt with program expansion during the ARRA period?

a. promoted existing weatherization staff to management positions and hired new entry level workers

b. hired new weatherization managers and hired new entry level workers

c. promoted existing weatherization staff to management positions and hired contractors to ramp up production

d. hired contractors to ramp up production

15. Were there any material, equipment or other supply chain bottlenecks during the ARRA period that negatively impacted weatherization production in your state?

a. No

b. Yes

If yes, what was in short supply? ______________________

16. To what extent have large DOE/OWIP programs, WAP, State Energy Program, and Energy Efficiency Community Block Grant Program competed for labor during the ARRA period?

a. Not at all

b. a small extent

c. a moderate extent

d. a large extent

e. a very large extent

17. During the ARRA period, how has state-level oversight of your state’s weatherization assistance program changed?

a. Greatly increased

b. Increased

c. Stayed the same

d. Decreased

e. Greatly decreased

18. Has ARRA funding allowed your state program to purchase and implement new information technologies to improve program administration?

a. Yes

b. No

If yes, please describe these new information technologies. __________________________

19 During PY 2010, how much of a burden were your state program’s administrative costs allocated to dealing with increased oversight during the ARRA period (e.g., from DOE IG, GAO)?

a. no burden

b. slight burden

c. moderate burden

d. substantial burden

e. extreme burden

20. Did your state change its audit approach during the ARRA-period from the approach used pre-ARRA (i.e., PY2008)?

a. Yes, went from priority list to computerized audit

b. Yes, went from computerized audit to priority list

c. Yes, changed from one computerized audit tool to another

d. No

e. Other _________________________

21. During the ARRA period, has your state passed any new laws and/or implemented any new regulations that have directly impacted your state’s weatherization assistance program?

a. Yes

b. No (Skip to Question 25)

22. Please describe the new laws and/or regulations. __________________________

23. On balance, how beneficial have these new laws and/or regulations been to your state’s weatherization program?

a. Extremely beneficial

b. Beneficial

c. Neither beneficial nor unbeneficial

d. Unbeneficial

e. Extremely unbeneficial

Please explain ______________________________________

24. Would these laws and/or regulations have been passed without the increased funding on the program attributable to ARRA?

a. No, Wholly due to ARRA

b. No, Primarily due to ARRA

c. No, Somewhat due to ARRA

d. Yes, Would have been passed anyway without ARRA

25. Did your state change the way it provides technical assistance to its subgrantees during the ARRA period?

a. No

b. Yes

If yes, how? ____________________________________

26. Has your state implemented new certification requirements for weatherization workers during the ARRA period?

a. No (go to Q28)

b. Yes

27. What new certifications are required? (Check all that apply)

a. BPI Building Analyst

b. BPI Envelope

c. BPI Residential Building Envelope Accessible Areas Air Leakage Control Installer

d. Residential Building Envelope Whole House Air Leakage Control Crew Chief

e. BPI Manufactured Housing

f. BPI Heating

g. BPI Air Conditioning and Heat Pump

h. BPI Multifamily

i. HERS

j. LEED

k. Lead Safe Weatherization

l. Lead Certified Renovator

m. NAHB Green Building

n. Other ___________________

28. Which statement best describes changes in the level of employment in your state resulting from Davis-Bacon?

a. large number of jobs created

b. small number of jobs created

c. no change in the number of jobs

d. small number of jobs lost

e. large number of jobs lost

f. don’t know

29. Which statement best describes the impact of Davis-Bacon on wages paid to weatherization workers in your state?

a. large increase in wages (over 10% increase)

b. moderate increase in wages (between 5 and 10% increase)

c. small increase in wages (between 1 and 5% increase)

d. no increase in wages

e. small decrease in wages(between 1 and 5% decrease)

f. moderate decrease in wages(between 5 and 10% decrease)

g. large decrease in wages (over 10% decrease)

30. How much of an impact did your state experience while coordinating wages stipulated by Davis-Bacon for local weatherization agencies whose operations spanned multiple counties?

a. no impact

b. small impact

c. moderate impact

d. large impact

e. very large impact

31. Overall, how did Davis-Bacon impact the costs of weatherization in your state?

a. greatly increased costs

b. increased costs

c. no change in costs

d. decreased costs

e. greatly decreased costs

32. In your state, on average, how much did Davis-Bacon rules change the cost of weatherizing low-income multifamily buildings four stories and higher?

a. 1-10% increase

b. 11-20% increase

c 21% + increase

d. no increase

e. 1-10% decrease.

f. 11-20% decrease

g. 21% + decrease

h. N/A

33. Does your state allow the weatherization of large low-income multi-family buildings?

a. yes

b. no

If not, why not? _______________________________

34. What are the barriers to weatherizing large low-income multi-family buildings in your state? (Check all that apply)

a. lack of trained auditors

b. lack of trained crew

c. too expensive

d. building owners are uncooperative

e. energy savings are not high enough

f. unclear guidance from DOE or other agencies on owner contributions

g. other __________________

35. Does your state allow the weatherization of public housing, that is, housing owned by a public housing authority?

a. Yes

b. No

If not, why not? _______________________________

36. Does your state allow the weatherization of HUD assisted housing?

a. Yes

b. No

If not, why not? _______________________________

37. How many units of each type were weatherized in your state in PY 2010?

Type of Housing	Large Multi-family (Not Public Housing or HUD Assisted	Public Housing Multi-family	HUD Assisted Multi-family

38. Are there any DOE rules that could be changed to make it easier to weatherize large low-income multi-family buildings?

a. Yes. Describe:_____________________________________________________________

b. No

39. Does your state’s weatherization program have an agreement with your State Historic Preservation Office (SHPO)?

a. Yes

b. No

40. What percentage of units weatherized in PY 2010 fell under the SHPO agreement?

a. 0

b. 1-5

c. 6-10

d. 11-15

e. 15+

41. Does your state have a deferral policy?

a. Yes

b. No

42. Please estimate the number of units where weatherization was deferred during PY 2010?

a. 0%

b. 1-5%

c. 6-10%

d. 10-20%

e. 21-30%

f. more than 30%

43. Please estimate what percentage of units where weatherization was deferred during PY 2010 will eventually be weatherized?

a. 0%

b. 1-25%

c. 26-50%

d. 51-75%

e. 76-90%

f. 91-100%

44. Please describe your states deferral rates in PY2010 compared to PY2008:

a. very great increase

b. great increase

c. increase

d. no change

e. decrease

f. great decrease

g. very great decrease

45. How has the visibility of your state’s weatherization program changed vis-à-vis the general public during the ARRA period?

a. greatly increased

b. increased

c. no change

d. decreased

e. greatly decreased

46. Please rate the quality of the media coverage your state’s weatherization program has received during the ARRA period?

a. very high quality

b. high quality

c. moderate quality

d. low quality

e. very low quality

f. N/A no media coverage (skip to 52)

g. no opinion

47. Please describe the overall media coverage of your state’s weatherization program during the ARRA period:

a. very positive

b. positive

c. neither positive or negative

d. negative

e. very negative

48. What topics did the media mainly focus on? (check all that apply)

a. Jobs created

b. Energy saved

c. Helping low income households

d. waste, fraud and abuse

e. Lack of energy savings

f. Organizational mis-steps

g. Other ______________________

49. Will weatherization issues identified by the media specifically during ARRA have lasting impacts on leveraging weatherization funding for your state in the future?

a. could substantially reduce funding

b. could reduce funding

c. no impact

d. could increase funding

e. could substantially increase funding

TRAINING

1. For those staff working in your state’s weatherization office who need to have knowledge about the following list of weatherization topics, how well trained were they in each area in PY 2010? Please use the following scale: 1– not at all well trained; 2 – not well trained; 3 – moderately well trained; 4 –well trained; 5 – very well trained; 6 – not applicable Circle best answer.

(1) Diagnostic procedures 1 2 3 4 5 6

(2) Insulation

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(3) Space heating, ventilation, air conditioning

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(4) Infiltration measures

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(5) Doors and windows

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(6) Hot water heating

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(7) Baseloads (e.g., lighting, refrigerators)

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

1a. For those staff working in your state’s weatherization office who need to have knowledge about the following list of administrative-related topics, how well trained were they in each area? Please use the following scale: 1– not at all well trained; 2 – not well trained; 3 – moderately well trained; 4 –well trained; 5 – very well trained; 6 – not applicable Circle best answer.

(1) Management 1 2 3 4 5 6

(2) Client education 1 2 3 4 5 6

(3) Auditing/estimating

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(4) Monitoring/quality control 1 2 3 4 5 6

(5) Financial topics 1 2 3 4 5 6

(6) Outreach and communications 1 2 3 4 5 6

(7) Other (please specify) 1 2 3 4 5 6

1b. For those staff working in your state’s weatherization office who need to have knowledge about the following list of health and safety topics, how well trained were they in each area? Please use the following scale: 1– not at all well trained; 2 – not well trained; 3 – moderately well trained; 4 –well trained; 5 – very well trained; 6 – not applicable Circle best answer.

(1) Fire safety 1 2 3 4 5 6

(2) Indoor air quality 1 2 3 4 5 6

(3) Measures to increase security of housing unit 1 2 3 4 5 6

(4) Measures to reduce common household hazards 1 2 3 4 5 6

(5) Mold and mildew 1 2 3 4 5 6

(6) Lead 1 2 3 4 5 6

(7) Asbestos 1 2 3 4 5 6

(8) Vermiculite 1 2 3 4 5 6

(9) General crew safety 1 2 3 4 5 6

(10) Other health and safety 1 2 3 4 5 6

(11) Other (please specify 1 2 3 4 5 6

1c. For categories receiving answers of (1)-not at all well trained, or (2)-not well trained to the above questions, what were the barriers for receiving this training:

a. Funding

b. Time

c. Not a priority

d. Not available

e. Other___________________

2. On which of the following weatherization subjects did staff working in your state’s weatherization office receive training in Program Year 2010 from DOE, your state, or other entities? (Check all that apply)

(1) Diagnostic procedures _____

(2) Insulation _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(3) Space heating, ventilation, air conditioning _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(4) Infiltration measures _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(5) Doors and windows _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(6) Hot water heating _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(7) Baseloads (e.g., lighting, refrigerators) _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

2a. On which administration-related topics did staff working in your state’s weatherization office receive training in Program Year 2010 from DOE, your state, or other entities? (Check all that apply)

(1) Management _____

(2) Client education _____

(3) Auditing/estimating _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(4) Monitoring/quality control _____

(5) Financial topics _____

(6) Outreach and communications _____

(7) Other (please specify) _____

2b. On which health and safety topics did staff working in your state’s weatherization office receive training in Program Year 2010 from DOE, your state, or other entities? (Check all that apply.)

_____ Fire safety

_____ Indoor air quality

_____ Measures to increase security of housing unit

_____ Measures to reduce common household hazards

_____ Mold and mildew

_____ Lead

_____ Asbestos

_____ Vermiculite

_____ General crew safety

_____ Other health and safety

_____ Other (please specify

3. For those staff working in your state’s weatherization office who need to have knowledge about the following list of diagnostic topics, how well trained were they in each area in PY 2010? Please use the following scale: 1– not at all well trained; 2 – not well trained; 3 – moderately well trained; 4 –well trained; 5 – very well trained; 6 – not applicable Circle best answer.

Pressure diagnostics:

• Blower door (house air leakage rate) 1 2 3 4 5 6

• Zonal pressure measurements 1 2 3 4 5 6

• Room-to-room pressure measurements 1 2 3 4 5 6

• Duct pressure pan measurements 1 2 3 4 5 6

• Duct blower measurements (duct air leakage rate) 1 2 3 4 5 6

Space-heating system:

• Flue gas analysis (steady-state efficiency measurements)1 2 3 4 5 6

• Heat rise measurements 1 2 3 4 5 6

• CO measurements in flues 1 2 3 4 5 6

• Draft/spillage (normal operation) 1 2 3 4 5 6

Air-conditioning system:

• Refrigerant charge (e.g., superheat, subcooling) 1 2 3 4 5 6

HVAC components and cross-cutting diagnostics:

• Air handler flow rate 1 2 3 4 5 6

• Thermostat anticipator current 1 2 3 4 5 6

• Worst case draft/spillage (CAZ) 1 2 3 4 5 6

Hot-water (water-heating) system:

• Flue gas analysis (steady-state efficiency measurements)1 2 3 4 5 6

• CO measurements in flues 1 2 3 4 5 6

• Draft/spillage (normal operation) 1 2 3 4 5 6

• Water flow rates (showerheads and faucets) 1 2 3 4 5 6

Other CO measurements:

• CO measurements in equipment rooms 1 2 3 4 5 6

• Cooking stove 1 2 3 4 5 6

• CO measurements in living areas 1 2 3 4 5 6

Other diagnostics and inspections:

• Refrigerator energy use 1 2 3 4 5 6

• Exhaust fan air flow rate measurement 1 2 3 4 5 6

• Infrared scanning (camera) 1 2 3 4 5 6

• Radon testing 1 2 3 4 5 6

• Lead testing 1 2 3 4 5 6

• Mold and mildew testing 1 2 3 4 5 6

• Moisture context testing 1 2 3 4 5 6

• Other (please specify) ____________________ 1 2 3 4 5 6

3a. For categories receiving answers of (1)-not at all well trained, or (2)-not well trained to the above question, what were the barriers for receiving this training:

a. Funding

b. Time

c. Not a priority

d. Not available

e. Other___________________

4. On which of the following diagnostic procedures did staff working in your state’s weatherization office receive training in Program Year 2010 from DOE, your state, or other entities? (Check all that apply.)

Pressure diagnostics:

• Blower door (house air leakage rate) _____

• Zonal pressure measurements _____

• Room-to-room pressure measurements (distribution balancing) _____

• Duct pressure pan measurements _____

• Duct blower measurements (duct air leakage rate) _____

Space-heating system:

• Flue gas analysis (steady-state efficiency measurements) _____

• Heat rise measurements _____

• CO measurements in flues _____

• Draft/spillage (normal operation) _____

Air-conditioning system:

• Refrigerant charge (e.g., superheat, subcooling) _____

HVAC components and cross-cutting diagnostics:

• Air handler flow rate _____

• Thermostat anticipator current _____

• Worst case draft/spillage (CAZ) _____

Hot-water (water-heating) system:

• Flue gas analysis (steady-state efficiency measurements) _____

• CO measurements in flues _____

• Draft/spillage (normal operation) _____

• Water flow rates (showerheads and faucets) _____

Other CO measurements:

• CO measurements in equipment rooms _____

• Cooking stove _____

• CO measurements in living areas _____

Other diagnostics and inspections:

• Refrigerator energy use _____

• Exhaust fan air flow rate measurement _____

• Infrared scanning (camera) _____

• Radon testing _____

• Lead testing _____

• Mold and mildew testing _____

• Moisture context testing _____

• Other (please specify) ___________________________________ _____

5. For each broad subject listed in the left-most column of the following table, put a check mark in the appropriate cell(s) to indicate which training method(s) you believe were most effective for imparting key skills and information in that area to your state’s in-house staff and any non-agency staff supporting the state program who work under contract to the state in PY 2010:

Subject	Conferences	Primarily Classroom Training	Primarily Field Training	In-person expert visits	Web casts	Other (specify)
Management
Weatherization skills and methods
Auditing/Estimating/ Measure selection
Monitoring and quality control
Financial topics
Outreach and communications
Health and safety
Diagnostic procedures
Client education
Other (specify)

6. For each broad subject listed in the left-most column of the following table, please indicate the quality of training received in Program Year 2010 at the training venues listed in the column headings. Please leave cells blank were your in-house staff did not receive training during this period of time. Please use the following scale: 1-very low; 2 - low; 3-medium; 4- high; 5-very high

	National Weatherization Program Conference	Affordable Comfort Conference	Regional Weatherization Conference	State Weatherization Conference	State/ Regional Training Center	Training Provided by Your Own State
Subject
Management
Weatherization skills and methods
Auditing/ Estimating
Monitoring/ quality control
Financial topics
Outreach and communications
Health and safety
Diagnostic procedures
Procedures for selecting weatherization measures
Client education
Other (specify)

7. On which of the following weatherization topics did your state provide training to your state’s local weatherization agencies or their contractors in Program Year 2010? (Check all that apply)

(1) Diagnostic procedures _____

(2) Insulation _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(3) Space heating, ventilation, air conditioning _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(4) Infiltration measures _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(5) Doors and windows _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(6) Hot water heating _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(7) Baseloads (e.g., lighting, refrigerators) _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

7a. On which of the following administrative-related topics did your state provide training to your state’s local weatherization agencies or their contractors in Program Year 2010? (Check all that apply)

(1) Management _____

(2) Client education _____

(3) Auditing/estimating _____

-- single family dwellings _____

-- multifamily dwellings _____

-- mobile homes _____

(4) Monitoring/quality control _____

(5) Financial topics _____

(6) Outreach and communications _____

(7) Other (please specify) _____

7b. On which of the following health and safety topics did your state provide training to your state’s local weatherization agencies or their contractors in Program Year 2010? (Check all that apply)

_____ Fire safety

_____ Indoor air quality

_____ Measures to increase security of housing unit

_____ Measures to reduce common household hazards

_____ Mold and mildew

_____ Lead

_____ Asbestos

_____ Vermiculite

_____ General crew safety

_____ Other health and safety

_____ Other (please specify)

8. On which of the following diagnostic procedures did your state provide training to your state’s local weatherization agencies or their contractors in Program Year 2010? (Check all that apply)

Pressure diagnostics:

• Blower door (house air leakage rate) _____

• Zonal pressure measurements _____

• Room-to-room pressure measurements (distribution balancing) _____

• Duct pressure pan measurements _____

• Duct blower measurements (duct air leakage rate) _____

Space-heating system:

• Flue gas analysis (steady-state efficiency measurements) _____

• Heat rise measurements _____

• CO measurements in flues _____

• Draft/spillage (normal operation) _____

Air-conditioning system:

• Refrigerant charge (e.g., superheat, subcooling) _____

HVAC components and cross-cutting diagnostics:

• Air handler flow rate _____

• Thermostat anticipator current _____

• Worst case draft/spillage (CAZ) _____

Hot-water (water-heating) system:

• Flue gas analysis (steady-state efficiency measurements) _____

• CO measurements in flues _____

• Draft/spillage (normal operation) _____

• Water flow rates (showerheads and faucets) _____

Other CO measurements:

• CO measurements in equipment rooms _____

• Cooking stove _____

• CO measurements in living areas _____

Other diagnostics and inspections:

• Refrigerator energy use _____

• Exhaust fan air flow rate measurement _____

• Infrared scanning (camera) _____

• Radon testing _____

• Lead testing _____

• Mold and mildew testing _____

• Moisture context testing _____

• Other (please specify) ___________________________________ _____

9. Which of the following types of personnel did your state use to provide training to your state’s local weatherization agencies or their contractors in Program Year 2010? (Check all that apply)

• DOE staff _____

• DOE contractor _____

• State staff _____

• State contractor _____

• Staff from another state _____

• State training center staff _____

• Local agency staff from your state _____

• Agency staff from another state _____

• Manufacturer representative _____

• Utility staff _____

• Representative from trade organization _____

• Consultant _____

• Other (please specify) _____________________________________ _____

10. What types of credentials or experience were required of the personnel your state used to provide training to your state’s local weatherization agencies or their contractors in Program Year 2010? (Check all that apply)

• Technical certification _____

• Extensive weatherization field experience _____

• Construction experience _____

• Extensive management experience _____

• Extensive experience with financial matters _____

• Other (please specify) _____________________________________ _____

10a. Using the scale below, please indicate how important each credential was for trainers to have in PY 2010?

1= Very Unimportant; 2=Unimportant; 3= Important; 4=Very Important

• Technical certification _____

• Extensive weatherization field experience _____

• Construction experience _____

• Extensive management experience _____

• Extensive experience with financial matters _____

• Other (please specify) _____________________________________ _____

11. How many of your state’s weatherization office staff acted as instructors at the following training events that your state provided (e.g., funded, organized) to your state’s local weatherization agencies or their contractors in Program Year 2010?

• State weatherization conference _____

• Other state conference _____

• State/regional training center class _____

• State-sponsored class taught at central location _____

• In-person expert visit (e.g., peer exchange, consultant) _____

• Instruction given to individual agency during an agency visit _____

• Web cast _____

• Other (please specify) _____________________________________ _____

12. For each broad subject listed in the left-most column of the following table, put a check mark in the appropriate cell(s) to indicate which training method(s) you believe were most effective for imparting key skills and information in that area to your local weatherization agencies or their contractors in PY 2010:

Subject	State weatherization conference	Other state conference	State/ regional training center class	State-sponsored class taught at central location	In-person expert visit	Instruction given to individual agency	Web casts	Other (specify)
Management
Weatherization skills and methods
Auditing/Estimating/ Measure selection
Monitoring and quality control
Financial topics
Outreach and communications
Health and safety
Diagnostic procedures
Client education
Other (specify)

13. On average, how well trained were local weatherization crews (both agency and contractor) in your state in the following weatherization topics in PY 2010? Please use the following scale: 1– not at all well trained; 2 – not well trained; 3 – moderately well trained; 4 –well trained; 5 – very well trained; 6 – not applicable Circle best answer.

(1) Diagnostic procedures 1 2 3 4 5 6

(2) Insulation

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(3) Space heating, ventilation, air conditioning

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(4) Infiltration measures

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(5) Doors and windows

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(6) Hot water heating

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(7) Baseloads (e.g., lighting, refrigerators)

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

13a. On average, how well trained were local weatherization crews (both agency and contractor) in your state in the following administrative-related topics in PY 2010? Please use the following scale: 1– not at all well trained; 2 – not well trained; 3 – moderately well trained; 4 –well trained; 5 – very well trained; 6 – not applicable Circle best answer.

(1) Management 1 2 3 4 5 6

(2) Client education 1 2 3 4 5 6

(3) Auditing/estimating

-- single family dwellings 1 2 3 4 5 6

-- multifamily dwellings 1 2 3 4 5 6

-- mobile homes 1 2 3 4 5 6

(4) Monitoring/quality control 1 2 3 4 5 6

(5) Financial topics 1 2 3 4 5 6

(6) Outreach and communications 1 2 3 4 5 6

(7) Other (please specify) 1 2 3 4 5 6

13b. On average, how well trained were local weatherization crews (both agency and contractor) in your state in the following health and safety topics in PY 2010? Please use the following scale: 1– not at all well trained; 2 – not well trained; 3 – moderately well trained; 4 –well trained; 5 – very well trained; 6 – not applicable Circle best answer.

(1) Fire safety 1 2 3 4 5 6

(2) Indoor air quality 1 2 3 4 5 6

(3) Measures to increase security of housing unit 1 2 3 4 5 6

(4) Measures to reduce common household hazards 1 2 3 4 5 6

(5) Mold and mildew 1 2 3 4 5 6

(6) Lead 1 2 3 4 5 6

(7) Asbestos 1 2 3 4 5 6

(8) Vermiculite 1 2 3 4 5 6

(9) General crew safety 1 2 3 4 5 6

(10) Other health and safety 1 2 3 4 5 6

(11) Other (please specify 1 2 3 4 5 6

13c. For categories receiving answers of (1)-not at all well trained, or (2)-not well trained to the above question, what were the barriers for receiving this training:

a. Funding

b. Time

c. Not a priority

d. Not available

e. Other___________________

14. Overall, how well trained were your state’s weatherization crews in PY 2010? (Check best answer)

_____ Very well trained

_____ Well trained

_____ Moderately well trained

_____ Poorly trained

_____ Very poorly trained

MONITORING

1. About how many state weatherization office staff went into the field to monitor local weatherization agencies in your state in Program Year 2010? {Note: do not include people who do quality assurance at the local agency level for the local agencies.}

• State staff _____

• State contractors _____

• Other (please specify) _____________________________________ _____

2. Which of the following types of post-weatherization quality control inspection did your state perform on weatherized dwelling units in Program Year 2010? (Check all that apply)

• Visual inspection of installed measures _____

• Verification of insulation depths/quantities _____

• Verification of operation of measures installed _____

• Assessment of quality of measures installed _____

• Identification of needed measures that were not installed _____

• Blower door test _____

• Heating system efficiency test (flue gas analysis) _____

• Draft/spillage tests of heating systems _____

• Carbon monoxide (CO) monitoring _____

• Infrared scanning _____

• Identification of unresolved health and safety issues _____

• Discussion with occupants _____

• Other (specify)________________________________________ _____

3. Please indicate which types of post-weatherization quality control inspection listed below were initiated since ARRA PY 2009. (Check all that apply)

• Visual inspection of installed measures _____

• Verification of insulation depths/quantities _____

• Verification of operation of measures installed _____

• Assessment of quality of measures installed _____

• Identification of needed measures that were not installed _____

• Blower door test _____

• Heating system efficiency test (flue gas analysis) _____

• Draft/spillage tests of heating systems _____

• Carbon monoxide (CO) monitoring _____

• Infrared scanning _____

• Identification of unresolved health and safety issues _____

• Discussion with occupants _____

• Other (specify)________________________________________ _____

4. Please indicate the cost, the amount of training needed, the amount of time needed and the effectiveness of the following types of post-weatherization quality control inspection procedures relative to each other for PY 2010. Please use the following scale: 1 – very low; 2 – low; 3 – medium; 4 – high; 5 – very high.

Type of Post-Weatherization Quality Control Inspection	Cost	Training Needed	Time Needed	Effectiveness
Visual inspection of installed measures
Verification of insulation depths/quantities
Verification of operation of measures installed
Assessment of quality of measures installed
Identification of needed measures that were not installed
Blower door test
Heating system efficiency test (flue gas analysis)
Draft/spillage tests of heating systems
Carbon monoxide (CO) monitoring
Infrared scanning
Identification of unresolved health and safety issues
Discussion with occupants
Other (specify)

5. On average, how many hours were spent by state weatherization office staff on-site conducting post-weatherization quality control in a typical weatherized home in Program Year 2010? __________

6. What types of credentials or experience were required of your post-weatherization quality control inspectors in your state weatherization office in Program Year 2010? (Check all that apply)

• Technical certification _____

• Extensive experience performing pre-weatherization audits _____

• Extensive experience performing weatherization work _____

• Extensive experience supervising weatherization work _____

• Construction experience _____

• Other (please specify) _____________________________________ _____

7. Please indicate their level of experience of the post-weatherization quality control inspectors in your state weatherization office for each of the following areas in Program Year 2010.

	Very High	High	Medium	Low	Very Low
Performing pre-weatherization audits
Performing weatherization work
Supervising weatherization work
Working in construction
Performing post-weatherization inspections
Other (specify)

8. On average, how frequently did state weatherization program office staff visit each local agency to conduct post-weatherization quality control inspections in Program Year 2010? (Check best answer)

_____ Weekly

_____ Monthly

_____ Quarterly

_____ Annually

_____ Other (please specify) _________________

9. On how many dwelling units did your state perform post-weatherization quality control inspections in Program Year 2010? _____

9a. Of those inspected, approximately how many were found to have a problem significant enough to require a return visit by local agency weatherization crews? _____

9b. Of those requiring a return visit, how many had work done that probably resulted in more energy savings? _____

9c. What were the three most common problems found in the dwelling units inspected by your state in Program Year 2010?

________________________________________________________________________________________________________________________________________________________________________________________________________________________

10. In those cases where a Program Year 2010 post-weatherization quality control inspection revealed a problem with the job performed, what single action was most commonly taken in response to that finding? (Check best answer)

• Made agency send crew back to correct problem _____

• Made agency send crew supervisor to correct problem _____

• Sent someone from state office to correct problem _____

• No action taken _____

• Other (please specify) ______________________________________ _____

11. What other actions were taken in Program Year 2010 in response to the discovery of a problem with the weatherization job performed? (Check all that apply)

• Made agency send original crew back to correct problem _____

• Made agency send different crew to correct problem _____

• Made agency send crew supervisor to correct problem _____

• Sent someone from state office to correct problem _____

• No action taken _____

• Other (please specify) ______________________________________ _____

12. When used, how often did the inspection reveal a misuse of the priority list?

1. Never

2. 1-5% of the time

3. 6-10% of the time

4. 11-20% of the time

5. More than 20% of the time

6. N/A

13. When used, how often did the inspection reveal a misuse of the computer audit?

1. Never

2. 1-5% of the time

3. 6-10% of the time

4. 11-20% of the time

5. More than 20% of the time

6. N/A

14. Which of the following monitoring tasks did your state perform in Program Year 2010 to check on the administration of local weatherization efforts? (Check all that apply)

• Verification of number of dwelling units weatherized _____

• Verification of clients’ income eligibility _____

• Verification of average expenditure per weatherized unit _____

• Verification of material expenditures _____

• Verification that installed measures had an SIR of 1.0 or greater _____

• Examination of vehicle costs _____

• Examination of other equipment costs _____

• Examination of training and technical assistance (T&TA) costs _____

• Examination of administrative costs _____

• Examination of material inventory _____

• Interviews with agency staff _____

• Interviews with agency contractor staff _____

• Interviews with agency clients _____

• Other (please specify) ___________________________________ _____

15. Please indicate which types of monitoring tasks listed below were initiated since ARRA to PY 2009. (Check all that apply)

• Verification of number of dwelling units weatherized _____

• Verification of clients’ income eligibility _____

• Verification of average expenditure per weatherized unit _____

• Verification of material expenditures _____

• Verification that installed measures had an SIR of 1.0 or greater _____

• Examination of vehicle costs _____

• Examination of other equipment costs _____

• Examination of training and technical assistance (T&TA) costs _____

• Examination of administrative costs _____

• Examination of material inventory _____

• Interviews with agency staff _____

• Interviews with agency contractor staff _____

• Interviews with agency clients _____

• Other (please specify) ___________________________________ _____

16. Please indicate the cost, the amount of training needed, the amount of time needed and the effectiveness of the following types of monitoring tasks relative to each other for PY 2010. Please use the following scale: 1 – very low; 2 -- low; 3 – moderate; 4 –high; 5 – very high.

Type of Monitoring Tasks	Cost	Training Needed	Time Needed	Effectiveness
Verification of number of dwelling units weatherized
Verification of clients’ income eligibility
Verification of average expenditure per weatherized unit
Verification of material expenditures
Verification that installed measures had an SIR of 1.0 or greater
Examination of vehicle costs
Examination of other equipment costs
Examination of training and technical assistance (T&TA) costs
Examination of administrative costs
Examination of material inventory
Interviews with agency staff
Interviews with agency contractor staff
Interviews with agency clients
Other (specify)

17. On average, how many hours were spent by state weatherization office staff on-site at each local agency monitoring agency administrative activities in Program Year 2010? __________

18. What types of credentials or experience were required of those who monitored the administration of local weatherization efforts in your state in Program Year 2010? Check all that apply.

• Technical certification _____

• Extensive experience performing pre-weatherization audits _____

• Extensive experience performing weatherization work _____

• Extensive experience supervising weatherization work _____

• Construction experience _____

• Extensive management experience _____

• Extensive finance experience _____

• Extensive experience administering local weatherization programs _____

• Other (please specify) _____________________________________ _____

19. Please indicate their level of experience of the local agency monitors in your state weatherization office for each of the following areas in Program Year 2010.

	Very High	High	Moderate	Low	Very Low
Management
Finance
Administration of local weatherization programs
Other (specify)

20. On average, how frequently did state weatherization program office staff visit each local agency to monitor administrative activities in Program Year 2010? (Check best answer)

_____ Weekly

_____ Monthly

_____ Quarterly

_____ Annually

_____ Other (please specify) _________________

21. For how many of the local weatherization agencies monitored in your state in Program Year 2010 was an administrative problem found that required corrective actions above and beyond acceptable findings and recommendations? _____

22. What were the three most common problems requiring corrective actions above and beyond acceptable findings and recommendations found in the local weatherization agencies monitored in your state in Program Year 2010?

________________________________________________________________________________________________________________________________________________________________________________________________________________________

23. In those cases where state monitoring of the administration of local weatherization efforts in Program Year 2010 revealed an administrative problem requiring corrective actions above and beyond acceptable findings and recommendations, what actions were taken in response? (Check all that apply)

• Sent written report to local agency _____

• Required corrective action _____

• Made presentation to local agency _____

• Sent someone from state office to help correct problem _____

• Sent state contractor to help correct problem _____

• No action taken _____

• Other (please specify) ______________________________________ _____

24 Did the observation of problems with the quality of weatherization work lead to changes in weatherization training for local agency staff?

_____ Yes

_____ No

24a. If Yes, what changes were made? ______________

25. Does your state observe weatherization training sessions to help identify potential problem areas for monitoring in the field (e.g., with respect to installation of measures that trainees seem to have trouble understanding)?

_____ Yes

_____ No

25a. If Yes, briefly describe how your in-field monitoring activities were affected by your training session observations. ____________________________________________________________

_____________________________________________________________________________

73