State Energy Program Evaluation

OMB Control No. XXXXXXXX

ID-8: Tech Assistance (Teacher/Trainers)

OMB Control No. XXXXXXXX

Note that this survey instrument will be used for programs where the participants are teachers. This includes sample points that fall under the following sub-categories: “Generalized Workshop or Demonstration,” “Targeted Training or Certification,” under three BPAC categories: (1) Building Retrofits, (2) Loans, Grants, and Incentives, and (3) Renewable Energy Market Development.

DATABASE VARIABLES

&INTERVIEWER NAME name of the caller

&CONTACT contact name from program records

&SPONSOR organization that sponsored the effort being researched

&PROGRAM program name

&DATE dates of workshop, demonstration, training funded by SEP

&APPOINT date/time to call back

&NAME person to call back

&PHONE extension or phone number to call back

&STATE state where program is offered

&WORKSHOP/DEMONSTRATION/TRAINING………Name of workshop, demonstration, or training

& TECHNICAL ASSISTANCE………………………….Name of technical assistance

&BPAC……………………………………………………Will indicate the specific-BPAC for sample

NOTE THAT OTHER VARIABLES ARE SHOWN IN THE DOCUMENT AS THEY ARE CREATED

INTRODUCTION AND FINDING CORRECT RESPONDENT

INITIAL. Hello, this is &INTERVIEWER NAME calling on behalf of the United States Department of Energy from Opinion Dynamics Corporation.

May I please speak with &CONTACT, [IF CONTACT NAME AVAILABLE]?

[IF NEEDED] This is not a sales call.

[IF NEEDED] This is a fact-finding survey only, authorized by the U. S. Department of Energy which wants to understand how you used the information provided through the [&WORKSHOP/TRAINING/DEMONSTRATION].

[No, that person is not available right now]	1	[GO TO APPOINT]
[Unable to refer someone who can help]	2	[GO TO APPOINT]
[Yes, that would be me]	3	[GO TO PURPOSE]
[Yes, let me transfer you to_________]	4	[GO TO INTRO]
[No, that is the wrong person]	5	[GO TO INITIAL]
[No, other reason (specify)]	6	[GO TO APPOINT]
[Don’t know]	-97	[GO TO APPOINT]
[Refused]	-98	[GO TO APPOINT]

APPOINT. When would be a good day and time for us to call back?

RECORD, CONTACT NAME, DAY OF THE WEEK, TIME OF DAY AND DATE TO CALL BACK		CALL BACK AT AGREED TIME
[Don’t know]	-97	THANK & TERMINATE; ASSIGN REFUSED AND REMOVE FROM CALL ORDER
[Refused]	-98	END CALL; KEEP CONTACT IN REGULAR CALL ORDER

INTRO. On &DATE, you attended a [&WORKSHOP/TRAINING/DEMONSTRATION] offered by &SPONSOR. In an effort to determine what actions you may have taken as a result of participating, we ask that you complete this brief survey. Your input will help [&SPONSOR] understand the effects of their past efforts. The survey should take no more than 45 minutes for you to complete. The responses you provide will be combined with those of many other individuals and will not be linked to you or your organization in any way.

The U.S. Department of Energy (DOE) would like to inform each individual that the information requested here is being solicited under the statutory authority of Title III of the Energy Policy and Conservation Act of 1975, as amended, which authorizes DOE to administer the State Energy Program (SEP). This information is being sought as part of a national evaluation of SEP, the purpose of which is to reliably quantify Program accomplishments and help inform decisions on future operations. The sole use of the information collected will be for an analysis of national-level Program impacts. Disclosure of this information is voluntary and there will be no adverse effects associated with not providing all or any part of the requested information.

SCREENER

S1. Do you recall attending the [&WORKSHOP/DEMONSTRATION/TRAINING/CERTIFICATION on [&DATE]?

[Yes]	1	[GO TO RI1]
[No]	2	[THANK AND TERMINATE]
[Don’t know]	-97	[THANK AND TERMINATE]
[Refused]	-98	[THANK AND TERMINATE]

RESPONDENT INFO: ROLE IN THE PROJECT

First, I’d like to get some information about your firm, your job and experience regarding energy efficiency and renewable energy in [&STATE].

RI1. What is your job title?

[RECORD JOB TITLE]	1	[GO TO RI2]
[Don’t know]	-97	[GO TO RI2]
[Refused]	-98	[GO TO RI2]

RI2. What are your specific job responsibilities? [OPEN END]

[OPEN END]	1	[GO TO AC1]
[Don’t know]	-97	[GO TO AC1]
[Refused]	-98	[GO TO AC1]

AC1. Which of the following best describes where you intended to apply the information you received? [READ CATEGORIES]

NOTE: IF THE ANSWER IS “SOMEWHERE ELSE”, SPECIFY THEN PROBE FOR WHICH OF THE FIVE CLASSIFICATIONS BEST DESCRIBES THEM.

At the facility(ies) my business occupies	2	[GO TO ALTERNATIVE NON-RES SURVEY/TERMINATE]
At the facility(ies) my business manages (e.g. Property managers)	3	[GO TO ALTERNATIVE NON-RES SURVEY/TERMINATE]
In facilities occupied or managed by customers to whom I provide services (e.g. Architects, engineering firms, contractors, code inspectors)	4	[GO TO ALTERNATIVE MARKET ACTOR SURVEY / TERMINATE]
In the classroom where I teach	5	[GO TO VN2]
Somewhere else: Specify____	6	[GO TO VN2]

RESPONDENT TYPE DEFINED FOR DISPOSITION

[CLASSIFY AC1=1 AS REU (RESIDENTIAL END-USE CUSTOMER)]

[CLASSIFY AC1=2, 3 AS CEU (COMMERCIAL END-USE CUSTOMER)]

[CLASSIFY AC1=4 AS MA (MARKET ACTOR)]

[CLASSIFY AC1=5 AS TEA (TEACHER)]

[CLASSIFY AC1=6 AS DEFAULT ASSUMED RESPONDENTS BASED ON PROGRAM TARGET]

INITIAL INVENTORY

VN2. Since [&DATE], have you taught any courses or offered training regarding the following equipment types? [READ LIST IN THE GRID. MARK ALL THAT APPLY]

a. Lighting	1	[GO TO OP3]
b. Cooling	2	[GO TO OP3]
c. Heating	3	[GO TO OP3]
d. Commercial Refrigeration	4	[GO TO OP3]
e. Motors/Drives	5	[GO TO OP3]
f. Appliances, such as dishwashers, clothes washers, refrigerators	6	[GO TO OP3]
g. Hot Water	7	[GO TO OP3]
h. Duct Testing	8	[GO TO OP3]
i. Insulation	9	[GO TO OP3]
j. Showerheads/Aerators	10	[GO TO OP3]
k. PV	11	[GO TO OP3]
l. Wind	12	[GO TO OP3]
m. Solar thermal	13	[GO TO OP3]
n. Biomass	14	[GO TO OP3]
o. Biogas	15	[GO TO OP3]
f. Any other courses?	16	[GO TO OP3]

EFFECT OF OTHER PROGRAMS

OP3. Did the [&WORKSHOP/DEMONSTRATION/TRAINING] inform you about any financial support available to buildings/customers such as incentives or loans offered by sponsors, such as, local utilities, industry associations, or government agencies?

[Yes]	1	[GO TO TO1]
[No]	2	[GO TO TO1]
[Don’t know]	-97	[GO TO TO1]
[Refused]	-98	[GO TO TO1]

ATTRIBUTION – MARKET CONTEXT

TRAINING OBJECTIVES

TO1. The [&WORKSHOP/DEMONSTRATION/TRAINING], was designed to achieve the following objectives: &USE COURSE SPECIFIC BELOW.

NOTE: WE WILL PROVIDE COURSE SPECIFICS BASED UPON A REVIEW OF CURRICULA, PARTICIPANT DATABASES AND INPUTS FROM PROGRAM MANAGER INTERVIEWS.

[INSERT TWO SENTENCE OR LESS DESCRIPTIONS OF EACH SPECIFIC EFFORT]

TO2. Prior to taking this course, had you searched for courses with similar curricula content?

[Yes]	1	[GO TO TO3]
[No]	2	[GO TO KA1]
[Don’t know]	-97	[GO TO KA1]
[Refused]	-98	[GO TO KA1]

TO3. Using a scale of 1 to 10, where 1 is no courses available and 10 is many courses available, how would you rate the availability of courses with similar curricula prior to [&DATE]?

None Available	1	[GO TO KA1]
	2	[GO TO KA1]
	3	[GO TO KA1]
	4	[GO TO KA1]
	5	[GO TO KA1]
	6	[GO TO KA1]
	7	[GO TO KA1]
	8	[GO TO KA1]
	9	[GO TO KA1]
Many Available	10	[GO TO KA1]
[Don’t know]	-97	[GO TO KA1]
[Refused]	-98	[GO TO KA1]

KNOWLEDGE AND AWARENESS EFFECTS

NOTE: IN THIS SECTION, WE IDENTIFY ANY CHANGES TO KNOWLEDGE AND AWARENESS AS A RESULT OF PARTICIPATION IN THE COURSE. NOTABLY, THIS SECTION WILL GATHER INFORMATION TO UNDERSTAND OTHER EFFECTS OF THE SEP TRAINING EFFORTS.

KA1. Did the [&WORKSHOP/DEMONSTRATION/TRAINING] provide you with any new information?

[Yes]	1	[GO TO KA2a]
[No]	2	[GO TO KA2a]
[Don’t know]	-97	[GO TO KA2a]
[Refused]	-98	[GO TO KA2a]

KA2a. Using a scale of 1 to 10, where 1 is no knowledge and 10 is significant knowledge, how would you rate your level of knowledge regarding the [&WORKSHOP/DEMONSTRATION/TRAINING] objectives prior to your participation in [&DATE]?

No Knowledge	1	[GO TO KA2b]
	2	[GO TO KA2b]
	3	[GO TO KA2b]
	4	[GO TO KA2b]
	5	[GO TO KA2b]
	6	[GO TO KA2b]
	7	[GO TO KA2b]
	8	[GO TO KA2b]
	9	[GO TO KA2b]
Significant Knowledge	10	[GO TO KA2b]
[Don’t know]	-97	[GO TO KA2b]
[Refused]	-98	[GO TO KA2b]

[SKIP IF KA1=2]

KA2b. On the same scale, how would you rate your [&WORKSHOP/DEMONSTRATION/TRAINING] objectives knowledge after your participation?

No Knowledge	1	[GO TO KA3]
	2	[GO TO KA3]
	3	[GO TO KA3]
	4	[GO TO KA3]
	5	[GO TO KA3]
	6	[GO TO KA3]
	7	[GO TO KA3]
	8	[GO TO KA3]
	9	[GO TO KA3]
Significant Knowledge	10	[GO TO KA3]
[Don’t know]	-97	[GO TO KA3]
[Refused]	-98	[GO TO KA3]

KA3. Did the [&WORKSHOP/DEMONSTRATION/TRAINING] increase your awareness of ways to improve the [energy efficiency/renewable energy]?

[Yes]	1	[GO TO KA4]
[No]	2	[GO TO KA4]
[Don’t know]	-97	[GO TO KA4]
[Refused]	-98	[GO TO KA4]

KA4. Did your participation in the [&WORKSHOP/DEMONSTRATION/TRAINING], make you more likely to teach courses regarding specific energy saving measures?

[Yes: Specify]	1	[GO TO CPT4]
[No]	2	[GO TO CPT4]
[Don’t know]	-97	[GO TO CPT4]
[Refused]	-98	[GO TO CPT4]

TEACHER CAPACITY BUILDING

NOTE: IN THIS SECTION, WE IDENTIFY ANY CAPACITY BUILDING THAT RESULTED FROM PARTICIPATION IN THE COURSE. NOTABLY, THIS SECTION WILL GATHER INFORMATION TO UNDERSTAND OTHER EFFECTS OF THE SEP TRAINING EFFORTS.

CPT4. Please tell me if you would agree with any of the following statements. As a result of the [&WORKSHOP/TRAINING/DEMONSTRATION]:

CPT4a. I have acquired additional [energy efficiency/renewable energy] skills that I share in the courses that I teach.

CPT4b. I am now able to offer more [energy efficiency/renewable energy] courses than before.

CPT4c. I am now teaching new types of courses.

CPT4d. I can now teach new information on [energy efficiency/renewable energy] in the courses that I teach.

CPT4e. &INSERT TRAINING SPECIFIC CAPACITY AREA

	CAPACITY BUILDING	CPT4a EE Skills	CPT4b EE Courses	CPT4c New Course Types	CPT4d New EE Info	CPT4e &INSERT TRAINING SPECIFIC CAPACITY AREA
1	Yes
2	Somewhat agree
3	No
5	[Don’t know]
6	[Refused]

ASK IF CPT4a-e <3

CPT5. You indicated that you agreed with &[READ IN CPT4a-e]. How specifically did the [&WORKSHOP/TRAINING/DEMONSTRATION] allow you to so?

[OPEN END]	1	[GO TO J1]
[Don’t know]	-97	[GO TO J1]
[Refused]	-98	[GO TO J1]

JOB QUESTIONS

J1. Were you hired to teach [&WORKSHOP/TRAINING/DEMONSTRATION] in [&PROGRAM YEAR]?

[Yes]	1	[GO TO J2]
[No]	2	[GO TO J2]
[Don’t know]	-97	[GO TO J2]
[Refused]	-98	[GO TO J2]

J2. To the best of your knowledge, were any other instructors hired to teach information and training activities for the [&WORKSHOPS/TRAINING/DEMONSTRATIONS] SEP in [&PROGRAM YEAR]?

[INSERT NUMBER OF INSTRUCTORS]	____	[GO TO EE1]
[No]	2	[GO TO EE1]
[Don’t know]	-97	[GO TO EE1]
[Refused]	-98	[GO TO EE1]

TEACHER CHARACTERISTICS

EE1. What energy saving action(s) was/were a principal major focus of [&WORKSHOP/TRAINING/DEMONSTRATION] in [&PROGRAM YEAR]?

[OPEN END]	1	[GO TO EE2]
[Don’t know]	-97	[GO TO EE2]
[Refused]	-98	[GO TO EE2]

EE2. Did your [offering] teach specific energy savings actions? Please describe these actions.

NOTE: SPECIFIC LISTS WILL BE DEVELOPED BASED UPON EARLIER INTERVIEWS AND PROGRAM MATERIAL REVIEW.

T1. Approximately how many courses do you teach per year?

[# OF COURSES]	____	[GO TO T2]
[Don’t know]	-97	[GO TO T2]
[Refused]	-98	[GO TO T2]

T2. On average, how many students attend each course?

[AVERAGE # OF STUDENTS]	____	[GO TO T3]
[Don’t know]	-97	[GO TO T3]
[Refused]	-98	[GO TO T3]

T3. Of these courses, how many of the courses that you teach incorporate curricula from the [&WORKSHOP/TRAINING/DEMONSTRATION] that you attended?

[# OF COURSES]	____	[GO TO T4]
[Don’t know]	-97	[GO TO T4]
[Refused]	-98	[GO TO T4]

T4. In general, which of the following best describes your students?

[MARK ALL THAT APPLY IN LIST IN THE GRID, UP TO 3]

K-12 students	1	[GO TO T6]
Community College students	2	[GO TO T6]
University students	3	[GO TO T6]
HERs raters or other code compliance market actors	4	[GO TO T6]
Trade allies, e.g. HVAC contractors, retrofitters, etc	5	[GO TO T6]
Teachers	6	[GO TO T6]
Residential customers	7	[GO TO T6]
Commercial or industrial customers	8	[GO TO T6]
Agricultural customers	9	[GO TO T6]
Other (Specify)	00	[GO TO T6]
[Don’t know]	-97	[GO TO T6]
[Refused]	-98	[GO TO T6]

T6. Which of the following sentences describes your average student’s knowledge about [energy efficiency/renewable energy] before they participated in your class?

They had NO knowledge	1	[GO TO T7]
They had VERY LITTLE knowledge	2	[GO TO T7]
They had SOME knowledge	3	[GO TO T7]
They had A LOT of knowledge	4	[GO TO T7]
[Don’t know]	-97	[GO TO T7]
[Refused]	-98	[GO TO T7]

T7. Think of your classes that presented at least some information that you had learned in the [&WORKSHOP/TRAINING/DEMONSTRATION] in [&PROGRAM YEAR]. On a scale of 1 to 10 where 1 is “not at all useful” and 10 is “very useful”, how useful was the [&WORKSHOP/TRAINING/DEMONSTRATION] in [&PROGRAM YEAR] in terms of building your curriculum?

[ENTER 1-10]	____	[GO TO T8]
[Don’t know]	-97	[GO TO T8]
[Refused]	-98	[GO TO T8]

T8. Did you receive any feedback from your students about the information from [&WORKSHOP/TRAINING/DEMONSTRATION] in [&PROGRAM YEAR] that you had included in your class?

[Yes: Specify]	1	[GO TO T9]
[No]	2	[GO TO T9]
[Don’t know]	-97	[GO TO T9]
[Refused]	-98	[GO TO T9]

T9. If the decision were up to you, would you include information that you had learned in the [&WORKSHOP/TRAINING/DEMONSTRATION] in [&PROGRAM YEAR] in your classes again? Why do you say that?

[Yes: Specify]	1	[GO TO T10]
[No]	2	[GO TO T10]
[Don’t know]	-97	[GO TO T10]
[Refused]	-98	[GO TO T10]

T10. In your own words, please describe what you teach?

[OPEN END]	1	[GO TO T11]
[Don’t know]	-97	[GO TO T11]
[Refused]	-98	[GO TO T11]

T11. In your own words, please describe any other impacts that you received from the [&WORKSHOP/TRAINING/DEMONSTRATION], such as energy savings kits, curriculum, etc.?

[OPEN END]	1	[GO TO T12a]
[Don’t know]	-97	[GO TO T12a]
[Refused]	-98	[GO TO T12a]

T12a. Were there any surveys or assessments that you conducted with your students that incorporated the [&WORKSHOP/TRAINING/DEMONSTRATION] curriculum?

Yes	1	[GO TO T12b]
No	2	[GO TO T13]
[Don’t know]	-97	[GO TO T13]
[Refused]	-98	[GO TO T13]

T12b. You mentioned that you conducted surveys or assessments with your students. Can you describe what these measured?

[OPEN END]	1	[GO TO T13]`
[Don’t know]	-97	[GO TO T13]
[Refused]	-98	[GO TO T13]

T13. What feedback have you received, if any, from your students regarding the information that you learned in the [&WORKSHOP/TRAINING/DEMONSTRATION] in [&PROGRAM YEAR]?

[OPEN END]	1	[THANK AND TERMINATE]
[Don’t know]	-97	[THANK AND TERMINATE]
[Refused]	-98	[THANK AND TERMINATE]

NOTE: THANK AND TERMINATE.

Page 5

OMB Control No. XXXXXXXX