Supervisor Performance Measures

---

Overview

Perf Measure
USFA

---

Sheet 1: Perf Measure

Program or Sub-Program Name:

PAS Code:

IMPORTANT:

All entries must be 1,000 characters or less, including spaces. Do not add rows.

LONG-TERM PERFORMANCE GOAL

Long term performance goal

Each Program and Sub-program must have at least on specific, high level, ambitious goal. The long term performance goal should reflect the mission of the program and what specifically is being measured in the Performance Measure.

PERFORMANCE MEASURE

Targets:

Actual

Current

Projected

Outyears: FY 2009-2013

Performance Measure Statement

2006

2007

2008

2009

2010

2011

2012

2013

Performance Measure

Enter the performance measure statement. State what is to be measured in plain language without jargon or acronyms. Measure statements typically start with words such as “Number of… Percent of… Ratio of… Cost of….”. Each Program and Sub-program must have at least one performance measure that reflects the mission of the Program or Sub-program.

Description of Measure

Target: Actual

Actual performance values for the previous fiscal year. Should be numeric unless “baseline.”

Target: Current

Target value for this fiscal year, as currently shown in the DHS FYHSP database.

Target: Projected

Target value for next fiscal year, based on funding in FY07 President's budget.

Target: Outyears

Target values for each year in the current planning period.

(1,000 characters max., including spaces.)

Description of Measure

Give a short description of what the performance assesses and why it is significant. Use plain language and avoid jargon and unnecessary acronyms.

VERIFICATION AND VALIDATION

Scope (Range) of Data

Scope (Range) of Data

An explanation of what the data is and any limitations it has. Include a description of the existence of relevant baseline data, including time-span covered by trend data. Also discuss any limitations on the data such as: time to collect/currency of data, margin of error if sample data, completeness of survey data, such as if nation-wide, are all areas of the country included?

(1,000 characters max., including spaces.)

Data Source

Data Source

Describe the source of the data/information, to include identification of external sources if relevant. This might be a description of a survey of customers conducted each quarter by an independent contractor, a review of a certain percent of cases by senior examiners for quality, or a named computer system from which the data is extracted, along with a description of the purpose of the system.

(1,000 characters max., including spaces.)

Data Collection Methodology

Data Collection Methodology

Describe the method that will be used to gather, compile, and analyze the data. Describe the expected use of existing IT systems in the collection and reporting of the data if relevant. Data collection could also be through the use of simple Excel spreadsheets or other tally sheets, which are then manually tallied and summarized.

(1,000 characters max., including spaces.)

Reliability Index

Reliability Index

Reliable - there is no material inadequacy in the data, that would significantly impede the use of the performance data by agency managers and government decision makers. Inadequate - there is material inadequacy in the data. TBD - a new measure whereby reliability of the data is to be determined.

Explanation Of Data Reliability Check

Explanation Of Data Reliability Check

If your selection to the reliability index (above) is either Reliable or Inadequate, then describe: 1) How reliability is verified or "double-checked" for accuracy; 2) Actions being taken to make the information reliable; 3) When reliable data will be available. If your selection for the reliability index (above) is T.B.D., then describe when reliable data will be available.

(1,000 characters max., including spaces.)

---

Sheet 2: USFA

Program or Sub-Program Name:

United States Fire Administration

PAS Code:

FEMA0006.02

IMPORTANT:

All entries must be 1,000 characters or less, including spaces. Do not add rows.

LONG-TERM PERFORMANCE GOAL

Reduce the effect of fire and all hazard emergencies through improving the delivery of state and local fire and emergency services.

Long term performance goal

Each Program and Sub-program must have at least on specific, high level, ambitious goal. The long term performance goal should reflect the mission of the program and what specifically is being measured in the Performance Measure.

PERFORMANCE MEASURE

Targets:

Actual

Current

Projected

Outyears: FY 2009-2013

Performance Measure Statement

(fatalities per million population)

2006

2007

2008

2009

2010

2011

2012

2013

Performance Measure

Enter the performance measure statement. State what is to be measured in plain language without jargon or acronyms. Measure statements typically start with words such as “Number of… Percent of… Ratio of… Cost of….”. Each Program and Sub-program must have at least one performance measure that reflects the mission of the Program or Sub-program.

Percent results from the supervisor level-three training evaluation survey.

per million population)

97%

80%

80%

80%

80%

80%

80%

80%

Description of Measure

The majority of supervisors of individuals trained reporting that their subordinate is better prepared to respond to disasters and emergencies as a result of the training they received.

Target

Target values for each year for the measure. Should be numeric unless “baseline.”

Actual

Actual performance values for completed quarters and years.

(1,000 characters max., including spaces.)

Description of Measure

Provide a short description of what the performance assesses and why it is significant. Use plain language and avoid jargon and unnecessary acronyms.

VERIFICATION AND VALIDATION

Note: Program Managers are responsible for the reliability of data and its classification in the reliability index.

Scope (Range) of Data

Approximately 8,000 individuals attend National Fire Academy resident training courses each year. Participants include fire and emergency response personnel and allied professionals. A stratified random sample of approximately 35-40 course deliveries or 800-1000 participants is collected, however the current paper-based system is being converted to an electronic web-based format that will allow for a census style collection that will include the entire resident population. Typically, 60% of level-three evaluation (long-term) questionnaires are completed and returned.

Scope (Range) of Data

An explanation of what the data is and any limitations it has. Include a description of the existence of relevant baseline data, including time-span covered by trend data. Also discuss any limitations on the data such as: time to collect/currency of data, margin of error if sample data, completeness of survey data, such as if nation-wide, are all areas of the country included?

(1,000 characters max., including spaces.)

Data Source

Data are obtained from level-three training evaluation questionnaires sent to the individual who received the training and their supervisor 3-6 months after the training course has ended.

Data Source

Describe the source of the data/information, to include identification of external sources if relevant. This might be a description of a survey of customers conducted each quarter by an independent contractor, a review of a certain percent of cases by senior examiners for quality, or a named computer system from which the data is extracted, along with a description of the purpose of the system.

(1,000 characters max., including spaces.)

Data Collection Methodology

Supervisors of students who received the training complete scannable questionnaires that are processed in the Academy's Training Evaluation center using SPSS software (Statistical Package for the Social Sciences). Once the electronic web-based system is complete, supervisors of the individuals who received the training will be sent a link that will enable them to complete the questionnaires on-line and the data will be captured and processed through an Oracle database system.

Data Collection Methodology

Describe the method that will be used to gather, compile, and analyze the data. Describe the expected use of existing IT systems in the collection and reporting of the data if relevant. Data collection could also be through the use of simple Excel spreadsheets or other tally sheets, which are then manually tallied and summarized.

(1,000 characters max., including spaces.)

Reliability Index

Reliable

Reliability Index

Reliable - there is no material inadequacy in the data, that would significantly impede the use of the performance data by agency managers and government decision makers. Inadequate - there is material inadequacy in the data. TBD - a new measure whereby reliability of the data is to be determined.

Explanation Of Data Reliability Check

Typically, 60% of the level-three evaluation questionnaires are completed and returned. The data is reliable because it is collected directly from the supervisor of the individual who received the training. The supervisor has first hand knowledge of how their subordinate has applied their learning on the job. All data is collected and reviewed by the Academy's Training Evaluation center for completeness prior to report complications and production.

Explanation Of Data Reliability Check

If your selection to the reliability index (above) is either Reliable or Inadequate, then describe: 1) How reliability is verified or "double-checked" for accuracy; 2) Actions being taken to make the information reliable; 3) When reliable data will be available. If your selection for the reliability index (above) is T.B.D., then describe when reliable data will be available.

(1,000 characters max., including spaces.)