2/09/11
Supporting Statement for
Paperwork Reduction Act Submissions
OMB Control Number: 1660 - 0044
Title: Emergency Management Institute Follow-up Evaluation Survey
Form Number(s): FEMA Form 519-0-1 (Presently FEMA Form 95-56)
A Supporting Statement, including the text of the notice to the public required by 5 CFR 1320.5(a)(i)(iv) and its actual or estimated date of publication in the Federal Register, must accompany each request for approval of a collection of information. The Supporting Statement must be prepared in the format described below, and must contain the information specified in Section A below. If an item is not applicable, provide a brief explanation. When Item 17 or the OMB Form 83-I is checked “Yes”, Section B of the Supporting Statement must be completed. OMB reserves the right to require the submission of additional information with respect to any request for approval.
Explain the circumstances that make the collection of information necessary.
Identify any legal or administrative requirements that necessitate the collection. Attach a copy of the appropriate section of each statute and regulation mandating or authorizing the collection of information. Provide a detailed description of the nature and source of the information to be collected.
44 CFR part 360, State Assistance Programs for Training and Education in Comprehensive Emergency Management, implements the Emergency Management Training Program, designed to increase States’ emergency management capabilities through training of personnel with responsibilities over preparedness, response, and recovery from all types of disasters.
The Robert T. Stafford Disaster Relief and Emergency Assistance Act (Public Law 93–288) as amended, authorizes training programs for emergency preparedness for State, local and Tribal government personnel to collect this data.
In response to the Government Performance and Results Act (GPRA), the information obtained from the Emergency Management Institute (EMI) ‘‘Follow-up Evaluation Survey,’’ will be a follow-up tool used to evaluate the knowledge and/or skills participants obtained at EMI during training courses, and to improve Emergency Management Institute courses. The information is critical to determine if the Emergency Management Institute is meeting strategic goals and objectives established by the Federal Emergency Management Agency (FEMA) in order to fulfill its mission.
2. Indicate how, by whom, and for what purpose the information is to be used. Except for a new collection, indicate the actual use the agency has made of the information received from the current collection. Provide a detailed description of: how the information will be shared, if applicable, and for what programmatic purpose.
Post-Course Evaluation Questionnaire, FEMA Form 519-0-1 (Presently FEMA Form 95-56) - is primarily used by Emergency Management Institute (EMI) course managers and senior management for ongoing course reviews and revisions. The information is also used to document program performance.
As such, and due to the qualitative nature of participant’s feedback collected from this survey, results are used in combination with other program metrics to document performance of EMI training program in compliance with GPRA and accountability reporting requirements. To date, the information has been published in reports distributed to staff, been included in GPRA and accountability reports, and has caused management to closely review and modify courses based on survey results.
3. Describe whether, and to what extent, the collection of information involves the use of automated, electronic, mechanical, or other technological collection techniques or other forms of information technology, e.g., permitting electronic submission of responses, and the basis for the decision for adopting this means of collection. Also describe any consideration of using information technology to reduce burden.
This is a 100% paper-based collection. A paper form is mailed to the students 3 months after the course completion. At present, there are no technological collection techniques in place. EMI is currently in a multi-year process of reviewing the entire Level 3 Evaluation procedures. During this process, EMI will consider how best to provide this form and collect the information in an electronic format.
4. Describe efforts to identify duplication. Show specifically why any similar information already available cannot be used or modified for use for the purposes described in Item 2 above.
The responses for the survey are from courses that are only offered through EMI and the questions are not asked on any other collection forms. This information is not available from any other source. Since training courses and content are modified often to reflect changing priorities, techniques, and methodologies of emergency management, and different trainees take different courses, there is no duplicated data being collected.
5. If the collection of information impacts small businesses or other small entities (Item 5 of OMB Form 83-I), describe any methods used to minimize.
This information collection does not have an impact on small businesses or other small entities.
6. Describe the consequence to Federal/FEMA program or policy activities if the collection of information is not conducted, or is conducted less frequently as well as any technical or legal obstacles to reducing burden.
If the collection of information is not conducted EMI would be missing the information needed to demonstrate that training conducted is beneficial in helping emergency management personnel be better prepared to deal with disaster events back on the job. Also, EMI would be lacking valuable information needed to review and revise courses and to respond to GPRA requirements effectively.
7. Explain any special circumstances that would cause an information collection to be conducted in a manner:
Requiring respondents to report information to the agency more
often than quarterly.
(b) Requiring respondents to prepare a written response to a
collection of information in fewer than 30 days after receipt of it.
Requiring respondents to submit more than an original and two
copies of any document.
Requiring respondents to retain records, other than health,
medical, government contract, grant-in-aid, or tax records for more than three years.
In connection with a statistical survey, that is not designed to
produce valid and reliable results that can be generalized to the universe of study.
(f) Requiring the use of a statistical data classification that has not
been reviewed and approved by OMB.
(g) That includes a pledge of confidentiality that is not supported by
authority established in statute or regulation, that is not supported by disclosure and data security policies that are consistent with the pledge, or which unnecessarily impedes sharing of data with other agencies for compatible confidential use.
(h) Requiring respondents to submit proprietary trade secret, or other confidential information unless the agency can demonstrate that it has instituted procedures to protect the information’s confidentiality to the extent permitted by law.
The special circumstances contained in item 7 of the supporting statement are not applicable to this information collection.
8. Federal Register Notice:
a. Provide a copy and identify the date and page number of publication in the Federal Register of the agency’s notice soliciting comments on the information collection prior to submission to OMB. Summarize public comments received in response to that notice and describe actions taken by the agency in response to these comments. Specifically address comments received on cost and hour burden.
A 60-day Federal Register Notice inviting public comments was published on March 8, 2011, Volume 76 pp 12749. No comments were received. See attached copy of the published notice included in this package.
A 30-day Federal Register Notice inviting public comments was published on June 27, 2011, Volume 76 pp 37359. No comments were received. See attached copy of the published notice included in this package.
b. Describe efforts to consult with persons outside the agency to obtain their views on the availability of data, frequency of collection, the clarity of instructions and recordkeeping, disclosure, or reporting format (if any), and on the data elements to be recorded, disclosed, or reported.
The collection of data has been discussed in the past with a number of State Training Officers in State Emergency Management Agencies. These individuals approve the applications for students who take the EMI courses and they agree we should collect this information. They also concur that the effort to respond to the request for information is minimal and not a burden on our students. It was recommended that the instrument be modeled after the level 3 evaluation methods developed by Dr. Donald Kirkpatrick to measure changes in trainee behavior and performance.
c. Describe consultations with representatives of those from whom information is to be obtained or those who must compile records. Consultation should occur at least once every three years, even if the collection of information activities is the same as in prior periods. There may be circumstances that may preclude consultation in a specific situation. These circumstances should be explained.
EMI has consulted with contract staff who compiles records to identify improved versions of the questions asked, in order to obtain better data from more participants. EMI has also consulted with survey participants who are members of the agency staff to solicit recommendations for improving the survey. Recommendations suggested including Likert Scale questions to add quantitative data elements for improved data analysis.
9. Explain any decision to provide any payment or gift to respondents, other than remuneration of contractors or grantees.
FEMA does not provide payments or gifts to respondents in exchange for a benefit sought.
10. Describe any assurance of confidentiality provided to respondents. Present the basis for the assurance in statute, regulation, or agency policy.
A Privacy Threshold Analysis (PTA) was submitted to the FEMA Privacy office on 2/2/2011 in order to determine if a Privacy Impact Analysis (PIA) for this collection is needed to also be forwarded to the FEMA Privacy Office for review. The PTA status is under review as of March 2011.
11. Provide additional justification for any question of a sensitive nature (such as sexual behavior and attitudes, religious beliefs and other matters that are commonly considered private). This justification should include the reasons why the agency considers the questions necessary, the specific uses to be made of the information, the explanation to be given to persons from whom the information is requested, and any steps to be taken to obtain their consent.
There are no questions of a sensitive nature.
12. Provide estimates of the hour burden of the collection of information. The statement should:
a. Indicate the number of respondents, frequency of response, annual hour burden, and an explanation of how the burden was estimated for each collection instrument (separately list each instrument and describe information as requested). Unless directed to do so, agencies should not conduct special surveys to obtain information on which to base hour burden estimates. Consultation with a sample (fewer than 10) of potential respondents is desired. If the hour burden on respondents is expected to vary widely because of differences in activity, size, or complexity, show the range of estimated hour burden, and explain the reasons for the variance. Generally, estimates should not include burden hours for customary and usual business practices.
It is anticipated that 3,800 respondents will complete FEMA Form 519-0-1. Each respondent will only complete the form once and each response will require .25 (15 minutes) hours to complete the form. The total annual hour burden is 3800 x .25 hours = 950 annual hours.
b. If this request for approval covers more than one form, provide separate hour burden estimates for each form and aggregate the hour burdens in Item 13 of OMB Form 83-I.
This collection only involves one form (FEMA Form 519-0-1, Post-Course Evaluation Questionnaire).
c. Provide an estimate of annualized cost to respondents for the hour burdens for collections of information, identifying and using appropriate wage rate categories. NOTE: The wage-rate category for each respondent must be multiplied by 1.4 and this total should be entered in the cell for “Avg. Hourly Wage Rate”. The cost to the respondents of contracting out or paying outside parties for information collection activities should not be included here. Instead this cost should be included in Item 13.
Estimated Annualized Burden Hours and Costs |
||||||||
Type of Respondent |
Form Name / Form Number |
No. of Respon-dents |
No. of Respon-ses per Respon-dent |
Total No. of Responses |
Avg. Burden per Response (in hours) |
Total Annual Burden (in hours) |
Avg. Hourly Wage Rate |
Total Annual Respondent Cost |
Individuals and Households |
Post -Course Evaluation Questionnaire/ FEMA Form 519-0-1 |
380 |
1 |
380 |
.25 (15 min.) |
95 |
$27.01 |
$2,565.95 |
State, Local and Tribal Government |
Post-Course Evaluation Questionnaire/ FEMA Form 519-0-1 |
3420 |
1 |
3420 |
.25 (15 min.) |
855 |
$33.59 |
$28,719.45 |
Total |
|
3,800 |
|
3,800 |
|
950 |
|
$31,285.40 |
According to the U.S. Department of Labor, Bureau of Labor Statistics website (www.bls.gov) the wage rate category for Individuals and Households is $19.29 and State, Local and Tribal Government is $23.99 and accounting for the 1.4 multiplier it is 27.01 and 33.59. Ten percent of the questionnaires are mailed to Individuals and Households, and 90% are mailed to State, local and Tribal government respondents. Therefore, the estimated burden hour cost to respondents (Individuals and Households and State, Local and Tribal Governments) is estimated to be 31,285.40 annually.
Note: The “Avg. Hourly Wage Rate” for each respondent includes a 1.4 multiplier to reflect a fully-loaded wage rate.
“Type of Respondent” should be entered exactly as chosen in Question 3 of the OMB Form 83-I
13. Provide an estimate of the total annual cost burden to respondents or recordkeepers resulting from the collection of information. The cost of purchasing or contracting out information collection services should be a part of this cost burden estimate. (Do not include the cost of any hour burden shown in Items 12 and 14.)
There are no record keeping, capital, start-up or maintenance costs associated with this information collection.
Annual Cost Burden to Respondents or Record-keepers
14. Provide estimates of annualized cost to the federal government. Also, provide a description of the method used to estimate cost, which should include quantification of hours, operational expenses (such as equipment, overhead, printing and support staff), and any other expense that would have been incurred without this collection of information. You may also aggregate cost estimates for Items 12, 13, and 14 in a single table.
Annual Cost to the Federal Government
Item |
Cost ($) |
Classroom Support Contract Costs (estimate cost per year to open returned questionnaires and input ratings into the database.) |
$10,000 |
Staff Salaries - (1 GS 7 step 1 employee spending approximately 10% of time annually to process and input data results. GS 7 step 1 (42,209x 1.4 = 59,092.60 x 10% = $5,909.26) |
$5,909.26 |
Facilities [cost for renting, overhead, etc. for data collection activity] |
0 |
Computer Hardware and Software [cost of equipment annual lifecycle] |
0 |
Equipment Maintenance [cost of annual maintenance/service agreements for equipment] |
0 |
Travel |
0 |
Printing [Approximate cost per month $83.00 x 12 months = 996.00 annually] |
$996.00 |
Postage [3800 annual number of data collection instruments x .44 postage =x=$1,672] |
$1,672 |
Other |
|
Total |
$18,577.26 |
* Note: The “Salary Rate” includes a 1.4 multiplier to reflect a fully-loaded wage rate.
15. Explain the reasons for any program changes or adjustments reported in Items 13 or 14 of the OMB Form 83-I in a narrative form. Present the itemized changes in hour burden and cost burden according to program changes or adjustments in Table 5. Denote a program increase as a positive number, and a program decrease as a negative number.
A "Program increase" is an additional burden resulting from an federal government regulatory action or directive. (e.g., an increase in sample size or coverage, amount of information, reporting frequency, or expanded use of an existing form). This also includes previously in-use and unapproved information collections discovered during the ICB process, or during the fiscal year, which will be in use during the next fiscal year.
A "Program decrease", is a reduction in burden because of: (1) the discontinuation of an information collection; or (2) a change in an existing information collection by a Federal agency (e.g., the use of sampling (or smaller samples), a decrease in the amount of information requested (fewer questions), or a decrease in reporting frequency).
"Adjustment" denotes a change in burden hours due to factors over which the government has no control, such as population growth, or in factors which do not affect what information the government collects or changes in the methods used to estimate burden or correction of errors in burden estimates.
15. Explain the reasons for any program changes or adjustments reported in Items 13 or 14 of the OMB Form 83-I in a narrative form. Present the itemized changes in hour burden and cost burden according to program changes or adjustments in Table 5. Denote a program increase as a positive number, and a program decrease as a negative number.
Itemized Changes in Annual Burden Hours |
||||||
Data collection Activity/Instrument |
Program Change (hours currently on OMB Inventory) |
Program Change (New) |
Difference |
Adjustment (hours currently on OMB Inventory) |
Adjustment (New) |
Difference |
Post -Course Evaluation Questionnaire/ FEMA Form 519-0-1 |
|
|
|
95 |
95 |
0 |
Post-Course Evaluation Questionnaire/ FEMA Form 519-0-1 |
|
|
|
855 |
855 |
0 |
Total(s) |
|
|
|
950 |
950 |
0 |
For FEMA Form 519-0-1, the previously approved burden hours were 950. The current estimated annual hour burden in the NOA dated 8/12/08 is 950 and there is no difference.
Itemized Changes in Annual Cost Burden |
||||||
Data collection Activity/Instrument |
Program Change (cost currently on OMB Inventory) |
Program Change (New) |
Difference |
Adjustment (cost currently on OMB Inventory) |
Adjustment (New) |
Difference |
Post -Course Evaluation Questionnaire/ FEMA Form 519-0-1 |
|
|
|
$1,832.55 |
$2,565.95 |
+733.40 |
Post-Course Evaluation Questionnaire/ FEMA Form 519-0-1 |
|
|
|
$20,511.45 |
$28,719.45 |
+8208.00 |
Total(s) |
|
|
|
$22,344.00 |
$31,285.40 |
+8941.40 |
Explain: There are no changes in burden time but the cost burden is increased to reflect higher wages used.
16. For collections of information whose results will be published, outline plans for tabulation and publication. Address any complex analytical techniques that will be used. Provide the time schedule for the entire project, including beginning and ending dates of the collection of information, completion of report, publication dates, and other actions.
The results of the collection are tabulated and compiled in a quarterly report that is distributed to the Director of the Training Division and the Section Chiefs within the Division. Surveys are not sent until 90 days after a participant completes a course and results are usually not received in less than 30 days. When a report is issued, it is for the period of activity 4-6 months previous. The data is tabulated in three columns without any complex analysis, and participant comments are included in the report.
17. If seeking approval not to display the expiration date for OMB approval of the information collection, explain reasons that display would be inappropriate.
This collection does not seek approval to not display the expiration date for OMB approval.
18. Explain each exception to the certification statement identified in Item 19 “Certification for Paperwork Reduction Act Submissions,” of OMB Form 83-I.
FEMA does not request an exception to the certification of this information collection.
| File Type | application/msword |
| File Title | Rev 10/2003 |
| Author | FEMA Employee |
| Last Modified By | nbouchet |
| File Modified | 2011-11-09 |
| File Created | 2011-11-09 |