The Department of Stateâs Bureau of Educational and Cultural Affairs (ECA) regularly monitors and evaluates its programs through the collection of data about program accomplishments in order to enable program staff to assess the results of its programs, where improvements may be necessary, and to modify/plan future programs. In order to more systematically assess the efficacy and impact of ECA funded-programs and to address the requirements of the Foreign Aid Transparency and Accountability Act (FATAA) and the Department of Stateâs updated monitoring and evaluation guidance (18 FAM 300), ECAâs Evaluation Division has created a robust performance monitoring framework that is responsive to these directives, measures programmatic goals and objectives, and provides a comprehensive view of overall Bureau activities. The Monitoring Data for ECA (MODE) Framework (https://eca.state.gov/impact/eca-evaluation-division/monitoring-data-eca-mode-framework) includes a results framework with indicators designed to track program performance and the direction, pace, and magnitude of change of ECA programs - leading to strengthened feedback mechanisms resulting in more effective programs. Each of these indicators has corresponding data collection questions defined so data will be collected uniformly whether by the program office, the Evaluation Division, or an award recipient. Implementation of the MODE Framework will enable ECA to standardize and utilize its data in the following ways:
⢠Assess data and performance metrics to enhance program performance
⢠Inform strategic planning activities at the Bureau, division, and individual exchange program levels
⢠Supplement the information ECA program officers receive from their award recipients and exchange participants to provide a comprehensive view of programmatic activities
⢠Respond quickly and reliably to ad-hoc requests from Congress, the Office of Management and Budget (OMB), and internal Department of State stakeholders
In order to collect data for the MODE Framework, the ECA Evaluation Division intends to conduct ongoing surveys of program participants, alumni, and participant host and home communities to monitor program performance, assess impact, and identify issues for further evaluation. Specifically, ECA will coordinate with award recipients to provide standard survey questions for both foreign national and U.S. citizen exchange participants immediately after completing the exchange (âParticipant Post-Program Surveyâ). ECAâs Evaluation Division also intends to administer standard surveys to foreign national and U.S. citizen exchange alumni roughly one year, three years and five years after completing their exchange experience. Conducting post-program surveys, particularly after three and five years, will provide information on the impact of ECA programs and insight into the achievements of participants.
To examine multiplier effects of ECA exchange programs on foreign and U.S. communities and institutions that sponsor, support, or provide exchange programs support or services, ECA intends to administer standard surveys to foreign and U.S. host community members (individuals or institutions) where feasible.
On behalf of this Federal agency, I certify that the collection of information encompassed by this request complies with 5 CFR 1320.9 and the related provisions of 5 CFR 1320.8(b)(3).
The following is a summary of the topics, regarding the proposed collection of information, that the certification covers:
(i) Why the information is being collected;
(ii) Use of information;
(iii) Burden estimate;
(iv) Nature of response (voluntary, required for a benefit, or mandatory);
(v) Nature and extent of confidentiality; and
(vi) Need to display currently valid OMB control number;
If you are unable to certify compliance with any of these provisions, identify the item by leaving the box unchecked and explain the reason in the Supporting Statement.
OMB PRA Legal Authorities_ECA MODE.docx
Monitoring Data for ECA (MODE) Framework