NIST MEP Information Reporting Guidelines (Annual)

NIST MEP
Information Reporting
Guidelines

OMB Control No. 0693-0032

Expiration Date:  09/30/2018

This collection of information contains Paperwork Reduction Act (PRA) requirements approved by the Office of Management and Budget (OMB).  Notwithstanding any other provisions of the law, no person is required to respond to, nor shall any person be subject to a penalty for failure to comply with, a collection of information subject to the requirements of the PRA unless that collection of information displays a currently valid OMB control number.  Public reporting burden for this collection is estimated to be 20 hours for the Quarterly Review, 4 hours for the Semi-Annual Review, 30 hours for the Annual Review and 80 hours for the Panel Review, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed and completing and reviewing the collection of information.  Send comments regarding this burden estimate or any aspect of this collection of information, including suggestions for reducing this burden, to the National Institute of Standards and Technology, Attn: Melissa Davis, 301-975-5039; [email protected]

<number>

<number>

 

Why is Reporting Necessary?

• •Used for CAR performance management, annual/panel reviews and reporting the program’s performance to Congress 

• •Generate standard sets of reports 

• •Cooperative Agreement Requirement 

Reporting is necessary for CAR performance management, conducting reviews and reporting the program’s performance to Congress.  From the data submitted, we generate a lot of reports for Centers and the National Network.

And… it’s a cooperative agreement requirement.

<number>

<number>

 

NIST MEP Reporting, Survey Confirmation and Survey process is a continual cycle.

NIST MEP Reporting, Survey Confirmation and Survey Process is a continual cycle starting with:

Reporting which is the submission of Client Information Files or (CIFs) and Project Information Files or (PIFs) into the MEIS system either manually, via XML file submission or Salesforce.  Reporting also includes updating staff, locations, contacts, roles, etc. at anytime.

Survey Confirmation  occurs one month prior to the Survey being conducted,  When the Survey Confirmation period opens Centers will have the ability to review the clients that will be surveyed in the next month.  This will be your opportunity to:

1.  Change the Estimated Impact Span (EIS)

2.  Change CAR Key Personnel

3.  Change Client Contact Information

During the Survey period Clients will be surveyed by a third party contractor.

After survey results are returned from the third party contactor, the data is analyzed for very large impacts, this is known as Outlier Verification and Centers will be notified to confirm any outliers within MEIS.

Once all of the data has been validated, both NIST MEP and centers can perform Data Analysis and Knowledge Sharing.  Center IMPACT Metrics are published one to two weeks after.

<number>

<number>

 

Reporting Schedule

                                But you can report any time!

Reporting is “Open” for one month each quarter; however the reporting period is a 3-month span.  For example: Reporting will be open from April 1 through April 30; however you can report at any time and as many times between April 1 through June 30 for any reporting element with the exception of Progress Plans and Progress Data.

<number>

<number>

 

2018 Calendar Cycle

This is the 2018 Calendar showing the Reporting, Survey and Survey Confirmation periods.  

Please note that  either reporting, survey confirmation or survey is happening with very little time where there is a lull in the process.

<number>

<number>

 

Reporting Elements and their Minimal Required Reporting Frequency

Quarterly

• •Information 

• •Locations 

• •Staff (but…) 

• •Contacts 

• •Progress Data 

• •Partners 

• •Board of Directors 

• •State Funding Partners 

• •Success Story 

Semi Annually

1. • –Progress Plan/Technical Report* 

• •As Needed 

• • –Operating Outcomes* 

• • –Clients 

  • –Projects and Events (but….) 

• • –Budget Actuals* 

• •Elements not applicable to all 

• • –SalesForce Configuration 

  • –Regional Offices 

* MEP and Center Partnership Model

**(but…) if you do not submit bad things can happen

 

Funding Programs

• •Center Operations 

• •MFG USA Embedding  

• •Rolling Competitive Award Program (RCAP) 

• •Manufacturing Disaster Assistance Program (MDAP) 

• •Each award has its own requirements 

• • –Center Operations typically has the most extensive requirements 

NOTE:  Not our intention to cover Other Funding Program reporting in this session but if you have any questions see us after the session.

In addition to the Center Operations (base award) NIST MEP has made available some additional funding.  

Manufacturing U.S.A. Embedding funding was awarded to several centers as a pilot project that embeds staff from MEP centers at fourteen institutes within The Manufacturing USA (f/k/a National Network for Manufacturing Innovation or NNMI) network.

Rolling Competitive Award Program (RCAP) is a performance-based rolling Notice of Funding Opportunity for pilot projects to allow MEP Centers to submit proposals on an on-going basis throughout a given fiscal year.

Manufacturing Disaster Assistance Program (MDAP) funding was awarded to a few centers after the devastation of Hurricanes Harvey, Irma and Maria.  

<number>

<number>

 

Reporting Elements by Award Type

Reporting Element	Center Operations	Embedding		RCAP		MDAP
Board of Directors	Shared Across All Awards
CAR Information	Shared Across All Awards
Clients	Yes	Yes *		Yes *		Yes *
Contacts	Yes	Yes		Yes		Yes
Locations	Shared Across All Awards
Partners	Shared Across All Awards
Progress Plan	Yes		Yes		Yes		Yes
Projects	Yes		Yes *		Yes *		Yes *
State Funding Partners	Shared Across All Awards
Staff	Yes		Yes		Yes		Yes
Sub-Recipient	Yes		No		No		No
Success Stories	Yes		No		No		No

Each funding program has their own reporting requirements that you need to be aware of.

This slide shows the reporting elements required for each award type.  Note that the Board of Directors, CAR Information, Location, Partners and State Funding Partner elements are shared with the Center Operations “base” funding agreements.  Each other element MUST maintain separate reporting.

<number>

<number>

 

Reporting Dashboard

This slide shows the Reporting Dashboard in MEIS and the status of each reporting element for the chosen reporting period.

There is a color-coded key at the bottom of the page for the meaning of each colored status icon.

<number>

<number>

 

Reporting Elements – Information

Purpose:

1. • –Intended to provide NIST MEP with general CAR contact information such as address, telephone number, fax number, and email address 

   • –MEP will use this information in communications with stakeholders and for publishing CAR information in marketing materials and web sites  

   • –Feeds MEP Public Site – Center Near You , MEP Quick List, State One Pager 

How to Report:

1. • –Click CIP, hover over Information, Submit Quarterly Reports, review data on the various tabs, click Actions Submit for Reporting  

1. • • •Highly recommend that you update this information as soon as something changes, no need to wait for a reporting period. 

     • •Center’s cannot change CAR Name or Organization Type 

The CAR Information reporting element is intended to provide NIST MEP with general contact information such as address, telephone number, email address, etc.  

This information feeds into the MEP Pubic Site for the  Center Near You Map, MEP Quick List and your State One Pagers.

From the MEIS dashboard, click on CIP, hover over Information, then click Submit Quarterly Reports.  Make the necessary changes or updates, then click Actions, Submit for Reporting.  Given that MEIS follows a similar pattern for each reporting element, I will not go over the detailed instructions for submitting although the instructions are included for each element in this presentation.

You do not need to wait until a Reporting period is open to make these changes.

<number>

<number>

 

Reporting Elements – Information

Related Reports: Either data used or clickable from page

1. • –CAR Information 

   • –CAR List 

   • –BIR Report (clickable from Information) 

   • –One Pager (clickable from One Pager) 

   • –CBP, Rural, Congressional Districts (Export from tab) 

   • –CBP Information 

   • –MEP Quick List 

   • –Users 

There are several related reports  that include data from the CAR Information module.  Some reports are available under Reports, CAR Reports and others are clickable from the CAR Information page.

<number>

<number>

 

Reporting Elements – Information       

Did you know:

1. • –Information – you can view your D&B BIR if already created by your FPO 

   • –One Pager – view the one pager, the SS that is part, based on this you can contact Communications to make changes 

   • –Staff – edit other user account records.  New center name so all new email addresses, center moved 

   • –Counties – CBP data and rural export 

   • –Dun & Bradstreet – your center record is there, we use this information for renewal packages.  Have you ever looked at this record?   

Did you know…

You can view your D&B BIR report from the Information page, by clicking on the “Dun  & Bradstreet” tab.

The one-pager can be viewed from the Information page along with the featured Success Story  by clicking on the “One-Pager” tab.

By clicking on the “Staff” tab, you can edit other user account records, if you have been assigned the reporting role.

On the Counties tab you can view  County Business Pattern  data and rural continuum codes by county.  

You can also view your Center’s Dun & Bradstreet record from this page.

<number>

<number>

 

Reporting Elements - Locations

Purpose:

1. • –Locations are physical addresses where CAR, sub-recipient, or partner staff are based or deliver services 

   • –The locations are intended to provide NIST MEP with general contact information such as address and phone information 

   • –MEP uses this information to communicate our national coverage area with our various stakeholders  

How to Report:

1. • –Click CIP, hover over Locations, Submit Quarterly Reports, review field offices, CAR regional offices, and partners as service delivery locations, click Actions Submit for Reporting  

NOTE:  We need centers to look at Locations closely, remove duplicates.  Some centers have a location as a field office, CRO, and partner.  These locations are being double and triple counted.

Locations are physical addresses where CAR, sub-recipients, field offices, CROs or partners that deliver services are located.  

It is important to keep this information updated as MEP will use this information to communicate our national coverage area with our various stakeholders.

Make sure that you have removed duplicates so locations are not double counted.  For example, you should not have sub-recipients also listed as Locations.

<number>

<number>

 

Reporting Elements - Locations

Related Reports: Either data used or clickable from page

1. • –CAR Information  

   • –CAR Locations 

Did you Know:

1. • –In order to update Partners as Service Delivery Location, you must do so from the Partners page 

   • –Adding or marking records inactive can be done either from the List or Submit Quarterly Reporting Forms 

There are a couple of related reports that include data from the CAR Information module.  These reports are available under Reports, CAR Reports.

Did you know…

In order to update Partners as Service Delivery locations, you must do so from the Partners Page.  

Adding or marking records inactive can be accomplished from either the List or Submit Quarterly Reporting Forms.

<number>

<number>

 

Reporting Elements - Staff

Purpose:

1. • –The staff element provides the CAR a mechanism for reporting on its active workforce 

   • –The staff listing is a compilation of registered CAR staff users 

How to report:

1. • –Click CIP, hover over Staff, Submit Quarterly Reports, review data, click Actions Submit for Reporting  

1. • • •Verify that the Staff list is current and complete and that all staff are assigned to the appropriate funding agreements 

     • •To the right on the Staff grid, columns of checkboxes are visible for each Funding Agreement, click the checkbox for each Funding Agreement a staff member is working 

     • •To remove a staff member, click the archive checkbox to the right on the Staff grid 

The Staff reporting element is intended to provide the CAR a mechanism for reporting on its active workforce.

Don’t forget to archive staff who are no longer with your center immediately and not wait until the next reporting period.  We do not want staff no longer employed by the National Network to have access to data on MEIS or MEP Connect.

<number>

<number>

 

Reporting Elements - Staff

Related Reports: Either data used or clickable from page

1. • –CAR Contacts 

   • –CAR Information  

   • –Clients and Projects 

   • –Clients/Projects/Impacts 

   • –MEP Quick List  

   • –Users 

There are several related reports  that include data from the Staff module.  Reports are available under Reports, CAR Reports.

<number>

<number>

 

Reporting Elements - Staff

Did you know:

1. • –Anyone devoted to the CAR, either as an employee or sub-recipient providing part of a partner’s cash or in-kind contributions, as delineated in the CARs current Operating Plan, is considered part of the CARs staff and should be reported 

   • –Each CAR staff member is responsible for maintaining his or her own record 

   • –CAR Staff members are automatically associated to a center when they register for access to the MEP MEIS but they are not automatically assigned to a funding program and will not appear in the Staff Listing until a funding program is assigned 

   • –Staff cannot be associated with a project unless they are tied to the appropriate funding agreement 

Did you know…

Anyone devoted to a CAR, either as an employee or sub-recipient providing part of a partner’s cash or in-kind contributions, as delineated in the CARs current statement of work, is considered part of the CARs staff and should be reported.

It is the responsibility of the staff member to maintain their contact information (address, phone, email, etc.), however, person(s) at the Center with the reporting role  do have access to staff records and can also maintain that information.

You must first associate the staff member to a funding program before they will appear in the Staff Listing or can be listed as CAR Key Staff on a project.

<number>

<number>

 

Adding Funding Program for Staff

To add staff to a funding program, they must first register for a MEIS account.

Once they have an account, a staff member with the Reporting role will need to associate the new staff member to one or more funding programs they are supporting.  Click on CIP, Staff, Submit Quarterly Reports

<number>

<number>

 

Adding Funding Program for Staff (Continued)

Find the staff member, click the appropriate radio button(s) for each Funding Program, click Actions, Submit for Reporting .  The new staff member will NOT show in the staff listing until this step is performed.

You can also click the “Archive” radio button to archive staff that are no longer a center staff.

Now I will turn it over to Kim who will cover the Contacts, Progress Data, Board of Directors and Board Members reporting elements.

<number>

<number>

 

Reporting Elements - Contacts

Purpose:

1. • –Contacts are CAR officials with specific duties for which there is the opportunity to correspond as a group 

   • –Contacts are used to communicate with the correct CAR staff through mailing lists and working groups 

How to report:

1. • –Click CIP, hover over Contacts, Submit Quarterly Reports, review different contact types, edit/add contacts, click Actions Submit for Reporting 

The Contacts reporting element is used for CAR officials with specific duties and to communicate with the correct CAR staff through email, postal mail and working groups.

 

<number>

<number>

 

Adding Contacts

To add a Contact, from the MEIS dashboard, click on CIP, hover over Contacts, then click Submit Quarterly Reports.  Click the edit icon to add staff to contact type.

<number>

<number>

 

Adding Contacts (Continued)

Choose the contact type from the drop down menu.  Search users by name through MEIS and click ADD to add the staff to the available list.  Or if the user is already showing in the available list, choose the name and move to the ‘selected’ list using the arrows.  Click OK.  

<number>

<number>

 

Reporting Elements - Contacts

• •The 8 different contact types are: 

• • –CAR Review Contact - Used as a communication channel for panel reviews 

  • –Director - One and only one due to marketing needs. Feeds MEP Public Site – Center Near You and MEP Quick List 

  • –Director Notification – Allows a center to designate users to receive the same notifications as center directors without feeding the MEP Public Site or MEP Quick List  

  • –Financial/Operations Manager – Used to support CFO communications and leveraged by grants and FPOs to get updated information and documents out - like new guidelines or terms and conditions 

  • –Marketing Manager – Provides a focused list of marketing managers and is used to support marketing manager communications 

  • –MEP Scouts – Used for the Supplier Scouting group on the MEP Connect site 

  • –Reporting Contact  – Used to send out communications in regards to the opening and closing of reporting cycles. Also used to communicate any updates to the reporting requirements, structure, guidelines, etc. 

  • –Survey Contact - Used to send out communications in regards to survey confirmations and outlier duties 

There are 8 different contact types.  

• -CAR Review Contact is used as a communication channel for panel reviews 

• -The Director contact type can only be assigned to the Center Director or the designated Acting Director.  This information feeds into the MEP Public Site and MEP Quick Lists. 

• -Director Notification contact type – allows the center to designate staff to receive the same notifications as the center director without feeding the MEP Public Site or MEP Quick Lists. 

• -Financial/Operations Manager  is used to support CFO communications and leveraged by grants and FPOs to get updated information and documents out like new guidelines or terms and conditions 

• -Marketing Manager – Provides a focused list of marketing managers and is used to support marketing manager communications 

• -MEP Scouts is used for the Supplier Scouting group on the MEP Connect site 

• -Reporting Contact  is used to send out communications in regards to the opening and closing of reporting cycles. Also used to communicate any updates to the reporting requirements, structure, guidelines, etc. 

• -Survey Contact is used to send out communications in regards to survey confirmations and outlier duties 

<number>

<number>

 

Reporting Elements - Contacts

Related Reports: Either data used or clickable from page

1. • –CAR Contacts 

   • –CAR Information  

   • –CAR List 

   • –MEP Quick List  

There are several related reports  that include data from the Contacts module.  Reports are available under Reports, CAR Reports.

<number>

<number>

 

Reporting Elements - Contacts

Did you know:

1. • –MEP list server- available to be used by anyone with MEIS account, messages are monitored - if you wanted to send an email to center directors, or marketing managers, you can 

   • –Changes made to contacts will be immediate and automatically transferred to the appropriate MEP mailing lists that correspond to those positions 

Did you know…

The MEP list server is available to be used by anyone with a MEIS account.  Messages are monitored.

Changes made to any Contact will be immediate and automatically updated in the corresponding MEP mailing list.

<number>

<number>

 

Reporting Elements – Progress Data

Purpose:

1. • –This reporting element is intended to collect quantifiable data for the award 

   • –This information is used to respond to stakeholders and may be used for review, marketing, or research purposes  

How to report :

1. • –Click CIP, hover over Progress Data, Submit Quarterly Reports, enter FTE and CME counts, click Actions Submit for Reporting 

1. • • •An FTE is full-time equivalent 

     • •CME is client manufacturing establishment  

The Progress Data reporting element is intended to provide the CAR a mechanism for reporting on its  active full time equivalents (FTEs) and clients served in the last 12 months.

NIST MEP uses the FTE counts in capacity utilization calculations fount within your Center Performance and Profile Report.  The CMEs served number is used to report to various stakeholders to show the breadth of the touches for the National Network.  This number is not the same as the number of clients attempted to be surveyed.

<number>

<number>

 

Reporting Elements – Progress Data

Related Reports: Either data used or clickable from page

1. • –Cohort Comparison 

Did you know:

1. • –The CME count found in this section is used in many different NIST MEP publications  

   • –Official source of all FTE counts  

There are several related reports that include Progress Data.  Reports are available under Reports, CAR Reports.

The Cohort Comparison chart is a great way to compare your Center’s performance against other Centers that may or may not have similar characteristics such as (federal funding, region, service delivery model etc.

 

You choose your cohort.

<number>

<number>

 

Reporting Elements – Board of Directors

Purpose:

1. • –The information contained in the Board of Directors section is intended to provide NIST MEP with general information about the Board and Board members 

   • –NIST MEP will use this information in the day-to-day role as a consultant to the CAR 

   • –Used in Annual and Panel Reviews  

• •How to report 

• • –Click CIP, hover over Board of Directors, Submit Quarterly Reports, review Board and Board Members, click Actions Add to add new Board, click Actions Submit for Reporting 

• • • •Centers are responsible for updating both the Board and Board Member record 

    • •Remove Board by marking it inactive 

    • •Remove Board Member by selecting the X under the Remove from Board column  

• • • • –Can also mark inactive in the Member profile 

The Board of Directors reporting element is intended to provide the CAR a mechanism for reporting on its  active Board of Directors.  You can add one or more boards, this is especially useful if you have both a fiduciary and advisory board.  Or if you are a center with center regional offices.  Each one of your offices can have its own board or boards.  

After you have created the board, do not forget to add members. You will be asked to indicate if the member is the board chair, their tenure and if their organization is a small manufacturer.

To remove a board or board member record, mark the status as inactive.

<number>

<number>

 

Reporting Elements – Board of Directors

Related Reports: Either data used or clickable from page

1. • –Board of Directors 

   • –CAR Information 

Did you know:

1. • –The Board Chair contact information is frequently used for communications from the Director and other working groups, so it is important to keep this information up to date 

1. • • •This is done by checking Chairperson in the Board Member record 

     • •Also important to keep the Tenure and Small manufacturer background information up to date in the Board Member record 

   • –Boards have Board Member records that need to be maintained 

   • –Centers are able to create MEIS accounts for Board Members 

     • •Access levels are determined by the center 

There are several related reports that include Board of Director information.  Reports are available under Reports, CAR Reports.

Did you know….

Boards have Board Members, do not forget to review and update this list periodically.

That the board chair contact information is used by MEP Management to send notifications about the program.

Centers can choose to request MEIS and MEP Connect accounts for any of their board members.

<number>

<number>

 

Reporting Elements – Board of Directors

Did you know:

1. • –A CAR may have two types of Boards – a fiduciary board and/or an advisory board 

1. • • •A fiduciary board exists for all freestanding non-profit organizations  

1. • • • –A fiduciary board will have a charter document and/or bylaws describing the duties and terms of the board members 

     • •An advisory board is usually a less formal body, and can be affiliated with any type of organization  

       • –The roles and responsibilities of advisory boards may be similar to fiduciary boards, or they may be more focused on areas such as client needs 

Did you know…

Centers can create more than one type of Board records.  

Fiduciary boards are typical for non-profit organizations.

Advisory boards are less formal than fiduciary and provide oversight to centers.

<number>

<number>

 

Creating a User Account for Board Members

To Create a User account for Board Members, from the MEIS dashboard, click on CIP, hover over Board of Directors, Submit Quarterly Reports, click the View/Edit icon for the Board,  under the Create MEIS Account column, click the link Create MEIS Login , you will be prompted to confirm that you want a MEIS/MEP Connect account created and that the board member will have access to some of your center data.  As soon as you click create account, the board member will receive an email indicating an account has been created for them.  Please make sure you notify the board member to expect to receive this email.  

<number>

<number>

 

Reporting Elements - Clients

Purpose:

1. • –NIST MEP uses client records for the purpose of conducting an in-house project impact survey measuring the realized impacts (sales, investment, employment, customer satisfaction, etc.) of our services to our clients 

   • –Client information may also be used for other purposes such as market and industry research 

How to report:

1. • –Click CIP, hover over Clients, Submit Quarterly Reports, either hit Actions Add New to manually add a client or click Select Files to upload CIF XML , click Actions Submit for Reporting, or Click Actions Submit from Salesforce 

1. • • •A unique client ID is assigned to each client. The CIF is the Client Information File. The file is found on MEIS 

     • •If uploading via CIF then file must be in XML 

     • •For Center Operations, the client must have a manufacturing (31-33) or R&D NAICS Code (541711 or 541712) and a valid DUNS Number (unless included in NIST MEP Definition of Manufacturing – DOM) 

     • •MEP uses Dun and Bradstreet for NAICS Code verification 

The Client reporting element is used by the centers to report clients to whom they have provided services.  NIST MEP uses the client records for the purpose of conducting an in-house project impact survey measuring the realized impacts of our services to clients.

From the MEIS dashboard, click on CIP, hover over Clients, then click Submit Quarterly Reports.  Either click Actions, Add, New to manually add a client or click Select Files to upload the CIF XML file.  Click Actions, Submit for Reporting, or Click Actions, Submit from Salesforce, if you are importing from your Salesforce CRM.

Once a new client is submitted, MEIS assigns a unique client ID.

<number>

<number>

 

Reporting Elements - Clients

Workflow:

1. • –There will be a workflow if clients are submitted as a batch submission (CIF) or from Salesforce as opposed to manually entered. The Salesforce utility will be described in detail later. 

   • –First, the CIF must be converted to XML 

1. • • •XML is an open standard for describing data and is an ideal solution for transferring structured data from server-to-client, server-to-server or application-to-application on any platform 

     • •NIST MEP provided CIF Template has an easy add-in to convert to XML 

   • –Ensure that you have the proper Reporting Period selected and then upload CIF XML 

   • –Click Action(s) - Submit for Validation. Any errors with the file are displayed. When a file is submitted for validation, the file is checked to ensure validity and consistency. Field level validation ensures that the data entered in all record fields are correct. However, this type of validation does not validate against client records already existing in the MEIS database. This is achieved through validation at the database level   

   • –If the file fails with errors, the XML file will need to be corrected and re-uploaded using the same process. Repeat this process until the file passes with no errors. You will then need to submit for reporting         

   • –Click Action(s) - Submit to System. The information in the file is submitted to the MEIS database 

   • –You are redirected to the CAR Dashboard. If you have successfully submitted Client information – the Status Icon will be half green/half yellow indicating the submission is “Passed Pending MEP Review”  

   • –A MEP staff member then has to review and finalize the submission to achieve the “Passed” icon  

If clients are submitted as a batch submission using the Client Information File (CIF) template provided or from Salesforce as opposed to manually entered, there is a workflow that needs to be followed.

• • -The CIF must be converted into XML format.  The CIF excel template has an “Add in” that will convert your excel file to XML for easy CIF submission into MEIS. 

  • -Ensure you have selected the correct Reporting Period prior to uploading your CIF XML file. 

  • -Click Action(s), Submit for Validation.  During this step, the file is checked to ensure validity and consistency.  Any errors with the file will be displayed. 

  • -If the file fails the validation, the XML file will need to be corrected and reloaded using the same process.  This process needs to be repeated until the file passes without error. 

  • -Click Action(s), Submit to system.  The information in the file is submitted into MEIS. 

  • -An MEP staff member will then review and finalize the submission. 

<number>

<number>

 

NIST MEP Expanded NAICS Codes (Definition of Manufacturing)

• •423510 - Metal Service Centers and Other Metal Merchant Wholesalers 

• •488991 - Packing and Crating 

• •541330 - Engineering Services 

• •541380 - Testing Laboratories 

• •561910 - Packaging and Labeling Services 

• •811310 - Commercial and Industrial Machinery & Equipment (except Automotive & Electronic) Repair & maintenance 

In addition to the 31 and 33 series manufacturing NAICS codes and the 54171x Research and Development codes, we have expanded the Definition of Manufacturing to include the following NAICS codes:

• •423510 - Metal Service Centers and Other Metal Merchant Wholesalers 

• •488991 - Packing and Crating 

• •541330 - Engineering Services 

• •541380 - Testing Laboratories 

• •561910 - Packaging and Labeling Services 

• •811310 - Commercial and Industrial Machinery & Equipment (except Automotive & Electronic) Repair & maintenance 

<number>

<number>

 

Reporting Elements - Clients

• •CAR Overview  

• •CAR Performance Metrics 

• •CAR Performance Review 

• •CAR Survey Results 

• •Clients and Projects 

• •Clients/Projects/Impacts 

• •Cohort Comparison  

• •Impact Analysis  

Related Reports: Either data used or clickable from page

• •IMPACT Metrics 

• •IMPACT Metrics Detail 

• •IMPACT Metrics Summary 

• •Industry Profile  

• •Success Story Details 

• •Survey Confirmation 

• •Survey Continuity  

• •Survey Outliers 

• •Survey Results  

• •Survey Summary
   

The reports listed are related to Client reporting.  You can access these reports by clicking CAR Reports from the top menu bar on your MEIS dashboard.

<number>

<number>

 

Reporting Elements - Clients

Did you know:

1. • –The CIF excel templates can be downloaded from the MEIS website on your Center Dashboard in MEP Documents 

1. • • •In order to use the template provided macros must be enabled in your Excel application.  

1. • –Instructions for using the CIF template are included in the Excel file on the Help worksheet 

1. • –The clients (or CIF) must be uploaded before the projects or Project Information File (PIF) can be uploaded 

Did you know…

The Excel template for the CIF can be downloaded from the MEIS website from your Center Dashboard, in the MEP Documents widget?

The instructions for using the CIF template are included in the Excel file on the Help worksheet?

The CIF must be uploaded before the PIF can be uploaded?

<number>

<number>

 

Reporting Elements - Clients

Did you know:

1. • –The client file has two tabs – one contains the information that the CAR has provided about the client and the other contains information that is pulled from the D&B database 

1. • • •A ! beside any field, means that the data that you entered differs from D&Bs data 

     • •You can hover over the ! and right click to accept the data if you believe it to be accurate.  

1. • –MEIS has a D&B portal which helps with obtaining DUNS Numbers and NAICS Codes and  conducting research on potential clients 

Did you know…

The client file has two tabs, one contains the information provided by the Cooperative Agreement recipient about the client and the second tab contains information that is pulled from the D&B database.

        - A red exclamation point beside any field is an indication that the data you entered is different from D&Bs data.

        - Hover over the red exclamation point and right click to accept the data if you believe it to be accurate.

MEIS has a D&B portal which helps with obtaining DUNS numbers and NAICS codes and with conducting research on potential clients.

<number>

<number>

 

Reporting Elements – Projects and Events

Purpose:

1. • –Project/Event information is collected for the purpose of conducting an in-house project impact survey measuring the realized impacts (sales, investment, employment, customer satisfaction, etc.) of services to our clients 

   • –Surveys are conducted six months after the completion of the project for new clients.  The survey period could vary for repeat clients 

   • –All projects and events reported to NIST MEP will be surveyed 

How to report:

1. • –Click CIP, hover over Projects and Events, Submit Quarterly Reports, either hit Actions Add New to manually add a project or click Select Files to upload PIF XML , click Actions Submit for Reporting, or click Actions Submit from Salesforce 

1. • • •Clients must be in the system before submitting projects 

     • •Each individual project/event reported on the PIF must be assigned a unique project/event identifier.  This unique id will identify each interaction 

     • •Each Project/Event will be directly associated to one of the Funding Agreement Ids 

     • •Projects are reported with a single Client ID and Events have multiple Client IDs per record 

The Project and Event reporting element is used by the centers to report projects.

NIST MEP uses the for projects and events for the purpose of conducting an in-house project impact survey, measuring the realized impacts (sales, investment, employment, customer satisfaction, etc.) of services to our clients.

From the MEIS dashboard, click on CIP, hover over Projects and Events, then click Submit Quarterly Reports.  Either click Actions, Add, New to manually add a project or click Select Files to upload the PIF XML file.  Click Actions, Submit for Reporting, or Click Actions, Submit from Salesforce, if you are importing from your Salesforce CRM.

Clients must be in the MEIS system before submitting projects.  Each individual project/event reported must be assigned a unique project/event identifier.  Each project/event will be directly associated to one of the Funding Agreement IDs.  Projects are reported with a single Client ID; however, Events have multiple Client IDs per record.

<number>

<number>

 

Reporting Elements – Projects and Events

Workflow:

1. • –There will be a workflow if projects are submitted as a batch submission (PIF) or submitted from Salesforce as opposed to manually entered.  The Salesforce utility will be described in detail later. 

   • –First, the PIF must be converted to XML 

1. • • •XML is an open standard for describing data and is an ideal solution for transferring structured data from server-to-client, server-to-server or application-to-application on any platform 

     • •NIST MEP provided PIF has easy add-in to convert to XML 

   • –Ensure that you have the proper Reporting Period selected and then upload PIF XML 

   • –Click Action(s) - Submit for Validation. Any errors with the file are displayed. When a file is submitted for validation, the file is checked to ensure validity and consistency. Field level validation ensures that the data entered in all record fields are correct. However, this type of validation does not validate against client records already existing in the MEIS database. This is achieved through validation at the database level   

   • –If the file fails with errors, the XML file will need to be corrected and re-uploaded using the same process. Repeat this process until the file passes with no errors. You will then need to submit for reporting         

   • –Click Action(s) - Submit to System. The information in the file is submitted to the MEIS database 

   • –You are redirected to the CAR Dashboard. If you have successfully submitted Client information – the Status Icon will be half green/half yellow indicating the submission is “Passed Pending MEP Review”  

   • –A MEP staff member then has to review and finalize the submission to achieve the “Passed” icon  

If Project and Events are submitted as a batch submission using the Project Information File (PIF) template provided or from Salesforce as opposed to manually entered, there is a workflow that needs to be followed.

1. • -The PIF must be converted to XML format.  The PIF excel template has an “Add in” that will convert your excel file to XML for easy PIF submission into MEIS. 

   • -Ensure you have selected the correct Reporting Period  prior to uploading your PIF XML file. 

1. • -Click Action(s), Submit for Validation.  During this step, the file is checked to ensure validity and consistency.  Any errors with the file will be displayed. 

   • -If the file fails the validation, the XML file will need to be corrected and reloaded using the same process.  This process needs to be repeated until the file passes without error. 

   • -Click Action(s), Submit to system.  The information in the file is submitted into MEIS. 

   • -An MEP staff member will then review and finalize the submission. 

<number>

<number>

 

Reporting Elements – Projects and  Events

• •CAR Overview  

• •CAR Performance Metrics 

• •CAR Performance Review 

• •CAR Survey Results 

• •Clients and Projects 

• •Clients/Projects/Impacts 

• •Cohort Comparison  

• •Impact Analysis  

Related Reports: Either data used or clickable from page

• •IMPACT Metrics 

• •IMPACT Metrics Detail 

• •IMPACT Metrics Summary 

• •Industry Profile  

• •Success Story Details 

• •Survey Confirmation 

• •Survey Continuity  

• •Survey Outliers 

• •Survey Results  

• •Survey Summary
   

The reports listed are related to Project and Event reporting.  You can access these reports by clicking CAR Reports from the top menu bar on your MEIS dashboard.

<number>

<number>

 

Reporting Elements – Projects and Events

Did you know:

1. • –Instructions for using the PIF template are included in the Excel file on the Help worksheet 

   • –Common errors include: 

1. • • •Date format 

     • •Cutting and pasting into project description – strange characters 

1. • • • –Textpad can be a useful tool to avoid this. Download TextPad at www.textpad.com 

     • •Total Project Value field only accepts whole values – no decimals 

     • •Staff name in CAR Key Staff MUST  be their MEIS User ID number 

     • •Incorrect email format 

     • •Using incorrect Funding Agreement Number 

     • •Substance code – number ONLY – Do Not Include Label 

   • –PIF files may be tested for validation as many times as needed by clicking Submit for Validation, but in order for the submission to be finalized the file MUST be submitted as final by clicking Submit to System 

Did you know…

Instructions for using the PIF excel template are included in the Excel file on the Help worksheet.

Listed on this slide are common errors received when submitting PIF for validation.

PIF files may be tested for validation as may times as needed by clicking “Submit for Validation” but in order for the submission to be finalized, the file must be submitted as final by clicking “Submit to System”.

<number>

<number>

 

CIF and PIF Reporting Suggestions

• •Surveys are triggered off of the project completion date, not the reporting period 

• •If you report a project, it will be surveyed 

• •Minimizing the burden on clients – before reporting the project, try to decide if you can determine impact for the activity. If you cannot, then do not expect clients to be able to either; 

• •Use Project EIS field to your advantage 

Some suggestions and reminders for submitting CIF and PIFs are:

         - Survey’s are triggered of project completion date, not the reporting date

        - If you report a project, it will be surveyed 6 months after the completion date of the project

        - Before reporting the project, try to determine impact for the activity and use the project Estimated Impact Span           (EIS) to your advantage.               

<number>

<number>

 

Reporting Elements - Partners

Purpose:

1. • –The Partner submission provides the CAR a readily available mechanism for reporting on its formal and informal relationships with other organizations 

   • –The importance of knowing a CAR’s Partners is to show the extent of a CAR’s reach beyond its own resources 

   • –This information is used to show that MEP CARs are working with partner organizations to deliver the best possible services and products to its clients through formal and informal agreements 

   • –CARs are expected to have a formal performance management process for its partners.   

   • –Used in Annual and Panel Reviews 

The Partners reporting element is intended to provide the CAR a mechanism for reporting on its  formal and informal relationships with other organizations and to show the extend of a CARs reach beyond it’s own resources.

NIST MEP uses this information in Annual and Panel reviews to show that MEP CARs are working with partner organizations to deliver the best possible products and services to it’s clients.  

<number>

<number>

 

Reporting Elements - Partners

How to report:

1. • –Click CIP, hover over Partners, Submit Quarterly Reports, review Partners, click Actions Add to add new partner, click Actions Submit for Reporting 

1. • • •Partners – Defined as an organization that contributes or aligns resources (human and/or monetary) through a long-term formal or informal agreement. They could provide cash or in-kind contributions to meet cost share, deliver services, provide office space and equipment, and/or provide staff time 

1. • • • –Sub-recipient – explicitly identified in a CARs Cooperative Agreement and maintained by FPOs in CIP, Funding Programs, Awards, Period of Performance.  SRAs are displayed but Centers cannot update this information. 

       • –Third-party Contributors – there is a formal agreement 

       • –Other Partners – no formal agreement – CAR wants to list the Partner as a resource 

From the MEIS dashboard, click on CIP, hover over Partners, Submit Quarterly Reports.  Review Partners, make necessary changes or updates, then click Actions, Submit for Reporting.  To add a new Partner, Click Actions, Add, enter the information for the new Partner, then click Actions, Submit for Reporting.

Given that MEIS follows a similar pattern for each reporting element, I will not go over the detailed instructions for submitting although the instructions are included for each element in this presentation.

<number>

<number>

 

Reporting Elements - Partners

Related Reports: Either data used or clickable from page

1. • –CAR Information 

   • –Partners  

Did you know:

1. • –Remove a Partner by marking the organization inactive  

   • –Adding/removing records can be done either from the List or Submit Quarterly Reporting options 

   • –Centers MUST designate Partners as Key Partners (up to five).  Key Partners typically have a formal agreement and provide services such as delivery, marketing, developing products, etc.   

NOTE:  Please review this list and ONLY include Partners that add value.  More is not always better, we need quality as this is a common data pull.

Reports related to Partners reporting are listed on this slide.

Did you know…

• -You can remove a Partner by marking the organization inactive? 

• -Adding and removing partner records can b e done either from the List or Submit Quarterly Reporting options 

• -Centers MUST designate Partners as Key Partners (up to five).  Key Partners typically have a formal agreement and provide services such as delivery, marketing, developing products, etc.   

Only Partners that add value should be added to this list.

<number>

<number>

 

Reporting Elements – State Funding Partner

Purpose:

1. • –Intended to provide the CAR a readily available mechanism for reporting on its relationships with State and Local Government Officials 

   • –State Funding Partners are the primary funding decision officials for the program within the state or local government for the CAR  

How to report:

1. • –Click CIP, hover over State Funding Partner, Submit Quarterly Reports, review State Funding Partners, click Actions Add to add new State Funding Partner, click Actions Submit for Reporting 

1. • • •All State Funding Partners must relate back to a Partner organization that is reported in the Partners element 

     • •Remove State Funding Partners by marking them inactive 

The State Funding Partner reporting element is intended to provide the CAR a mechanism for reporting on its relationships with State and Local Government Officials.  

State Funding Partners are the primary funding decision officials for the program within the state of local government for the CAR.

From the MEIS dashboard, click on CIP, hover over State Funding Partners, Submit Quarterly Reports.  Review State Funding Partners, make necessary changes or updates, then click Actions, Submit for Reporting.  To add a new State Funding Partner, Click Actions, Add, enter the information for the new State Funding Partner, then click Actions, Submit for Reporting.

<number>

<number>

 

Reporting Elements – State Funding Partner

Related Reports: Either data used or clickable from page

1. • –CAR Information 

   • –State Funding Partners 

Did you know:

1. • –Centers are able to create MEIS accounts for State Funding Partners 

1. • • •Access levels are determined by the center 

     • •Instructions similar to Board Member account creation 

Question:  Why is this element not used by centers often?  Is it misunderstood or there just are not that many State Government Organizations/People that your center partners with?

Reports related to State Funding Partner reporting are listed on this slide.

Did you know…

• -Centers are able to create MEIS accounts for State Funding Partners?  Access levels are determined by the center. 

To Create a User account for State Funding Partner, from the MEIS dashboard, click on CIP, hover over State Funding Partner, Submit Quarterly Reports, click Actions, Add.  Enter information for State Funding Partner,  under the Create MEIS Login Account row, check the checkbox to Create MEIS Login Account.  You will be prompted to confirm that you want a MEIS/MEP Connect account created and that the State Funding Partner will have access to some of your center data.  As soon as you click create account, the State Funding Partner will receive an email indicating an account has been created for them.  Please make sure you notify the State Funding Partner to expect to receive this email.  

<number>

<number>

 

NIST MEP Partnership Model

The NIST MEP Partnership Model  (previously known as Center 2.0) was devised by a cross-functional team at NIST to streamline the Center reporting and review process.  

<number>

Confidential, Working Draft Only

<number>

Confidential, Working Draft Only

Confidential, Working Draft Only

 

Changes from Previous to Current…

NIST Partnership Model	Previous	Current
Years Covered	'89 - '15	'15 - '25
Guaranteed Number of Competitions after 10 Years	0	1
Number of Times Decision to Renew Designation (Year 5)	10	1
Number of Panel Reviews	5	2
Number of Major Ops Plan Renewals (3, 4 Years)	10	3
Number of Progress Plan/Technical /Budget Reports (SF 425s)	40	20

From previous version to the current Partnership Model, the number of times a center has to go through most actions has decreased (ex. Panel Reviews, Progress Plans/Technical Reports).  The only exception is that there is a guaranteed competition after 10 years under the current NIST Partnership Model and previously there was not.  

Confidential, Working Draft Only

<number>

Confidential, Working Draft Only

<number>

<number>

 

NIST MEP Partnership Model: Modular Approach

• •The MEP Partnership Model takes a modular look at program execution 

• •Begins with Proposal/Statement of Work where information is obtained 

• •Operationalize by layering on Operating Outcomes and multi-year budgets 

• • •Three years of detailed goals and budgets 

  • •Remaining two years will be requested after Panel Review in Year Three 

• •Report regularly, review annually, amend when necessary, to ensure compliance 

• •Communication is key to this partnership 

50

50

 

NIST MEP Partnership Model Timeline

 

“Idealized” Future

 

 

NIST MEP’s goal is to create an “Idealized” future where the NIST MEP Strategy is the guide and that all inputs and outputs are aligned according to the same strategy foundation.

<number>

<number>

 

Annual Review Process

<number>

When a Center is not undergoing a Panel Review in Years 3 and 8, an on-site Annual Review occurs.  During the Annual Review the Federal Program Officer and Regional Manager review and validate the Proposal/Statement of Work, progress to Operating Outcome goals, 5 year Budget as as well as Current and Next Year Budgets.  

If no changes are needed the annual forms are submitted for the next year of funding.

If some changes are needed, the documents are revised, the annual forms submitted for the next year of funding.

<number>

<number>

 

Alignment of Operating Outcomes

Element	Strategic Plan	FFO	Operating Guidance	Progress Plan Narrative	Definitions
Work with Small, Rural, Start-up Companies	Element #1	a.i.(1) & (2)	Numeric (I)	Open Field & Count	MRPEG, D&B
Transformational Clients	Element #1	a.iii.(1)	Numeric (I)	Open Field & Count	NIST Guidance
Balance of Top Line & Bottom Line Growth	Element #1	a.iii.(2)	Numeric (I)	Open Field & Count	MRPEG, Center
Making New Technologies Available	Element #1 – MEP AB	a.i.(2) & a.iii.(2)	Milestone (F)	Open Field	Center
Center Key Initiatives	Element #3	a.Ii	Milestone (F)	Open Field	Center
Board Development	Element #2 – MEP AB	b.i	Milestone (F)	Open Field	Center
Performance Measures/Levels	Element #4	a.iii.(4)	Numeric (O)	Open Field	Center

Each element in the Operating Outcomes Statement is aligned with the Strategic Plan, FFO, Operating Guidance, and Progress Plan narratives. Also included in the last column are the entities responsible for defining the definitions and where applicable the sources to validate data.

Confidential, Working Draft Only

<number>

Confidential, Working Draft Only

<number>

<number>

 

Client Goals - Very Small, Rural, Start-up and SMEs Served – All D&B Based

• •Definitions provided in Operating Outcome documents  

• • –Very Small = <20 employees 

  • –Rural = Using USDA Rural Continuum Code  

  • –Start-up = established within last 5 years 

  • –Other SME’s not captured in one of the specific groupings above 

  • –Total unique clients  

• •Within the Progress Plan narratives, describe the overall program progress describing center strategy for serving these clients.  NIST MEP does not want just a list of company names. 

• •Data in table is calculated based on what was submitted in your Projects.  

• •Without a project, a client alone does not count towards these goals. 

• •NOTE:  Client goals are based on what the current D&B record in MEIS states.  Records are updated automatically is the last update date is older than 6 months. As soon as a project is Finalized by NIST MEP the tracking of progress to goal occurs.   

Client counts are triggered by project/event completion dates.  If there is no project, there can not be a client that meets a goal.  Progress to Very Small, Rural and Start-up goals will be validated based on Dun and Bradstreet (D&B) data.  

• •Very small clients – establishment employment <20 employees 

• •Rural clients – located in counties designated as rural according to the United States Department of Agricultural Rural Continuum Code (RUCC).  County is determined by D&B FIPS State and County Codes 

• •Startup – company established (year founded) within the last 5 years 

• •Other SMEs – if a client served does not meet one of the designations for Very Small, Rural, Startup as defined on this slide or Transformation as defined on the next slide, then it is an “Other SME”  As an example, a manufacturing client with employees = 232 or a client located in a county designated as urban 

• •Total Unique Clients – distinct count of clients (Duns number)  

In addition to the progress towards client engagement goals, Centers must address as part of their Progress Plan narrative a response to meeting these goals.

Please remember, as previously stated, without a project, a client alone does not count towards these goals and is validated based on D&B data.  If D&B data in MEIS is older than 6 months an automatic update from the D&B servers is initiated.  As soon as a project is finalized by NIST MEP, the tracking of progress to goals occurs.

If a center submits their Clients (CIF) and Projects/Events (PIF) prior to completing the Progress Narrative, progress for each Year/Quarter will be displayed on your Progress Plan.

Please note, these are not mutually exclusive categories, a client might count in several categories at one time (ex.  Very Small and Rural).

And finally, Centers can run the Client/Project report, scroll to the far right, to see the counts of clients/projects that meet each of these definition

<number>

<number>

 

Client Goals – What is a transformational client?

• •Definition used by NIST MEP 

• • –“In Client record Centers select “Yes” or “No” to indicate if a client is considered to be in an ongoing transformative relationship with the center…Yes: Indicates the center has established a long-term, coaching relationship with the client and is helping the client transform.” 

• •Your center decides which Clients/Projects fit this definition 

• •Within the Progress Plan narratives describe your center’s overall program progress describing the center’s strategy for serving transformational clients.  This is  to be detailed description as to how your center is transforming clients.  This MUST not be just a list of company names 

• •Data in table is calculated based on what was submitted in your Projects. 

NOTE:  A client MUST be marked as transformational before you submit a project.  As soon as a project is Finalized by NIST MEP the tracking of progress to goal occurs.  

In order for a client to be counted as transformation, the client record MUST be marked as Transformation prior to the submission of the Project/Event.  It is up to the Center along with your Regional Manager (RM) to determine the appropriate definition of a transformation client.  

Centers MUST also include a narrative in response to the Center’s strategy for serving transformational clients.  

Please note, a client MUST be marked as Transformational prior to submission of the project/event.  Centers can run the Client/Project report, scroll to the far right, to see the counts of clients/projects that meet each of these definition.

<number>

<number>

 

Engagement Goals - Top Line/Bottom Line Growth

• •The Progress Plan includes two separate narrative sections related to engagement goals.  The determination of a project falling under Top Line or Bottom Line Growth is aligned with the NIST MEP substance codes.  Centers determine which projects fit where in the mix. 

1. • –Progress Narrative, overall program progress, not just a list of services 

   • –Data in table is calculated based on what was submitted in your Projects. 

   • –Percentage of all projects submitted in the quarter/time period 

Top Line Growth	Bottom Line Growth
25 – Growth Service Product Suite	23 – Lean Product Suite
27 – Strategic Management Suite	24 – Quality Product Suite
28 – Technology Services Suite	26 – Sustainability Suite
29 – Financial Analysis Suite	31 – Engineering Srvs/Plant Layout Suite
30 – Sales/Bus Dev Suite	32 – Information Technology Suite
	33 – Workforce Development

Engagement goals are based on the Substance Code assigned to the project by the Center.  The NIST MEP Substance Codes are assigned to either contribute to Top Line or Bottom Line Growth.  

In addition to the percent of total projects completed per Year/Quarter that are Top Line or Bottom Line can be viewed in the Center Progress Plan.

Centers can run the Client/Project report, scroll to the far right, to see the counts of clients/projects that meet each of this definition

<number>

<number>

 

MEP Partnership Model – Three interrelated components as far as Reporting.

• •Operating Outcome Statements 

• • –Proposal/Statement of Work (SOW) 

  • –Narratives (3000 character limit - not a dissertation!) 

  • –Goals ( Client and Engagement) 

• •Progress Plan (aka Technical Report) 

  • –Narrative response to Operating Outcome Statement (3000 character limit) 

  • –SF425 

  • –Other Resources 

• •Budget Actuals 

  • –Revenue and expenses based on an as of date 

  • –Reporting Set (construct in MEIS to allow NIST MEP to evaluate center performance based on the likely 10 year period between competitions 3-2, 3-2) 

There are three interrelated Reporting Components within the MEP Partnership Model, the Operating Outcomes Statement, Progress Plan and Budget Actuals.

Operating Outcome Statements provide the Center’s plan related to several operational areas over the first three years of the cooperative agreement, prior to the first panel review or the last two years of the cooperative agreement.  Operating outcomes should be submitted anytime there is a change in narratives or the Client and Engagement goals need to be adjusted.  Typically changes are identified during the Annual Review process.

Progress plans are to be submitted bi-annually and will include any changes to the budget as part of the required upload of the SF426 Financial Form.

While the SF425 details the award cumulative budget, the Budget Actuals detail the revenues and expenses for the Period of Performance.

<number>

<number>

 

Operating Outcome Statements

Purpose:

• •Creation of mutually agreed upon strategy and goals between NIST MEP (RM) and the Center 

• •Streamline documentation for CAR Response to Federal Funding Opportunity (FFO), renewals, annual reviews, panel reviews, best practices, performance measurement. 

Workflow:

1. • –Initially your Federal Program Officer enters the information at the time your award is finalized into MEIS 

   • –Center either on their own or due to a conversation with your RM determines that an update to the existing Operating Outcomes is needed. 

   • –Upon submittal RM and FPO are notified that a modification has occurred. 

   • –RM reviews the changes 

1. • • •CLEAN – deletes the submission due to unnecessary submission 

     • •RESET– RM sends the Operating Outcome back to Center for changes.  Notification includes reason for RESET. 

     • •FINISH –RM approves the changes.  A notification goes out to the Center, RM, FPO and sometimes Grants  

The Operating Outcome Statements describe the Center strategy and goals mutually agreed upon by the Center and the NIST MEP Regional Manager.  The categories found within the Operating Outcome Statements are consistent with other documentation that a Center will need to provide throughout the life of the award including Federal Financial Opportunity, renewal documentation, Annual Reviews, Panel Review, Best Practices and Performance Measurement.

Centers MUST prepare an approved Operating Outcome Statement within 90 days of award approval.  Initially the Operating Outcome Statements are entered by your Federal Program Officer into MEIS.  Centers either on their own or due to a conversation with your Regional Manager determine that the Operating Outcome Statements need to be updated.  

The Center updates the narratives and/or Client Engagement Goals within MEIS.  Centers will be required to enter an explanation as to what pieces of the Operating Outcome Statement were changed.  When finished, the Regional Manager and Federal Program Officer are notified that a change has been submitted.  It is the responsibility of the Regional Manager to approve the changes.  Once approved, MEIS will send a notification to the Center that their updates have been approved.

If the changes are not accepted, the Regional Manager may choose to CLEAN the submission which deletes any record that updates were made or the Regional Manager can RESET the submission effectively sending it back to the Center for additional editing.  Regardless in any action taken, Centers will be notified of the status of their submission.

<number>

<number>

 

Operating Outcomes are to be updated as needed. - most likely prior to an annual/panel review.

How to report:

• •Click CIP Operating Outcomes, Submit Updates, edit the information, click Actions Submit  

• • –Update the Proposal/SOW (previous versions are maintained) 

  • –Update the Narrative – only enter information for the sections you wish to change.  If you enter “No Changes” then the words “No Changes” are going to overwrite what is currently stored in MEIS 

  • –Modify the Client or Engagement Goals – adjust the estimated goals as needed and circumstances change 

  • –Reviewed by your Regional Manager and will either be accepted or reset (sent back for additional clarification).  Once approved a notification is made to the FPO and Grants acknowledging that the RM has accepted the changes. 

To update your Operating Outcome Statements, click CIP, Operating Outcomes, Submit Updates, edit the information (either the narratives or the goal estimates), provide an explanation of changes, Click Actions, Submit to notify your Regional Manager and Federal Program Officer that changes to the current Operating Outcome Statements have been made.

Centers CANNOT update the Proposal/Statement of Work (SOW) using this mechanism.  The Proposal/SOW is an official document and must go through an approval process that includes both NIST MEP and Grants.  If changes are required to this document, Centers MUST submit these changes through email to your Federal Program Officer.

To make it easier to update the Narratives, the current version for each category is displayed.  Centers and insert, delete and modify content as needed.  Do not enter “No Changes” as that will replace the existing content with the words “No Changes”.  If there are NO CHANGES needed, simply leave the existing content as is.

To adjust the estimated Client and Engagement Goals edit one or more of the categories in the table.  Make sure you are editing the applicable time period within the Repoting Set so that your changes are reflected as desired.

An email is sent to the Regional Manager and Federal Program Officer when Centers update these statements.  The changes will be Reviewed by your Regional Manager and will either be accepted (aka FINISHED) or sent back to the center for additional work (RESET_  

<number>

<number>

 

Operating Outcomes (Continued)

Related Reports:

1. • –To be determined – are they necessary? What would be useful? 

Gotchas:

1. • –Newish process and neither NIST MEP or Centers have it formalized yet. 

Did you know…

1. • –Visible within your Progress Plan 

   • –Center is also responsible for information in the Operating Outcomes. Click on this element, read it, make sure the information entered is accurate..  If not you, make sure your Center Director and/or others on your management team know about this section. 

   • –Operating Outcomes mirror the narratives that you will respond to in your semi-annual Progress Plan. 

   • –Operating Outcomes will be used in your Annual/Panel reviews. 

At this time MEIS does not provide a standard Operating Outcome Statements report.  Would this be helpful?  Lease let us know what you think.  We do output in the Clients/Projects Report, the status of each project as relates to the Client and Engagement Goals.  Run the report and scroll all the way to the right to see if a particular client/project submitted met one or more of these goals.

This is a fairly new process and NIST MEP and Centers are still working out the kinks. Centers are experiencing some confusion as the concept that Operating Outcome Statements  is NOT a quarterly reporting requirement has not been adequately communicated.  There is absolutely no need to submit an update to the Operating Outcome Statements each quarter.  This starts an unnecessary workflow when you do.

Did you Know….

That your current Operating Outcome Statements are visible within your Progress Plan  for reference as you complete the Progress Plan/Technical Report submission.  Click the link Show/Hide Operating Outcomes Statement above each category to see the current narratives on file.

Did you know that as a Center you are responsible for the accuracy of the Operating Outcome Statements.  Click on this element, read the content, review the Client and Engagement Goals, make sure the information entered is accurate..  If ti is not what was expected, make sure your Center Director is aware and initiates a conversation with your Regional Manager to update.

Did you know that the categories in the Operating Outcome Statements mirror the categories Centers are required to respond to in their semi-annual Progress Plan submissions?

And finally, did you know these same categories will also be used in your Annual and Panel Reviews.

This is the goal of the MEP Partnership Model, alignment across proposal, reporting, review, and renewals with the MEP Strategy.

<number>

<number>

 

Operating Outcome Statements (Continued)

Here is a screenshot of the Operating Outcome Statements update page.  Please note that Centers can click on Proposal/SOW documents  but cannot upload them.

<number>

<number>

 

Operating Outcomes (Continued)

This screenshot shows the table for the Client Goals that can be edited as needed.

<number>

<number>

 

Reporting Elements – Progress Plan/Technical Report (Semi-annually)

Purpose:

1. • –Technical Report – cooperative agreement requirement including the SF425 

   • –Narrative for NIST MEP staff outside of your RM/FPO to be familiar with your Center activities 

   • –Feeds Annual/Panel Reviews 

Workflow:

• •Once submitted, an email is sent to your  FPO, RM and Grants Specialist to notify them that the report is ready for review. 

• •FPO and/or RM has initial review and will either: 

  • –FINISH – accept submission, no longer editable by the center (email is sent to Center, FPO, RM and Grants) 

  • –RESET – Center is able to edit again to make revisions, an email is sent to all parties indicating the submission has been RESET, process begins again 

  • –CLEAN – Submission is deleted, an email is sent to all parties 

The Progress Plan/Technical Report is specifically called out in your cooperative agreement as a required submission that MUST be received by your Grants Specialist in the NIST Grants Office no later than 30 days after the end of the time period covered.  The specifics of this are detailed in your Special Award Conditions (SACs).  This report is a formal mechanism for communicating Center activities to NIST MEP Management and your Regional Team (Regional Manager, Federal Program Officer, Grants Specialist).

Once submitted an email is sent to your Federal Program Officer, Regional Manager and Grants Specialist notifying them that the report is ready for review.  Your Federal Program Officer and/or Regional Manager will review the document for compliance and will either:

• •Approve (FINISH) the submission making the report no longer editable by the Center and an email will be sent to the Center Director, Center Reporting Contact, Federal Program Officer, Regional Manager and Grants Specialist indicating the report is final. 

• •RESET the submission if it is incomplete or incorrect which then opens the report up for editing by the Center again.  Once the report has been remedied the Center will SUBMIT again starting the workflow over. 

• •CLEAM – the submission is deleted as it was unnecessary and an email is sent to all parties with an explanation.  

<number>

<number>

 

Reporting Elements – Progress Plan/Technical Report (Semi-annually)

How to Report:

• •Click CIP, Progress Plan, Submit Quarterly Reports, enter information (oh if only it were that easy), Click Actions Submit for Reporting 

• • –Enter your narrative response for each major section.  If there is nothing new to report for the period, let your RM and FPO know that you did not just skip the section.  (3000 characters) 

  • –Attach your SF 425 

  • –Make sure you check all of the acknowledgements (official of CAR, change budget with Grants, change OO with NIST MEP), otherwise MEIS will not allow you to submit. 

  • –If there is additional information to be included, attach document(s) in Related Documents.  

• •Most complex and time consuming reporting element.  

To report, the Center clicks on CIP, Progress Plan, click Submit Quarterly Reports, enter the information and Click Actions Submit for Reporting.

This report is one of the more time consuming which is why the requirement was changed from quarterly to semi-annually.  If applicable respond to every major section, Centers have 3,000 characters available to detail work done.  If there is nothing new to report for the period, let your Regional Manager and Federal Program Officer know that you did not unintentionally skip a section..  Make sure you check all of the acknowledgements )official of the Center, in the process of changing the budget with Grants if necessary, in the process of changing the Operating Outcome Statement) and attach the SF 425 or MEIS will not allow you to submit.  If there is additional information to be included Centers can attach documents in the Related Documents area.

<number>

<number>

 

Reporting Elements – Progress Plan/Technical Report (Semi-annually)

Workflow (Continued) :

1. • –Grants has a secondary review which may/may not be going on simultaneously Typically look at SF425 and will RESET if the form submitted is not correct/reasonable 

   • –When Finished, the entire package including PDFs of the narrative, SF425 and supplemental documents are sent to Grants, RM, FPO and Center. 

Related Reports:

1. • –Progress Plan – from the Progress Plan List – Click Actions, Print 

   • –MEIS Dashboard – CAR Documents Widget – link to most recent report 

Gotchas:       

1. • –Budgets total after Budget Actuals are entered by the Center 

At the same time that your Federal Program Officer and Regional Manager are reviewing your Progress Plan submission, so is the Grants Specialist.  The Grants Specialist is primarily looking at he SF425 financial form for compliance with regulations.  While the Grants Specialist will not RESET your submission and return it to you directly, they will contact your Federal Program Officer and ask them to RESET so that you can fix and resubmit. Because of timing this could happen after you are already received an acceptance email.

When all approvals have been received, the entire package including PDFs of the narratives, SF425, and supplemental documents are sent to Grants, Federal Program Officer, Regional Manager and the Center for filing purposes.

A printable version of the Progress Plan can be generated from the Progress Plan list page.  Click Actions, Print and export to PDF.

Until the Budget Actuals are entered by the Center, this information in the View Budget link from the Progress Plan will not appear in the report.

<number>

<number>

 

Reporting Elements – Progress Plan/Technical Report (Semi-annually)

Did you know:

1. • –You can read your Proposal/Statement of Work from within your Progress Plan. 

   • –Click to view/hide Operating Outcome Statements 

   • –Click to view/hide Previous Progress Plan narratives 

   • –Click to see your Budget Table 

   • –Click to view/hide Client and Engagement Goals 

   • –Click on the Year/Qtr links to see clients identified by name that meet each goal 

   • –You can attach additional documents to provide more information to NIST MEP about the project (Schedules, Gantt Charts, Graphs, Images, Narratives) 

Did you know that the Progress Plan has lots and lots of clickable links that display all kinds of useful information including:

• •Proposal/Statement of Work (SOW) history and clickable/downloadable links 

• •Click the View/Hide Operating Outcome Statement for each category 

• •Click the View/Hide Previous Progress Plan narratives 

• •The View Budget link to display the Actual and Estimated budgets across all known awards and includes variance and total calculations. 

• •Click the View/Hide link to display Client and Engagement Goals, when you click this link a table appears, click the Year/Quarter link to see which Clients and Projects are included in the counts for each. 

And if you have additional information you want to convey to NIST MEP that require supporting documentation, upload a variety of electronic file formats in the Related Document section.

<number>

<number>

 

Progress Plan – Semi-annual response to Operating Outcomes

This is a screenshot showing where to click to Show/Hide Operating Outcome Statement as well as a sample narrative response to the Car Client Activity Levels by type of Company.

<number>

<number>

 

Progress Plan – Semi-annual response to Operating Outcomes (Continued)

This screenshot shows where to click to View/Hide the Client Goals, drill down to Year/Quarter and then the details.  The number at the bottom is a unique count across the time period (3 or 2 years).

<number>

<number>

 

Progress Plan – Semi-annual response to Operating Outcomes (Continued)

Click the Budget Tab  to voew  Actual Budget by Period of Performance (POP) and use the checkboxes to display Estimated Budgets and Variance for one or more awards.

<number>

<number>

 

Budget Actuals

Purpose:

• •Communication of detailed Revenue and Expenses during the reported time period. 

Workflow:

1. • –Centers enter Budget Actuals as frequently as needed for activities happening such as a Panel Review where current financials are important to be stated 

   • –Notifications are sent to Centers, Federal Program Officer and Regional Manager.  Please note Mailbox icon at top right of MEIS dashboard, if notifications are pending there will be a count shown in red if: 

1. • • •Budget Actuals are >180 days old 

     • •Budget Actuals have been recently changed 

     • •Budget Actual As of Date does not equal end date of the Period of Performance and it is greater than 30 days after the end of the Period of Performance 

     • •Budget Actuals As of Date does not equal end date of the Award and is greater than 90 days after the end of the Award 

The Budget Actuals entity is used to communicate detailed current Revenue and Expenses during the reported time period.

Centers enter Budget Actuals as frequently as needed for activities happening such as a Panel Review where current financials are imported to be stated and analyzed.

Due to the importance of having access to recent Budget Actual information, various notification are visible when updates are needed or changes have recently occurred.

Please note the Envelope icon at the top right of the MEIS dashboard, if notifications are pending, there will be a count shown in red. If:

Budget Actuals are >180 days old

Budget Actuals have been recently changed

Budget Actual As of Date does not equal end date of the Period of Performance and it is greater than 30 days after the end of the Period of Performance

Budget Actuals As of Date does not equal end date of the Award and is greater than 90 days after the end of the Award

<number>

<number>

 

Budget Actuals are to be updated when and as often as needed.  Though most likely when submitting a Progress Plan and prior to an annual/panel review.

How to report:

• •Click CIP Budget Actuals, click on appropriate Reporting Set, enter the information for As of Date, Revenues and Expenses, automatically saved on entry  

Related Reports:

1. • –To be determined – are they necessary? What would be useful? 

Gotchas:

1. • –Newish process and neither NIST MEP or Centers have it formalized yet. 

Did you know…

1. • –Visible within CIP, Progress Plan 

   • –Visible within CIP, Funding Program, Budget Tab 

   • –. Used within your Center Profile and Performance Report (CPPR) 

Budget Actuals are to be updated when and as often as needed though most like when submitting a Progress Plan due to complimentary nature and prior to an Annual or Panel Review.  

To update your Budget Actuals, click CIP, Budget Actuals, click on appropriate Reporting Set, enter the information for As of Date, Revenues and Expenses.  Changes are automatically saved on entry and clicking or tabbing to next field.

This is a newish process so there is still significant confusion among NIST MEP and Centers as to when and how to enter this information.  As such there are no standard reports developed yet, though there will be some in the near future.

Did you know that Budget Actual information is visible within the Progress Plan and Funding Program elements.

<number>

<number>

 

Budget Actuals

• •Insert screenshot 

<number>

<number>

<number>

 

Centers can only view data in Funding Programs. It is a great place to look at budget, reporting sets, and quarterly allocations for IMPACT Metrics

Purpose:

1. • –Centers need to be familiar with the information in this module as it is affects your ability to report and how your center’s performance is measured 

1. • • •General Information about the award 

     • •Contacts – who is who at NIST MEP and Grants on your Cooperative Agreement 

     • •Federal Quarterly Allocation – Used in metric calculations. 

     • •Total Cash Quarterly Allocation – Displayed on The CARD. 

     • •Budget – read only view of all budget information 

     • •Reporting Set – construct necessary for reporting and to look at center performance over 10 year period prior to competition 

How to report:

1. • –Not a direct submission by Centers though Budget Table Actuals are updated by Progress Plan submission 

Related Reports:  TBD

Centers can only view data in the Funding Programs entity.  This module has a wealth of information about Center Cooperative Agreement Awards, Periods of Performance, NIST MEP Contacts and Sub-recipient Agreements.

<number>

<number>

 

Funding Programs – General Information – Funding Agreement (Awards)

This is a screenshot of the Funding Agreements (also known as Awards) list showing reporting frequency for the Progress Plan/Technical Report.  Centers can drill down to see award information.

<number>

<number>

 

Funding Programs – General Information – Funding Agreement (Awards)

The Funding Agreement (Awards) record displays the Agreement Number (necessary for Project reporting, the recipient name, start and end date of the multi-year award, Periods of Performances and associated Proposals/Statements of work.  

<number>

<number>

 

Funding Programs – General Information - Period of Performance

From the Funding Program (Awards) list, Centers can drill down into the Periods of Performance (POPs) for each award.  Within each Period of Performance are any Sub-recipients who have a legal and financial responsibility to the Center on the Cooperative Agreement.

The Sub-recipients identified here are included on Center Locations maps within MEIS and the CPPR.

<number>

<number>

 

Funding Programs – Contacts

 

Funding Programs – Federal Quarterly Allocation

 

Funding Programs – Total Cash Quarterly Allocation

 

Funding Programs – Budget

 

Funding Programs – Reporting Set

 

Reporting Elements – Success Story

Purpose:

1. • –Success Stories reflect the variety and depth of impacts that companies realize and are one of the most effective tools to communicate the value of MEP services 

   • –Success Stories are used to share experiences, and to communicate the value of MEP’s services to stakeholders and potential clients, and are often used as part of presentations for the budgeting process to demonstrate the effectiveness of the system and how it operates  

   • –NIST and MEP create promotional materials using Success Stories that best describe the value and quality of their services to potential clients 

   • –Posted on NIST MEP Public Website (last 3 years) 

How to report:

1. • –Click CIP, hover over Success Stories, Submit Quarterly Reports, review Success Stories, click Actions Add to add new Success Story, click Actions Submit for Reporting 

1. • • •At least one Success Story is required every quarter 

     • •Success Stories will be based on projects or events that were completed with small manufacturing establishments 

     • •The project cannot be over 3 years old 

     • •The primary NAICS codes of the SMEs must be between 31 and 33, or one of NIST MEP’s R&D or DOM NAICS 

The purpose of the Success Story reporting element is to reflect the variety and depth of impacts that companies realize and are one of the most effective tools to communicate the value of the MEP services to stakeholders and potential clients.   NIST and MEP use Success Stories in their promotional materials.  

Centers are required to submit at least one Success Story every reporting quarter.  The project cannot be over 3 years old and are posted on the NIST MEP Public Website.

From the MEIS dashboard, click on CIP, hover over Success Stories, Submit Quarterly Reports, review Success Stories, click Actions, Add to add a new Success Story.  Click Actions, Submit for Reporting.

<number>

<number>

 

Reporting Elements – Success Story

Workflow:

1. • –Each time the CAR submits a Success Story a NIST MEP staff person will review the material. A story may be accepted or rejected.  A story is accepted if it meets all of the requirements and if it is well written. A story will be rejected if it is missing required information, or if it is not well written.  At least one quantified impact is required. 

   • –If the story is rejected, the CAR staff person that submitted the story, the Marketing Contact and the CAR Director will be notified by e-mail  and given the reason(s) for rejection. The CAR will then edit the story online from the CAR Information Page and submit it again. If the story is accepted, the CAR staff person assigned the CAR Reporting Role will be notified of the acceptance by e-mail. 

   • –There will be two separate versions of a Success Story. One will be submitted to the CAR Information Page, which will serve as a record that the CAR met its reporting requirements. The second copy will become the working copy that will be edited by NIST MEP for Success Story publication. After a story has been edited, the two copies will not match. CARs will not be allowed to directly edit a story from the CAR Information Page after it has been accepted 

   • –NIST MEP will review and edit the story if necessary. The story will be showcased after acceptance and made available in MEIS (https://meis.nist.gov) and on the MEP Public Site (http://nist.gov/mep) 

Each time as Success Story is submitted for reporting, there is a workflow that needs to be followed.

• -Once a Success Story is submitted, it is reviewed and accepted or rejected by a NIST MEP staff person.  A story will be rejected if it is missing required information, not written well, or does not include at least one required quantified impact. 

• -If a story is rejected the CAR staff person that submitted the story, the Marketing contact and the CAR Director will be notified by email and given the reason for rejection.  The CAR will then edit the story online from the CAR Information Page and resubmit.  If the story is accepted, the CAR staff person assigned with the Reporting Role will be notified of the acceptance by email. 

• -There will be two separate versions of the Success Story.  Once will be submitted to the CAR Information Page, which will serve as a record that the CAR met it’s reporting requirements.  The second copy will become the working copy that will be edited by NIST MEP for Success Story publication.  After a story has been edited, the two copies will not match.  CARs will not be allowed to directly edit a story from the CAR Information Page after it has been accepted. 

• -Success Stories will be showcased after acceptance ad made available in MEIS and on the MEP Public Site. 

<number>

<number>

 

Reporting Elements – Success Story

Related Reports: Either data used or clickable from page

1. • –Clients/Projects/Impacts 

   • –Success Story Details 

   • –One Pager (MEIS Dashboard or Documents/Communications) 

   • –MEP Public Site 

   • –Success Story – Marketing  

   • –Success Story - Original 

Did you know:

1. • –The project must be accepted by NIST MEP and in MEIS as “finished” before it is available to be written about in a Success Story. 

   • –Before submitting a Success Story for public use, the CAR must obtain the client’s written approval to release the information contained in the story 

   • –NIST MEP encourages CARs to create the narrative portions of the Success Story report using a word processing program and then cut and paste the information into the online form. You would not want to compose long narratives on the web and then have a network problem cause you to lose the information.   

   • –All formatting is stripped when submitted so no need to make it “pretty”. 

   • –If corrections are needed after the Success Story has been submitted to NIST MEP, contact the NIST MEP Success Story Administrator 

Useful reports related to Success Stories are listed on this slide.

Did you know…

• -The project must be accepted by NIST MEP and in MEIS as “finished” before it is available to be written about in a Success Story? 

• -Before submitting a Success Story for public use, the CAR must obtain the client’s written approval to release the information contained in the story? 

• -NIST MEP encourages CARs to create the narrative portions of the Success Story report using a word processing program and then cut and paste the information into the online form?  This is to prevent Centers from composing long narratives on the web and then have a network problem cause you to lose the information. 

• -All formatting is stripped when submitted so no need to make it “pretty”? 

• -If corrections are needed after the Success Story has been submitted to NIST MEP, you must contact the NIST MEP Success Story Administrator? 

<number>

<number>

 

State Fact Sheet aka One Pager

• •State One Pager includes description, recent impacts, recent Success Story 

• •To access  

• • –MEIS Dashboard – CAR Documents click on Fact Sheet (most current version) 

  • –CAR Information – Click on CIP, click on Information, click on One Pager tab, click view most current version. 

  • –Click CIP, Click Documents/Communications, filter the Document Type to “Fact Sheet (Public Site Document)”.  While more complicated way to get to One Pagers, this is where you can find historical documents. 

• •This document is often times used with stakeholders and potential clients who would like a brief overview of how impactful your center is on the State 

The State Fact Sheet (One-Pager) includes a Center description, recent impacts and the most recent Success Story.

There are several ways to access the One-Pager:

• -From the MEIS dashboard - CAR Documents, click on Fact Sheet (most current version) 

• -From CAR Information – Click on CIP, click on Information, click on One-Pager tab (most current version) 

• -Click CIP, Documents/Communications, filter the Document Type to “Fact Sheet (Public Site Document)”.  While this is a more complicated way to get to One-Pagers, this is where you can find historical documents (see next slide for screenshot). 

<number>

<number>

 

Accessing State Fact Sheet (The Hard Way)

Accessing the State Fact Sheet the hard way, will allow you to view historical documents.

Click CIP, Documents/Communications, filter the Document Type to “Fact Sheet (Public Site Document)”.  

<number>

<number>

 

State Fact Sheet Example

Example of State Fact Sheet (one-pager) with Success Story.

<number>

<number>

 

Non reporting element- Documents & Communications

• •The Documents & Communications section of MEIS is a repository of information directly relating to your center 

• •Documents found in this section include: 

• • –The CARD 

  • –D&B Company File 

  • –Operating Plan 

  • –State Fact Sheets 

  • –Review documents  

The Documents and Communication (non-reporting element) is a repository of information directly related to your center.

Documents found in this section include:

• -The IMPACT metric 

• -D&B Company File 

• -Operating Plan 

• -State Fact Sheets 

• -Review Documents 

From the MEIS dashboard, click CIP, Documents/Communications.  Click column filter icon to filter by document type.

<number>

<number>

 

Survey Confirmation

<number>

<number>

 

Survey Confirmation Schedule

	Quarter 1	Quarter 2	Quarter 3	Quarter 4
Period	January 1 – March 31	April 1 - June 30	July 1 – September 30	October 1 – December 31
Start Date	March 1	June 1	September 1	December 1
End Date	March 31	June 30	September 30	December 31

The schedule for the Survey Confirmation process is shown in this slide.

<number>

<number>

 

Take Advantage of the Many MEIS Reports
Survey Confirmation – 2 Reports

There are 2 survey confirmation reports available to assist you.

• -Survey Confirmation (All Clients & Projects) – Lists clients and projects that went to survey in any given period of time, based on your selection criteria. 

• -Survey Confirmation (Clients per Tab) – lists clients and projects for any given period of time, based on your selection criteria, on separate tab, if exported to Excel.   

<number>

<number>

 

Survey Confirmation

• •Clients and Project data is submitted well before the survey occurs. 

• •CARs are given one month immediately prior to the survey to review client contact information and make changes. 

• •Opportunity to update information needed to conduct the survey and ensure that the materials sent to the client appear as professional as possible. 

• •Most CARS involve their field staff in the review process since it is the field staff that are most aware of changes. 

• •All client records with valid manufacturing MEP DOM NAICS Codes will be sent to survey regardless of whether the CAR has completed the confirmation process. 

Each quarter, NIST MEP will use the client and project information to select clients for survey. The client unique identifier will be used to identify the clients that will be surveyed as well as the associated Projects and Events that will appear on the project list.

After the clients and projects/events are selected, CARs will then be able to confirm and correct the data before the survey begins.  This process is called Survey Confirmation.

One month prior to the survey occurring, CARS will review and confirm the information that will be shared with their clients and used in conducting the survey.  This is an opportunity for CARs to edit the following fields:

• • -Client information such as: name, address, and phone number. 

  • -Client primary and secondary contact information such as: salutation, first name, last name, position, phone, and email. 

CARs should take advantage of the data confirmation process to ensure every piece of information that will be seen by the client presents a professional image.

In many cases, CARs may want to involve field staff in reviewing the information and appropriate arrangements should be made to ensure that field staff understand the process and are able to complete it in the time allotted.

All Client records with a valid manufacturing MEP DOM NAICS code ill be sent to survey regardless of whether the CAR has completed the confirmation process.

<number>

<number>

 

Survey Confirmation Suggestions

• •Use this one-month period as a time to reconnect with clients. Go over project(s) up for survey to discuss expected impacts and investigate current needs and look for new opportunities with the customer.  

• •Use this period to initiate a D&B Investigation for any clients that do not have an acceptable NAICS Code. They are marked with a red exclamation point ! 

• •Let clients know that you are trying to minimize the burden on them. Provide clients with third-party survey vendor name, survey schedule, and describe the process in detail to set expectations. 

• •Emphasize taking the web-based survey and that it should not take more than 15 minutes of their time if the field agent has already had a project close-out/feedback session where it was determined the success of the project. 

Suggestions for Survey Confirmation:

• -Use this one-month period as a time to reconnect with Clients.  Review projects up for survey to discuss expected impacts and investigate current needs and possible new opportunities with the customer. 

• -Use this period to initiate a D&B investigation for any clients that do not have an acceptable NAICS code.  They are marked with a red exclamation point. 

• -Let clients know that you are trying to minimize the burden on them.  Provide clients with third-party survey vendor name, survey schedule, and describe the process in detail to set expectations. 

• -Emphasize taking the web-based survey and that it should not take more than 15 minutes of their time if the field agent has already had a project close-out/feedback session with them. 

<number>

<number>

 

During Survey Confirmation, centers can update client contact information and manage the number of times a project is surveyed (EIS)

During Survey Confirmation, centers can update client contact information and manage the number of times a project is surveyed by updating Estimated Impact Span (EIS).  Use it to your advantage.

As client/project records are reviewed, the client moves from “Pending Review” to either “Reviewed” or :”EIS set to # times surveyed”.  A client can ONLY be moved to “Excluded” by contacting the NIST MEP Survey
Administrator.

It is important to remember that projects trigger surveys, so a client may be surveyed on more than one project.  If you are a client where EIS was set too high, centers MUST make sure that the EIS is set to equal the number of times surveyed for every project identified to be surveyed.

<number>

<number>

 

Outlier Verification

<number>

<number>

 

• •After survey closes, third-party contractor exports data from their system 

• •Data are imported into MEIS. 

• •Center Regional Office Aware 

After the Survey closes, a third party contractor exports data from their system.  Data are then imported into MEIS.

NIST MEP will examine the survey responses to identify survey results requiring verification, also known as outliers.

All survey responses with a total quantified dollar impact amount of $5 million or more, and/or total job impact of 250 or more will require verification.

<number>

<number>

 

Reporting Elements – Outlier Verification

Purpose:

• •Sometimes clients report significant impacts that NIST MEP requires be validated by the Center by communicating with the client to make sure what was reported is accurate. 

• •Outliers are flagged and confirmed by Centers by indicating the method for communication with the client and a short paragraph describing the work and why the large impact was realized as a result. 

• • –>5M Total$ 

  • –>250 Jobs 

How to report:

1. • –Click CIP, hover over Survey, Survey Outliers 

1. • • •Click on the View edit icon for the appropriate impact verification record. 

     • •Click the radio button to indicate the Verification Type 

     • •Click the radio button to indicate the Verification Status 

     • •Make any changes necessary to the quantified amounts. 

     • •Enter the narrative justification (minimum 500 characters) 

   • –Click Save Outlier 

<number>

Sometimes clients report significant impacts that NIST MEP requires be validated by the Center by communicating with the client to make sure what was reported is accurate.

Outliers (>$5M Total, >250 Jobs) are flagged and confirmed by Centers by indicating the method for communication with the client and a short paragraph describing the work and why the large impact was realized as a result.

$

<number>

<number>

 

Reporting Elements – Outlier Verification

Workflow:

1. • –Centers are notified via email when Outliers need to be verified including a date when verifications MUST be entered into MEIS> 

   • –Centers edit the Outlier records in MEIS.  When complete, the record is saved and an email is generated and sent to the NIST MEP Survey Administrator, Center Survey Contact, Center Director and NIST MEP Manager for Program Evaluation. 

   • –The NIST MEP Survey Administrator  reviews the information provided and adjusts the impacts if necessary. 

   • –Once all Outliers have been reviewed and adjusted, the IMPACT Metrics reports are run and distributed to Centers. 

Each time an Outlier Verification is identified  for review, there is a workflow that needs to be followed.

Centers are notified via email when Outliers need to be verified including a date when verifications MUST be entered into MEIS>

Centers edit the Outlier records in MEIS.  When complete, the record is saved and an email is generated and sent to the NIST MEP Survey Administrator, Center Survey Contact, Center Director and NIST MEP  Manager for Program Evaluation.

The NIST MEP Survey Administrator  reviews the information provided and adjusts the impacts if necessary.

Once all Outliers have been reviewed and adjusted, the IMPACT Metrics reports are run and distributed to Centers.

<number>

<number>

 

Outlier Verification

<number>

This screen shot indicates the Outliers to be verified.

<number>

<number>

 

Outlier Verification

<number>

This screenshot shows the two radio buttons that have to be clicked on to display the Verification Type and Status.   Impacts that are incorrectly reported can ONLY be changed downward.  Impacts cannot be increased.

<number>

<number>

 

Outlier Verification

<number>

This screenshot shows the inclusion of a narrative justifying the large impacts.  This has been recently changed to require 500 characters at a minimum.

<number>

<number>

 

Post-Survey Data Analysis - Knowledge Sharing

<number>

<number>

 

Post-Survey Data Analysis - Knowledge Sharing

• •After all survey outliers have been verified, the data are ready to be analyzed 

• •Centers’ survey results are made available 

• •Analysis 

Once required outlier verifications are complete, CAR’s survey results data files will be available for download from their CAR Browser.  

In addition to making the raw data files available to CARs, NIST MEP will load the data files into a database for permanent storage. Output reports derived from this database will be available to CARs under the security of their CAR Browser on the MEIS Web Site.

<number>

<number>

 

Post-Survey Data Analysis Suggestions

• •Take advantage of the survey results reports in MEIS. 

• •Review the data you receive from the survey. 

• •Analyze the impacts, your response rate, Net Promoter Score™, clients comments, answers to challenges question, etc. 

• •The more you can learn from your clients the more efficiently you can respond to their needs. 

Post-Survey suggestions:

• -Take advantage of the Survey Results (Quarter) report by clicking Reports>CAR Reports in MEIS. 

• -Review the data received from the survey. 

• -Analyze the impacts, your response rate, Net Promoter Score™, clients comments and answers to challenge questions. 

The more you can learn from your clients, the more efficiently you can respond to their needs.

<number>

<number>

 

Panel Reviews

<number>

 

Purpose of the Performance Panel Reviews

The intent of the Performance Panel Reviews:

1. • –Satisfy Statutory Requirement (American Innovation & Competitiveness Act); 

   • –Assess their overall performance as it relates to market penetration, economic impact, and financially sustainability to improve the productivity and performance of the U.S. manufacturing; 

   • –Focusing on trends and patterns to diagnose the causes for strong and weak performances; 

   • –Include evaluation of a Center’s own Performance Management System effectiveness and use, including self-assessment; 

   • –Provide feedback on Center strengths and opportunities for performance improvement, including deficiency areas, if any, as defined in the Performance Policy; 

   • –Promotes the sharing of information across the National Network; and 

   • –Identify common Center performance gaps so the program can leverage internal and/or external resources to assist the National Network in improving performance. 

<number>

NIST MEP is required to measure the performance of the Center against the following which are identified in detail in the AICA language.

8 Objectives:

‘(c) OBJECTIVE.—The objective of the Program shall be to enhance competitiveness, productivity, and technological performance in United States manufacturing through—

        1) the transfer of manufacturing technology and techniques developed at the Institute to Centers and, through them, to manufacturing companies throughout the United States;

        2) the participation of individuals from industry, institutions of higher education, State governments, other Federal agencies, and, when appropriate, the Institute in cooperative technology transfer activities;

        3) efforts to make new manufacturing technology and processes usable by United States-based small and medium-sized companies;

        4) the active dissemination of scientific, engineering, technical, and management information about manufacturing to industrial firms, including small and medium-sized manufacturing companies;

        5) the utilization, when appropriate, of the expertise and capability that exists in Federal agencies, other than the Institute, and federally-sponsored laboratories;

        6) the provision to community colleges and area career and technical education schools of information about the job skills needed in manufacturing companies, including small and medium-sized manufacturing         businesses in the regions they serve;

        7) the promotion and expansion of certification systems offered through industry, associations, and local colleges when appropriate, including efforts such as facilitating training, supporting new or existing         apprenticeships, and providing access to information and experts, to address workforce needs and skills gaps in order to assist small- and medium sized manufacturing businesses; and

        8) the growth in employment and wages at United States-based small and medium-sized companies.

<number>

<number>

 

Center Performance Panel Review Inputs

<number>

There are several key inputs to the Panel Review:

• •CPPR/Strategic Plan 

• •PY Annual/Panel Review Reports 

• •Centers Response to Pre-Panel Questions 

• •Centers Performance Management System Overview (Presentation) 

The structure of the CPPR is intended to provide:

• •a consistent review structure across the National Network; 

• •an opportunity to assess a Center’s overall performance across three elements: 1.) market penetration 2.) effective and efficient use of Center capacity and financial resources, and. 3.) trends on Center generated economic impact and financial viability; 

• •trends and appropriate comparisons between the National Network, State and the Center’s performance to support diagnosis of potential causes for high or low performance; and 

• •brief, factual background information such as a brief history of the Center, location, governance, size, services, market, financial structure and partnerships. 

Data charts distributed throughout CPPR are intended to show potential indicators for the results seen in the 10 metrics on the IMPACT.

Note: Information pre-populated in the CPPR has been leveraged from MEIS.  Focus is to ask for information we do not have readily available to extract from MEIS.

Annual Review Reports - The Annual Review focus on the Center’s strategic alignment to NIST MEP’s overall program objectives, the Center’s activities, progress and performance in implementing the NIST MEP award, lessons learned, monitoring of subrecipients, resource expenditures, activities planned for the next year, and any proposed changes to the project plan or budget.

Centers Response to Pre-Panel Questions – Through the pre-panel discussion a series of questions or clarifying points will be identified by the panel.  The center will be asked to provide a written response.  The additional information gathered through  this Q&A will provide additional context for the Centers performance and profile to assist the panel in completing their evaluation of the Centers performance.  

Pre-Panel conference will take place approximately two weeks ahead of review.

Provides another layer of center structural and performance information to allow panel to effectively evaluate the Center’s performance.

Centers Performance & Evaluation Management System Overview (Presentation during panel review)

In preparation for the Performance Panel Review, the Center will be asked to present on the following areas:

Center Strategy (2 Slides)

Performance Management System (Maximum 5 Slides)

Describe your Performance Management System

What do you collect/measure/monitor?  Why?

How does your Center analyze/use the data to evaluate your Center’s performance?

Based on the information above, what is your assessment of your Center’s performance to date?

<number>

<number>

 

Center Performance & Profile Report

109

 

Center Performance Panel Review – Output

110

Following each evaluation, a Center Performance Summary Report will be provided to the Center, noting the panel’s independent observations, deficiencies (if any), and recommendations for improvement and commendations on the Center’s performance.  Centers will have 30 days to provide comments in response to the report.  Following receipt and consideration of the comments from the Center, MEP will notify the Center in writing of the final recommendations stemming from the panel evaluation.

 

If a Center receives a positive performance evaluation from the Panel or Secretarial Evaluations, the Secretary may continue to provide financial assistance in accordance with 15 U.S.C. 278k(g)(4).  

If a Center receives other than a positive performance evaluation, the Center shall be placed on probation and NIST will follow the provisions set forth in 15 U.S.C. 278k(g)(5).  This includes but is not limited to development and implementation of a success plan and quarterly reviews of progress against the plan.  A reevaluation of the Center shall take place no later than 12 months after the Center has been notified that it is on probation.  In the event a Center is unable to remedy any deficiencies or demonstrate significant improvement in performance before the end of the probation period, a competition for a new operator for that Center shall be initiated.

Additionally, the Panel may identify distinctive practices that may be beneficial to share with the MEP network.  Any common weaknesses identified across multiple panel reviews will be leveraged as input to NIST MEP to identify internal and/or external resources to assist the networks overall performance.

If a Center receives an evaluation that is other than positive, the evaluation panel or Secretary, as applicable, shall— (i) notify the Center of the reason, including any deficiencies in the performance of the Center identified during the evaluation;

(ii) assist the Center in remedying the deficiencies by providing the Center, not less frequently than once every 3 months, an analysis of the Center, if considered appropriate by the panel or Secretary, as applicable; and

(iii) reevaluate the Center not later than 1 year after the date of the notice under clause (i).

(C) Continued support during period of probation (i) In general The Secretary may continue to provide financial assistance under subsection (e) for a Center during the probation period.

(ii) Post probation After the period of probation, the Secretary shall not provide any financial assistance unless the Center has received a positive evaluation under subparagraph (B)(iii).

(6) Failure to remedy may result in a recompetition

110

110

 

Center Performance Panel Review Process

110

This slide outlines the Center Performance Panel Review Process.

• -Larger circles identify key milestones for the Center undergoing the review. 

• -Smaller circles identify the activities of the panel members and NIST MEP representatives. 

<number>

<number>

 

MEIS – Review Module

<number>

The Panel Review detail page provides several pieces of information as it relates to the Panel Review.  It provides logistical information for key teleconferences, names of key participates in the review, training material for both the Center and Panel Members and lastly it provides access to all key review documentation.

<number>

<number>

 

MEIS – Review Module

<number>

This is a screenshot of the Panel Review milestones.  You will be able to view all key due dates and the 3 key events taking place during the overall process.  This section assists the Center and Panel Members in keeping apprise of key events and deliverables.

You can add events to your calendar by selecting the calendar icon in the “Event” column.  Once you click on the icon, you will receive a pop-up at the bottom of your screen prompting you to open and save.  Select open and then save to your calendar.  All logistics will be included in the calendar event.

<number>

<number>

 

Thank You

<number>

<number>

 

File Type	application/vnd.openxmlformats-officedocument.presentationml.presentation
File Modified	0000-00-00
File Created	0000-00-00

---

© 2024 OMB.report | Privacy Policy

---