PMM User Guide Subscriber and Performance Data Upload-R2.2

Connect America Fund - Performance Testing Measures

PMM User Guide Subscriber and Performance Data Upload-R2.2

OMB: 3060-1265

Document [pdf]

Download: pdf | pdf

Performance Measures Module:
User Guide
Covers Subscriber Upload, Performance Data Upload and Compliance Report

Universal Service Administrative Company

Performance Measures Module User Guide

TABLE OF CONTENTS
Contents
Covers Subscriber Upload, Performance Data Upload and Compliance Report ................................................................................. 1
General Information and System Requirements ............................................................................................................................... 5
Portal Home Page ............................................................................................................................................................................ 6
Downloading & Re-uploading Data ...................................................................................................................................................................................................... 6
Speed Tier Tables ............................................................................................................................................................................................................................. 9
Assigning Subscriber Identifying Numbers..................................................................................................................................................................................... 10
Steps to Download & Re-upload Data............................................................................................................................................................................................ 10
Files Uploaded ................................................................................................................................................................................................................................ 11
Reviewing Subscriber Detail ........................................................................................................................................................................................................... 12
Submitting Subscribers to the Randomizer.................................................................................................................................................................................... 13
Unsubmitting Subscribers to the Randomizer (Revert Randomizer) ............................................................................................................................................. 13
Randomizer......................................................................................................................................................................................................................................... 14
Steps to Generate Sample:............................................................................................................................................................................................................. 14
Steps to Request Replacement: ..................................................................................................................................................................................................... 15
Timing to Request Replacement: ................................................................................................................................................................................................... 16
Steps to Request Supplement: ....................................................................................................................................................................................................... 17
Steps to submit No Valid Subscriber request with 0 subscribers:.................................................................................................................................................. 17
Steps to submit No Valid Subscriber request with 1 or more subscribers: .................................................................................................................................... 17
Performance Data/Upload Data......................................................................................................................................................................................................... 18

Universal Service Administrative Company

Performance Measures Module User Guide

Review Data........................................................................................................................................................................................................................................ 20
Certify Data......................................................................................................................................................................................................................................... 22
Compliance Report ............................................................................................................................................................................................................................. 25
Compliance Report Calculations ......................................................................................................................................................................................................... 28
Data Specifications ............................................................................................................................................................................................................................. 30
Subscriber Upload .......................................................................................................................................................................................................................... 30
Speed Data Upload Template ........................................................................................................................................................................................................ 33
Latency Data Upload Template ...................................................................................................................................................................................................... 36
Data Error Codes................................................................................................................................................................................................................................. 39
Performance Data Upload Error Codes .......................................................................................................................................................................................... 42
Incomplete Data Issue Codes ......................................................................................................................................................................................................... 50

Universal Service Administrative Company

Performance Measures Module User Guide

FCC NOTICE REQUIRED BY THE PAPERWORK REDUCTION ACT
We have estimated that your response to this collection of information will take, on average, 98 hours annually. Our estimate
includes the time to gather and submit the data for active subscribers, install any necessary software or testing equipment, conduct
testing, and gather and submit the results. If you have any comments on this estimate, or on how we can improve the collection and
reduce the burden it causes you, please write the Federal Communications Commission, Office of Managing Director, AMD-PERM,
Washington, DC 20554, Paperwork Reduction Act Project (3060-1265). We will also accept your PRA comments via the Internet if
you send an e-mail to [email protected].
Please DO NOT SEND ANY ACCESS REQUESTS OR SUBMIT ANY DATA REQUIRED BY THIS COLLECTION TO THIS
ADDRESS. You are not required to respond to a collection of information sponsored by the Federal government, and the government
may not conduct or sponsor this collection, unless it displays a currently valid OMB control number and/or we fail to provide you with
this notice. This collection has been assigned an OMB control number of 3060-1265.
THIS NOTICE IS REQUIRED BY THE PAPERWORK REDUCTION ACT OF 1995, PUBLIC LAW 104-13, OCTOBER 1, 1995, 44
U.S.C. SECTION 3507.

Universal Service Administrative Company

Performance Measures Module User Guide

General Information and System Requirements
Requirement
Internet Browsers and
Versions Supported

Description
•
•
•
•
•

Internet Explorer version 11
Safari version 10 and above
Edge version 14 and above
Chrome version 51 and above
Firefox version 46 and above

User Access

Carrier GCs and SPOs will be granted access to this system through our e-file system. Additional user
access will be granted by the GC or SPO of the company.

Concurrent Accounts

Each organization will be permitted to have an unlimited number of users. However, after six months of
no usage, an unused user account will be deactivated.

Session Timeout

Sessions will timeout after 30 minutes of inactivity. You will receive a warning modal 5 minutes prior to
the expiration of your session.

Universal Service Administrative Company

Performance Measures Module User Guide

Portal Home Page
The initial landing point for the system is the Upload Subscribers page. The Portal Home Page initially has navigation links to three sections of
the USAC Performance Measures Module (PMM): Upload Subscribers, Subscriber Detail and Randomizer. You may switch between these three
sections by clicking on either of the links in the navigation header.

Downloading & Re-uploading Data
The Upload Subscribers page allows you to generate your HUBB data and upload your
subscriber file. Only carriers who have entered certified broadband location data into
the HUBB portal against speed tier obligations can generate and download a valid
template file. The ‘Speed Tier(s) will be based on the Program Fund’s Final ‘Obligated
Speed Tier authorizations for each Study Area Code (SAC).
Fund
CAF II
ACAM
Alaska
RBE
ACAM II
CAF II
AUCTION
CAF BLS

Speed Tier(s)
10/1 Mbps
4/1 Mbps, 10/1 Mbps, 25/3 Mbps
Based on Authorizations (Varies)
Based on Authorizations (10/1 Mbps or 25/5 Mbps)
4/1 Mbps, 25/3 Mbps
Based on Authorizations (10/1 Mbps, 25/3 Mbps, 100/20 Mbps,
1000/500 Mbps)
25/3 Mbps

Universal Service Administrative Company

Performance Measures Module User Guide

The assigned PMM obligated speed tier may differ from the reported speed tier uploaded into HUBB. The PMM assigned obligated speed tier
utilizes cascading logic for multiple speed tiers within a SAC based on the final obligated speed tier authorizations, at the time of certification
within the HUBB.

Universal Service Administrative Company

Performance Measures Module User Guide

s
8

Universal Service Administrative Company

Performance Measures Module User Guide

Speed Tier Tables
Speed Tier Table for All Funds Except Alaska

Speed Tier ID

Download
Speed

Upload Speed
(Meets or
Exceeds)

1 Mbps

256 kbps

4 Mbps

1 Mbps

10 Mbps

1 Mbps

25 Mbps

3 Mbps

25 Mbps

5 Mbps

50 Mbps

5 Mbps

100 Mbps

20 Mbps

100 Mbps

25 Mbps

1 Gbps

500 Mbps

Speed Tier Table for Alaska
HUBB
Alaska
Speed Tier
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21

download
1 Mbps
4 Mbps
6 Mbps
10 Mbps
10 Mbps
25 Mbps
25 Mbps
50 Mbps
100 Mbps
1 Gbps
4 Mbps
4 Mbps
4 Mbps
6 Mbps
6 Mbps
6 Mbps
10 Mbps
10 Mbps
25 Mbps
25 Mbps
1 Gbps

upload
256 Kbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
3 Mbps
3 Mbps
5 Mbps
5 Mbps
500 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
3 Mbps
3 Mbps
100 Mbps

PMM
Alaska
Speed
Tier
1
2
3
4
4
5
5
6
7
9
2
2
2
3
3
3
4
4
5
5
8

download
1 Mbps
4 Mbps
6 Mbps
10 Mbps
10 Mbps
25 Mbps
25 Mbps
50 Mbps
100 Mbps
1 Gbps
4 Mbps
4 Mbps
4 Mbps
6 Mbps
6 Mbps
6 Mbps
10 Mbps
10 Mbps
25 Mbps
25 Mbps
1 Gbps

upload
256 Kbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
3 Mbps
3 Mbps
5 Mbps
5 Mbps
500 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
1 Mbps
3 Mbps
3 Mbps
100 Mbps

Universal Service Administrative Company

Performance Measures Module User Guide

Assigning Subscriber Identifying Numbers
The HUBB generated file will have all your HUBB data, meeting obligated speed tier requirements, with an additional column, “Subscriber ID”.
Please fill in your subscriber IDs (separated by a semi-colon, if you have more than one subscriber for the listed HUBB Location ID) for all
subscribers associated with each location. This information must be included prior to re-uploading this file into the system. The HUBB Location
ID and Subscriber ID are the only required fields for uploading subscriber data into the PMM system. The remaining fields are provided as a
reference.
HUBB does not contain personally identifiable information (PII). For this reason, when assigning SINs, carriers should not use their subscriber’s
PII, including for example:
1.
2.
3.
4.
5.
6.
7.
8.

Name
Phone number
Social Security Number
Tribal ID Number
Carrier customer ID
Driver’s license number
Medicaid/Medicare/SNAP numbers or other similar numbers
Geolocation coordinates (Latitude/longitude)

Carriers will retain the underlying data matching to the SINs. This data will not be shared with USAC or the FCC except as maybe ordered in
specific circumstances (i.e., audits).

Steps to Download & Re-upload Data
1. Click on the “Generate HUBB data” button. All your Certified HUBB data will be included in one file. Once a file download is complete,
you may retrieve the file from wherever your computer automatically downloads files.
2. Fill out the “Subscriber ID” column in the downloaded .csv file. If you do not have a subscriber at a HUBB location you should delete
that row from your data file. If you leave the ‘Subscriber ID’ field blank you will receive a warning in your data log file for that HUBB
location.
3. Click on the “Upload Subscriber File” button

Universal Service Administrative Company

Performance Measures Module User Guide

Files Uploaded
Further down on the Upload Subscribers page is the “Recently Uploaded Files” table. In this table, you will find all the files that you have
uploaded for validation. Within this table, you
will have the ability to:
1. Review your progress and the summary
of data after the validation of the
uploaded file is completed.
2. Download data errors generated during
the validation of the file after upload.
You can view a list of Error Codes in the
Data Error Codes section of this manual.
3. Delete the uploaded file from the PMM
system. Please note: Delete will remove
all data associated with that file from
the PMM system.
All locations without errors will be automatically
saved in the PMM system. Locations with errors
needs to be downloaded, corrected and reuploaded in the system through the “Upload
Subscriber File” button.

Universal Service Administrative Company

Performance Measures Module User Guide

Reviewing Subscriber Detail
Locations without errors will be automatically
saved and shown in a table on the Subscriber
Detail page.
In this page, you will be able to do the
following:
1. Filter table data by Fund and SAC. The
Filter by Fund feature will default to
“All Funds” and allow you to view
subscriber ID related data for all
Funds. The Filter by SAC feature will
default to “All SACs” and allow you to
view subscriber ID related data for all
SACs.
2. Download data filtered by SAC, using
the filtering feature labeled, “Filtered
by SAC”.
3. Click “# of Subscriber IDs” in order to
ensure the number of subscriber IDs
listed matches the subscriber IDs
uploaded. Upon click, a modal, listing your subscriber IDs will pop up for your review.
4. Submit the locations you have reviewed and are ready to submit to the PMM randomizer tool. Note: Only Certifying Officers will have
the Submit to Randomizer Button enabled.

Universal Service Administrative Company

Performance Measures Module User Guide

Submitting Subscribers to the Randomizer
All subscriber IDs for valid HUBB Location IDs will be randomized by:
1.
2.
3.
4.

Fund
SAC
State
Speed tier

In order to receive your randomized list for performance testing, you must submit these locations to the Randomizer. This is done through
clicking the “Submit to Randomizer” button. Upon submission, the subscribers associated with these HUBB Location IDs will be locked in the
HUBB application. This means, these locations will not be available for editing until after the performance testing on these subscribers is
completed. If you have subscribers in the same SAC that reside across a State boundary then a sample for each State will be generated. Only a
Certifying Officer (SPO Role) of your company is able to engage the ‘Submit to Randomizer’ button. Do not submit subscribers for
randomization until all your subscribers have been uploaded into the system.

Unsubmitting Subscribers to the
Randomizer (Revert Randomizer)
In order to revert your randomized list for
performance testing, you must have previously
submit these locations to the Randomizer. The Revert
Randomizer will not revert samples that have been
created. Once the generate button has been utilized
to create the sample for a SAC, State, Speed tier, it
cannot be undone. Only a Certifying Officer (SPO
Role) of your company is able to engage the ‘Revert
Randomizer’ button. Once selected, the subscriber
details page will populate with reverted subscribers
for review or updating.

Universal Service Administrative Company

Performance Measures Module User Guide

Randomizer
The Randomizer Samples allow you to generate your randomized samples by your Fund, SAC, State, and Speed tier. You will only see the SACs of
the states that are assigned to you. Each Sample will have the required number of subscribers according to the number of subscribers that were
sent to the randomizer, on the Subscriber Details Page.
In this table, you will be able to do the following:
1.
2.
3.
4.
5.

Generate a sample for a particular Fund, SAC, State and Speed Tier.
Download a generated sample for a particular Fund, SAC, State and Speed Tier.
Replace one or more subscribers from a sample.
Supplement one or more subscribers to a sample.
View history of each sample which will include any changes or
updates made to a sample. For example, if a carrier replaces a
subscriber from a sample, the history modal will show the details
of the replacement action.
6. Click the icon for ‘No Valid Subscribers’ when there are no more
subscribers to supplement or replace within a SAC, State and
Speed Tier.

Steps to Generate Sample:
1. Select a State to view all SACs from that State.
2. Click the ‘Generate’ button located in the table to generate the
sample for each row.
3. Download the generated sample from the ‘Actions’ column by
clicking on the download icon, located in each row.

Universal Service Administrative Company

Performance Measures Module User Guide

Steps to Request Replacement:
Click on the ‘Replace’ button in the Replace Subscribers column. Do not select the “+” icon unless you
want to add to overall count of your sample. For example, if you have a sample size of 25 and initiate the
supplement process (“+” icon), then add 25 subscribers, your overall sample count will be 50.
1. Select the reason for the replacement request from the drop-down.
a. Subscriber refuses to allow installation of testing equipment at customer premises
b. Subscriber dropped service (no longer active), includes customers who have been
discontinued due to lack of payment
c. Subscriber demands removal of testing equipment at customer premises, includes
customer’s purposeful destruction of testing equipment
d. Natural Disaster
e. Other (upon submission the subscriber locations in the sample will be frozen until the
request has been approved, expect decision within five business days or sooner)
2. Select the Subscriber IDs that apply to the selected reason.
3. If the selected reason is ‘Other’, provide an explanation in the displayed text box for the replacement request.
4. Navigate to view all of the Subscriber IDs by clicking on the pagination control.
5. Click ‘Replace’ to submit the replacement request and exit the modal.
6. Click ‘Cancel’ to cancel the replacement request and exit the modal.

Universal Service Administrative Company

Performance Measures Module User Guide

Timing to Request Replacement:
Click on the ‘Replace’ button in the Replace Subscribers column. If data is collected for all subscribers from the original randomized sample list
within the quarter, it is highly recommended that carriers submit and certify performance data for the quarter prior to requesting a subscriber
replacement for next quarter’s data collection. However, if a carrier is unable to contact a subscriber for performance data collection, it is
recommended that carriers initiate subscriber replacement for the quarter prior to data submission and certification.

Universal Service Administrative Company

Performance Measures Module User Guide

Steps to Request Supplement:
1. Only commence with this process if you need to increase the sample size for your
SAC and speed tier. For example, if you have a sample size of 10 and you want to
increase your sample size to 20, utilize this procedure
2. Enter the number of additional subscriber locations you would like to request.
3. Check the checkbox to acknowledge the bolded statement.
4. Click ‘Request Additional Subscribers’ button to submit the Supplement Request and
exit the screen.
5. Click ‘Cancel’ to cancel the Supplement Request and exit the screen.
Note: You will be responsible for testing any additional/supplemented subscribers you add
to a sample

Steps to submit No Valid Subscriber request with 0 subscribers:
1. If you are attempting to remove a subscriber and have 0 subscribers, please
contact USAC for assistance at [email protected].

Steps to submit No Valid Subscriber request with 1 or more
subscribers:
1. Click the icon for ‘No Valid Subscribers’ when there are no more subscribers
to
supplement or replace within a SAC, State and Speed Tier.
2. There will be a modal informing you to contact the FCC. You are not required to contact the FCC, the process is automated once the
checkbox is selected and submit action is taken.
3. Check the checkbox.
4. If you initiated the no valid subscriber in error. Click ‘Cancel’ to cancel the No Valid Subscriber request and exit the screen.
5. Otherwise, click ‘Submit’ button to submit the request for No Valid Subscribers and exit the screen.
6. Once the no valid process is initiated, it must be reviewed and approved by USAC. When in this stage you will see a “Pending Review
status

Universal Service Administrative Company
7.
8.
9.
10.

Performance Measures Module User Guide

Once the request is approved by USAC, the status column will indicate “Pending Upload”.
Follow the subscriber upload process and upload additional subscribers. Link process Steps to Download & Re-upload Data.
Upon completion of the subscriber replacement, the status column will update to “Ready”.
The new random sample is available for download.

Performance Data/Upload Data
Performance Data is comprised of three pages you will need to Upload, Review
and Certify your performance testing data. When you select the Performance
Data Tab you will start on the Upload Data page. Step 1 is to download the
Speed Testing Template (SpeedTestingTemplate.csv) and the Latency Testing
Template (LatencyTestingTemplate.csv). The field definitions for these files can
be found in the Data Specifications section. If your tests has failed due to
crosstalk (Test Status 2) or any other reason (Test Status 3), you must submit
the following four fields at a minimum: HUBB LOCATION ID, SUBSCRIBER ID,
START TEST, TEST STATUS.
After you have populated the templates with your performance testing data you
will be ready to upload your files. Please note the maximum file size is 200
MB. You may break your files into multiple smaller files if you exceed the file
size limit. After uploading your file, the summary table will be populated.
In Step 2 you will upload your individual speed and latency files, you must select the appropriate State, Sample (Fund-SAC-State-Speed Tier
format), File Type (Speed Test, Low Latency or High Latency) and Start Date of your seven day data submission period (Use MM/DD/YYYY
format). The low latency option will appear for carriers with samples that should be measured against Low Latency (<=100 ms roundtrip). The
high latency option will appear for carriers with samples that should be measured against High Latency (<=750 ms roundtrip). You must select
the FIRST day of your seven-day test period. Upload and Download speed tests must be taken during the same seven-day period. If data is
collected at multiple times during the quarter, data must be submitted for the seven-day period in which you want performance data assessed
by PMM. The FIRST day of the seven-day test period must be selected.
Latency files do not have to begin testing the same day as Speed tests but are still subject to the same seven consecutive day testing
requirement. The Data Submission requirement for each type of test is summarized below:

Universal Service Administrative Company

Test Type
required)

Download Speed

Upload Speed

Low Latency

High Latency

(* =

Performance Measures Module User Guide

Minimum Data Submission Requirement

•

One successful (Test Status=1) test/hour between the hours of 6:00pm and Midnight local time (18:0023:59) in 24 hour time format

•

Seven Consecutive Days

•

42 successfully completed tests (Test Status=1) per Subscriber in each sample

•

One successful (Test Status=1) test/hour between the hours of 6:00pm and Midnight local time (18:0023:59) in 24 hour time format

•

Seven Consecutive Days

•

42 successfully completed tests (Test Status=1) per Subscriber in each sample

•

One test/minute between the hours of 06:00pm and Midnight local time (18:00-23:59) in 24 hour time
format

•

Seven Consecutive Days

•

2,520 tests (Test Status=1,2 or 3) per Subscriber in each sample

•

One test/minute between the hours of 06:00pm and Midnight local time (18:00-23:59) in 24 hour time
format

•

Seven Consecutive Days

•

2,520 tests (Test Status=1,2 or 3) per Subscriber in each sample

Please note the Data Submission Requirement shown above is for ONE Subscriber in your Sample. In other words, you will need to submit as a
minimum 42 Upload Speed Tests, 42 Download Speed Tests and 2,520 Latency Tests per Subscriber in EACH Sample in order to meet the
minimum Data Submission Requirement.

Universal Service Administrative Company

Performance Measures Module User Guide

After your file has completed uploading, it will appear in the
‘Recently Uploaded Files’ table shown below the ‘Upload
Performance Data’ button.
The Recently Uploaded Files table displays the performance data
templates that you have uploaded into the system. The table
allows you to filter by State and Sample that you have created in
the Randomizer section and for which you have uploaded a file
with Upload Speed, Download Speed, Low Latency or High
Latency test data. This table shows the records (rows of data)
that have been uploaded and saved by the system. The table
also displays any data errors found in your file(s). If you have
data errors in any part of your file(s) you can download a data
error log. In order to repair the file you can either delete the
previously uploaded file or upload a new file that contains the corrected data elements. A key to the error codes in the data errors log file can
be found in the Data Errors section of this user guide.
Once you have successfully uploaded all of your performance data, you are ready to proceed to Step 3, Review Data.

Review Data
Review Data is the third step in the performance data submission process. In this section you can review the Performance Details of your data
and verify that you have met the minimum 7-day data submission requirement at the subscriber level for each of your State, Samples and File
Type. Once you have reviewed the data you are ready for the last step, certification.
There is a filter for selecting the appropriate Testing Quarter for your data submission.
Once the Testing Quarter has been identified, you may further filter on State, Sample (Fund-SAC-State-Speed Tier format) and Test Type
(Download Speed, Low Latency, High Latency and Upload Speed). Once you have made your selection press the Filter button to see the results
displayed in the Data Submission Status Table at the bottom of the page.

Universal Service Administrative Company

Performance Measures Module User Guide

The Data Submission Status table displays the Subscribers in the
particular Sample you have selected.
The Data Submission Status table provides an overview of the
performance tests you have submitted for individual samples. # of
Test(s) Submitted displays the total count of valid performance
tests of the selected Test Type for each Subscriber in the Sample.
# of Incomplete Test(s) displays the total count of invalid
performance tests of the selected Test Type for each Subscriber in
the Sample. Submission Status indicates whether you have met
the minimum Data Submission requirement for the Test Type
selected. The minimum data submission requirement is discussed in the previous section.
The Download All Incomplete Test(s) button lets you download an error log file that contains all the Incomplete Test(s) with an associated error
message. The definition of errors can be found in the Incomplete Data Issue Codes section at the end of this guide.
After submitting your performance data you are ready to go to the last step, Certify and View Performance Results on the Certify Data page.

Universal Service Administrative Company

Performance Measures Module User Guide

Certify Data
Certify/View Performance Results lets you
manage the certification of your performance
testing data across Testing Quarters, States and
Test Types. You will begin by selecting the
Testing Quarter for which you wish to certify by
selecting the Select Testing Quarter filter. The
filter will only show the quarter for which you
have submitted performance testing data.
Please remember you will not be able to update
data once it has been certified.
The Certify Performance Test Data table
displays your performance test data by Testing
Quarter. You can select the appropriate testing
quarter using the filter ‘Select Testing Quarter.’
You should only certify data once the ‘Data
Submission Progress’ for Sample and Test Type
shows as 100%. You may still certify data that
has not met the 100% Data Submission Progress
benchmark, however, this data set will be
considered ‘Incomplete’ as it has not yet met
the minimum testing requirement standards
described in the Upload Data page. In addition,
samples with incomplete data will not be
included in compliance gap calculations.
The Certify Performance Test Data table contains three filters Data Status, State and Test Type. Data Status lets you view data in your samples
that is either Certified, Not Certified and Not Uploaded (data in the sample remains ‘Incomplete’). The State field will only show the State(s) for
which you have successfully uploaded performance data. Test Type, as described earlier, consists of Download Speed, Upload Speed, High
Latency and Low Latency. The fields in the table display information about your individual samples (Fund, SAC, State, Speed Tier). The last four
columns in the table show your progress towards Data Submission for the sample. Sample Size % displays the percent of subscribers with data
submitted in comparison the original sample set value. # of Test(s) Completed displays the number of tests in the sample that have met the data

Universal Service Administrative Company

Performance Measures Module User Guide

submission requirement. # of Test(s) Required displays the number of performance test needed to meet the data submission requirement and
is calculated based on the number of subscribers in your sample. For example, a DL Speed Test with five subscribers in the sample will require
210 DL Speed Tests successfully completed, while a sample with 50 subscribers will require 2,100 DL Speed tests successfully completed (Test
Status = 1). Note, there is one exception to the UL and DL speed test minimum requirement due to ‘cross-talk.’ (Test Status = 2) If you have
further questions about this exception please review the Performance Measures Order or contact High Cost Operations Support
([email protected]). Data Submission Progress shows the percentage of completed tests that meet the data submission requirement for
the sample. If your data has met or exceeded the Data Submission requirement you are ready to Certify. You can select one or more samples in
the Certify Performance Test Data table and select the ‘Certify’ button under the table.
The sample size percent, # of Test(s) completed, # of Test(s) Required and Data Submission Progress do not display an adjusted calculation for
subscriber replacement or pretesting waivers. The PMM readjusts the calculation based upon subscriber replacement or pretesting waivers, when
deriving the compliance percentage score.

Universal Service Administrative Company

Once you have selected ‘Certify’ you will see a modal appear titled Sign and Certify.
Please note, if you have not met the Data Submission requirement for the sample there
will be a warning message highlighted in Yellow. You can complete certification for the
sample(s) selected by typing your name as it is populated below the signature box. Upon
completion of certification you will see a confirmation modal which includes a
Confirmation number.
The Certification Summary table displays the number of Certified and Not Certified
samples for each Test Type in the State selected. When you no longer have a count in
the Not Certified Sample column you have completed certification for that Test Type.

Performance Measures Module User Guide

Universal Service Administrative Company

Performance Measures Module User Guide

Compliance Report
The compliance report is accessible under the performance data menu. The compliance report will display the following error message upon
navigating to the page. The error message will no longer display after the PMM system completes compliance report calculations. Carriers will
receive notification of availability of the compliance report calculations once available.

The compliance report will display a summary assessment of performance data results for each SAC.

Universal Service Administrative Company

Performance Measures Module User Guide

Quarterly Compliance
When navigating to the Compliance Report page, select quarterly and the applicable quarter within the Quarter Filter. The Quarter Filter will be
pre-populated with a list of all the quarters for which the
compliance was calculated. The Quarter and year values
will be in descending order. When selecting the Test Type
Filter, the following values will appear in the drop-down
menu with the selected default value of “All”:
•
•
•
•
•

All
DL Speed
UL Speed
High Latency
Low Latency

If selected fields require correcting, choose the “Clear” button to clear the data. The Test Type Filter will default back to “All” selected for test
type. Upon scrolling down on the 'Compliance Report' page, the following page components should display in a table format:
i. Fund
v. Test Type
ix. Compliance %
ii. SAC
vi. # of Tests Compliant
x. Compliance Level
iii. State
vii. # of Tests Non-Compliant
iv. Speed Tier
viii. # of Missed Tests

If the sample and the test-type combination is not eligible for compliance calculation due to not certifying data submission, the value will be
designated with a dash. Where the compliance calculation % value is greater than 100%, the respective compliance % column will be capped at
100% and populated with 100%. All Compliance % values are truncated to whole numbers. An exportable table formatted report is available for
download by selecting the Download Report button on the top left of the table for data export.

Universal Service Administrative Company

Performance Measures Module User Guide

Annual Compliance
When navigating to the Compliance Report page, select Annual. The Year Filter will be pre-populated with a list of all the years for which the
compliance was calculated. The year values will be in descending order. When selecting the Test Type Filter, the following values will appear in
the drop-down menu with the selected default value of “All”:
•
•
•
•
•

All
DL Speed
UL Speed
High Latency
Low Latency

iv. Speed Tier
v. Test Type
vi. # of Tests Compliant

vii. # of Tests Non-Compliant
viii. Compliance %
ix. Compliance Level

Universal Service Administrative Company

Performance Measures Module User Guide

Compliance Report Calculations
More detailed information about the compliance report calculations can be found on USAC’s website:
https://www.usac.org/wp-content/uploads/high-cost/documents/Tools/PMM-Compliance-Calculations.pdf.
The "# of Tests Compliant" column is populated with the total count of certified valid successful tests (status 1) that meet the compliance
benchmark. (i.e test data certified with test status 1 which meets the following compliance calculation criteria based on the test-type value
selected). Either low latency or high latency is assessed in the compliance calculations based upon Fund and technology type.
Download Speed

Upload Speed

Low Latency

High Latency

Total count of certified valid successful
Download Speed Tests with a Calculated
Mbps >= 80% of the Obligated Speed
Tier's Download speed

Total count of certified valid
successful Upload Speed Tests with
a Calculated Mbps >= 80% of the
Obligated Speed Tier's Upload speed

Total count of certified valid
successful Latency Tests with
an RTT ≤ 100ms

Total count of certified valid
successful Latency Tests with
an RTT ≤ 750ms

The "# of Tests Non-Compliant" column is populated with the total count of certified valid successful tests (status 1) that do not
meet the compliance benchmark. (i.e test data certified with test status 1 which do not meet the following compliance calculation
criteria based on the test-type value selected.) Either low latency or high latency is assessed in the compliance calculations based upon Fund
and technology type.
Download Speed

Upload Speed

Low Latency

HIgh Latency

Total count of certified valid successful
Download Speed Tests with a Calculated
Mbps < 80% of the Obligated Speed
Tier's Download speed

Total count of certified valid
successful Upload Speed Tests with
a Calculated Mbps < 80% of the
Obligated Speed Tier's Upload speed

Total count of certified
valid successful Latency
Tests with an
RTT >100ms

Total count of certified valid
successful Latency Tests with
an RTT > 750ms

Universal Service Administrative Company

Performance Measures Module User Guide

The "# of Missed Tests" column is populated with difference between the total number of required tests submitted for each test
type and the total count of certified valid tests (status 1, 2 and 3). Either low latency or high latency is assessed in the compliance
calculations based upon Fund and technology type.
Download Speed

Upload Speed

Latency

Total count of expected tests for each
subscriber within the sample for each hour over
a 7-day period between 6:00 PM and 12:00 AM
taking into account cross-talk exception less the
Total count of certified valid Download Speed
Tests

Total count of expected tests for each
subscriber within the sample for each hour
over a 7-day period between 6:00 PM and
12:00 AM taking into account cross-talk
exception less the Total count of certified valid
Upload Speed Tests

Total count of expected tests for each
subscriber within the sample for each
minute over a 7-day period between
6:00 PM and 12:00 AM less the Total
count of certified valid Latency Tests

Compliance % values are calculated by dividing the number of certified valid successful tests compliant by the total number of certified valid of
tests (status 1) plus the total number of tests missed.
Compliance % values are truncated to whole numbers. Where the compliance is not calculated, it will be reflected as incomplete and designated
with a dash. Where the compliance calculation % value is greater than 100%, the respective compliance % column will be capped at 100% and
populated with 100%. Based on the compliance % values, the compliance levels will be populated and display the following:

Compliance Level

Compliance % (x)

Compliance Level

Compliance % (x)

Fully Compliant

x ≥ 100%

Level 3

55% ≤ x < 70%

Level 1

85%≤ x < 100%

Level 4

0% < x < 55%

Level 2

70% ≤ x < 85%

Incomplete

null

Universal Service Administrative Company

Performance Measures Module User Guide

Data Specifications
Subscriber Upload
The table below provides the specification for the Subscriber Upload CSV file.

Field (* = required) Description
SAC

The 6-digit Study Area Code (SAC) for the study area containing the location.
This field is populated into your template but is not validated for PMM data
submission. Edits to this field in your PMM data file upload will not be reflected
in the HUBB.

Latitude

Latitude of the location to which you have made service available and
tested. It must have at least 6 decimal places.

Data
Type

Max
Length

Example

Integer

579999

Float

N/A

39.509220

Float

N/A

-98.433700

Coordinates must be in the WGS84 or NAD83 geographic coordinate system.
This field is populated into your template but is not validated for PMM data
submission. Edits to this field in your PMM data file upload will not be reflected
in the HUBB.
Longitude

Longitude of the location to which you have made service available. It must
have at least 6 decimal places.
Coordinates must be in the WGS84 or NAD83 geographic coordinate system.
This field is populated into your template but is not validated for PMM data
submission. Edits to this field in your PMM data file upload will not be reflected
in the HUBB.

Universal Service Administrative Company

Field (* = required) Description
Address

Number and street address of this location. If possible, use the
standardized Postal Service format. However, this information will be
neither standardized nor validated by the HUBBHUBB.

Performance Measures Module User Guide

Data
Type

Max
Length

Example

Text

100

715
Wisconsin
Street

Text

Integer

If a location does not have a traditional street address, enter a description of
where the served premises is located (e.g., an intersection, a road, etc.).
This field is populated into your template but is not validated for PMM data
submission. Edits to this field in your PMM data file upload will not be reflected
in the HUBB.
State

2-letter postal abbreviation of the state associated with this location.
This field is populated into your template but is not validated for PMM data
submission. Edits to this field in your PMM data file upload will not be reflected
in the HUBB.

Speed Tier

Select link to speed tier table with document. Speed Tier Table

Universal Service Administrative Company

Field (* = required) Description
# of Units

Performance Measures Module User Guide

Data
Type

Max
Length

Example

The number of units associated with this location.
If the address or building contains only one housing unit or
business location, enter 1.
If the location is a building with multiple units, such as an apartment
or office building containing qualifying locations, enter the number
units at that location.

Integer N/A

Text

12345

Text

A12345

This field is populated into your template but is not validated for PMM
data submission. Edits to this field in your PMM data file upload will
not be reflected in the HUBBHUBB.
Carrier Location ID

The Carrier Location ID field is available for carriers to add their internal
ID associated with a location. If you do not have an ID available, this field
can be left blank.
This field is populated into your template but is not validated for PMM
data submission. Edits to this field in your PMM data file upload will not
be reflected in the HUBBHUBB.

HUBBHUBB
Location ID*

The HUBB location ID field will be entered in the subscriber data upload
template. This id must remain unchanged. This field is REQUIRED.

Universal Service Administrative Company

Performance Measures Module User Guide

Field (* = required) Description
Subscriber ID*

Data
Type

The subscriber ID is the unique identifier assigned by the Provider
to designate active subscribers that are occupying locations
previously reported in the HUBB. If you have multiple Subscriber
IDs for a single HUBB location, you MUST use a semicolon ‘;’
instead of a comma ‘,’ before the next Subscriber ID.
This field is REQUIRED.

Max
Length

Example

,A-80098678
or
;A-78694494

Speed Data Upload Template
The table below provides the specification for the Speed Data Upload Template (Speed Testing Template) CSV file

Field
HUBB Location ID*

(* = required)

Description

Data Type

Max Length

Example

The HUBB location ID field will be entered in the
Speed Testing or Latency testing template. This ID
can be retrieved from the sample file generated in
the Randomized Module. This id must remain
unchanged. This field is REQUIRED.

Text

N/A

A12345

Universal Service Administrative Company

Field
Subscriber ID*

(* = required)

Description
The subscriber ID is the unique identifier
assigned by the Provider to designate active
subscribers that are occupying locations
previously reported in the HUBB. This ID can
be retrieved from the sample file generated in
the Randomized Module. This id must remain
unchanged.

Performance Measures Module User Guide

Data Type

Max Length

Example

Text

N/A

,A-80098678

Integer

‘1’ or ‘2’

String

100

‘192.168.10.10’

This field is REQUIRED.
Speed Type*

IP Target*

Speed Type = '1' for Download Speed (DL) or '2'
for Upload Speed (UL)
IP Target = (host name or ip address) of the IP
server that is designated for the test

Or ‘MEX-IX

McAllen’
Start Test*

Start Test = ISO 8601 UTC format to include
milliseconds AND time zone offset.
Ex: yyyy-mm-dd hh:mm:ss:SSS±HH:MM
("+" for positive UTC timezone offset, "-" for
negative UTC timezone offset)
This is the only accepted format for this field.

String

200

‘2020-03-05
01:03:01:12305:00’

Universal Service Administrative Company

Field

(* = required)

End Test*

Description
End Test = ISO 8601 UTC format to include
milliseconds AND time zone offset.

Performance Measures Module User Guide

Data Type

Max Length

Example

String

200

‘2020-03-05
01:03:01:14305:00’

Integer

‘20000’

Integer

‘1’

String

500

‘This location
had faulty
testing
equipment that
was replaced
during the test
period’

Ex: yyyy-mm-dd hh:mm:ss:SSS±HH:MM
("+" for positive UTC timezone offset, "-" for
negative UTC timezone offset)
This is the only accepted format for this field.
Bytes*

Test Status*

Comment (optional)

Bytes = total bytes received or sent across all
connections or threads
Test Status = Status of Test (1=success; 2= test not
run due to cross talk traffic; 3= test not run due to
other reason)
Text string, not required

Universal Service Administrative Company

Performance Measures Module User Guide

Latency Data Upload Template
The table below provides the specification for the Speed Data Upload Template (Speed Testing Template) CSV file.

Field

Description

Data Type

Max Length

Example

HUBB Location ID*

The HUBB location ID field will be entered in the
subscriber data upload template. This ID can be
retrieved from the sample file generated in the
Randomized Module. This id must remain
unchanged.

Text

N/A

A12345

Subscriber ID*

The subscriber ID is the unique identifier assigned by
the Provider to designate active subscribers that are
occupying locations previously reported in the
HUBB. . This ID can be retrieved from the sample file
generated in the Randomized Module. This id must
remain unchanged.

Text

N/A

,A-80098678

String

100

‘192.168.10.10’

IP Target*

(* = required)

IP Target = (host name or ip address) of the IP
server that is designated for the test

Or ‘MEX-IX

McAllen’

Universal Service Administrative Company

Field
Start Test*

(* = required)

Description
Start Test = ISO 8601 UTC format to include
milliseconds AND time zone offset.

Performance Measures Module User Guide

Data Type

Max Length

Example

String

200

‘2020-03-05
01:03:01:12305:00’

Integer

‘200’

Integer

100

‘20’

Integer

100

‘18’

Integer

‘1’

Ex: yyyy-mm-dd hh:mm:ss:SSS±HH:MM
("+" for positive UTC timezone offset, "-" for negative
UTC timezone offset)
This is the only accepted format for this field.
Daylight Savings Time is supported
Latency*

Packets Sent*

Packets Received*

Test Status*

Roundtrip time (RTT) in milliseconds

Packets Sent= Number of packets successfully sent

Packets Received = Number of packets successfully
received
Test Status = Status of Test (1=success; 2= test not
run due to cross talk traffic)

Universal Service Administrative Company

Field

(* = required)

Comment (optional)

Description
Text string, not required

Performance Measures Module User Guide

Data Type

Max Length

Example

String

500

‘This location
had faulty
testing
equipment that
was replaced
during the test
period’

Universal Service Administrative Company

Performance Measures Module User Guide

Data Error Codes
If submitted data fails validations, you may download the Data Errors CSV file from the “Recently Uploaded Files” table on the Upload
Subscriber List page. The table below provides a list of all data error codes generated by the system.
Category

Code or Error Message

File Error

File name contains one or many invalid characters. Please
File names cannot have the following invalid characters:
reference the USAC-provided Data Standards for file naming
• Left curly brace ("{")
convention instructions.
• Backslash ("\")
• Non-printable ASCII characters (128–255 decimal
characters)
• Caret ("^")
• Right curly brace ("}")
• Percent character ("%")
• Grave accent / back-tick ("`")
• Right square bracket ("]")
• Quotation marks
• 'Greater Than' symbol (">")
• Left square bracket ("[")
• Tilde ("~")
• 'Less Than' symbol ("<")
• 'Pound' character ("#")
• Vertical bar / pipe ("|")

File Error

The uploaded file is not in CSV format. Please reference the The uploaded file must be in CSV format.
USAC-provided template.

File Error

The uploaded file has an incorrect header row. Please
reference the USAC-provided template.

Description

The uploaded file’s first row (also known as the header row)
must match the first row of the template you downloaded by
clicking the Generate HUBB Data button.

Universal Service Administrative Company

Performance Measures Module User Guide

File Type	application/pdf
Author	Jonathan McCormack
File Modified	2022-10-13
File Created	2022-09-02