MACBIS Software Application Electronic Survey

Status: Original and derived artifacts are available for this document.

Download: xlsx | pdf | html

Number (Target fewer than 10 questions
in a single webinar)

1

2

3

4

5

6

7

8

9
10

11

12

13

14

15

16

17

18

19

20

21

22

23

24
25
26
27

28

29
30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46
47

48

49

50

51

The following question options were approved in the 2019 PRA submission

52

53
54
55

56

57

58

59

60

61
62
63

PRA Disclosure Statement Your response to our polls or
survey are voluntary. CMS is collecting infromation on the
usability and effectiveness of the Medicaid and Chip
Business Information System (MACBIS) T-MSIS software
and associated processes. Under the Privacy Act of 1974
any personally identifying information obtained will be kept
private to the extent of the law. According to the Paperwork
Reduction Act of 1995, no persons are required to respond
to a collection of information unless it displays a valid OMB
control number. The valid OMB control number for this
information collection is 0938-1185 (CMS-10719). The time
required to complete this information collection is estimated
to average 5 minutes per response, including the time to
review instructions, search existing data resources, gather
the data needed, and complete and review the information
collection. If you have comments concerning the accuracy
of the time estimate(s) or suggestions for improving this
form, please write to: CMS, 7500 Security Boulevard, Attn:
PRA Reports Clearance Officer, Mail Stop C4-26-05,
Baltimore, Maryland 21244-1850.

Survey Question

This T-MSIS National Webinar was valuable to my T-MSIS work. [Pick one]
a.Strongly disagree
b.Disagree
c.Undecided
d.Agree
e.Strongly agree
On a scale of 1-5 (1 being easiest), how easy is it to find T-MSIS Priority Issue-related data quality issues tr
Data Quality Tool? [Pick one]
a.1
b.2
c.3
d.4
e.5

On a scale of 1-5 (1 being easiest), how easy is it to find measures/rules and their definitions which trigger
a.1
b.2
c.3
d.4
e.5
(multiple choice/single answer) On a scale of 1-5 (1 being easiest), how easy is it to find the valid values and descr
Dashboard (ex. TOOTH-NUM)?
a.1
b.2
c.3
d.4
e.5

What actions could CMS take that would help your state find data quality issues or validation errors, identi
values on the T-MSIS dashboards? [short answer]
Which of the published guidance items would be helpful to highlight or discuss further? (select all that app
a.Reporting eligible identifiers
b.Reporting dispensing fee in the T-MSIS RX File
c.Reporting denied claims and encounter records
d. Reporting health home data
e.Provider classification requirements
f.Overview of the T-MSIS Priority Items (TPIs)
g.Reporting restricted benefits code
h. Reporting quantity fields in the claims files
i. Primary Care Case Management reporting
j. Reporting paid and billed amounts on managed care encounters
k. Other (list below)

If there is other published guidance that your state would find helpful for CMS to present on, please includ

What T-MSIS topics would you like addressed by CMS or state representatives? [Select all that apply]
a. Understanding T-MSIS guidance as it relates to new policy
b. Prioritizing and implementing coding fixes from T-MSIS guidance and data dictionary changes
c.T-MSIS team resource support
d. Getting state leadership buy-in on the importance of fixing Data Quality issues
e. Review of tools supporting Data Quality activities
f. Getting state Medicaid/CHIP program policy staff support for T-MSIS data quality activities
g.Coding fixes from T-MSIS guidance and data dictionary changes
h.The large system enhancement process
i. Implementing a research process to investigate and identify the root cause of DQ issues

Please provide additional suggestions for T-MSIS related topics or elaborate on your response to the previ
Additional comments for the T-MSIS webinar team? [short answer]

Please select the top guidance topic from the list below that you would like addressed by CMS or state representative
a. Medicaid Paid Amount
b. "Atypical" Providers
c. Institutional vs. Professional Claims
d. Pass through data elements
e. Service Tracking Payment Claims
f. Medicaid Paid Date for Encounters
g. Non-Managed Care Per Member Per Month Payments
h. Provider ID/MSIS ID Change
i. Reporting CDT Code in T-MSIS Guidance
j. Retention Period Guidance
k. Unsure
l. Other (list below)

What T-MSIS topics would you like addressed by CMS or state representatives? [Select all that apply]
a. Understanding T-MSIS guidance to new policy [please send additional information about the specific policy to yo
b. Prioritizing and implementing coding fixes from T-MSIS guidance and data dictionary changes
c. T-MSIS team resource report
d. Getting state leadership buy-in on the importance of fixing Data Quality issues
e. Review of tools supporting Data Quality activities
f. Other(list below)
The T-MSIS team is working through the design of an integrated Ops Dashboard, Data Quality Tool, and Da
help your team achieve improved data quality. Would you be interested in participating in feedback sessio
a. Yes
b. No
c. Unsure

If you are interested in participating in the feedback sessions, please share your preferred cadence of part
a. Yes - Prefer to meet once a month for 1-hour
b. Yes - Prefer to meet bi-weekly for 30 minutes
c. Yes - Prefer to be informed of feedback sessions and meet as my schedule allows
d. I'm not interested at this time
e. Unsure
Are you aware that [list T-MSIS product or TAF Analytic report] for the Medicaid and CHIP scorecard was s
a. Yes
b. No
c. Unsure
Does your state plan to resubmit [insert date] historic T-MSIS data by [deadline] ? [Pick one]
a. Yes
b. No
c. Unsure

Is your state’s CMS Technical Assistant aware of your historical data re-submission plans? [Pick one]
a. Yes
b. No
c. I am not the right state contact to answer this question
d. Unsure
Has a ticket been submitted on the State Support Site to track your state’s re-submission plans? Has your
[Pick one]
a. Yes, a ticket has been created, and we provided our re-submission schedule
b. Yes, a ticket has been created, but our schedule is not ready for submission
c. No, we have not submitted a ticket
d. Unsure
The guidance provided today by CMS will help my state maintain accurate and complete T-MSIS data. [Pick
a. Strongly disagree
b. Disagree
c. Undecided
d. Agree
e. Strongly Agree
The addition of a T-MSIS guidance-focused webinar is valuable to my current T-MSIS work. [Pick one]
a. Strongly disagree
b. Disagree
c. Undecided
d. Agree
e. Strongly Agree
I am satisfied with the timelines of the guidance and data quality feedback provided by CMS. [Pick one]
a. Strongly disagree
b. Disagree
c. Undecided
d. Agree
e. Strongly Agree
The data quality feedback provided by CMS through this webinar will help me resolve T-MSIS data quality i
a. Strongly disagree
b. Disagree
c. Undecided
d. Agree
e. Strongly Agree
Overall, the data quality technical assistance and tools provided by CMS helps me resolve T-MSIS data qua
a. Strongly disagree
b. Disagree
c. Undecided
d. Agree
e. Strongly Agree
Please share any suggestions you have for the state T-MSIS staff on how we may better communicate data q
Did you experience any issues in accessing the webinar presentation? [Pick one]
a. Yes
b. No
Do you have any outstanding questions from today’s webinar presentation? If so, please insert your comment below
Have you accessed [specify information or webpage] in the OD? [Pick one]
a. Yes
b. No
Did you find the [specify demo name] demo to be helpful? [Pick one]
a. Yes
b. No

Please share any suggestions for how we may better communicate with state T-MSIS staff concerning data
I felt that the format of today's webinar was helpful. [Pick one]
a. Strongly Disagree
b. Disagree
c. Agree
d. Strongly Agree
I am satisfied with the clarity and consistency of T-MSIS communications and announcements provided on
MSIS State Technical Assistants and State Liaisons. [Pick one]
a. Strongly disagree
b. Disagree
c.Undecided
d.Agree
e.Strongly agree
Has your state started to review [state priority errors] on the T-MSIS Dashboards [name location]? [Pick on
a. My state is only reviewing TPIs 1-12
b. My state is only reviewing TPIs 1-24
c.My state is reviewing TPIs 1-32
d.My state is not reviewing TPIs
e. Unsure
How frequently do you use the T-MSIS Dashboards [name location or resource]? [Pick one]
a. Rarely / Never
b. Daily
c. Weekly
d. Monthly
e. Quarterly
f. Yearly
Overall, how would you rate the T-MSIS Dashboards [name location or resource]? [Pick one]
a. I love it
b. I like it
c. It’s okay
d. I dislike it
e. I hate it
What would help resolve your state data quality issues? [Select all that apply]
i. Sample records for missingness
ii. Sample records for DQ measures
iii. Submit Addendum E and STTM updates online through the OD
iv. See file resubmission schedule and status on the OD
v. Other (chat in response in Q&A widget) or list options below

If CMS has the capacity to deliver T-MSIS Analytic Files (TAF), would your state be interested in receiving y
one]
a. Yes
b. No
c. Unsure
What is today's weather in your area? [Pick one]
a. Sunny
b. Partly cloudy
c. Overcast
d. Raining
e. IDK - stuck in the office

Please tell us who you are: [Pick one]
a. State Medicaid staff
b. State Contractor
c. A group (+2) of state Medicaid staff and state contractor(s)
d. Federal staff/ contractor
e. Other stakeholder (list)

Would your State Medicaid Directors be interested in receiving summary reports about data validation/bus
increases, new errors, error resolutions, etc.) based on the monthly file submissions? [Pick one]
a. Very interested
b. Somewhat interested
c. Indifferent
d. Not interested
What would make the [name report] Reports most valuable to you? [Pick one]
a. Drill down available to record-level detail on the Operations Dashboard
b. Consolidated report from the OD and DQ Tracking Report
c. Links from the DQ Tool to the OD
d. A summary that could be passed along as a report to other State Executives
e. Other (list)
Would you be interested in attending a separately scheduled call with others that would allow you to get m
regarding [specify] T-MSIS information e.g. guidance, software enhancement? [Pick one]
a. Yes
b. No
c. Depends on the T-MSIS topic
d. I prefer to discuss this T-MSIS topic with my current State TA
After all this working at home, what one thing do you miss most from your office that you wish you could h
a. Computer monitor and desk set-up
b. Office coffee maker
c. Office chair
d. Co-workers
e. Office door

The new guidance released on [date] regarding [T-MSIS reporting requirement] applies to the following qua
a. True
b. False

The new eligibility COVID-19 codes for the COVID-19 testing optional Medicaid eligibility group cannot be u
ended. [Pick one]
a. True
b. False
We demo-ed the[name] feature on the [specify T-MSIS Dashboard]. Have you used this feature to prioritize
[Pick one]
a. I have never used it
b. I used it one time
c. I have used it
d. I use it and found the new feature helpful
e. What is the this feature?

Does your state use state-specific (local) procedure codes and/or modifiers (non CPT/HCPCS codes) for services with feder

Yes
No
If you responded yes to the previous question "Does your state use state-specific (local) procedure codes and/or modifier
How often are state-specific (local) procedure codes updated? Are there new codes added, modified or terminated peri
Weekly
Monthly
Every other month
Quarterly
Every 6 months
Annually
More frequently than options listed
Less frequently than options listed
Are you sending updated Addendum Es when there are updates to state specific procedure codes or modifiers? [Pick on
Yes
No
Are there plans to stop using state-specific (local) procedure codes and move to national code sets? [Pick one]
A. Yes
b. If no, why?
How long will it take your T-MSIS team to transition to using the national valid values for <specify data elem
6-12 months
12-18 months
18-24 months
2-3 years
Other (specify)
e approved in the 2019 PRA submission
Do you think <this CMS MACBIS software application> is useful for <CMS / State / Drug Manufacturer> interaction?
I would not use this product
I would not use this product.
I would use this regularly.
I believe this is valuable for someone else on our T-MSIS team.
I believe this is valuable for Medicaid directors and other executives.
It is helpful to see our state's data from CMS' perspective.
I would like to see more personalized information about our state
Other (please specify)
What part of this new “feature” do you feel is most useful and why? [short answer]
Note: this question will display in close placement to the new feature(s)

What part of <this CMS MACBIS software application> do you feel is most useful and why? [short answer]
If you could build any feature you wanted on <this CMS MACBIS software application>, what would you want? [shor
Overall, how usable is <this CMS MACBIS software application>? [Pick one]
Very easy
Easy
Neither easy nor difficult
Difficult
Very difficult

1. Did you feel that you had complete documentation to do the testing? [Select all that apply]
I would have preferred to have received the information earlier.
The document provided was helpful for testing.
The document provided was too complicated.
I would have preferred more guidance about expectations.
The kickoff webinar was helpful in setting expectations.
The kickoff webinar was too time-consuming.
Timelines were made clear.
Timelines were unclear.
Other Comments
Was there enough communication during UAT? [Select all that apply]
I would have preferred a daily touch point.
I would have preferred no kickoff meeting.
CMS did not respond to my comments in a timely manner.
CMS was responsive.
I feel that my feedback was heard.
My questions were answered.
Other Comments
Do you think this new feature is useful? [Pick one]
Note: this question will display in close placement to the new feature(s)
I would not use this product.
I would use this regularly.
I believe this is valuable for someone else on our team.
I believe this is valuable for Medicaid directors and other executives.
It is helpful to see our data from CMS' perspective.
I would like to see more personalized information.
Other Comments

Thank you very much for participating in the <MACBIS software> UAT. Based on this experience... [Select all that a
I enjoyed having a preview of the product and being able to give feedback.
I would not want to participate in the future.
It was too time consuming.
I am interested in testing upcoming new features.
Other Comments

Have states noticed faster turnaround from the time they submit data to T-MSIS until they can view this data on the
Is it important for states to view error details for older reporting periods i.e. periods other than the prior and current m
Is it important to view error detail in aggregate to understand error trends? Do you utilize trend information for errors

h federal funding?", please explain” ___ [short answer]

e to see error detail for?