CMS-10719 MACBIS Software Application Electronic Survey

Number (Target fewer than 10 questions in a single webinar)	Survey Question
1	This T-MSIS National Webinar was valuable to my T-MSIS work. [Pick one] a.Strongly disagree b.Disagree c.Undecided d.Agree e.Strongly agree
2	On a scale of 1-5 (1 being easiest), how easy is it to find T-MSIS Priority Issue-related data quality issues triggered by the latest file submission on the Data Quality Tool? [Pick one] a.1 b.2 c.3 d.4 e.5
3	On a scale of 1-5 (1 being easiest), how easy is it to find measures/rules and their definitions which triggered a T-MSIS Priority Issue [Pick one] a.1 b.2 c.3 d.4 e.5
4	(multiple choice/single answer) On a scale of 1-5 (1 being easiest), how easy is it to find the valid values and descriptions for a data element on the Operations Dashboard (ex. TOOTH-NUM)? a.1 b.2 c.3 d.4 e.5
5	What actions could CMS take that would help your state find data quality issues or validation errors, identify validation rules/measures, or find valid values on the T-MSIS dashboards? [short answer]
6	Which of the published guidance items would be helpful to highlight or discuss further? (select all that apply) [Select all that apply] a.Reporting eligible identifiers b.Reporting dispensing fee in the T-MSIS RX File c.Reporting denied claims and encounter records d. Reporting health home data e.Provider classification requirements f.Overview of the T-MSIS Priority Items (TPIs) g.Reporting restricted benefits code h. Reporting quantity fields in the claims files i. Primary Care Case Management reporting j. Reporting paid and billed amounts on managed care encounters k. Other (list below)
7	If there is other published guidance that your state would find helpful for CMS to present on, please include that information below. [short answer]
8	What T-MSIS topics would you like addressed by CMS or state representatives? [Select all that apply] a. Understanding T-MSIS guidance as it relates to new policy b. Prioritizing and implementing coding fixes from T-MSIS guidance and data dictionary changes c.T-MSIS team resource support d. Getting state leadership buy-in on the importance of fixing Data Quality issues e. Review of tools supporting Data Quality activities f. Getting state Medicaid/CHIP program policy staff support for T-MSIS data quality activities g.Coding fixes from T-MSIS guidance and data dictionary changes h.The large system enhancement process i. Implementing a research process to investigate and identify the root cause of DQ issues
9	Please provide additional suggestions for T-MSIS related topics or elaborate on your response to the previous question. [short answer]
10	Additional comments for the T-MSIS webinar team? [short answer]
11	Please select the top guidance topic from the list below that you would like addressed by CMS or state representatives over the next six months. [Pick one] a. Medicaid Paid Amount b. "Atypical" Providers c. Institutional vs. Professional Claims d. Pass through data elements e. Service Tracking Payment Claims f. Medicaid Paid Date for Encounters g. Non-Managed Care Per Member Per Month Payments h. Provider ID/MSIS ID Change i. Reporting CDT Code in T-MSIS Guidance j. Retention Period Guidance k. Unsure l. Other (list below)
12	What T-MSIS topics would you like addressed by CMS or state representatives? [Select all that apply] a. Understanding T-MSIS guidance to new policy [please send additional information about the specific policy to your State TA] b. Prioritizing and implementing coding fixes from T-MSIS guidance and data dictionary changes c. T-MSIS team resource report d. Getting state leadership buy-in on the importance of fixing Data Quality issues e. Review of tools supporting Data Quality activities f. Other(list below)
13	The T-MSIS team is working through the design of an integrated Ops Dashboard, Data Quality Tool, and Data Guide (documentation and guidance) to help your team achieve improved data quality. Would you be interested in participating in feedback sessions related to this initiative? [Pick one] a. Yes b. No c. Unsure
14	If you are interested in participating in the feedback sessions, please share your preferred cadence of participation below. [Pick one] a. Yes - Prefer to meet once a month for 1-hour b. Yes - Prefer to meet bi-weekly for 30 minutes c. Yes - Prefer to be informed of feedback sessions and meet as my schedule allows d. I'm not interested at this time e. Unsure
15	Are you aware that [list T-MSIS product or TAF Analytic report] for the Medicaid and CHIP scorecard was sent to state contacts in [list date] [Pick one] a. Yes b. No c. Unsure
16	Does your state plan to resubmit [insert date] historic T-MSIS data by [deadline] ? [Pick one] a. Yes b. No c. Unsure
17	Is your state’s CMS Technical Assistant aware of your historical data re-submission plans? [Pick one] a. Yes b. No c. I am not the right state contact to answer this question d. Unsure
18	Has a ticket been submitted on the State Support Site to track your state’s re-submission plans? Has your state provided a re-submission schedule? [Pick one] a. Yes, a ticket has been created, and we provided our re-submission schedule b. Yes, a ticket has been created, but our schedule is not ready for submission c. No, we have not submitted a ticket d. Unsure
19	The guidance provided today by CMS will help my state maintain accurate and complete T-MSIS data. [Pick one] a. Strongly disagree b. Disagree c. Undecided d. Agree e. Strongly Agree
20	The addition of a T-MSIS guidance-focused webinar is valuable to my current T-MSIS work. [Pick one] a. Strongly disagree b. Disagree c. Undecided d. Agree e. Strongly Agree
21	I am satisfied with the timelines of the guidance and data quality feedback provided by CMS. [Pick one] a. Strongly disagree b. Disagree c. Undecided d. Agree e. Strongly Agree
22	The data quality feedback provided by CMS through this webinar will help me resolve T-MSIS data quality issues? [Pick one] a. Strongly disagree b. Disagree c. Undecided d. Agree e. Strongly Agree
23	Overall, the data quality technical assistance and tools provided by CMS helps me resolve T-MSIS data quality issues? [Pick one] a. Strongly disagree b. Disagree c. Undecided d. Agree e. Strongly Agree
24	Please share any suggestions you have for the state T-MSIS staff on how we may better communicate data quality issues. [short answer]
25	Did you experience any issues in accessing the webinar presentation? [Pick one] a. Yes b. No
26	Do you have any outstanding questions from today’s webinar presentation? If so, please insert your comment below. [short answer]
27	Have you accessed [specify information or webpage] in the OD? [Pick one] a. Yes b. No
28	Did you find the [specify demo name] demo to be helpful? [Pick one] a. Yes b. No
29	Please share any suggestions for how we may better communicate with state T-MSIS staff concerning data quality issues. [free text]
30	I felt that the format of today's webinar was helpful. [Pick one] a. Strongly Disagree b. Disagree c. Agree d. Strongly Agree
31	I am satisfied with the clarity and consistency of T-MSIS communications and announcements provided on the T-MSIS State Support Site and by the T-MSIS State Technical Assistants and State Liaisons. [Pick one] a. Strongly disagree b. Disagree c.Undecided d.Agree e.Strongly agree
32	Has your state started to review [state priority errors] on the T-MSIS Dashboards [name location]? [Pick one] a. My state is only reviewing TPIs 1-12 b. My state is only reviewing TPIs 1-24 c.My state is reviewing TPIs 1-32 d.My state is not reviewing TPIs e. Unsure
33	How frequently do you use the T-MSIS Dashboards [name location or resource]? [Pick one] a. Rarely / Never b. Daily c. Weekly d. Monthly e. Quarterly f. Yearly
34	Overall, how would you rate the T-MSIS Dashboards [name location or resource]? [Pick one] a. I love it b. I like it c. It’s okay d. I dislike it e. I hate it
35	What would help resolve your state data quality issues? [Select all that apply] i. Sample records for missingness ii. Sample records for DQ measures iii. Submit Addendum E and STTM updates online through the OD iv. See file resubmission schedule and status on the OD v. Other (chat in response in Q&A widget) or list options below
36	If CMS has the capacity to deliver T-MSIS Analytic Files (TAF), would your state be interested in receiving your state’s version of its annual TAF? [Pick one] a. Yes b. No c. Unsure
37	What is today's weather in your area? [Pick one] a. Sunny b. Partly cloudy c. Overcast d. Raining e. IDK - stuck in the office
38	Please tell us who you are: [Pick one] a. State Medicaid staff b. State Contractor c. A group (+2) of state Medicaid staff and state contractor(s) d. Federal staff/ contractor e. Other stakeholder (list)
39	Would your State Medicaid Directors be interested in receiving summary reports about data validation/business rule/measure error results (error increases, new errors, error resolutions, etc.) based on the monthly file submissions? [Pick one] a. Very interested b. Somewhat interested c. Indifferent d. Not interested
40	What would make the [name report] Reports most valuable to you? [Pick one] a. Drill down available to record-level detail on the Operations Dashboard b. Consolidated report from the OD and DQ Tracking Report c. Links from the DQ Tool to the OD d. A summary that could be passed along as a report to other State Executives e. Other (list)
41	Would you be interested in attending a separately scheduled call with others that would allow you to get more information and/or ask questions regarding [specify] T-MSIS information e.g. guidance, software enhancement? [Pick one] a. Yes b. No c. Depends on the T-MSIS topic d. I prefer to discuss this T-MSIS topic with my current State TA
42	After all this working at home, what one thing do you miss most from your office that you wish you could have at home? [Pick one] a. Computer monitor and desk set-up b. Office coffee maker c. Office chair d. Co-workers e. Office door
43	The new guidance released on [date] regarding [T-MSIS reporting requirement] applies to the following qualified beneficiaries [specify]. [Pick one] a. True b. False
44	The new eligibility COVID-19 codes for the COVID-19 testing optional Medicaid eligibility group cannot be used once the Public Health Emergency has ended. [Pick one] a. True b. False
45	We demo-ed the[name] feature on the [specify T-MSIS Dashboard]. Have you used this feature to prioritize your work or for any reporting purposes? [Pick one] a. I have never used it b. I used it one time c. I have used it d. I use it and found the new feature helpful e. What is the this feature?
46	Does your state use state-specific (local) procedure codes and/or modifiers (non CPT/HCPCS codes) for services with federal funding? [Pick one] Yes No
47	If you responded yes to the previous question "Does your state use state-specific (local) procedure codes and/or modifiers (non CPT/HCPCS codes) for services with federal funding?", please explain” ___ [short answer]
48	How often are state-specific (local) procedure codes updated?  Are there new codes added, modified or terminated periodically? [Pick one] Weekly Monthly Every other month Quarterly Every 6 months Annually More frequently than options listed Less frequently than options listed
49	Are you sending updated Addendum Es when there are updates to state specific procedure codes or modifiers? [Pick one] Yes No
50	Are there plans to stop using state-specific (local) procedure codes and move to national code sets? [Pick one] A. Yes b.   If no, why?
51	How long will it take your T-MSIS team to transition to using the national valid values for <specify data element>? [Pick one] 6-12 months 12-18 months 18-24 months 2-3 years Other (specify)
The following question options were approved in the 2019 PRA submission
52	Do you think <this CMS MACBIS software application> is useful for <CMS / State / Drug Manufacturer> interaction? [Pick one] I would not use this product I would not use this product. I would use this regularly. I believe this is valuable for someone else on our T-MSIS team. I believe this is valuable for Medicaid directors and other executives. It is helpful to see our state's data from CMS' perspective. I would like to see more personalized information about our state Other (please specify)
53	What part of this new “feature” do you feel is most useful and why? [short answer] Note: this question will display in close placement to the new feature(s)
54	What part of <this CMS MACBIS software application> do you feel is most useful and why? [short answer]
55	If you could build any feature you wanted on <this CMS MACBIS software application>, what would you want? [short answer]
56	Overall, how usable is <this CMS MACBIS software application>? [Pick one] Very easy Easy Neither easy nor difficult Difficult Very difficult
57	1. Did you feel that you had complete documentation to do the testing? [Select all that apply] I would have preferred to have received the information earlier. The document provided was helpful for testing. The document provided was too complicated. I would have preferred more guidance about expectations. The kickoff webinar was helpful in setting expectations. The kickoff webinar was too time-consuming. Timelines were made clear. Timelines were unclear. Other Comments
58	Was there enough communication during UAT? [Select all that apply] I would have preferred a daily touch point. I would have preferred no kickoff meeting. CMS did not respond to my comments in a timely manner. CMS was responsive. I feel that my feedback was heard. My questions were answered. Other Comments
59	Do you think this new feature is useful? [Pick one] Note: this question will display in close placement to the new feature(s) I would not use this product. I would use this regularly. I believe this is valuable for someone else on our team. I believe this is valuable for Medicaid directors and other executives. It is helpful to see our data from CMS' perspective. I would like to see more personalized information. Other Comments
60	Thank you very much for participating in the <MACBIS software> UAT. Based on this experience... [Select all that apply] I enjoyed having a preview of the product and being able to give feedback. I would not want to participate in the future. It was too time consuming. I am interested in testing upcoming new features. Other Comments
61	Have states noticed faster turnaround from the time they submit data to T-MSIS until they can view this data on the Operations Dashboard?
62	Is it important for states to view error details for older reporting periods i.e. periods other than the prior and current month? If so, how far back would you like to see error detail for?
63	Is it important to view error detail in aggregate to understand error trends? Do you utilize trend information for errors older than 1 year?
PRA Disclosure Statement Your response to our polls or survey are voluntary. CMS is collecting infromation on the usability and effectiveness of the Medicaid and Chip Business Information System (MACBIS) T-MSIS software and associated processes. Under the Privacy Act of 1974 any personally identifying information obtained will be kept private to the extent of the law. According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is 0938-1185 (CMS-10719). The time required to complete this information collection is estimated to average 5 minutes per response, including the time to review instructions, search existing data resources, gather the data needed, and complete and review the information collection. If you have comments concerning the accuracy of the time estimate(s) or suggestions for improving this form, please write to: CMS, 7500 Security Boulevard, Attn: PRA Reports Clearance Officer, Mail Stop C4-26-05, Baltimore, Maryland 21244-1850.