0938-NEW: Clearance for Evaluation of Stakeholder Training
Health Insurance Marketplace and Market Stabilization Programs
Part B. Statistical Methods
The primary purpose of these collections will be for internal review by a contractor to continually improve the services provided to stakeholders. There are no plans to publish or otherwise release this information.
Universe and Respondent Selection
CMS procured the services of a contractor, A. Reddix & Associates (ARDX), to help with its training and technical outreach efforts that support Health Insurance Marketplace and market stabilization program development. With the services of the contractor, CMS will provide training and technical assistance primarily through weekly, bi-weekly, monthly, and quarterly Webinars, Webinar-based Question and Answer (Q&A) Sessions, and User Group Series. A web portal (www.REGTAP.info) was developed to support CMS’ training efforts and to provide a centralized location for resource information, training session registration, and technical assistance. The contractor (ARDX) plans to utilize surveys as part of a comprehensive evaluation process, and will solicit voluntary feedback from stakeholders regarding individual training sessions and technical assistance provided under this contract. Stakeholders also have an opportunity to provide unsolicited feedback regarding REGTAP through the web portal.
The universe of respondents includes stakeholders participating in the Health Insurance Marketplace and in the market stabilization programs (e.g., health insurance issuers, self-insured group health plans, third-party administrators, agents, brokers and other entities) who register for and participate in training programs. The proposed data collections will not employ statistical sampling procedures or use statistical methods to produce population estimates.
2. Procedures for Collecting Information
The Agency expects to use a variety of methodologies for these collections. For example, the Agency or its contractor (ARDX) will use the following instruments and associated methods to conduct these evaluations:
On-site Post-Training Surveys will be provided to each participant for completion at the end of each day of onsite events (with hardcopy and online survey completion options);
Webinar Post-Training Participant Surveys, Webinar Q&A Feedback Surveys, and User Group Post-Training Surveys will be emailed to participants following those sessions in which they participated (with participants’ web browsers directed to the survey for more immediate survey completion); and
An open-ended Web Portal Feedback Form will be available to web portal users 24-hours per day, 7 days per week for unsolicited feedback.
Personally Identifiable Information will not be collected as a part of any of these data collections.
Methods to Maximize Response
The contractor will use a mixed mode approach to maximize survey response rates. For example, following Webinars, the contractor will solicit feedback from stakeholders through an email request including a link to the Web-based Post-Training Participant Survey. In addition, the contractor will direct participants’ web browsers to the survey at the end of the Webinar session, allowing participants the opportunity to provide feedback as soon as each training session ends.
For onsite events, the contractor will provide hardcopy post-training surveys to each participant for completion at the end of each day of the event. In addition, onsite participants will have an opportunity to complete the survey using a web-based application.
Information collected under this generic clearance will not yield generalizable quantitative findings.
Testing of Procedures
Pretesting may be conducted with internal staff and/or customers who are familiar with the programs and products. If pretests are conducted with members of the public, and the number of pretest respondents exceeds nine members of the public, the Agency will submit the pretest instruments for review under this generic clearance.
Contacts for Statistical Aspects and Data Collection
Each program will obtain information from statisticians in the analysis of customer/partner service surveys, when appropriate. This information will be available from contractors and the Agency will include the names and contact information of persons consulted in the specific information collection requests submitted under this generic clearance.
| File Type | application/msword |
| Author | malanoski |
| Last Modified By | Sadie Bennett1 |
| File Modified | 2016-11-01 |
| File Created | 2016-11-01 |