NIST - ITL - EHR Usability Study - Part 1 - Supporting Statement

NIST-ITL-EHR-Part-1-FourStandardSurveyQuestions-7-25-12.doc

NIST Generic Clearance for Usability Data Collections

NIST - ITL - EHR Usability Study - Part 1 - Supporting Statement

OMB: 0693-0043

Document [doc]
Download: doc | pdf

OMB Control No. – 0693-0043 – NIST Generic Clearance for Usability Data Collections


Project title: Study of Electronic Health Record Usability

PART 1 – Web Surveys of EHR Usability


FOUR STANDARD SURVEY QUESTIONS



1. Explain who will be surveyed and why the group is appropriate to survey.


The Information Technology Laboratory (ITL) of the National Institutes of Standards and Technology (NIST), will be working with participants consisting of clinical staff (e.g., physicians, nurses and radiology technicians) and non-clinical staff (e.g., hospital unit clerks) at study sites who interact directly with electronic health record (EHR) systems as part of their professional duties within one of the research sites. We will select research sites based on the EHR system that they use, their geographic location, and their availability to participate in the research study. Specifically, we aim to recruit a sample of research sites that use a variety of EHR vendors and at locations within close proximity to the research team’s locations. Web survey participants will be recruited and reminded about participation opportunities via standardized mass communication: e-mail distribution lists and written letters of invitation placed in institutional mailboxes. A copy of the e-mail invitation has been uploaded into ROCIS. Participants will not be contacted by telephone or by mail to their places of residence. Participation in this study will be open to all individuals, regardless of race, ethnicity, gender, or other personal characteristics. The aim of the recruitment strategy is inclusiveness and no EHR user will be denied the opportunity to participate as long as enrollment is open. The enrollment period will extend from September 28, 2011 to May 27, 2013. This group is appropriate to survey because they will provide us with the necessary information to understand how individuals across a variety of professions and institutions use EHR systems.



2. Explain how the survey was developed including consultation with interested parties, pre-testing, and responses to suggestions for improvement.


The survey methodology was developed by the contractors and subcontractors in consultation with the team from the National Institute for Standards and Technology (NIST). Key personnel from the contracting organization, Wiklund Research & Design (WR&D), developed the first draft of the survey. WR&D sent the survey via email to the subcontracting organizations (Vanderbilt University, Design Science and University of Wisconsin) for review and comments. All subcontractors were given approximately two weeks to submit comments to WR&D. WR&D incorporated the subcontractors’ suggestions for improvement and provided NIST with a draft for feedback. The final draft of the survey reflects the feedback that WR&D received from NIST. Notably, all of the suggestions for improvement were incorporated into the document.


While WR&D did not conduct formal pre-testing of the survey questions and methodology, several of the subcontractors are clinicians who interact directly with EHR systems and could assess the appropriateness of the survey as qualified participants. Moreover, the contractors and subcontractors developed the survey based on materials from previous usability studies that had proved to be an effective means to obtain information about users’ interactions with health information technology (HIT).



3. Explain how the survey will be conducted, how customers will be sampled if fewer than all customers will be surveyed, expected response rate, and actions your agency plans to take to improve the response rate.


The prime- and sub-contractors will distribute web-based, self-administered surveys to understand how end-users interact with EHR systems to accomplish clinical and non-clinical tasks. Users who have used EHR systems will be invited to complete the web survey at their convenience. The survey will consist of questions intended to understand EHR system users’ experiences with, perceptions about, and preferences for EHR systems (filename: Usability data collection questions), slightly modified for content and duration to accommodate the survey mode. Survey will be designed to optimize response rates and thus will have a maximum completion time of 60 minutes. General demographic information but not user identity will be collected. NO identifying information about EHR users or patients, or patients’ protected health information (PHI) will be captured.


Data Management: Survey responses will be collected in a secure electronic database. All survey data will undergo a cleaning process to ensure both respondent and affiliated institution anonymity and confidentiality. For example, the web survey will have questions that permit participant narrative responses. These will be reviewed and edited by authorized research project staff to remove any participant or patient names or other identifying text (e.g., patient’s PHI).


NIST will not have access to any of the raw data. Instead, the prime- and sub-contractors’ will analyze the raw numeric and narrative data to create Summary Reports that are completely devoid of identifying information or characteristics. Only the Summary Reports will be provided to anyone outside the research team. Therefore, NIST will never possess any information that is traceable to individual participants, specific commercial vendors, or specific healthcare entities.


Initial web survey response rates are expected to be 60%, the research team (Wiklund Research & Design and members of the subcontracting organizations) will continue to recruit participants until we have achieved the sample size goals for the effort. We will also attempt to improve the response rate by sending reminder emails and asking the department managers within the research sites to verbally remind their staff to complete the web survey. We will use validated survey design approaches to tailor the content of surveys (e.g., length) to optimize response rates (D.A. Dillman, 2008, Mail and Internet Surveys: The Tailored Design Method; Wiley: Hoboken, NJ).



4. Describe how the results of the survey will be analyzed and used to generalize the results to the entire customer population.


The research team will collate and integrate descriptive data with coded qualitative findings from all participants. We will analyze the results by looking for trends in the data overall and across different clinical roles (e.g., physician, nurse, resident, administrative secretary) and departments/facility types (e.g., intensive care unit, clinic, emergency room). Based on the observed data trends, we will develop a narrative description of user characteristics, use environments, EHR-related tasks, functions, goals, and best practices. We will measure associations between variables (e.g., between amount of EHR use and satisfaction with EHR). The findings yielded from this survey will help inform continuing research, guidelines, and policy. The results will generalize to the entire population of EHR users to the extent a representative sample of users can be obtained. In cases where the data cannot be generalized to the entire EHR user population, they may be generalized to specific EHR user groups (e.g., most common tasks performed by EHR users in intensive care units).



3


File Typeapplication/msword
File TitleOMB Control No
AuthorDarla Yonder
Last Modified ByYonder, Darla
File Modified2012-07-25
File Created2012-07-25

© 2024 OMB.report | Privacy Policy