Form 7 Attachment J: CDS Connect – Participant

Attachment J

Form Approved
OMB No. 0935-XXXX
Exp. Date XX/XX/20XX

CDS Connect – Participant

This protocol will be used for members of the CDS Connect workgroup.

Introduction/Consent

• Introduce members of group.

• Thank you very much for your time today.

• NORC at the University of Chicago is a not-for-profit research organization, and we are working with the Agency for Healthcare Research and Quality (AHRQ) as the independent evaluator of the Patient Centered Outcomes Research (PCOR) Clinical Decision Support (CDS) Initiative.

• I am going to be leading this interview, but others may chime in with follow-up questions.

• Just a few things before we get started.

  • Your participation is voluntary and you can conclude the discussion at any time. We are interested in your opinions – it is completely okay for you not to answer any questions that you do not want to. There are no wrong answers to the questions I will ask.

  • We will not attribute anything you have to say as coming from you personally. We will keep your name confidential in any summaries or reports we make available to AHRQ or the public.

    • You are also free to make comments “off record” in which case we will only consider them as background.

  • We have scheduled this meeting to last [x] minutes. If you need to stop for any reason, that is fine. We know you are busy and may schedule a follow up interview or e-mail you to address any unanswered questions. We appreciate your participation.

• We have a member of our team from NORC taking notes so we can write our reports, and we would like to make an audio recording to help make sure we capture everything correctly. The notes and recording will only be used by NORC to write our reports.

• Do you offer your consent to participate in the interview, and are you okay with us recording our conversation?

• Do you have any questions before we begin?

This survey is authorized under 42 U.S.C. 299a. The confidentiality of your responses to this survey is protected by Sections 944(c) and 308(d) of the Public Health Service Act [42 U.S.C. 299c-3(c) and 42 U.S.C. 242m(d)].  Information that could identify you will not be disclosed unless you have consented to that disclosure. Public reporting burden for this collection of information is estimated to average XX minutes per response, the estimated time required to complete the survey. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number.  Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: AHRQ Reports Clearance Officer Attention: PRA, Paperwork Reduction Project (0935-XXXX) AHRQ, 5600 Fishers Lane, Room #07W42, Rockville, MD 20857.

Opening

• Could you please start by introducing yourself, and your organization?

• What is your personal or organizational experience with CDS development and/or implementation?

• How had you heard of CDS Connect, and how did you get involved with it?

• What is your understanding of PC CDS?

  • How important is it for CDS tools/artifacts to have incorporated patient or caregiver preferences?

• To what extent do you think the PCOR CDS Initiative has made a contribution to the development of this type of CDS?

  • What about CDS Connect specifically?

• Could you please tell us which, if any, of the CDS Connect resources you have used?

  • Repository, Authoring tool? Github?

  • Do you have confidence in the reliability of the resources?

Workgroups

• We understand from the publically available meeting minutes that you participated in CDS Connect workgroups.

  • How often did you participate?

  • Is there any reason why you participated in some sessions and not others?

• What was your experience like participating in these workgroups?

  • What did you like about participating?

  • Is there anything you were hoping to learn about or gain from participating that you did not? If so, what?

• To what extent did you contribute to the design of the CDS Connect Repository through the workgroups?

  • What specific role did you play?

• Did your participation in these groups inform your or your organization's development or implementation of CDS?

Repository

• Did you find the CDS Connect website easy or challenging to navigate?

  • Are there any additional features or tools that would be useful to include?

• Our understanding is that one of the primary goals of CDS Connect was to build a trusted platform to disseminate evidence-based CDS. How did you define or think about "trust" in the context of the CDS Connect Repository?

  • Does this change when you think about the perspective of the Consumer vs Contributor?

• What features or characteristics of the Repository help engender trust of Participants?

• What issues or concerns have you faced with trust since the development of CDS Connect, and to what extent do you believe that at this time the platform is trusted for the successful dissemination of CDS? Please describe why or why not.

• Were there any particular lessons learned or recommendations that you could draw from these experiences related to developing CDS or a repository of CDS?

Contributing

• Have you ever considered contributing an artifact to the Repository?

  • What factors influence your decision to submit artifacts to CDS Connect?

• What do you think are the main reasons someone might choose to contribute an artifact to CDS Connect versus another CDS repository?

Consuming

• Have you used any of artifacts from CDS Connect? How?

  • Did the artifacts meet your need?

  • Did you adapt them for local use?

  • Were you able to implement the adapted artifact in a local environment?

    • How is that implementation going? What kinds of outcomes do you see?

    • Did using an artifact from the Repository affect the time or effort required to develop the artifact?

    • If no, why not?

• What do you feel are the main reasons someone might choose to use an artifact from CDS Connect Repository versus another CDS repository?

• Are there certain types of stakeholders who are more or less likely to use artifacts from CDS Connect? Why?

• What are the barriers and facilitators to using publically available CDS artifacts such as those available through the CDS Connect repository?

Authoring Tool

If informant is on list of registered users of Authoring Tool and responds that they used the authoring tool above:

• We understand that you registered to gain access to the Authoring Tool. Have you ever used the CDS Connect Authoring Tool to develop the CDS logic for a CDS artifact? Did you use it to develop the logic for the artifact that you submitted to the CDS Connect Repository?

  • Can you describe how you used the Authoring Tool? What did you like about the tool? What did you not you like about using the tool?

  • Would you use it again? Why/Why not?

If informant is on NOT on list of registered users of Authoring Tool and responds that they do not use the authoring tool above:

• Have you heard of the CDS Connect Authoring tool? If yes, is there a reason why did you not use the tool?

  • Would you consider using it in the future?

  • Is there another resource or tool you would use instead to develop CDS logic, and why?

GitHub Open Source Resources

• Are you aware of the CDS Authoring Tool and CDS Connect API open source resources that are on GitHub?

  • If yes, have you ever used them? How?

  • What did you find helpful or not helpful about these resources?

  • What are the benefits to making resources like this available on open source repositories like GitHub?

Impact

• To what extent do you think that CDS Connect is a valuable set of resources and why?

  • What challenges do you see with either using it, or with the entire concept of it?

  • Do you have any recommendations for it?

• To what extent do you feel that CDS Connect has been disrupting the field of CDS development and encouraged more developers to make shareable, standards-based interoperable CDS? Why?

Sustainability

• What would you like to see become of CDS Connect in the future? Would you like to see it be sustained, and how?