NIST ITL User Experience with Smart Home Devices - Part 2 - Information Collection

NIST Generic Clearance for Usability Data Collections

0693-0043-IoTSmartHomeDevices-InterviewQuestions-3-4-19

NIST ITL User Experience with Smart Home Devices - Part 2 - Information Collection

OMB: 0693-0043

Document [docx]
Download: docx | pdf

User Experiences with IoT Devices

December 13, 2018, ITL-2018-0118

OMB Control #0693-0043

Expiration Date 3/31/2022


Interview Questions

SECTION A: Terminology

  1. You may have heard the term “internet of things,” or IoT for short. Can you talk a little about what you think the internet of things is?



  1. You may have heard the term “smart devices.” What about devices makes them “smart?”



  1. What does it mean to have a smart home?



  1. What do you think is the relationship, if any, between the internet of things and smart devices?



SECTION B: Purchase and General Use

[Very briefly review devices, hubs, and virtual assistants that participant listed in the screener.]

When answering the interview questions, please talk about your overall or general experiences with your devices. So, there’s no need to answer a question separately for every device you own. However, if you had any particularly notable or different experiences with specific devices, please do mention those.

  1. Who was involved in the decision to purchase the smart home devices?



  1. What are the reasons the smart home devices were purchased?

  • [If participant doesn’t mention sources of information:] How did you [or a household member] learn about the devices before buying them?



  1. What hesitations, if any, did you have about getting the devices prior to purchase?



  1. For what purposes do you use your smart home devices?



  1. How do you access the devices – remotely with an app, while physically in the home, or both?

  • [If using a virtual assistant:] How do you access your devices using [insert assistant name]?

  • [If using a hub:] Do you use the hub app to access your devices, or do you use an individual app specific to each device?

  • How do others in your household use the smart home devices?



  1. What do you like most about the devices?

  • What are the benefits, if any, of having these devices?



  1. What do you like least or dislike about the devices?



  1. How have your opinions or expectations of the devices changed, if at all, from the time you first used them until now?



  1. What concerns, if any, do you have about the devices?



  1. In what ways, if any, have you changed your behaviors because of your smart home devices?



  1. In what ways, if any, have you become reliant on your smart home devices?



  1. What do the other members of your household think about the smart home devices?



  1. Have you had visitors to the home who have had to use the smart home devices?

  • [If yes:] How did they use the devices?

  • What did they think?



  1. What smart home devices, if any, have you had in the past, but are no longer using?

  • What are the reasons for no longer using this device?



  1. What kinds of things would you like to be able to do with your devices, but haven’t, don’t know how, or are not sure that you can?



  1. What devices would you like to get in the future? For what reasons?





SECTION C: Installation and Troubleshooting

  1. Who installed the smart home devices?



  1. Who administers (configures or maintains) the smart home devices?



For Installers:

  1. In general, what was your experience with the installation of the devices?

  • What went well?

  • What didn’t go as well?



  1. Have you ever had to reinstall a device? If so, what were the reasons for the reinstallation?



  1. [If have more than one device:] What has been your experience adding additional devices to the home?



For DIYers:

  1. In the screening questionnaire you indicated you build your own or create extensions for your smart home devices and platforms. Can you briefly summarize what you’ve done?



For Administrators:

  1. What configuration changes, if any, have you made to the devices since installation?

  • [If participant makes configuration changes:] How often do you make changes?

Let’s now talk about manufacturer updates to your devices. These could be updates that fix known issues or updates to the next version of software or firmware.

  1. How do you know that updates are available or needed?

  • How are updates done on your device - automatically or do you have to initiate them?

  • [If manual initiation:] How often do you check for updates?

    • How do you decide whether to update or not update?



For Everyone:

  1. How do you try to figure out how to do something new with your devices?

  • What sources do you consult or use?



  1. What kinds of problems, if any, have you encountered while using your smart home devices?

  • How did you go about trying to resolve those problems?

SECTION D: Privacy

  1. What type of information, if any, do you think the devices are collecting?

  • Which of this information, if any, would you consider to be personal?



  1. Where do you think the information goes?



  1. In what ways, if any, does your device or the device manufacturer provide a means to control or manage what information is collected and how it is shared?



  1. What are your concerns, if any, about how information is collected, stored, and used and who can see that information?

  • In what ways, if any, have you acted to minimize or alleviate some of those concerns?

  • What kinds of actions would you like to be able to take to address your concerns, but haven’t, don’t know how, or are not sure that you can?



  1. Who do you think is responsible for protecting the privacy of information collected by your smart home device?



SECTION E: Security

For this next set of questions, when I am talking about security, I don’t mean physical security like someone breaking into your home. Rather, I’m referring to how the devices protect your information from people who might try to access your devices without your permission or even someone in your household who might do something purposefully or accidentally.

  1. What are your concerns, if any, about the security of your devices?

  • In what ways, if any, have you acted to minimize or alleviate some of those concerns?

  • What kinds of actions would you like to be able to take to address your concerns, but haven’t, don’t know how, or are not sure that you can?



  1. What restrictions, if any, are placed on who in your home can use the devices and what they can do?



  1. How do you authenticate to or get into any apps associated with the device? [If not sure how to answer:] for example, password, PIN, fingerprint, face recognition

  • What issues or problems, if any, have you experienced with authentication?



  1. Does more than one person in your household use an app to access the same device?

  • Does more than one person use the same account and authentication to access the app?

  • What concerns, if any, do you have with multiple people having access to the app?



  1. Who do you think is responsible for the security of your smart home devices?

SECTION F: SAFETY

For the next two questions, when I talk about safety, I’m referring to the physical safety and well-being of the people and items in your household.

  1. In what ways, if any, do you think the devices contribute to safety?



  1. In what ways, if any, do you think the devices might pose a safety risk?



SECTION G: Conclusion

  1. Is there anything else you’d like to add related to anything we’ve talked about?











This collection of information contains Paperwork Reduction Act (PRA) requirements approved by the Office of Management and Budget (OMB). Notwithstanding any other provisions of the law, no person is required to respond to, nor shall any person be subject to a penalty for failure to comply with, a collection of information subject to the requirements of the PRA unless that collection of information displays a currently valid OMB control number. Public reporting burden for this collection is estimated to be 60 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed and completing and reviewing the collection of information. Send comments regarding this burden estimate or any aspect of this collection of information, including suggestions for reducing this burden, to the National Institute of Standards and Technology, Attn: Susanne Furman at [email protected] or 301-975-3271. OMB Control #0693-0043, expiration date 3/31/2022.



File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
File Modified0000-00-00
File Created0000-00-00

© 2024 OMB.report | Privacy Policy