Form Attachments A-D Attachments A-D Interview Protocol

Appendix A: Introduction

• Hi! Thank you for coming in today.

• I have a couple colleagues in the next room that will be observing and taking notes.

• Explanation of the study purpose:

  • Today we’re going to be testing a part of the Consumer Expenditure survey. This survey collects information about how US households spend their money. We currently ask people to complete a paper diary to keep track of expenses, but with the increased use of the Internet, we want to give people the option of entering this information on their computers and smartphones. Today we’ll be working with a desktop Internet version and a mobile Internet version of the website.

  • It’s important to note that this is not a test of your ability. Our purpose today is to find out how easy or difficult it is to use the diary and to identify ways to improve it. Your feedback now can help make our future work more productive.

• Consent Form and permission to audiotape

• Any questions before we begin?

Appendix B: Screenshots of Mobile and Web Diaries

Login	Initial Setup	Expense Summary
Common Entry	Food Away From Home	Food At Home

Clothing	Other Expense	Edit Expense

Login

Initial Setup

Expense Summary

Common Entry

Food Away From Home

Food At Home

Clothing

Other Expense

Appendix C: Interview Protocol

NOTES: Dates highlighted in yellow will change depending on timing of the testing and the date range set in the diary.

Rows shaded in green note where there is a change between the Web and Mobile diary.

Diary Task Instructions

Now I’m going to ask you to complete a series of tasks using both the mobile and computer diary. We are trying to simulate what it would be like for you to complete the diary. If you have any questions while we’re going through, remember that there are materials here and help menus within the diary.

Do you have any questions before we begin?

	Task Title and Instructions	Group 1	Group 2
1.	Navigate to Website and Log In	Mobile	Web
	Let’s get started. First, I’d like you to use [this computer/your smartphone] to navigate to this website and log into the diary using this Username and Password… CE Mobile Diary URL: http://respond.census.gov/poc Username: [FILL USERNAME] Password: [FILL PASSWORD]
2.	Set Start Date	Mobile	Web
	Next, you will see a screen asking you to select your start date. Please select January 20th as your start date. Below the start date, you will see that we ask for your e-mail address. You can skip that box. Please select the “Continue” button.
3.	Enter Own Food Expense	Mobile	Web
	Think back to the last purchase you made, other than food. Please add that item to the diary as if the purchase was made on January 21st.
4.	Navigate to Website and Log In	Web	Mobile
	Now, I would like you to navigate to the website using [the computer/your smartphone] and login. You can use the login information I gave you earlier.
5.	Enter Own Non-Food Purchase	Web	Mobile
	Think back to the last food purchase you made. Please add that item to the diary as if the purchase was made on January 21st.
6.	Enter Book for Friend, Enter Jeans for Self	Web	Mobile
	On January 22nd, you go shopping and buy a book for a friend and a pair of jeans for yourself. Here are the receipts. Please enter these expenses into the diary.
7.	Enter Dinner, Enter Movie	Web	Mobile
	After shopping, you go to dinner and a movie with a friend and you pay for both. You decide to enter the purchases into the diary [as you’re waiting for the movie to begin/once you get home]. Here is your ticket stub and the receipt from dinner.
8.	Enter Car Insurance Bill	Web	Mobile
	On January 23rd, you pay your car insurance bill online. This is the billing statement. Please enter this expense into the diary.
9.	Change Book Details	Web	Mobile
	You also decide that, rather than give the book to your friend, you are going to keep it for yourself. Please update that item to reflect that the book was purchased for you.
10.	Switch Modes	Mobile	Web
	We will now switch to the [computer/smartphone]. Please open the diary and login on that device.
11.	Delete Pants	Mobile	Web
	On the 24th, you decide to return the pants that you had bought. Please go back and delete that item.
12.	Enter Shoes	Mobile	Web
	While you’re out returning the pants, you stop at Percy’s department store and buy a pair of running shoes. Here is the receipt. Please enter the shoes into the diary.
13.	Enter Multiple Items
	On January 25th, you go shopping for groceries. Here is the receipt.
14.	Enter Food Away Expense	Mobile	Web
	On January 26th, you stop at a coffee shop on your way to work and pick up breakfast; coffee and a bagel. Here is your receipt.
15.	Enter Long Receipt	Choice	Choice
	For the next task, you can enter the information on either the computer or mobile version. Whichever you think will be easier for you. On the 25th, you go to the Val-U-Mart superstore to buy a few things for your house – enter your expenses from this receipt

Appendix D: Follow-up Questions

1. What did you think of the mobile diary?

1. Was it easy or difficult to use? Very Easy, Somewhat Easy, A Little Easy, Neither Easy nor Difficult, A Little Difficult, Somewhat Difficult, Very Difficult

2. How confident did you feel in filling out the entries in the diary? Not at all Confident, A Little Confident, Somewhat Confident, Very Confident, Extremely Confident

2. What did you think of the computer diary?

1. Was it easy or difficult to use? Very Easy, Somewhat Easy, A Little Easy, Neither Easy nor Difficult, A Little Difficult, Somewhat Difficult, Very Difficult

2. How confident did you feel in filling out the entries in the diary? Not at all Confident, A Little Confident, Somewhat Confident, Very Confident, Extremely Confident

3. Did you prefer one version over the other?

   1. Which One?

   2. Why?

4. If you had a choice between the versions you just used and a paper diary, which would you prefer? Why?

5. Imagine that you agreed to keep track of your expenses for a week. Do you think you would use one of these versions more than the other?

1. About what percentage of the time would you use the Mobile version? How about the computer version?

2. Do you think you would use one or the other in certain situations? Tell me more about that.

6. Is there anything you would change about either version of the diary?

   1. Are there any functions or features that would make either of them better or easier to use?

1