Cognitave Think-Aloud Interviews

Qualitative Testing of Mortgage Servicing Related Model Forms and Disclosures

DDT Servicing Protocol 2-21-2012

Cognitave Think-Aloud Interviews

OMB: 3170-0018

Document [zip]
Download: zip | pdf


Design and Testing of Mortgage Servicing Disclosures:

Protocol for In-Depth Cognitive Interviews

Introduction (2 minutes)

My name is ___________ and I work for a company called ICF International. We are a research company that conducts interviews and focus groups on behalf of different organizations across the country. For this specific project, we are working on behalf of the Consumer Financial Protection Bureau. The Consumer Financial Protection Bureau is a new agency of the Federal government whose role is to make markets for consumer financial products and services work for Americans — whether they are applying for a mortgage, choosing among credit cards, or using any number of other consumer financial products. Today, we are going to be talking about several topics related to mortgages, and I’m going to ask you to review a few documents. I want to be clear up front that I am not an expert in this topic—you can ask me questions, but I may not be able to answer them. This interview will take no more than 60 minutes, and you may take a break and step out or end the interview at any time.


Before we begin, have you had an opportunity to read and sign the informed consent? Do you have any questions about it?


I’d like to remind you of a few things that were on that document.

  • We will be videotaping this discussion, to make sure we don’t miss anything that you say.

  • Behind the glass, there are people observing this interview from both the Consumer Financial Protection Bureau and my company, ICF International.

  • Everything that you say in this discussion will be private. Your name will never be used in any of our reports.


Do you have any questions before we begin?

Section I: Background Information (5 minutes)

Let’s begin by talking for a few minutes about your experience with mortgages.

  1. Do you have a mortgage?

    1. If Yes: How long have you had it?

    2. How close are you to paying it off?

  2. Tell me a little about the terms of your mortgage.

    1. Is your interest rate fixed, or can it change?

  3. Is this your first mortgage?

    1. If no: Tell me a little about your other mortgages. Were they different from your current mortgage loan in any way? If so, how?


  1. Do you get statements about your mortgage payment? Do you get them by mail or do you get them delivered electronically?

    1. What do you do with those statements when you get them?

    2. How closely do you read those statements? If you don’t read them, did you used to read them when you first got the mortgage?

    3. What information do you look at on the statement?

Section II: Periodic Statement (18 minutes)

At this point I would like you to imagine that you have a mortgage with a company called “Springside Mortgage.” I’d like you to imagine that you just received your mortgage statement for this month in the mail. I would like you to review this document just like you do your actual statement. As you are reading, I want you to “think aloud.” By that, I mean that I would like you to describe what you are thinking as you read. In particular, let me know if you read anything that you find surprising, interesting, or confusing.

Before you start reviewing the periodic statement, I want to let you know that last month you were a little short on money, so you didn’t make your full mortgage payment.

Give participant the periodic statement. Give him or her a few minutes to read while thinking aloud. When he or she is finished, continue.

  1. If this were your statement, is there any information that would catch your attention or be particularly important to you?

  2. Is there anything you found confusing or unclear about this monthly statement?

    1. Are there any questions you would have if this were your statement?

Now I’d like to ask you some specific questions about the information presented in this document. But before I do, I want to make sure you understand that I’m not testing you or your knowledge. The reason I’m asking the questions is because I want to see how easy the statement is to read and understand. So you are free to look at the statement when you’re answering the questions.

Based on the information in this monthly statement:

  1. How much is Springside Mortgage expecting you to pay this month?

    1. What is your regular monthly payment—that is, the amount that you are normally expected to pay each month?

    2. Why are you being asked to pay more this month? (Probe to see if participant is aware that (a) they were charged fees; and (b) they have to pay the remainder from last month.)

  2. When is this payment due?

  3. Were you charged any fees in the past month?

    1. If so, why were those fees charged?

  4. What is the interest rate on your mortgage?

  5. Is that interest rate going to stay the same, or might it change in the future?

    1. Why? What makes you say that?

    2. [If participant indicates that the rate could change] When is the soonest your interest rate could change?

  6. What is the total amount of money that you owe Springside Mortgage?

    1. Did the bank receive your payment last month? How do you know? How much did you pay last month?

    2. What did Springside Mortgage do with the money that you paid last month?

      1. Did they use it to pay down the amount of your loan?

      2. [If participant is unsure] What do you think they did with the money, based on what you see here?

    3. Point out the fact that last month’s payment is listed in a row labeled “Partial Payment (Unapplied)”. What do you think this means?

  7. Imagine that you won the lottery and wanted to pay off your mortgage entirely this month. Would Springside Mortgage charge you any fee for doing so?

    1. How do you know? What would be the size of that fee?

    2. Would you owe a fee if you paid off your mortgage in the year 2015? Why or why not?

  8. How much money have you paid in interest so far this year?

  9. Imagine that you were having trouble paying your mortgage. What would you do?

    1. Are there organizations that could give you advice on what to do?

    2. How could you contact these organizations?

    3. [If necessary] Is there any information on this statement about how you could contact an organization to get advice?

The Consumer Financial Protection Bureau is responsible for making rules that tell mortgage companies what information they have to put on monthly statements.

  1. Is there any additional information that you think should be included on monthly statements because it would be helpful for borrowers to know?

  2. With that in mind, do you have any suggestions for how they could make this document clearer or more useful?

Section III: Hybrid ARM Reset Notice (15 minutes)

[Take away periodic statement.] Now I’d like you to assume that you had a different mortgage loan through Springside Mortgage. Imagine that you have had that mortgage for about two and a half years. Imagine also that the interest rate on your mortgage has so far been fixed at 4.25%, and has never changed. One day, you receive an envelope from Springside Mortgage with a document in it. As we did before, I’d like you to review this document just as you would if you had received it in the mail, and to “think aloud” as you go through it.

Give participant the hybrid ARM rate reset notice. Give him or her a few minutes to read while thinking aloud. When he or she is finished, continue.

  1. In a couple of sentences, explain what this document is telling you.

    1. What is going to happen?

    2. When is it going to happen?

  2. Is there anything you found confusing or unclear about the document?

Again, I’d like to now ask you some specific questions about the information in this document.

  1. What does this notice tell you about the terms of the mortgage you originally signed up for?

    1. If participant merely responds that they signed up for an “adjustable rate mortgage,” probe to see if they understand what that means—i.e., that their rate was fixed for the first three years, and then becomes adjustable.

  2. According to this letter, when are your rate and payment scheduled to change?

If participant does not know that their rate could change in six months, point this out to them at this point.

  1. Do you think your rate could change before August 20? How do you know?

    1. Do you think your rate could change again after August 20? How do you know?

      1. [If participant understands that rate will continue to change] How often will your rate change after August 20?

  2. What do you think your interest rate and payment are going to become on August 20?

    1. [If participant identifies the estimated rate and payment] Will this definitely be your interest rate and payment, or might your rate and payment actually be different on that date? How do you know?

  3. Does Springside Mortgage decide what your interest rate will become on August 20? Why or why not?

    1. [If yes] If they wanted to, could Springside Mortgage decide to make your interest rate 6.00% on that date, instead of 5.75%? Why or why not?

    2. [If no] If Springside Mortgage doesn’t decide what your rate becomes, what does determine what your rate will be?

    3. [If respondent indicates that their interest rate is based on an index] Does Springside Mortgage control what the index/LIBOR rate will be? If not, what does determine what the index/LIBOR rate will be?

    4. If participant does not understand that their interest rate is based on an index, ask them to re-read the Interest Rate section of the notice. Please explain what this is saying in your own words.

      1. According to this, how is your interest rate determined?

      2. [If not already asked] Does Springside Mortgage control what the index/LIBOR rate will be? If not, what does determine what the index/LIBOR rate will be?

  4. If you felt that you might not be able to make your future mortgage payments, what would you do?

  5. [If necessary] Imagine that you decided you wanted to talk to a counselor about your financial situation. Who would you contact?

    1. Is there any information on this document about who you could contact to get help, and how you could contact them?

    2. Which of the organizations on this list would you contact?

      1. What kinds of help do you think these organizations could provide?

  6. Imagine that you got this document and decided that you did not want to have this mortgage if the rate was going to start changing. What could you do?

    1. If participant does not mention the list of alternatives: Is there anything else you could do?

    2. If participant still has not noticed the list of alternatives, point it out to him or her. For each alternative on the list provided by the document, ask:

      1. In your own words, what does this mean? What would happen if you pursued this alternative?

The purpose of this document is to inform a mortgage borrower that his or her mortgage interest rate is going to become adjustable. The Consumer Financial Protection Bureau is going to require that mortgage companies send this document to alert borrowers when this is going to happen for the first time. To help consumers, the Consumer Financial Protection Bureau wants to make sure that the information is clear and easy to understand.

  1. Is there any additional information that should be included on this document because it would be helpful for borrowers to know?

  2. Do you have any suggestions for how they could make this document clearer or more useful?

Section IV: Force-Placed Insurance (FPI) Notice (10 minutes)

[Take away previous documents.] Now I’d like you to imagine that you again had a loan with Springside Mortgage, and again one day you received an envelope that said “Springside Mortgage” on it, and inside it was a document. As we did before, I’d like you to read this document as you would if you had received it in the mail, and to “think aloud” as you go through it.


Hand participant the FPI notice. Give him or her a few minutes to read while thinking aloud. When he or she is finished, continue.

  1. In a few sentences, explain what this document is telling you.

  2. What would be your reaction to this document if you received it? Why?

  3. Is there anything you found confusing or unclear about the document?

  4. What would you do if you received this document in the mail?

    1. Why would you do that?

    2. Do you think it would make any difference how quickly you did it? Why?

  5. [WP Version Only] According to this document, if you don’t do anything what could happen?

    1. When could this happen?

    2. What impact could it have on you?

    3. If you did not want Springside Mortgage to purchase insurance for you, what could you do?

  6. [AP Version Only] If you wanted Springside Mortgage to cancel the insurance it took out for you, what could you do?

  7. Imagine that after you got this letter you called your insurance company and learned that your insurance really had expired. What would you do?

    1. [If participant indicates that he or she would renew policy, or would get another policy] Why would you want to get your own policy, if the letter already says that Springside Mortgage [purchased (AP version)/may purchase (WP version)] insurance on your behalf?

  8. Again, imagine that after you got this letter you called your insurance company, and it turned out that your policy had expired. You then renewed your policy, but not before there was a one-week period during which you didn’t have your own insurance. You then sent proof of insurance to Springside Mortgage. Assuming that Springside Mortgage had taken out insurance for you during that one week that you didn’t have your own insurance, could they charge you for that week? How do you know?

    1. Now imagine that there was a week of overlap, during which both you and Springside Mortgage had insurance policies on your house. Could they charge you for that week of coverage? How do you know?

The purpose of this document is to inform the mortgage holder that Springside Mortgage has no evidence that there is homeowners’ insurance on the property, and that if they do not receive that evidence they will go ahead and get their own insurance. Because this is important information for mortgage holders, the Consumer Financial Protection Bureau wants to make sure that it is clear and easy to understand.

  1. Is there any additional information that you think should be included in the document because it would be helpful for borrowers to know?

  2. With that in mind, do you have any suggestions for how they could make this document clearer or more useful?

False Close and Conclusion (10 minutes)

Interviewer will excuse him or herself and tell the participant that he or she is going to speak with the observers to see whether they have any follow-up questions. If observers have follow-up questions or topics to revisit, the remainder of the interview should be spent addressing those questions or topics. At the conclusion of the interview, thank the participant for their assistance and lead them to the front desk.


Page 6


File Typeapplication/zip
File Modified0000-00-00
File Created2021-01-31

© 2024 OMB.report | Privacy Policy