Department
of Education
Customer
Satisfaction Program App.
B:
COD (FinalFinalDraft 14Final)Approved Survey Examples
U.S. Department of Education
(Items in BOLD are interviewer instructions, and are not intended to be read to the Client)
(Items marked i.e. or e.g. should only be read if respondent needs clarification)
Note: There are three separate lists used for this study: Direct Loan, Pell and those that are both Direct Loan and Pell. As a general rule, each will have the appropriate contact and an FAA contact in addition. When calling:
if it is a Direct Loan school, first use the Direct Loan contact, then the Pell (if provided), then the FAA contact
if it is a Pell school, first use the Pell contact, then the Direct Loan (if provided), then the FAA contact
if it is considered both, first use the Direct Loan, then Pell, then FAA
Hello, this is
____________________ calling from [data vendor] on behalf of the
United States Department of Education. May I please speak to
(name from list)?
(If necessary: We’re
calling as part of an initiative the Department has undertaken to
improve its customers’ satisfaction.)
1 (If
speaking to right person, continue at INTRO4INTRO2)
2 (If
asked to hold and wait for correct person, proceed at INTRO4 INTRO2
when
respondent
comes to phone)
3 (If
named person is not available, schedule callback)
4 (If
named person is no longer at this number, use
next contact provided)
5 (In
no such person, use INTRO3INTRO2)
9 Refused/Hung
Up
Is there another number at which I
could reach him/her? (If
necessary: We’re calling as part of an initiative the
Department has undertaken to improve its customers’
satisfaction.)
1 (Take
number) >>
Thank you and have a good
day! (Contact new number)
May I please speak to theAre you the person in your organization responsible for interactions with the U.S. Department of Education related to student financial assistance, such as ? (If necessary: Mmatters related to the Common Origination and Disbursement process and/or coordinating financial transactions?.)
1 Yes (Go to INTRO4)
2
No >>
May I speak to this
person? (If yes, thank, and
go to INTRO1. If no, ask for contact information. If still no, dial
next contact (Direct Loan, Pell or FAA) and use INTRO1)
3
(Refused) >>
Thank you and have a good day! (Dial
next contact and use INTRO1)
(When
respondent comes to phone)
I’m calling on behalf of the United States Department
of Education. This call is part of an initiative the Department has
undertaken to improve its customers’ satisfaction. We’d
like to discuss your interaction with areas related to the Common
Origination and Disbursement process (COD). The discussion will take
about 10 minutes.
This
interview is authorized by the U.S. Office of Management and Budget
Control No.
1845-0045.
Your comments will remain strictly confidential, and you will never
be identified by name unless you choose to do so. Is now a good
time for us to speak?
1 Yes (Continue
with Next Question)
2 No (Can
we schedule a time that is more convenient for you?)
INTRO4. Are you the Pell or Direct Loan contact for your school?
1
Pell
2 Direct
Loan
3 Both
Before we begin, I’d like to ask you a few questions about yourself.
In the past 12 months, have you accessed the COD web site?
In the past 12 months, have you called COD School Relations (800-848-0978 or 800-4PGRANT) for program or technical assistance?
What type of software do you use for processing Pell and/or Direct Loans? [read list and record all that apply]
ED Express [read as “E-D Express”]
Your school’s mainframe system or another “homegrown” application
Another vendor’s software (i.e., purchased by your school)
DEMO4. How long have you been using COD? [if necessary, clarify Common Origination and Disbursement]
Less than 1 year
1 to 2 years
2 years plus
DEMO54. How many years have you used financial aidHow long have you been working in financial aid administration? [read choices]
Less than a year
2-5 years2 years to less than 51 - 3 years
Longer than 3 yearsplusor more
DEMO45. How long have you been using COD? [read choices]
Less than 6 months
6 months to less than a year
1 year to less than-to 2 years
years or moreOver 2 years
(Ask the following questions if DEMO1=Yes)
WEBINTRA How frequently do you use the COD website? [DO NOT READ CATEGORIES; listen for response and code; clarify if necessary]
At least once per day
more than once a week but less than once a day
more than once per month but less than once per week
once per month
less than once per month
Every day
More than once a week but not every day
Once a week
More than once a month
Monthly
WEBINTRB Which areas of the COD website do you visit? [read list, check all that apply]:
Student-specific access
Batch processing
Reconciliation/Cash management
Others [specify]
Think about your experience using the COD web site. Using a 1 to 10 scale, where “1” means “poor” and “10” means “excellent”, how would you rate the…
Ease of logging into the site
Ease of navigating the web site
Availability of the web site (for clarification, if needed: site not being down)
Modifications to the web site interface over the past year (i.e., the "look and feel" of the site)
(Ask the following questions if DEMO1=Yes)
Think about the content and information provided by the COD web site. Using a 1 to 10 scale, where “1” means “poor” and “10” means “excellent”, how would you rate…
The clarity of the instructions
The accuracy of the demographic information presented on the site
The accuracy of the financial information presented on the site
Your ability to readily access school reports
The ease of submitting data
The timeliness of financial data being processed
(Ask the following questions if DEMO2=Yes)
Think about the assistance you received when you have called the 800 number in the past year. Using a 1 to 10 scale, where “1” means “poor” and “10” means “excellent”, how would you rate the representative on…
Courtesy
Ability to help you with your inquiry
Providing you accurate information
Resolving your inquiry in a timely fashion
Following up on your inquiry, when needed
Explaining the cause of the problems you experienced
(Note: CSP2 and CSP4 will be reported in a separate component)
Please think about the various ways COD and the Customer Service staff communicate with you. Using a 1 to 10 scale, where “1” means “not at all useful” and “10” means “very useful”, how would you rate the usefulness of…
COMM6. What sources do you typically consult for information about COD? [listen and check all that apply]
COD “Web Messages”
The daily COD Processing update (i.e., the PDF file you can access from the COD web site’s home page)
E-mail customer service communications
IFAP [read as "eye-fap" - stands for Information for Financial Aid Professionals] web site postings
The Technical Reference
Other [specify]
COMM6a How often do you typically consult each of the sources of information you mentioned? [ask for each source noted above in COMM6 (web messages, IFAP, etc.). DO NOT READ CATEGORIES; listen for response and code; clarify if necessary]
At least once per day
more than once a week but less than once a day
more than once per month but less than once per week
once per month
less than once per month
COMM7. What is your most preferred source for information about COD? [listen and check one]
COD “Web Messages”
The daily COD Processing update (i.e., the PDF file you can access from the COD web site’s home page)
E-mail customer service communications
IFAP [read as "eye-fap" - stands for Information for Financial Aid Professionals] web site postings
The Technical Reference
Other [specify]
Now, using a 1 to 10 scale, where “1” means “not at all useful” and “10” means “very useful”, how would you rate the usefulness of…
COMM4. [If COMM6=1] The COD “Web Messages” you see when you log in to the system
[If COMM6=2] The daily COD Processing Update (i.e., the PDF file you can access from the COD web site’s home page)
[If COMM6=3] E-mail customer service communications
[If COMM6=4] IFAP [(read as "eye-fap" - stands for Information for Financial Aid Professionals]) web site postings
COMM8. [If COMM6=5] The Technical Reference
[Iif any COMM1-COMM4, or COMM8<6] What specific improvements could COD make to improve their communications with you? [capture open end response]
Now, please consider all of your job-related experiences working with the Common Origination and Disbursement process. Using a 10 point scale on which “1” means “very dissatisfied” and 10 means “very satisfied”, how satisfied are you with the COD process?
Consider now all of your expectations for working with the Common Origination and Disbursement process. Using a 10 point scale on which "1" now means "falls short of your expectations" and "10" means "exceeds your expectations," to what extent has working with COD process fallen short of or exceeded your expectations?
Now forget for a moment your experience working with the current Common Origination and Disbursement process. I want you to imagine an ideal origination and disbursement process for institutions such as yours. (INTERVIEWER PAUSE) How well do you think the current COD process compares to that ideal process? Please use a 10 point scale on which "1" means "not at all ideal," and "10" means "very close to the ideal."
In the past 6 months, have you ever complained about any aspect of the Common Origination and Disbursement process to FSA or to the Department of Education?
1 Yes
2 No
[skip to
CLOSE2a]
8 Don’t
Know [skip to
CLOSE2a]
Refused [skip to CLOSE2a]
CLOSE2.1 What was the nature of your complaint? [capture open ended response, code per below]
Length of time to resolve issue
Funding
Customer Service
Reports
Other
CLOSE2a One of the original goals for COD was to allow schools to better integrate their systems for administering Direct Loans and Pell Grants, and help them to be more efficient and student-centric. Has your school integrated or streamlined its systems as a result of the COD implementation?
Yes
No [skip to CBT1]
CLOSE2b On a scale of 1 to 10, with 1 being “Not at All” and 10 being “Very Much”, to what extent did COD facilitate the integration and streamlining of your business processes?
CBT1 [If DEMO5=1, elseotherwise skip to CLOSE3] Were you aware that FSA provides Computer Based Training or “CBT” for COD through IFAP to help you better understand COD website content, navigation and the system functionality?
Yes
No [skip to Customer Service ProcessCLOSE3]
CBT1a Have you used this Computer-Based Training?
Yes
No [skip to CLOSE3]
CBT2 On a scale of 1 to 10, with 1 being the lowest and 10 being the highest, how helpful was the CBT in improving your understanding of the COD website content, navigation and system functionality?
Are there any
specific ways that FSA could improve its service to you? (i.e.,
with respect to any aspect of the relationship between your
institution and FSA)
(enter
verbatim response)
As I mentioned at the beginning of the survey, your responses are completely confidential and your name will not be attached to your responses, unless you wish to do so. So that they may better serve you, would you like the Department of Education to see your name attached to your responses?
1 Yes
2 No
8 Don’t
Know
9 Refused
Those are all the questions I have for you today. Thank you again for your time. Have a good day!
U.S. Department of Education
Hello,
this is ____________________ calling from PGM Incorporated on behalf
of the United States Department of Education office of Federal
Student Aid. May I please speak to
(name from list)?
(If necessary: We’re
calling as part of an initiative the FSA has undertaken to improve
its customers’ satisfaction.)
1 (If
speaking to right person, continue at INTRO3)
2 (If
asked to hold and wait for correct person, proceed at INTRO3 when
respondent
comes to phone)
3 (If
named person is not available, schedule callback)
4 (If
named person is no longer at this number, use )
No such person
9 Refused/Hung Up
Is there
another number at which I could reach him/her? (If
necessary: We’re calling as part of an initiative FSA has
undertaken to improve its customers’ satisfaction.)
1 (Take
number) >>
Thank you and have a good
day! (Contact new number)
2 (Refused)
>> Thank you and
have a good day!
(When
respondent comes to phone)
I’m calling on behalf of the United States Department
of Education Office of Federal Student Aid. This call is part of an
initiative FSA has undertaken to improve its customers’
satisfaction. We’d like to discuss your interactions with FSA
on issues related to the Lender Payment Process, that is, LaRS/ED
799 [read "lars
ed 799"].
The discussion will take about 10 minutes.
This
interview is authorized by the U.S. Office of Management and Budget
Control No.
1845-0045.
Your comments will remain strictly confidential, and you will never
be identified by name unless you choose to do so. Is now a good
time for us to speak?
1 Yes (Continue
with Next Question)
2 No (Can
we schedule a time that is more convenient for you?)
Before we begin, we’d like to ask you few questions about yourself.
How would you classify your institution’s primary role related to the Department of Education?
Lender [skip to DEMO2]
Servicer
DEMO1a. How many lenders does your organization service?
Fewer than 100
100 to 999
1,000 or more
When you contact FSA, which office do you typically contact?
Washington, DC
Atlanta
Boston
Chicago
Dallas
New York
San Francisco
Other office
Have not contacted an office
In the past 12 months, have you been personally involved in submitting financial reports to FSA?
In the past 12 months, have you contacted FSA for program or technical assistance with LaRS?
How do you submit invoicing and financial information to FSA?
Web
FTP – File Transfer Protocol (SAIG) [read as four letters s-a-i-g]
Both
(Ask the following questions if DEMO4=Yes)
Think about your interaction with FSA in the process of invoicing and receiving interest and special allowance payments using LaRS. Using a 1 to 10 scale, where “1” means “poor” and “10” means “excellent”, how would you rate the…
Availability of the LaRS system
Logging into the LaRS system
Ease of navigating the system
Clarity of instructions
Accuracy of instructions
Ease of submitting information
Ease of correcting mistakes
(if DEMO1=1) Timeliness in receiving payment information
(if DEMO1=1) Accuracy of payment information
(Ask the following questions if DEMO4=Yes and DEMO1=1)
Think about your interaction with FSA in remitting funds for fees due to the Department of Education using LaRS. Using a 1 to 10 scale, where “1” means “poor” and “10” means “excellent”, how would you rate the…
Timeliness in receiving your statement of account (bill)
Accuracy of information on your statement of account
Clarity of instructions for submitting payments
Accuracy of instructions for submitting payments
Ease of submitting information
Ease of correcting mistakes
(Ask the following questions if DEMO5=Yes)
TECH1. On your last inquiry to FSA, how did you contact FSA?
1 Called
the 1-800 number
2 Called an FSA staffer directly
3 E-mail
8 Don’t
Know
Now think about the assistance you received on your last inquiry regarding LaRS. On a scale from 1 to 10, where “1” means “poor” and “10” means “excellent”, please rate the…
TECH1a. Representative’s courtesy
Representative’s willingness to help
Knowledge of the representative
Representative’s understanding of the issues that affect your business
Time it took for FSA to resolve your inquiry
TECH6. Thinking about your last inquiry, was it resolved on your first contact with FSA?
Yes
No
8 Don’t Know
Think about the communications and information you receive from FSA about LaRS, such as e-mail alerts and information provided via IFAP [pronounce as “Eye-Fap”] or the Financial Partners Web Portal. Using the same 1 to 10 scale, how would you rate the communications on being:
Timely
Informative
Useful
Accurate
What sources do you typically consult for information about LaRS? [listen and check all that apply]
IFAP [pronounce as “Eye-Fap”]
The FSA Financial Partners Web Portal
E-mail alerts
Other [specify]
Now, please consider all of your job-related experiences working with the LaRS process. Using a 10 point scale on which “1” means “very dissatisfied” and 10 means “very satisfied”, how satisfied are you with the LaRS process?
Consider now all of your expectations for working with the LaRS process. Using a 10 point scale on which "1" now means "falls short of your expectations" and "10" means "exceeds your expectations," to what extent has working with the LaRS process fallen short of or exceeded your expectations?
Now forget for a moment your experience working with the LaRS process. Imagine an ideal process for providing federal loan program support for institutions such as yours. How well do you think the LaRS process compares with that ideal process? Please use a 10 point scale on which "1" means "not very close to the ideal," and "10" means "very close to the ideal."
In what department do you work?
1 IT
2 Accounting
3 Loans
4 Other (specify)
How would you characterize your familiarity with computers?
1 Novice
2 Moderate
Expert
DEMO8a How long have by been filing invoicing and payment requests (799 or LaRS) with the Department of Education? [read and record appropriate choice]
Less than 1 year
1 year to less than 5 years
5 years or more
How would you characterize your Internet connection at work?
1 Dial
up, accessibility to any site
2 Dial up, limited access to
non-approved sites
3 Broadband, accessibility to any site
4
Broadband, limited access to non-approved sites
5 Other
(specify)
CLOSE1. On a scale from 1 to 10, where 1 is “not at all confident” and 10 is “very confident”, how confident are you in the accuracy of the information in the FSA systems, including LaRS?
CLOSE2. In the past 6 months, have you ever complained to the Department of Education regarding LaRS or FSA’s administration of the student loan program?
1 Yes
2 No
CLOSE3. Finally,
are there any specific ways FSA could improve its service to you?
(i.e., with respect to any
aspect of the relationship between your institution and FSA)
(enter
verbatim response)
Thank you again for your time. To complete the survey and submit the results, please hit the “Finish” button below. Have a good day!
U.S. Department of Education
2006 FAFSA on the Web Questionnaire
(Items in BOLD are interviewer instructions, and are not intended to be read to the Client)
(Items marked i.e. or e.g. should only be read if respondent needs clarification)
Hello,
this is ____________________ calling from _____ on behalf of the
United States Department of Education. May I please speak to
(name from list)
? (If
necessary: We’re conducting a customer satisfaction survey and
are trying to contact people who have completed the FAFSA form via
the Department of Education website. FAFSA is the form most people
fill out to determine their eligibility for federal loans, grants,
and work-study.)
1 (Named
person is on the phone, continue at INTRO4)
2 (Named
person is available, proceed at INTRO2.
when respondent comes to phone)
3 (Named
person is unavailable, schedule callback)
4 (Named
person is no longer this number, use )
9 Refused/Hung
Up
Is
there another number at which I could reach him/her? (If
necessary: We’re conducting a customer satisfaction survey and
are trying to contact people who have completed the FAFSA form via
the Department of Education website. FAFSA is the form used to
determine a student’s eligibility for federal loans, grants,
and work-study.)
1 (Will
provide new number) >>
Thank you and have a good
day? (Contact new number)
2 (Refused
to provide new number) >>
Thank you and have a good day!
(When
respondent comes to phone)
Hello, this is [interviewer
name]
calling from [data vendor], a market research firm calling on behalf
of the United States Department of Education. (Continue)
We’re calling as part of an initiative the U.S. Department of Education has undertaken to improve its customers’ satisfaction. Have you completed the Free Application for Federal Student Aid, or FAFSA form, via the Department of Education’s website in the past two months? (if necessary: FAFSA is the form used to determine a student’s eligibility for federal loans, grants, and work-study.)
1 Yes (Continue
at INTRO2.)
2 No Thank
you, but, for purposes of this study, we would like to talk to people
who have recently used the department’s website to fill out the
FAFSA form. Have a nice day.
Don’t know
Refused
The Department of Education is conducting this survey with customers such as you to measure satisfaction with its products and services. I’d like to take some time now to go through this survey with you. This interview is authorized by the U.S. Office of Management and Budget, Control No. 1845-0045. Your comments will, of course, remain strictly confidential. The discussion will take about 10 minutes. Is this a good time?
1 Yes (Continue
with Next Question)
2 No (When
would be a more convenient time for you to complete this study?)
Please keep in mind that all the questions we will be asking on the rest of this survey pertain to the FAFSA website.
Let’s start out by thinking about the home page for the FAFSA site. This is the first page you see when you go to FAFSA on the web. On a scale from 1 to 10, where “1” means “poor” and “10” means “excellent”, how would you rate…
The ease of reading the home page
The clarity of the home page’s organization
Your ability to find what you needed
The ease of navigating to the right place
Now think about your experience filling out the FAFSA application online. On a scale from 1 to 10, where “1” means “poor” and “10” means “excellent”, how would you rate…
The clarity of the instructions for filling out the FAFSA
The clarity of the questions
The ease of navigating through the application pages
Your ability to save and retrieve your application
The clarity of the instructions for submitting the FAFSA
The usefulness of the information on the confirmation page (i.e. the page you are taken to after you submit your application)
WORK1 Did you use the FAFSA on the Web worksheet prior to filling out the FAFSA form?
1 Yes
2 No (skip
to GHELP1)
WORK2 Where did you obtain the worksheet? [listen and code as appropriate, clarify if needed]
1 High School/High School
counsellor
2 College/University/Postsecondary school
3 Public library
4 Online
5 Other
(please
specify)
8 Don’t
Know
9 Refused
WORK3 Using the 1 to 10 scale where “1” now means not at all helpful and “10” means very helpful, how helpful was it to you to fill out the worksheet prior to submitting the FAFSA?
Please think about the ways you could get help filling out the FAFSA form online. These include online Frequently Asked Questions (FAQ's) and help text; the 1-800 number, and the online live help. On the same 1 to 10 scale, with 1 as “poor” and 10 “excellent”, please rate FAFSA on the web on:
GHELP1 The variety of the options for getting help
When you filled out the FAFSA, did you actually access any of the following forms of help? (yes/no)
ONLINE The online FAQs and help text (i.e., the text you could reach for help on specific questions by clicking on the question mark next to the item)
1800 The 1-800 number
CHAT The online live help
(if ONLINE, 1800, or CHAT = yes) Let’s now consider the help you received. On a scale of 1 to 10, where “1” means “poor” and “10” means “excellent”, how would you rate…
How informative the help was
The time it took to answer your question
The clarity of the information you received
(if 1800 or CHAT=yes) Courtesy of the representative who helped you
(if 1800 or CHAT=yes) Hours of operation of the help desk
(if 1800 or CHAT=yes) Was the issue you sought help for resolved on your first contact with FAFSA on the Web?
Yes
No
We now have a few questions about obtaining and using a Personal Identification Number, or PIN, to electronically sign applications and to access and fully utilize the Department of Education's web-based features.
PINAP1. While you were on-line filling out your FAFSA form, did you apply for a PIN?
1 Yes
2 No
(skip to next
section)
3 Already
have a PIN (skip to
PINAP2)
8 Don’t
Know (skip to next
section)
9 Refused (skip to next section)
Think about the PIN application process. On a scale of 1 to 10, where “1” means “poor” and “10” means “excellent”, how would you rate…
The ease of applying for the PIN
The turnaround time for receiving the PIN
Ease of getting a replacement or duplicate PIN
PINUSE1. Did you use a PIN to sign your application electronically?
1 Yes
2 No
(skip to
PINUSE4)
8 Don’t
Know (skip to
PINUSE4)
9 Refused (skip to PINUSE4)
Using the same 1 to 10 scale, how would you rate…
The ease of using the electronic signature process
The ease of having your parents sign electronically
Did you know that you can use your PIN to view your data or make corrections to your FAFSA information?
1 Yes
2 No
(skip to next
section)
8 Don’t
Know (skip to next
section)
Refused (skip to next section)
Using the same 1 to 10 scale where 1 is “poor” and 10 is “excellent”, how would you rate…
The ease of using your PIN to access your FAFSA information
Using a 10-point scale on which “1” means “very dissatisfied” and 10 means “very satisfied”, how satisfied are you with the FAFSA process on the web?
Using a 10-point scale on which "1" now means "falls short of your expectations" and "10" means "exceeds your expectations," to what extent did the FAFSA process on the web fall short of or exceed your expectations?
Imagine what an ideal website for applying for grants, loans, and work-study would be like. How well do you think the FAFSA process on the web compares with the ideal you just imagined? Please use a 10-point scale on which "1" means "not at all close to the ideal," and "10" means "very close to the ideal."
(If ACSI1-ACSI2 >=2) How could the FAFSA web site better meet your expectations? [capture verbatim; clarify; probe for comparison to other web sites]
Using a scale of 1 to 10
where “1” means “not at all confident” and
“10” means “completely confident”, how
confident are you that your information on the website is secure
and that it reached the intended target?
Using a scale of 1 to 10 where “1” means “not at all likely” and “10” means “very likely”, how likely would you be to use the website to apply for financial aid in the future?
Finally, using the same
1-to-10 scale, how likely would you be to recommend the website
to others that might have a need for it?
COMP1. In the past six months, have you registered a complaint with the Department of Education about the FAFSA application process?
1 Yes
2 No
8 Don’t
Know
9 Refused
To help us better understand the users of the department’s website, we would like to know what your level of experience is with the internet. How long have you been using the internet?
less than a year,
1-2 years, or
over 2 years
In your own words, what could the Department of Education do to improve the FAFSA process on the web? (enter verbatim response)
Those are all the questions I had for you. Thank you for your time, and have a good day.
J
uneAprilMay
June, 200420065
File Type | application/msword |
Author | Computer12 |
Last Modified By | DoED |
File Modified | 2007-02-12 |
File Created | 2007-02-12 |