528 2013 528 HRSA MCHB - MIECHV Questionnaire

HRSA MCHB - MIECHV Satisfaction Questionnaire

Maternal, Infant, and Early Childhood Home Visiting Program Local Implementing Agencies

Satisfaction Survey

Health Resources and Services Administration

Maternal and Child Health Bureau

Survey to be administered via the Web. Instructions and headings in BOLD and question numbers will not be seen by the respondents.

Survey Introduction

For quality improvement purposes, we are requesting feedback on your agency’s experiences with the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program.

Under the MIECHV program, the Maternal and Child Health Bureau (MCHB) at Health Resources and Services Administration (HRSA) provides grant funds to states* for the purpose of implementing evidence-based home visiting programs in at risk communities. Your agency was selected to participate in this survey because you receive funds as part of a statewide MIECHV program.

MCHB/HRSA is conducting this survey in order to learn more about the local implementing agency application, family enrollment, technical assistance, communication and data reporting processes in addition to understanding needs of agencies that are providing home visiting services to families. Feedback obtained from your agency will be used for quality improvement purposes. Please provide one response per agency. It is recommended that the respondent be someone who has broad knowledge of issues affecting implementation at the local level.

Please note that throughout the survey when we refer to “state”, we are referring to the state (including the District of Columbia) or U.S. territory in which your agency provides MIECHV services.

This survey is hosted on a secure server and your responses will remain anonymous. This survey is authorized by Office of Management and Budget Control No. 1090-0007 (expires March 31, 2015).

The survey will take approximately 30 minutes to complete. Thank you in advance for your participation. Questions about this survey can be directed to [email protected]

Please click on the “Next” button below to begin.

*non-profit organizations receive MIECHV funding in Florida, North Dakota and Wyoming

Introduction

1. Which of the following best describes your position at your agency? (Select all that apply)

   1. Agency Administrator (for example, Executive Director, Chief Operating Officer, Chief Financial Officer)

   2. Other Program Administrator (for example, Project Director or Program Coordinator)

   3. Home Visitor Supervisor

   4. Home Visitor

   5. Other: Please describe:_____________________ [Text Box]

2. Which of the following best describe the location(s) of your MIECHV service population(s)? (Select all that apply)

   1. Urbanized Area of 50,000 or more people

   2. Urban Cluster of at least 2,500 and less than 50,000 people

   3. Rural area, not frontier (any county with greater than 6 people per square mile)

   4. Rural area, frontier (any county with 6 or fewer people per square mile)

3. From the drop-down box, please select the state in which your agency provides MIECHV home visiting services.

4. Has your agency signed an agreement to be included in the Mother and Infant Home Visiting Program Evaluation (MIHOPE)?

   1. Yes

   2. No

5. Which of the following home visiting models is your agency implementing with MIECHV funding? (Select all that apply)

   1. Child First

   2. Early Head Start - Home Based Option

   3. Early Intervention Program for Adolescent Mothers

   4. Healthy Families America

   5. Healthy Steps

   6. Home Instruction for Parents of Preschool Youngsters

   7. Nurse-Family Partnership

   8. Parents as Teachers

   9. SafeCare (Augmented)

   10. Promising Approach (Please name: _________________) [Text Box]

6. For how long has your agency been implementing any evidence-based home visiting program?

   1. Less than 3 years

   2. 3-5 years

   3. More than 5 years

7. Are you aware that the MIECHV program is funded by the Patient Protection and Affordable Care Act?

   1. Yes

   2. No

8. How does your agency view your home visiting program in relation to an early childhood system that provides a coordinated network of comprehensive services and supports that meet the overall health and developmental needs of young children?

1. not part of a coordinated network of comprehensive services

2. minimally contributes to a coordinated network of comprehensive services

3. somewhat contributes to a coordinated network of comprehensive services

4. greatly contributes to a coordinated network of comprehensive services

Application Process

Thinking about the process your agency went through in order to receive the MIECHV funding, use a scale from 1 to 10, where 1 is “Poor” and 10 is “Excellent” and N/A means “Not Applicable,” to rate the following:

9. Ease of completing the application or community plan submitted by your agency to the state MIECHV program

10. After completing the application or other process to become a recipient of MIECHV funding, how long did it take to receive a notice of funding award or approval to implement the MIECHV program?

    1. Less than 1 month

1. 1-3 months

2. 4-6 months

3. 7-12 months

4. Greater than 12 months

5. N/A

Thinking about the process your agency has to go through to receive payment for MIECHV services, use a scale from 1 to 10, where 1 is “Poor” and 10 is “Excellent” and N/A means “Not Applicable,” to rate the following: [Randomize]

11. Ease of submitting claims, deliverables or invoicing for the purpose of receiving payment

12. Timeliness of payment

13. Accuracy of payment

14. What, if any, barriers has your agency experienced in its ability to spend all of the MIECHV funding awarded to your agency? [Capture Verbatim Response]

Family Enrollment Process

15. After entering into the MIECHV agreement (i.e., signing the contract or otherwise receiving MIECHV funding to implement the MIECHV program) how long did it take your agency to begin enrolling MIECHV families?

    1. Less than 1 month

6. 1-3 months

7. 4-6 months

8. 7-12 months

9. Greater than 12 months

10. N/A

16. If there was a delay enrolling families after being awarded MIECHV funding, what were the reasons for the delay? CAPTURE VERBATIM RESPONSE

17. How many families does your agency intend to serve with the MIECHV funds available to your agency?

1. 0-10

2. 10-25

3. 26-50

4. 51-100

5. 101-500

6. 501 or more

Thinking about your agency’s experience enrolling and retaining eligible MIECHV families, use a scale from 1 to 10, where 1 is “Poor” and 10 is “Excellent” and N/A means “Not Applicable,” to rate the following: [Randomize]

18. Ease of finding families to participate in the MIECHV program

19. Ease of retaining families in the MIECHV program

20. Helpfulness of your MIECHV state lead agency in the family recruitment and retention process

21. Helpfulness of the model developer(s) in the MIECHV family recruitment and retention process

22. What are the greatest challenges to your agency or your home visitors in achieving MIECHV goal caseload? [Capture Verbatim Response]

23. What additional resources would help your agency with the MIECHV family recruitment, enrollment and retention process? [CAPTURE VERBATIM RESPONSE]

Workforce

24. Has your agency experienced any difficulties recruiting staff to provide MIECHV program services?

1. Yes

2. No

25. Has your agency experienced any difficulties retaining staff to provide MIECHV program services?

1. Yes

2. No

26. Which of the following professionals does your agency have difficulty recruiting or retaining as staff for the MIECHV program? (Select all that apply)

    1. Nurses with Associate degree

    2. Nurses with Bachelor degrees

    3. Nurses with Masters degrees

    4. Social workers with bachelor degrees

    5. Social workers with masters degrees

    6. Home Visitors with other Associate degrees

    7. Home visitors with other Bachelor degrees

    8. Home Visitors with other Masters degrees

    9. Home visitors with high school degrees

    10. Other (please be specific)

    11. None

27. If your MIECHV program were to expand (or enroll more families), does your agency anticipate that this would cause future challenges with recruiting or retaining any of the following professionals? (Select all that apply)

    1. Nurses with Associate degree

    2. Nurses with Bachelor degrees

    3. Nurses with Masters degrees

    4. Social workers with bachelor degrees

    5. Social workers with masters degrees

    6. Home Visitors with other Associate degrees

    7. Home visitors with other Bachelor degrees

    8. Home Visitors with other Masters degrees

    9. Home visitors with high school degrees

    10. Other, please specify

    11. None

28. In the space provided below please elaborate further on the difficulties your agency has experienced recruiting, hiring and/or retaining staff for the MIECHV program. Please be as specific as possible, describing the model(s), community(ies), staff position(s) and the specific issue(s). [Capture verbatim response]

MIECHV Training and Program Implementation

Thinking about the training of MIECHV home visitors at your agency, use a scale from 1 to 10, where 1 means “Poor” and 10 means “Excellent” and N/A means “Not Applicable”, to rate the adequacy of all training provided by model developers to do the following:

29. Address safety concerns of the home visitors during home visits

30. Address cultural competence of the home visitors

Rate your agency’s experience in implementing the MIECHV program model(s), using a scale from 1 to 10, where 1 is “Poor” and 10 is “Excellent”: [Randomize]

31. Quality of the training available to implement the model(s)

32. Timeliness of the training to implement the model(s)

33. Responsiveness of the model developer(s) to address implementation issues as they arise

34. Extent to which your agency has knowledge of the requirements of the model(s)

35. Extent to which your agency is able to comply with the requirements of the model(s)

36. Has your agency worked directly with the model developer(s) to become accredited or certified by them?

    1. Yes

    2. No

    3. Not Applicable

Thinking about the training of MIECHV home visitors at your agency, use a scale from 1 to 10, where 1 means “Poor” and 10 means “Excellent,” to rate the adequacy of all training provided by the state MIECHV program to do the following:

37. Ensure collection of data on demographics and program benchmarks

38. Enable home visitors to assess and deal with serious issues for which there are few resources for referral or reluctance of family to seek support (e.g., mental health, substance abuse, domestic violence)

39. [Ask if Q39 < 7] In what ways does your agency experience challenges in meeting model requirements? Be specific [Capture verbatim response]

40. Rank the top three issues in terms of how they present challenges to your agency’s MIECHV program.

1. Child abuse/Neglect within a family enrolled in the MIECHV program

2. Mental Health of a MIECHV program participant

3. Domestic Violence of a MIECHV program participant

4. Drug and/or alcohol use of a MIECHV program participant

5. Tobacco use of a MIECHV program participant

6. Prenatal Care of a MIECHV program participant

7. Well Child Visits for a family member of a MIECHV program participant

8. Housing issue of a MIECHV program participant

9. Food Security of a MIECHV program participant

10. Transportation of a MIECHV program participant to receive other community services

11. Engagement of families (including no shows or drop outs)

12. Reflective Supervision of a MIECHV home visitor

13. Difficulty with care coordination or connecting families to community resources

14. Other: Please Describe:______

Technical Assistance

41. Has your agency received any technical assistance (information or support) related to implementing the MIECHV program in the past 12 months?

1. Yes

2. No [Skip to Q53]

42. From where has your agency received technical assistance for your MIECHV program? (Select all that apply)

1. State MIECHV program

2. An agency or individual contracted by the state MIECHV program

3. HRSA

4. Technical Assistance Coordinating Center at Zero to Three

5. Model developer(s)

6. Other (name here): _____________________

43. Which of the following method(s) of accessing technical assistance has your agency used? (Select all that apply)

1. Live Webinar

2. Recorded Webinar

3. Phone call or conference call

4. Email

5. Interactive online portal

6. In-person

7. Other, please specify

44. What are your agency’s top three preferred methods for accessing technical assistance resources? (Choose no more than three)

1. Webinar

2. Phone call or conference call

3. Email

4. Interactive online portal

5. In-person

6. Other, please specify

Thinking about your agency’s experiences with the technical assistance you have received during the past year, use a scale from 1 to 10, where 1 means “Poor” and 10 means “Excellent” and N/A means “Not Applicable,” to rate the following: [Randomize]

45. Support in helping you meet program requirements

46. Organization of the information provided

47. Effectiveness of the information/training provided

48. Ease of understanding the information provided

49. Sufficiency of detail to meet your needs

50. Time it takes to connect with a technical expert

51. What percentage of your agency’s technical assistance needs do you feel are being met?

1. None

2. 1-10%

3. 11-20%

4. 21-30%

5. 31-40%

6. 41-50%

7. 51-60%

8. 61-70%

9. 71-80%

10. 81-90%

11. 91-99%

12. 100%

52. Does your agency have unmet technical assistance needs? If so, please list the topics or describe the types of technical assistance your agency needs. CAPTURE VERBATIM RESPONSE

Customer Service

The following questions are to understand the contact you have had for purposes other than technical assistance. If your program is not funded directly by the state MIECHV program, you may indicate your experience with the agency from which you receive MIECHV funding.

53. During the past 3 months, have you had contact with the state MIECHV staff for purposes other than technical assistance?

1. Yes

2. No (Skip to 63)

54. Thinking about your most recent interaction with the state MIECHV staff, what contact method did you use?

1. Phone

2. Email

3. In person

4. Website

5. Other, please specify

Thinking about your most recent interaction with state MIECHV staff, use a scale from 1 to 10, where 1 means “Poor” and 10 means “Excellent”, to rate the following: [Randomize]

55. Ease of reaching a representative

56. Courteousness of the representative

57. Knowledge of the representative

58. Timeliness of the representative’s response to your inquiry or concern

59. Relevance of the information provided by the representative

60. Thinking about your most recent interaction with state MIECHV staff, how long did it take the state MIECHV staff to respond?

    1. Less than 24 hours

    2. 1 to 2 days

    3. 3 to 4 days

    4. 5 to 7 days

    5. 8 days to 1 month

61. Thinking about your most recent interaction with state MIECHV staff, was your issue resolved or question answered to your satisfaction?

1. Yes

2. No

62. Ideally, how long should it take state MIECHV staff to respond to your initial contact?

1. Less than 24 hours

2. 1- 2 days

3. 3 to 4 days

4. 5 to 7 days

5. 8 days to 1 month

Communication

Thinking about any communications your agency has received from the state MIECHV program in the last 12 months, use a scale from 1 to 10, where 1 means “Poor” and 10 means “Excellent”, to rate the following: [Randomize]

63. Timeliness of the communications

64. Relevance of the information provided

65. Sufficiency of details to meet your needs

66. Your understanding of the information

67. Frequency of communications

68. Ideally, how would you like to receive future communications from the state MIECHV program? [Select all that apply]

1. Electronic Newsletters

2. Interactive online portal

3. Email

4. Postal Mail

5. Website

6. Text Message (SMS)

7. Group Conference Calls

8. Webinars

9. Social Media (such as Facebook or Twitter)

10. In-person training, meeting or summit

11. Other, please specify

69. How often would you like to receive communications from the state MIECHV program?

1. Weekly

2. Monthly

3. Quarterly

4. Twice per year

5. Yearly

6. Other, please specify

70. What types of information would you like to be included in the state MIECHV program communications? [Capture verbatim response]

Data Systems and Reporting

Where we refer to data reporting in the following questions we mean reporting of demographic, service utilization and benchmark area/performance measure data.

71. What do you think of the required data reporting for the MIECHV program?

1. Too difficult

2. About right

3. Too easy

72. Are there specific demographic, service delivery or benchmark area/performance measure data that you feel are unnecessary or too difficult to collect? [CAPTURE VERBATIM RESPONSE]

73. What system or method best describes the way in which your agency reports MIECHV data to the state MIECHV program (or other agency if your MIECHV program is not funded directly by the state MIECHV program)? (Check all that apply)

1. Paper data forms

2. Electronic spreadsheets

3. Web based data system

4. Other/Please specify

Rate your agency’s experience with data systems and data reporting for the MIECHV program, on a scale from 1 to 10, where 1 means “Poor” and 10 means “Excellent” and N/A means “Not Applicable”: [Randomize]

74. Ease of submitting your agency’s MIECHV data

75. Ability to meet data reporting deadline(s)

76. Usefulness of the data system in carrying out quality improvement activities

77. Please use the space below to provide any additional recommendations for improving the system you use to report MIECHV data to the state MIECHV program (or other agency if your MIECHV program is not funded directly by the state MIECHV program). [Capture Verbatim Response]

American Customer Satisfaction Index Benchmark Questions

78. Please consider all of the experiences you have had as an agency funded to provide MIECHV services. Using a 10-point scale on which 1 means “Very Dissatisfied” and 10 means “Very Satisfied”, how satisfied are you with participation in the MIECHV program?

79. Using a 10-point scale on which 1 means “Below Expectations” and 10 means “Exceeds Expectations”, to what extent has the MIECHV program fallen short of or exceeded your agency’s expectations?

80. Imagine an ideal home visiting program. How well do you think the MIECHV program compares with that ideal program? Please use a 10-point scale on which 1 means “Not Very Close to Ideal” and 10 means “Very Close to Ideal”.

Future Behaviors

81. On a scale from 1 to 10 where 1 means “Not at All Likely” and 10 means “Very Likely”, how likely is your agency to continue to provide MIECHV services in the future assuming continued availability of MIECHV funding?

82. On a scale from 1 to 10 where 1 means “Not at All Likely” and 10 means “Very Likely”, how likely are you to recommend the MIECHV grant funding to another agency?

Additional Questions

83. What do you need from the state MIECHV program or from the federal government, in order to ensure the success of your agency’s MIECHV program? [Capture Verbatim Response]

84. Please use this space to provide any recommendations you have to improve the MIECHV program? [Capture Verbatim Response]

Thank you for your time. The Health Resources and Services Administration’s Maternal and Child Health Bureau appreciates your input!

____________________________________________________________________________________________

1/30/21 Questionnaire – Page 23