State Administrator Interview 12 Month

OMB Control No: _____

Expiration Date: ______

Length of time for instrument: 2.00 hours

ATTACHMENT 8: MIHOPE STATE ADMINISTRATOR INTERVIEW_

12 Month

Revised 9/12/2012

State Administrator Interview – 12 Month

The U.S. Department of Health and Human Services has contracted with MDRC to evaluate the federal Maternal, Infant and Early Childhood Home Visiting (MIECHV) Program.

The Mother and Infant Home Visiting Program Evaluation (MIHOPE) is designed to build knowledge for policymakers and practitioners about the effectiveness of MIECHV.

MIHOPE gathers information from many different perspectives—state administrators, home visiting program staff, community service providers, and families.

Your answers will be kept confidential. Only the research team will have access to this information. Your answers will not be shared with anyone at your program or any other agencies. In our research reports, the information you provide will not be attributed by name to you or your individual program.

One objective of MIHOPE is to learn how implementing agencies and other organizations work together to design and implement home visiting program services. We are requesting that you participate in this interview because you are a state administrator of one of the states participating in MIHOPE. Your answers will help us understand your state’s home visiting programs and implementation systems.

The following request will be sent to the state MIECHV Administrator approximately one month before the interview:

Before we meet to discuss your state’s MIECHV program, please provide us with any modifications that have occurred in the last twelve months to the written contracts you are using with the sites participating in the MIECHV evaluation (MIHOPE). These materials will help us to use your time most efficiently by focusing our discussion on aspects of the program that are not available in writing.

Timing of Interview

The interview will occur either in-person or via phone about twelve months after the site’s first families are enrolled in the study.

Purpose of Interview

The purpose of this interview is to understand more about your experiences at the state level implementing the MIECHV program over the last 12 months. Your experience and opinions are very important to us, and we want to thank you for taking the time to speak with us.

Your comments will remain confidential, and we will not quote your name in any publications or presentations about this project. Do you have any questions for me before we begin?

A. CHANGES TO THE STATE MIECHV PROGRAM IN THE LAST YEAR

First, we’d like to know if there have been any changes to the state MIECHV program in the last year.

1. Have there been any major changes in

1. The communities targeted? If yes, please describe: ___________

2. Populations or subgroups of families to target? If yes, please describe: ___________

3. Home visiting models used? If yes, please describe: ___________

2. Do you anticipate any changes in the following in future state MIECHV plans?

1. The communities targeted? If yes, please describe: ___________

2. Populations or subgroups of families to target? If yes, please describe: ___________

3. Home visiting models used? If yes, please describe: ___________

3. Have you made any other fundamental changes to your MIECHV formula program in the last twelve months, beyond those that we already discussed? These might be changes in communities, target populations, national models, or other aspects of your program. Please answer even if MIHOPE sites were not involved.

 Yes

 No [SKIP TO QUESTION 5]

4. Can you describe those changes? Why were these changes made?

5. Have you made any other fundamental changes to your MIECHV competitive program since your FY11 or FY12 state plan was submitted, beyond those that we already discussed?

 Yes

 No [SKIP TO SECTION B]

6. Can you describe those changes? Why were these changes made?

B. CURRENT INVOLVEMENT OF STAKEHOLDERS IN PLANNING PROCESS

1. You mentioned that [XX, YY, and ZZ] were involved in the initial decision process in MIECHV. To what extent, and through what mechanisms, are these stakeholders part of the continuing planning process for MIECHV? [INTERVIEWER: CHECK ANY THAT APPLY AND DESCRIBE IF NEEDED].

 State MIECHV task force

 Regularly scheduled meetings between particular stakeholders.

Which ones? (specify):

 MOUs between state agencies

For what purposes? (specify):

 Other formal mechanisms (specify):

C. OTHER HOME VISITING PROGRAMS OPERATING IN POTENTIAL EVALUATION COMMUNITIES

[INTERVIEWER DESCRIBES]. Your needs assessment provided information about the other home visiting programs that were available in the communities that might be included in the national evaluation.

1. Is it your understanding that these models/programs are still operating in these communities?

 Yes [SKIP TO 3]

 No

2. Why are they not being implemented anymore?

3. Are you aware of any other home visiting models being implemented in these communities that were not mentioned in your state plan?

D. STATE DECISIONS TO CHANGE ELIGIBILITY CRITERIA, ADAPTATIONS, ENHANCEMENTS, AND STAFF TRAINING AND SUPERVISION RELATIVE TO NATIONAL MODELS

1. In the last 12 months, has the state made any decisions about eligibility criteria for MIECHV that narrow or broaden the eligibility criteria relative to the eligibility criteria usually used by the national models being used in your MIECHV program?

 Yes

 No [SKIP TO 4]

2. Can you describe those changes?

3. Who advocated for these changes relative to the national model? [CHECK ALL THAT APPLY]

 National program model or developer

 Federal government

 State agency operating MIECHV program

 Agency operating the local program

 State’s Title V agency

 Title II of the Child Abuse Prevention

 State child welfare agency

 Single state agency for substance abuse services

 State’s Child Care and Development Fund (CCDF)

 Director of the State’s Head Start State Collaboration Office

 State Advisory Council on Early Childhood Education and Care authorized by 642B(b)(1)(A)(i) of the Head Start Act

 State’s Individuals with Disabilities Education Act (IDEA) Part C and Part B Section 619 lead agency/ies

 State’s Elementary and Secondary Education Act Title I or State pre-kindergarten program

 State’s Medicaid/Children’s Health Insurance program (or the person responsible for Medicaid Early Periodic Screening, Diagnosis, and Treatment (EPSDT) Program)

 State’s Domestic Violence Coalition

 State’s Mental Health agency

 State’s Public Health agency

 State agency charged with crime reduction

 State’s Temporary Assistance for Needy Families (TANF) agency

 State’s Supplemental Nutrition Assistance Program (SNAP) agency

 State’s Injury Prevention and Control (Public Health Injury Surveillance and Prevention) program

 Other : _____________________

Additional comments:_____________

4. In the last 12 months, has the state asked the local MIECHV programs to implement any adaptations to the national models?

 Yes

 No [SKIP TO 7]

5. Can you describe those changes?

6. Who advocated for these changes relative to the national model?

 National program model or developer

 Federal government

 State agency operating MIECHV program

 Agency operating the local program

 State’s Title V agency

 Title II of the Child Abuse Prevention

 State child welfare agency

 Single state agency for substance abuse services

 State’s Child Care and Development Fund (CCDF)

 Director of the State’s Head Start State Collaboration Office

 State Advisory Council on Early Childhood Education and Care authorized by 642B(b)(1)(A)(i) of the Head Start Act

 State’s Individuals with Disabilities Education Act (IDEA) Part C and Part B Section 619 lead agency/ies

 State’s Elementary and Secondary Education Act Title I or State pre-kindergarten program

 State’s Medicaid/Children’s Health Insurance program (or the person responsible for Medicaid Early Periodic Screening, Diagnosis, and Treatment (EPSDT) Program)

 State’s Domestic Violence Coalition

 State’s Mental Health agency

 State’s Public Health agency

 State agency charged with crime reduction

 State’s Temporary Assistance for Needy Families (TANF) agency

 State’s Supplemental Nutrition Assistance Program (SNAP) agency

 State’s Injury Prevention and Control (Public Health Injury Surveillance and Prevention) program

 Other : _____________________

Additional comments:_____________

7. In the last 12 months, has the state asked the local MIECHV programs to adopt any enhancements to the national models?

 Yes

 No [SKIP TO 10]

8. Can you describe those changes?

9. Who advocated for these changes relative to the national model?

 National program model or developer

 Federal government

 State agency operating MIECHV program

 Agency operating the local program

 State’s Title V agency

 Title II of the Child Abuse Prevention

 State child welfare agency

 Single state agency for substance abuse services

 State’s Child Care and Development Fund (CCDF)

 Director of the State’s Head Start State Collaboration Office

 State Advisory Council on Early Childhood Education and Care authorized by 642B(b)(1)(A)(i) of the Head Start Act

 State’s Individuals with Disabilities Education Act (IDEA) Part C and Part B Section 619 lead agency/ies

 State’s Elementary and Secondary Education Act Title I or State pre-kindergarten program

 State’s Medicaid/Children’s Health Insurance program (or the person responsible for Medicaid Early Periodic Screening, Diagnosis, and Treatment (EPSDT) Program)

 State’s Domestic Violence Coalition

 State’s Mental Health agency

 State’s Public Health agency

 State agency charged with crime reduction

 State’s Temporary Assistance for Needy Families (TANF) agency

 State’s Supplemental Nutrition Assistance Program (SNAP) agency

 State’s Injury Prevention and Control (Public Health Injury Surveillance and Prevention) program

 Other : _____________________

Additional comments:_____________

10. In the last 12 months, has your agency provided any additional training or TA, including state-wide meetings or conferences, to MIECHV sites?

 Yes

 No [SKIP TO 12]

11. What training and TA activities do you provide? Are they required?

12. In the last 12 months, to your knowledge, has any other agency provided any training or TA, including state-wide meetings or conferences, to MIECHV sites?

 Yes

 No [SKIP TO 17]

13. Which agency(ies), and what training and TA activities do they provide?

 Stakeholder group

 National program model or developer

 Federal government

 State agency operating MIECHV program

 Agency operating the local program

 State’s Title V agency

 Title II of the Child Abuse Prevention

 State child welfare agency

 Single state agency for substance abuse services

 State’s Child Care and Development Fund (CCDF)

 Director of the State’s Head Start State Collaboration Office

 State Advisory Council on Early Childhood Education and Care authorized by 642B(b)(1)(A)(i) of the Head Start Act

 State’s Individuals with Disabilities Education Act (IDEA) Part C and Part B Section 619 lead agency/ies

 State’s Elementary and Secondary Education Act Title I or State pre-kindergarten program

 State’s Medicaid/Children’s Health Insurance program (or the person responsible for Medicaid Early Periodic Screening, Diagnosis, and Treatment (EPSDT) Program)

 State’s Domestic Violence Coalition

 State’s Mental Health agency

 State’s Public Health agency

 State agency charged with crime reduction

 State’s Temporary Assistance for Needy Families (TANF) agency

 State’s Supplemental Nutrition Assistance Program (SNAP) agency

 State’s Injury Prevention and Control (Public Health Injury Surveillance and Prevention) program

 Other : ______

Additional comments:_____________

14. Has the state asked the local MIECHV programs to make any changes to the supervision required for home visitors relative to that required by the national models?

 Yes

 No [SKIP TO SECTION E]

15. Can you describe those changes?

16. Who advocated for these changes relative to the national model? [CHECK ALL THAT APPLY]

 Stakeholder group

 National program model or developer

 Federal government

 State agency operating MIECHV program

 Agency operating the local program

 State’s Title V agency

 Title II of the Child Abuse Prevention

 State child welfare agency

 Single state agency for substance abuse services

 State’s Child Care and Development Fund (CCDF)

 Director of the State’s Head Start State Collaboration Office

 State Advisory Council on Early Childhood Education and Care authorized by 642B(b)(1)(A)(i) of the Head Start Act

 State’s Individuals with Disabilities Education Act (IDEA) Part C and Part B Section 619 lead agency/ies

 State’s Elementary and Secondary Education Act Title I or State pre-kindergarten program

 State’s Medicaid/Children’s Health Insurance program (or the person responsible for Medicaid Early Periodic Screening, Diagnosis, and Treatment (EPSDT) Program)

 State’s Domestic Violence Coalition

 State’s Mental Health agency

 State’s Public Health agency

 State agency charged with crime reduction

 State’s Temporary Assistance for Needy Families (TANF) agency

 State’s Supplemental Nutrition Assistance Program (SNAP) agency

 State’s Injury Prevention and Control (Public Health Injury Surveillance and Prevention) program

 Other : ______

Additional comments:_____________

E. ACCOUNTABILITY MECHANISMS

[INTERVIEWER WILL HAVE A LIST OF FEDERAL BENCHMARK DOMAINS TO REFER TO IF NEEDED]. As part of MIECHV, states are required to monitor and periodically report on the federal benchmark areas.

1. In the last 12 months, have there been any major changes in how your collect federal benchmarks?

2. At the state level, how do you use or plan to use the information you collect about federal benchmarks? [INTERVIEWER: CHECK ALL THAT APPLY]

 Primarily for federal reporting purposes

 To identify needs for technical assistance to programs

 To identify training needs for staff

 Benchmarks are incorporated into our state’s contracts with local MIECHV programs

 Other (specify): _________

3. In the last 12 months, have there been any changes in how you use or plan to use the information you collect about federal benchmarks?

4. In the last 12 months, have there been changes in how funding is awarded to local MIECHV programs in your state?

5. If by contract, is performance reporting incorporated into the contracts?

6. In the last 12 months, have there been changes in what the state considers programs to be accountable for?

7. What are the consequences if the programs do not meet their performance requirements?

8. In the last 12 months, have there been any additional monitoring mechanisms developed or used?

9. Do you have a state level MIS system for your MIECHV program?

 Yes, some program sites use it (List which ones: )

 Yes, all program sites use it

 No [SKIP TO 12]

10. What kind of information does it collect?

 Family eligibility information

 Dates / types of services delivered

 Screening results for children

 Screening results for parents

 Outcomes for children

 Outcomes for parents

 Provision of information activities

 Education activities

 Support activities

 Referrals

 Other(s) _______________________________________________

11. Has this changed in the last twelve months?

12. What levels of staff and management receive reports from this MIS system?

13. How frequently are these reports generated and how are they used?

14. Does your state have a Continuous Quality Improvement (CQI) plan?

 Yes

 No [SKIP TO 16]

15. What CQI activities do you have in place now?

16. Is your current MIS system sufficient for the CQI processes you would like to use?

 Yes [SKIP TO SECTION F]

 No

17. If no, what concerns do you have with your MIS system?

F. STATE PERSPECTIVES ON PROGRAM GOALS AND OUTCOMES

Instructions: In this section, we would like to learn how state administrators perceive their state’s intended outcomes, as well as any training or TA provided to achieve those outcomes. Home visiting programs vary in the outcomes they try to achieve with families. In general, a program outcome is a benefit to a child, parent, or family. For example, some states might see the improvement of prenatal health as an important outcome. 

Below is a list of possible outcomes. We know your state may care about all of these benefits for your families.  However, we would like to get a sense of which outcomes your state has identified as more important than others.  We would like you to check the box that best represents what you think your state MIECHV program believes about the outcome. To help you decide on an outcome’s rank, think about whether it is discussed routinely in training and in communication to local agencies and programs.

You might notice that some of these are similar to questions we asked you a year ago. This is because we are interested in how your approach may have changed over that time.

1. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting good prenatal health, such as diet, exercise, rest, and not smoking?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

2. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is preventing poor birth outcomes such as pre-term birth and low birth weight?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

3. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting breastfeeding?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

4. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting maternal physical health outside of pregnancy such as good nutrition, exercise, and rest?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

5. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting family planning and birth spacing?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

6. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is preventing and reducing maternal tobacco use?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

7. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is preventing and reducing mental health and substance use problems?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

8. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is preventing and reducing domestic violence?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

9. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting family economic self-sufficiency such as reaching goals for employment and education?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

10. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting children’s preventive health care such as having all recommended well-child visits, being up-to-date on immunizations, and having parents baby-proof their home to prevent injuries?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

11. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting positive parenting behaviors, such as nurturing, encouraging the child’s learning, and using positive behavior management techniques?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

12. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is preventing and reducing child abuse and neglect?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

13. Considering all of the outcomes your state MIECHV program aims to achieve, how much of a priority is promoting child cognitive and language development and social- emotional well-being?

										
0	1	2	3	4	5	6	7	8	9	10
Not a Priority at All					Moderate Priority					Highest Priority

G. STATE PERSPECTIVES ON PROMISE AND CHALLENGES OF MIECHV HOME VISITING

Now we’ll talk a little more about actually putting this program into operation over the last twelve months.

1. What are your impressions of implementation to date?

1. Are some sites more successful than others in implementing their program models?

2. What seems to affect the success of implementation?

3. Has anything happened this year at the state or local levels that may have affected the implementation of MIECHV? If so, please explain.

2. When you think about implementing your state’s MIECHV program over the last year, what were the three biggest obstacles you faced?

3. When you think about implementing your state’s MIECHV program over the last year, what were the three biggest success stories?

4. Which of the following statements best describes the current role of home visiting in your state’s early childhood system?

 Home visiting has a well-specified role to play in our state’s system of early childhood programs.

 Within the next few years, I expect home visiting to have a well-specified role in our state’s system of early childhood programs.

 Home visiting does not have a clear role in our state’s early childhood system and based on my state’s track record, it is hard to know how many years it will be before that changes.

5. Are there other issues that have influenced the implementation of MIEHCV? If so:

   1. What were these issues?

2. How did they arise?

3. How were they addressed?

6. Is there anything else that you think we should know, in order to understand your state’s MIECHV program over the last year?