Ongoing Research and Evaluation

ISED is currently conducting six program research and evaluation projects. Select a project below to learn more about these activities.

You can also view ISED's completed Research and Evaluation projects.

Bethany Christian Services Project Return Home

ISED is partnering with Bethany Christian Services in Grand Rapids, Michigan to conduct the program evaluation of Project Return Home, which provides trauma treatment services to children in foster care and their biological parents.  ISED is conducting the process and outcome studies.

Project Overview

In the process study, ISED will track how services are designed and implemented and to what extent participants are satisfied with the services they receive.

In the outcome study, ISED will analyze the impact of the program, for both the children and their biological parents.  Assessment tools will be used to determine whether symptoms that the children and biological parents experience decrease over the course of the program, and whether improvements are maintained after the program is completed.  The outcome study will also examine whether Project Return Home children, who receive trauma treatment services, are more likely to be returned to their biological parents than other foster children who do not receive these services.

Organizational Profile of Beneficiaries

Project Return Home, a program of Bethany Christian Services, will provide trauma treatment services to children ages 3 through 18 who have been removed from their homes due to child abuse, neglect, or maltreatment and who live in foster care.  Trauma treatment services will also be delivered to their biological parents, most of whom struggle with their own unresolved sources of childhood trauma. 

Project Activities

During the first year of the project, project activities center around obtaining Institutional Review Board approval for the research project, conducting the process study, and conducting a pilot of the Project Return Home program.   

Upcoming Events

Upcoming events include a survey of the Child Welfare Professionals Council and focus groups with participants of the remaining three councils (of foster parents, foster care youth, and biological parents).  The four stakeholder councils inform the development and implementation of the project.

Period

The project funding period is October 1, 2009 to September 30, 2013.

Funder

The Substance Abuse and Mental Health Services Administration (SAMHSA), Department of Health and Human Services

Project Manager

Maria Hein

 

Michigan Longitudinal IDA Evaluation

ISED is conducting a five-year longitudinal evaluation of the Michigan IDA Partnership (MIDAP) to determine if people who purchased their homes through the Michigan IDA program still have their homes and how home ownership has affected their lives.

Project Overview

While there is general agreement that IDA programs are having a positive effect on participant households, the major question that remains unanswered in research is the long-term outcome for these households. What happens after families purchase homes through the help of an IDA program?”

ISED is conducting a five-year longitudinal evaluation of the Michigan IDA Partnership (MIDAP) to determine if people who purchased their homes through the Michigan IDA program still have their homes and how home ownership has affected their lives.

Since this is a longitudinal study, the same group of people is surveyed over the five years. ISED is only surveying MIDAP participants who have purchased a home within 6 months of the survey date. People who pursued education or microenterprise through their IDA are not part of this research study. In addition to the telephone surveys, a small number of people will be interviewed to complete in-depth case studies. Having this qualitative data (i.e., personal stories) is an important way to illustrate how people’s lives have been affected by homeownership.

Organizational Profile of Beneficiaries

This longitudinal research study is critical to the asset building field and its future development. Providing longitudinal data is vital, especially in light of the current housing crisis. Through this research, ISED will document continuing ownership rates and how homeownership has affected the lives of the IDA-assisted homeowners.

Project Activities

  • Telephone survey created and piloted
    • Data analysis underway
    • In-depth case studies completed
    • A final report and research brief will summarize the findings of the research

Upcoming Events

Research report expected to be available in the Fall of 2009.

Period

The project funding 2005 to 2009.

Funder

Charles Stewart Mott Foundation

Project Manager

Jan Losby, Director of Research

 

Mountain BizWorks Business Development Services for People with Limited Income 

ISED is partnering with Mountain BizWorks in Asheville, North Carolina to conduct the program evaluation for their Job Opportunities for Low Income (JOLI) grant.  ISED is conducting  process and outcome studies.

Project Overview

In the process study, ISED tracks how services provided to JOLI participants are designed and implemented, including how the project is tailored to meet the needs of low-income individuals and minorities. The process study also includes a focus group with JOLI participants to obtain their feedback about services.

In the outcome study, ISED analyzes program data to determine whether the services are having the intended impact.  Outcome domains examined include: increased self-confidence and knowledge about small business development, the rate at which participants start businesses and keep them open, the number of jobs created, and access to business loans. 

Organizational Profile of Beneficiaries

Mountain BizWorks was funded to implement a JOLI project, under the program’s self-employment/microenterprise option, that would provide a customized package of comprehensive classroom training and individual business coaching to low-income individuals in the 12 western counties of North Carolina.

Project Activities

During each year of the three year project, ISED staff participate in the following activities: 

  • Maintain communication with Mountain BizWorks staff regarding changes in the program design and progress on the evaluation activities
  • Work with the Mountain BizWorks Database Manager to obtain data, conduct the data analysis, and prepare the semi-annual data report 
  • A 1 ½ day site visit to Asheville, which typically includes:
    • Interviews with Mountain BizWorks staff, including the CEO, Regional Director, Director of Lending, Communications Manager, and Program Specialist
    • Observation of a Foundations course session and Growth through Objectives (GO) Coaching session
    • Focus group with Mountain BizWorks participants
    • Discussion of project data needs with the Database Manager
    • Visit a Mountain BizWorks supported business started by a JOLI participant
  • Analyze process and outcome study data and prepare the annual evaluation report

Upcoming Events

We are currently in the third year of the three year JOLI grant.  ISED will conduct the yearly site visit to Mountain BizWorks during the summer of 2009.  The year three evaluation report will be submitted to Mountain BizWorks and the Office of Community Services (which funds the JOLI grants) fall 2009. 

Period

The project funding period is October 1, 2006 to September 30, 2009.

Funder

The Office of Community Services, Administration for Children and Families, Department of Health and Human Services

Project Manager

Maria Hein

 

Office of Refugee Resettlement’s IDA (Individual Development Account) Program Evaluation

ISED is conducting an evaluation of the ORR-funded IDA program.  The purpose of the research is to determine what changes have taken place in the lives of the participants from the time of enrollment to at least three years after the person acquired an asset through the program. 

Project Overview

ISED is conducting an evaluation of the ORR-funded IDA program.  The purpose of the research is to determine what changes have taken place in the lives of the participants from the time of enrollment to the time of the survey which is at least three years after asset acquisition (see diagram below). 

Two hundred refugees who acquired an approved asset through the ORR IDA Program will be surveyed.  The sample for the survey is any ORR IDA participant who acquired an approved asset (i.e., car, home, microenterprise, post secondary education/vocational training/recertification, computer, or home renovation) at least three years ago.

In addition to the survey data, up to 10 individuals will complete more in-depth interviews in order to capture their personal stories in case studies.  A final report and research brief will summarize the findings of the evaluation.

Organizational Profile of Beneficiaries

The lessons drawn will have direct implications for ORR, IDA programs, and also for agencies that serve refugees.  ORR plans to use the data from this study to highlight the outcomes of the IDA program in ORR’s Annual Report to Congress.

Project Activities

  • Telephone survey created and reviewed by ORR and ORR IDA grantees.
  • Research package submitted to OMB (Office of Management and Budget) for review and approval.  OMB granted approval for the research to commence.
  • The sample is being collected from the ORR IDA grantees that served these participants.  This work is ongoing.
  • Once the sample is obtained, telephone surveying will begin.
  • After the telephone surveying is complete, data analysis will begin. 
  • In-depth case studies will be conducted after survey data are analyzed.
  • A final report and research brief will summarize the findings of the research.

Upcoming Events

The research report and shorter research brief will be submitted to ORR in September 2009.  After ORR approval these documents will be available to the public.

Period

The project funding period is September 30, 2007 to September 29, 2009.

Funder

Office of Refugee Resettlement

Project Manager

Jan Losby

 

Prisoner Re-Entry Evaluation

ISED is conducting a process and outcome evaluation of the Learn-to-Earn Post-Release Project in Cobb and Douglas County, Georgia. The purpose of the research is to determine how former prisoners benefit from the casemanagement and financial assistance offered through the project.

Project Overview

The Learn-to-Earn Post-Release Project offers casemanagement and financial assistance to 50 participants after release from prison. The purpose of the research is to determine how ex-offenders benefit from the services offered through the project. Of particular interest is the area of employment and self-employment. The research study tracks participant activities and also records how the program itself has changed over time.

Organizational Profile of Beneficiaries

The research findings will benefit the field of prisoner re-entry interventions. Cobb and Douglas County Community Services Board will benefit from having a third-party evaluation of its intervention since recommendations will be made to help improve participant outcomes.

Project Activities

  • Logic model developed
  • Data sources identified
  • Data collection procedures are in place
  • Process and outcome data collection is underway
  • In-depth case studies will be conducted in 2010
  • A final report will summarize the findings of the research

Upcoming Events

The research report will be submitted to funder in March 2010.

Period

The project funding period is March, 2008 to March, 2010.

Funder

Bureau of Justice Assistance (Office of Justice Programs with the U.S. Department of Justice). ISED has a subcontract with the Georgia Cobb and Douglas County Community Services Board.

Project Manager

Jan Losby, Director of Research

 

System of Care for Youth in Transition

ISED is partnering with the Counseling Center of Lake View in Chicago to conduct the program evaluation of the System of Care for Youth in Transition, which provides services to homeless youth. ISED is conducting process and outcome studies.

Project Overview

In the process study, ISED examines the program design, its implementation, and its effectiveness.  ISED also conducts individual interviews with program participants to obtain their feedback about services.

In the outcome study, ISED conducts data analysis to determine whether the intervention resulted in improvements in short-term and long-term outcomes for participants.  Short-term outcomes of interest are improved access to mental health services and substance abuse services.  Long-term outcomes of interest include mental health; coping skills; alcohol and drug use; housing stability; employment, job training, and school enrollment; income; physical health; social connectedness; appropriate behavior; and safety.

Organizational Profile of Beneficiaries

The System of Care for Youth in Transition (SOCYIT) is being implemented by the Counseling Center of Lake View (CCLV) and four community housing partners.  SOCYIT provides mental health and substance abuse services to homeless youth in Chicago, Illinois. 

Project Activities

  • Maintaining communication with CCLV staff and the housing partners, including attendance of quarterly partner’s meetings
  • In-person interviews with youth participants each summer
  • Analysis of process study data for each quarterly evaluation report
  • Analysis of process and outcome study data for each annual evaluation report
  • Presenting evaluation findings at the partner’s meetings, as they are available
  • Attending the annual grantee conference, and additional meetings and conference calls as needed

Upcoming Events

We are currently in the third year of the five year grant.  ISED will conduct the in person interviews with the participants again during the summer of 2009.  A report of the results will be available at the end of the summer. 

Period

The project funding period is October 1, 2006 to September 30, 2011.

Funder

The Substance Abuse and Mental Health Services Administration (SAMHSA), Department of Health and Human Services

Project Manager

Maria Hein

 Website Design and Development by Fluency