VR-ROI Projects
Ongoing Research on the Return on Investment in State Vocational Rehabilitation ProgramsPurpose
The current project is updating and simplifying VR-ROI models that help VR agencies provide efficient and effective services to persons with disabilities. VR agencies are called to invest time and energy to understand the factors that predict sustained employment outcomes.
Our proposed updated and simplified models will provide guidance about the mix of services that provide superior outcomes and enable VR agencies to examine data across subgroups (i.e., race, geography).
This project continues efforts of two prior NIDILRR grants awarded to the University of Richmond to develop rigorous and methodologically sound VR ROI econometric models.
Collaborators
About the VR-ROI Project Grants
Current goals and how we got here...The National Institute for Independent Living and Rehabilitation Research (NIDILRR) has funded three grants relating to the VR-ROI Project. An overview of each is provided here (from newest to oldest).
The most recent grant is active and is the focus of this website.
2022-2025 Grant: Update and Simplify the VR ROI Model
New Return on Investment Models (ROI) for the Public Vocational Rehabilitation (VR) Program: Develop an Enhanced and Simplified ROI Model
This NIDILRR Field Initiated Development Grant number 90IFDV0028 was awarded to the George Washington University Center for Rehabilitation Counseling, Research, and Education for the period September 1, 2022 – August 31, 2025.
Major Project Partners
- North Carolina Division of Services for the Blind and Division of Rehabilitation Services.
- Consultants from the University of Richmond (professor emeritus), University of Virginia Department of Economics, Stoneybrook University Department of Economics, University of Chicago Harris School of Business, University of Montana Rural Institute
Project Goals
Develop VR-ROI models that help VR agencies provide efficient and effective services to persons with disabilities. The proposed models will provide guidance about the mix of services that provide superior outcomes and enable VR agencies to examine data across subgroups (i.e., race, geography).
Goal 1: Update Data. Our refined VR-ROI model uses agency data for individuals who applied for VR services between 2017 to 2021; i.e., after revised WIOA common performance measures were integrated into program data collection. Updated data allow investigation of correlations between common performance data elements and long-term employment outcomes, as well as COVID-impacted service provision and outcomes.
Goal 2: Measures of Service Intensity. Our post-WIOA model will include measures to account for VR-delivered service intensity, such as expenditures, service units, and variation between vendor and in-house provided services.
Goal 3: Simplified VR-ROI Model. We will explore the econometric characteristics of a simplified and more accessible version of the VR-ROI model that can be used by VR agencies across the country. This will put VR agencies in a better position to make timely decisions for enhancing services for their consumers with disabilities.
Goal 4: Knowledge Translation. We will use community-based participatory research methods with stakeholder groups to solicit input on model development and relevant products for understanding and utilizing VR-ROI models to improve VR services.
VR ROI Approach
- Uses readily available administrative data on:
-
- Characteristics of VR program participants
- VR services provided.
- Employment and earnings from state UI program records
- Conducts longitudinal analyses with up to 3 years of pre-VR employment data and at least 5 years of post-application data.
- Employs state-of-the-science statistical controls to ensure that the outcomes are the result of VR rather than other factors.
Outcomes
- Estimates employment & earnings impacts at the individual level
- Examines the impact of specific types of VR services on participants’ employment and earnings.
- Examines the impact of VR on employment and earnings for individuals with different kinds of disabling conditions.
- Estimates quarterly and annual rates of return (ROR) for specific populations as well as agency wide.
Feedback Mechanisms and Activities
- Project input from stakeholder focus groups and Advisory Council meetings
- Meetings with staff from partner agencies to discuss approach and review results
- Presentations at Economic & Vocational Rehabilitation meetings
- Publications in Economic & Vocational Rehabilitation journals
2014-2021 Grant: The VR ROI Model
Estimating Return on Investment in State Vocational Rehabilitation Programs
This NIDILRR Disability and Rehabilitation Research Project grant number 90DP007001 was awarded to the University of Richmond for the period October 1, 2014 – September 30, 2019 and extended through 2021.
New Return on Investment Models (ROI) for the Public Vocational Rehabilitation (VR) Program: Develop an Enhanced and Simplified ROI Model
This NIDILRR Field Initiated Development Grant number 90IFDV0028 was awarded to the George Washington University Center for Rehabilitation Counseling, Research, and Education for the period September 1, 2022 – August 31, 2025.
Major Project Partners
- The Virginia Department of Aging and Rehabilitative Services and George Washington University.
- State Vocational Rehabilitation (VR) agencies in Delaware (general), Kentucky (general), Maryland (combined), North Carolina (general and blind), Texas (general and blind), and Virginia (general and blind).
- Consultants from the University of Virginia Department of Economics.
Key Project Goals
Goal 1: Refine and test the ROI model. Further refine and test the VR-ROI model developed under a previous NIDILRR development grant using a larger, more heterogeneous set of state agencies and a more recent cohort of applicants for VR services (July 1, 2011 – June 30, 2012).
Goal 2: Training. Provide training to interested state VR agencies and other stakeholders in the use of the ROI model and the Estimator to be developed through this project.
Goal 3: Dissemination. Disseminate project information nationally to VR audiences, other stakeholders, and economics & VR researchers. Nine agencies across five states partnered in this grant.
VR ROI Approach
- Using readily available administrative data from a variety of sources (state VR agency client data systems, state Unemployment Insurance program wage records, Federal civilian employment records, and Social Security disability benefits data)
- Examining the impact of VR on employment and earnings for individuals with different disabling conditions (e.g., mental illness, intellectual disability, learning disabilities, physical impairments, blindness and vision impairments)
- Examining the impact of specific types of VR services on participants’ employment and earnings
- Starting to estimate VR’s impact when services begin, not when they end (i.e., applicant cohorts rather than closure cohorts)
- Conducting longitudinal analyses that include up to three years of pre-VR employment data and at least five years of post-application data
- Examining services provided over multiple VR cases
- Estimating annual rates of return for specific populations as well as agency-wide
- Employing statistical controls to ensure that the observed employment outcomes result from the provision of VR services rather than other factors
Training & Technical Assistance Activities
- Policy Brief, Speaker’s Kit, Introductory Webinar, Social Media, Journal Articles and Presentations
- Develop website: vrroi.org
Feedback Mechanisms and Activities
- Continuous project input from stakeholder focus groups, Advisory Council meetings, and Learning Community feedback sessions
- Meetings with staff from partner agencies to discuss approach and review results
- Presentations at Economic & Vocational Rehabilitation meetings
- Publications in Economic & Vocational Rehabilitation journals
2010-2013 Grant: Developing Models for Assessing ROI
Enhancing Outcome-Based Performance Measures for the Public Vocational Rehabilitation Program: Developing Models for Assessing Return on Investment
This NIDILRR Field Initiated Development Grant number 90IF000301 was awarded to the University of Richmond for three years (October 2010 – September 2013) and extended through 2015. Co-Principal Investigators David H. Dean and Robert M. Schmidt.
Project Partners
- The Virginia Department of Rehabilitative Services
- State Vocational Rehabilitation (VR) agencies in Maryland (combined), Oklahoma (combined), and Virginia (general and blind).
- Consultants from the University of Virginia Department of Economics, Florida State University Department of Economics, Virginia Commonwealth University Performance Management Group, University of Massachusetts – Boston Institute for Community Inclusion.
Project Goals
Goal 1: ROI model development and testing. Identifying the necessary components for a sound ROI model for VR, using Virginia data to develop VR-specific outcome models, and validating these models with other state VR agencies, including the Virginia Department for the Blind and Vision Impaired, the Maryland Division of Rehabilitation Services, and the Oklahoma Department of Rehabilitation Services, using data from those states’ administrative records.
Goal 2: Model interagency agreements. Development of model interagency agreements and protocols for accessing employment and earnings data from existing state administrative records and from SSA, testing those models with the partner states, and providing technical assistance in their use.
Goal 3: Guidance Documents. Development and testing of guidance documents, and provision of technical assistance to partner state VR agencies, to conduct ROI analyses with their own states’ administrative data.
Training & Technical Assistance Activities
- Planned products include exemplars, tools, and guidance that other State VR agencies can use to develop and implement their own long-term outcome evaluation and ROI programs.
Feedback Mechanisms and Activities
- Continuous project input from stakeholder focus groups, Advisory Council meetings, and Learning Community feedback sessions
- Meetings with staff from partner agencies to discuss approach and review results
- Presentations at Economic & Vocational Rehabilitation meetings
- Publications in Economic & Vocational Rehabilitation journals