Title
Data Issues in Developing Valid ROI Estimates
Abstract
This paper discusses issues associated with using readily available administrative data in estimating ROI for vocational rehabilitation services. It starts with a discussion of longitudinal outcomes data. The discussion is divided up into labor market outcomes data, other types of outcomes data, necessary sample sizes (power analysis), and ways to deal with people systematically excluded from the outcomes data. Next, the paper focuses on services data. The topics covered include the need for control groups, using service cohort data, different sources of service, and merging service data with outcomes data. Finally, the paper moves to the need for other controlling explanatory variables including discussions of inclusion of demographic explanatory variables and data from local labor markets. Two online appendices to this paper provide additional details through (1) an example of a power analysis to illustrate sample size issues and (2) a discussion of Institutional Review Board issues associated with conducting empirical investigations using administrative data.
Document Type
Article
Publication Date
2019
Recommended Citation
Stern, S., Clapp, C. M., Pepper, J. V., & Schmidt, R. M. (2019). Data issues in developing valid ROI estimates. The Journal of Rehabilitation Administration, forthcoming.
Click below to download online appendices.
Appendix A- A Simplified Power Analysis.pdf (156 kB)Appendix A: A Simplified Power Analysis
Appendix B- Institutional Review Board Issues.pdf (171 kB)
Appendix B: Institutional Review Board Issues