The federal School Improvement Grant (SIG) program allocated US$7 billion over nearly a decade in an effort to produce rapid and lasting improvements in schools identified as low performing. In this article, we use a regression discontinuity design to estimate the effect of Ohio’s SIG turnaround efforts on student achievement and school administration. The results indicate that Ohio’s SIG program significantly increased reading and math achievement, with effects in both subjects of up to 0.20 standard deviations in the second year after SIG eligibility identification. Estimates for the third year are somewhat larger, in the range of one quarter of a standard deviation. We provide evidence that these effects were primarily attributable to schools that implemented the SIG Turnaround model. We also show that SIG eligibility had a positive effect on per-pupil spending, but no average effect on administrative outcomes, including staff turnover, the number of staff members in the school, and school closure. These null overall effects mask heterogeneity across SIG models, however. Most notably, Turnaround schools experienced more turnover than they otherwise would have, whereas Transformation schools experienced less.

References

Abdulkadiroğlu, A., Angrist, J. D., Dynarski, S. M., Kane, T. J., Pathak, P. A. ( 2011 ). Accountability and flexibility in public schools: Evidence from Boston’s charters and pilots . The Quarterly Journal of Economics, 126, 699 – 748 .

Google Scholar Crossref | ISI

Abdulkadiroğlu, A., Angrist, J. D., Hull, P. D., Pathak, P. A. ( 2016 ). Charters without lotteries: Testing takeovers in New Orleans and Boston . American Economic Review, 106, 1878 – 1920 .

Google Scholar Crossref | ISI

Adnot, M., Dee, T., Katz, V., Wyckoff, J. ( 2017 ). Teacher turnover, teacher quality, and student achievement in DCPS . Educational Evaluation and Policy Analysis, 39, 54 – 76 . doi:10.3102/0162373716663646

Google Scholar SAGE Journals | ISI

Angrist, J. D., Pathak, P. A., Walters, C. R. ( 2013 ). Explaining charter school effectiveness . American Economic Journal: Applied Economics, 5(4), 1 – 27 .

Google Scholar Crossref | Medline | ISI

Atteberry, A., Loeb, S., Wyckoff, J. ( 2017 ). Teacher churning: Reassignment rates and implications for student achievement . Educational Evaluation and Policy Analysis, 39, 3 – 30 .

Google Scholar SAGE Journals | ISI

Bartalotti, O., Brummet, Q. ( 2017 ). Regression discontinuity designs with clustered data . In Cattaneo, M. D., Escanciano, J. C. (Eds.), Advances in econometrics–regression discontinuity designs: Theory and applications (Vol. 38, pp. 383 – 420 ). Bingley, UK : Emerald Group .

Google Scholar Crossref

Bifulco, R., Duncombe, W., Yinger, J. ( 2005 ). Does whole-school reform boost student performance? The case of New York City . Journal of Policy Analysis and Management, 24, 47 – 72 .

Google Scholar Crossref

Bifulco, R., Ladd, H. F. ( 2006 ). The impacts of charter schools on student achievement: Evidence from North Carolina . Education Finance and Policy, 1, 50 – 90 .

Google Scholar Crossref | ISI

Borman, G. D., Hewes, G. M., Overman, L. T., Brown, S. ( 2003 ). Comprehensive school reform and achievement: A meta-analysis . Review of Educational Research, 73, 125 – 230 .

Google Scholar SAGE Journals | ISI

Boyd, D., Lankford, H., Wyckoff, J. ( 2008 ). Increasing the effectiveness of teachers in low-performing schools . In Ladd, H. F., Fiske, E. B. (Eds.), Handbook of research in education finance and policy ( 1st ed. , pp. 612 – 630 ). New York, NY : Routledge .

Google Scholar

Branch, G. F., Hanushek, E. A., Rivkin, S. G. ( 2012 ). Estimating the effect of leaders on public sector productivity: The case of school principals (National Bureau of Economic Research, Working Paper No. 17803). Cambridge, MA : National Bureau of Economic Research .

Google Scholar

Bross, W., Harris, D. N., Liu, L. ( 2016 ). The effects of performance-based school closure and charter takeover on student performance (Technical report). New Orleans, LA : Education Research Alliance for New Orleans .

Google Scholar

Brummet, Q. ( 2014 ). The effect of school closings on student achievement . Journal of Public Economics, 119, 108 – 124 .

Google Scholar Crossref | ISI

Calonico, S., Cattaneo, M. D., Farrell, M. H., Titiunik, R. ( 2017 ). rdrobust: Software for regression-discontinuity designs . The Stata Journal, 17, 372 – 404 .

Google Scholar SAGE Journals

Calonico, S., Cattaneo, M. D., Titiunik, R. ( 2014 a). Robust data-driven inference in the regression-discontinuity design . The Stata Journal, 14, 909 – 946 .

Google Scholar SAGE Journals | ISI

Calonico, S., Cattaneo, M. D., Titiunik, R. ( 2014 b). Robust nonparametric confidence intervals for regression-discontinuity designs . Econometrica, 82, 2295 – 2326 .

Google Scholar Crossref | ISI

Carlson, D., Borman, G. D., Robinson, M. ( 2011 ). A multistate district-level cluster randomized trial of the impact of data-driven reform on reading and mathematics achievement . Educational Evaluation and Policy Analysis, 33, 378 – 398 .

Google Scholar SAGE Journals | ISI

Carlson, D., Lavertu, S. ( 2015 ). School closures and student achievement: An analysis of Ohio’s urban district and charter schools. Washington, DC : Thomas B. Fordham Institute .

Google Scholar

Carlson, D., Lavertu, S. ( 2016 a). Charter school closure and student achievement: Evidence from Ohio . Journal of Urban Economics, 95, 31 – 48 .

Google Scholar Crossref | ISI

Carlson, D., Lavertu, S. ( 2016 b). Ohio School Turnaround Interventions: Impacts and Achievement, Attainment, and Administration. Columbus : Ohio Education Research Center .

Google Scholar

Cellini, S. R., Ferreira, F., Rothstein, J. ( 2010 ). The value of school facility investments: Evidence from a dynamic regression discontinuity design . The Quarterly Journal of Economics, 125, 215 – 261 .

Google Scholar Crossref | ISI

Chetty, R., Friedman, J. N., Rockoff, J. E. ( 2014 ). Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood . American Economic Review, 104, 2633 – 2679 .

Google Scholar Crossref | ISI

Clotfelter, C. T., Ladd, H. F., Vigdor, J. L. ( 2007 ). Teacher credentials and student achievement: Longitudinal analysis with student fixed effects . Economics of Education Review, 26, 673 – 682 .

Google Scholar Crossref | ISI

Clotfelter, C. T., Ladd, H. F., Vigdor, J. L. ( 2010 ). Teacher credentials and student achievement in high school: A cross-subject analysis with student fixed effects . Journal of Human Resources, 45, 655 – 681 .

Google Scholar Crossref | ISI

Cowen, J. M., Butler, J. S., Fowles, J., Streams, M. E., Toma, E. F. ( 2012 ). Teacher retention in Appalachian schools: Evidence from Kentucky . Economics of Education Review, 31, 431 – 441 .

Google Scholar Crossref | ISI

Dee, T. ( 2012 ). School turnarounds: Evidence from the 2009 stimulus (Program on Education Policy and Governance Working paper series). Retrieved from http://www.hks.harvard.edu/pepg/PDF/Papers/PEPG12-04_Dee.pdf

Google Scholar

de la Torre, M., Gwynne, J. ( 2009 ). When schools close: Effects on displaced students in Chicago public schools. Chicago, IL : Consortium on Chicago School Research .

Google Scholar

Dobbie, W., Fryer, R. G. ( 2013 ). Getting beneath the veil of effective schools: Evidence from New York City . American Economic Journal: Applied Economics, 5(4), 28 – 60 .

Google Scholar Crossref | ISI

Dragoset, L., Thomas, J., Herrmann, M., Deke, J., James-Burdumy, S., Graczewski, C., . . . Giffin, J. ( 2017 ). School improvement grants: Implementation and effectiveness (NCEE 2017-4013). Washington, DC : National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education .

Google Scholar

Engberg, J., Gill, B., Zamarro, G., Zimmer, R. ( 2012 ). Closing schools in a shrinking district: Do student outcomes depend on which schools are closed? Journal of Urban Economics, 71, 189 – 203 .

Google Scholar Crossref | ISI

Fryer, R. G. ( 2014 ). Injecting charter school best practices into traditional public schools: Evidence from field experiments . The Quarterly Journal of Economics, 129, 1355 – 1407 .

Google Scholar Crossref | ISI

Grissom, J. A., Kalogrides, D., Loeb, S. ( 2015 ). Using student test scores to measure principal performance . Educational Evaluation and Policy Analysis, 37, 3 – 38 .

Google Scholar SAGE Journals | ISI

Gross, B., Booker, T. K., Goldhaber, D. ( 2009 ). Boosting student achievement: The effect of comprehensive school reform on student achievement . Educational Evaluation and Policy Analysis, 31, 111 – 126 .

Google Scholar SAGE Journals

Hanushek, E. A. ( 2011 ). The economic value of higher teacher quality . Economics of Education Review, 30, 466 – 479 .

Google Scholar Crossref | ISI

Heissel, J. A., Ladd, H. F. ( 2016 ). School turnaround in North Carolina: A regression discontinuity analysis (Working Paper 156). Retrieved from http://www.caldercenter.org/publications/school-turnaround-north-carolina-regression-discontinuity-analysis

Google Scholar

Henry, G. T., Guthrie, J. E. ( 2015 ). Outcomes and impacts of North Carolina’s initiative to turn around the lowest-achieving schools. Consortium for Educational Research and Evaluation—North Carolina . Retrieved from http://cerenc.org/wp-content/uploads/2015/09/ES-FINAL-Final-DST-Report-9-3-15.pdf

Google Scholar

Herman, R., Dawson, P., Dee, T., Greene, J., Maynard, R., Redding, S., Darwin, M. ( 2008 ). Turning around chronically low-performing schools: IES practice guide. Washington, DC : National Center for Education Evaluation and Regional Assistance .

Google Scholar

Hess, F. M. ( 1998 ). Spinning wheels: The politics of urban school reform. Washington, DC : Brookings Institution Press .

Google Scholar

Imbens, G., Kalyanaraman, K. ( 2012 ). Optimal bandwidth choice for the regression discontinuity estimator . The Review of Economic Studies, 79, 933 – 959 .

Google Scholar Crossref | ISI

Jackson, C. K. ( 2009 ). Student demographics, teacher sorting, and teacher quality: Evidence from the end of school desegregation . Journal of Labor Economics, 27, 213 – 256 .

Google Scholar Crossref | ISI

LiCalsi, C., Citkowicz, M., Friedman, L. B., Brown, M. ( 2015 ). Evaluation of Massachusetts Office of District and School Turnaround Assistance to Commissioner’s Districts and Schools: Impact of School Redesign Grants. Washington, DC : American Institutes for Research .

Google Scholar

McCrary, J. ( 2008 ). Manipulation of the running variable in the regression discontinuity design: A density test . Journal of Econometrics, 142, 698 – 714 .

Google Scholar Crossref | ISI

Papay, J. ( 2015 , November ). The effects of school turnaround strategies in Massachusetts. Presented at the 2015 Conference of the Association of Public Policy and Management in Miami , FL .

Google Scholar

Rivkin, S. G., Hanushek, E. A., Kain, J. F. ( 2005 ). Teachers, schools, and academic achievement . Econometrica, 73, 417 – 458 .

Google Scholar Crossref | ISI

Schochet, P. Z. ( 2008 ). Technical methods report: Statistical power for regression discontinuity designs in education evaluations (NCEE 2008-4026). Washington, DC : National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education .

Google Scholar

Slavin, R. E. ( 1989 ). The PET and the pendulum . Phi Delta Kappan, 70, 752 – 758 .

Google Scholar ISI

Strunk, K. O., McEachin, A. ( 2014 ). More than sanctions: Closing achievement gaps through California’s use of intensive technical assistance . Educational Evaluation and Policy Analysis, 36, 281 – 306 .

Google Scholar SAGE Journals | ISI

Strunk, K. O., McEachin, A., Westover, T. N. ( 2014 ). The use and efficacy of capacity-building assistance of low-performing districts: The case of California’s district assistance and intervention teams . Journal of Policy Analysis and Management, 33, 719 – 751 .

Google Scholar Crossref

Tyack, D. B., Cuban, L. ( 1995 ). Tinkering toward Utopia. Cambridge, MA : Harvard University Press .

Google Scholar

Witte, J., Weimer, D., Shober, A., Schlomer, P. ( 2007 ). The performance of charter schools in Wisconsin . Journal of Policy Analysis and Management, 26, 557 – 573 .

Google Scholar Crossref | ISI

Zimmer, R., Gill, B., Booker, K., Lavertu, S., Sass, T. R., Witte, J. ( 2009 ). Charter Schools in Eight States: Effects on Achievement, Attainment, Integration, and Competition. Santa Monica, CA : RAND Corporation .

Google Scholar Crossref