Other Scholarly Content

 

NEPC Review: Urban Charter School Study Report on 41 Regions 2015 Public Deposited

Downloadable Content

Download PDF
https://scholar.colorado.edu/concern/defaults/zk51vh669
Abstract
  • Following up on a previous study, researchers sought to investigate whether the effect on reading and math scores of being in a charter school was different in urban areas compared with other areas and to explore what might contribute to such differences. Overall, the study finds a small positive effect of being in a charter school on both math and reading scores and finds that this effect is slightly stronger in urban environments. There are significant reasons to exercise caution, however. The study’s “virtual twin” technique is insufficiently documented, and it remains unclear and puzzling why the researchers use this approach rather than the more accepted approach of propensity score matching. Consequently, the study may not adequately control for the possibility that families selecting a charter school may be very different from those who do not. Other choices in the analysis and reporting, such as the apparent systematic exclusion of many lower-scoring students from the analyses, the estimation of growth, and the use of “days of learning” as a metric, are also insufficiently justified. Even setting aside such concerns over analytic methods, the actual effect sizes reported are very small, explaining well under a tenth of one percent of the variance in test scores. To call such an effect “substantial” strains credulity.

Creator
Date Issued
  • 2015-04-27
Academic Affiliation
Subject
Last Modified
  • 2021-03-18
Resource Type
Rights Statement
Language
License

Relationships

In Collection:

Items