GothamSchools — daily independent reporting on NYC public schools

Charter Schools’ 2009-2010 Test Data: Who Is Still Proficient?

As discussed here and here, the state released the results of the 2009-2010 Grade 3-8 Math and English language arts test results last week. The focus has been on the new, higher bar for passing the tests and the resulting large drop in the percentage of students judged as proficient. Charter schools, like traditional public schools across the city, saw their much-touted proficiency gains plummet. Barbara Martinez at the Wall Street Journal did a good job of summarizing charter schools’ results in New York City. In order to give a more complete picture, I analyzed the 2009-2010 results for charters to see which schools performed best and how the schools performed compared to their traditional public school counterparts. I also posted data on individual schools below and in this spreadsheet.

PROFICIENCY

I defined proficiency in the customary way: as the proportion of students at a charter school that scored a Level 3 or higher on the ELA or math tests. In order to look at overall school performance, I averaged the proficiency rate across grade levels broken down by subject, and then took the average of both the ELA and math tests to come up with a single “proficiency” number. The schools that had the highest average proficiency rates were Harlem Success Academy, Icahn Charter School 2, the Bronx Charter School for Excellence, and the Williamsburg Collegiate Charter School. (The other two Icahn Schools also scored in the top 10 of all charter schools.) To be clear, different schools serve different grades and comparing performance across grades can be misleading.

I’ve posted a chart below that lists the average proficiency rates as well as the ELA and math proficiency rates, for every charter school that posted test results during the 2009-2010 school year. Scroll over the name of the school to find out what grades the school services, which grades were tested, and other salient information relating to the school’s performance.

PEER PERFORMANCE

I also compared average charter school performance to average traditional public school performance in neighborhoods in which there is a large cluster of charter schools. This gives a rough sense of how charters compare to traditional public schools with somewhat similar demographics. The neighborhoods I chose were the same that the UFT looked at in their analysis of charter schools: the South Bronx, Central Brooklyn, and Harlem.

Using this simple metric, I found that charters in the South Bronx, Harlem, and Central Brooklyn performed much better than their traditional public school counterparts. Average charter proficiency in all three neighborhoods was about 50% compared to 35% in traditional public schools. Charters performed significantly better in math than traditional public schools, which mirrors the trend citywide. Charter schools located in the South Bronx in particular had a proficiency rate that was around 25 points higher than that of traditional public schools in the same neighborhood. The chart below summarizes my findings.

My analysis of charter school test performance did not take into account demographics, such as the proportion of ELL or special education students or the number of students who are eligible for free or reduced priced lunch. These factors, of course, can make a significant difference in test performance.

As always, I welcome your feedback for ways that I can improve this analysis, as well as other methods that I could use to make the data more understandable.

  • http://tuttlesvc.org Tom Hoffman

    Where can one find all the raw data on the NYS or NYC website?

  • Kim Gittleson

    Hi Tom – The data on all schools is available here: http://www.emsc.nysed.gov/irts/ela-math/
    My spreadsheet with the charter data is available here: http://www.box.net/shared/static/8ppbkixx0o.xls Hope that helps! Kim

  • Sally Bee

    Hi Kim. Thanks for all your good work. Is there any way the chart can add the special ed or special ed/ELL percentage data? Maybe some different colored polka dots in the bars? I have been following Opportunity Charter School’s saga–it certainly would be interesting to be able to see immediately that they have 50%+ of special needs students. Since it is so rare for a charter to have a mission specifically to support special ed populations/inclusion/English Learners I was thinking including this info could be an improvement in your graph. I love the shading device–it works well!

  • http://www.classsizematters.org Leonie Haimson

    I hope that all those who provided so much attention and PR for the Equity Project’s charter school (whose rationale was based upon high teacher salaries and large classes, though it wasn’t clear that the classes were really much larger than average middle schools in D6) will now take a look at the relatively poor results in terms of their test scores. Paying large salaries (as a recent NY Times article proposed for Kindergarten teachers) does not necessarily lead to good results.

  • Mike

    Kim-
      Thanks for an interesting analysis.  In my opinion, you could strengthen your findings by doing a weighted average as opposed to a straight (or unweighted) average across all grades and tests in a school.  A weighted average would adjust the calculation by the number of students tested in a grade and test as a function of the total number of students tested.  
    Mike

  • taxpayer

    What can money buy?

    I am interested to see what the operating budgets look like for each of the schools because I know for a fact that one school with an enormous budget scored very low on the list…prompts one to ask, exactly what can money buy?

  • http://curious2.typepad.com Kim Gittleson

    I don’t have expense data for this year (so the schools that opened during the 2009-2010 year are absent) but charter expenses from 2008-2009 can give you a sense of what charters spent per pupil, including philanthropy. The post is available here: http://gothamschools.org/2010/01/14/charter-school-expenses-2009/
    Mike and Sally – thanks for your suggestions. I’ll update my analysis accordingly and let you know!
    Kim

  • Ticked-off Taxpayer

    Taxpayer — the new charter school law now permits state audits of charter schools, so we should be seeing information like that sometime soon.  When people do see it, and they realize how much more money is being spent — combining taxpayer dollars with private money — for results no different from, and often worse than, most public schools, maybe they’ll wake up to this corporate heist of public education and vote the charterizers out of office.

  • dirk

    thanks again Kim, as others stated would love to see a little more nuanced analysis that took some account of student demographics, etc. As to the budget issues, charters are public schools and subject to FOIL, so their budgets are available as well as their tax filings– and indeed I think gotham did an analysis of 990s previously. I am not standing up for Equity Project or criticizing them as i dont have enough information to make those value judgments, but I believe they opened with a 5th grade, where current scores may reflect prior educational experiences more than the school’s quality– that said, obviously the scores were fairly low. Aaron, Kim and others– would love to see some regression analysis here or something, that is a little less raw in terms of data. But thanks for this first step

  • asdfi

    Kim please learn to use the (more…) button. You should really place large graphics like that below the break. 

  • Jack

    Leonie,

    Slamming TEP’s test scores means you’re making an illogical causative leap from high salaries to low test scores. How do we know that the scores wouldn’t be even lower without high salaries? Do you expect teachers to work miracles within one year?

    If you’re really interested in an objective comparison then compare TEP’s students to their community school peers – and do it after three years, not one.

    Best,

    Jack

  • Gideon

    I’m not sure averaging across grade levels is a fair comparison since students tend to be more proficient in lower grades than higher grades, thus giving elementary schools an advantage over middle schools, especially since schools that enroll students in grades 5 or 6 have had fewer years to affect their students than those that enroll in Kindergarten and grade 1 and then don’t test until grade 3. Similarly, you shouldn’t compare a school with only a few testing grades, especially elementary schools, to a district with scores for all six testing grades.

  • http://www.classsizematters.org Leonie Haimson

    Jack, of course you are right; and one year’s test scores are nearly meaningless without more context, analysis and time.

    However, I’m pretty sure that if TEP charter had outperformed its district’s schools, they would have put out a press release and opeds, arguing that their high test scores proved that class size doesn’t matter and that whatever they are doing instead is the key to their success.

    After all, isn’t that what Joel Klein, Eva Moskowitz, the editors of the News and the Post, and the charter school lobby does each year?

  • Jack

    Leonie,

    Thanks for your response. I have a great deal of respect for the work you do. Every child deserves an appropriate class size.

    I am not in a position to speak for TEP but it seems that the theory behind the school is potentially sound. Putting a superb instructor in front of 36 students is a potentially superior option to putting a mediocre teacher in front of 18 students. Twice the kids can benefit from a teacher who’s twice as effective. Other countries do this without much hassle and they’re attaining test scores that make ours in the USA look measly by comparison.

    I don’t agree with everything that goes on at TEP; teaching Latin seems like gimmickry to me when their student population might benefit more from ESL. However, I’m objecting to the cynical position you’ve taken that looks at one point in the data to extrapolate a conclusion that has not yet been borne out. Of course TEP’s test scores are far lower than we would want, but let’s give them a chance to teach the kids for a few years before questioning their model. And I’ll also object to the broad brush stroke you’ve used to paint all charter schools: TEP and Harlem Success Academy are separate organizations, and we should treat them accordingly.

    Best,

    Jack

  • Pogue

    Broad Brush Alert! – “Super teachers vs. Bad/mediocre teacher” comment made again.

  • ASTRAKA

    Jack regarding:
    “Putting a superb instructor in front of 36 students is a potentially superior option to putting a mediocre teacher in front of 18 students. Twice the kids can benefit from a teacher who’s twice as effective.”

    Very interesting mathematics. AMAZING! I would say.

    That Idea will solve every problem that exists in our public education.

  • Ciizen X

    I find it utterly painful and incredibly sad that this artlcle and all the comments seem to accept that the New York State criterion-referenced tests with their bogus scaled scores offer any valid or reliable measure of student learning. Folks: get a grip: the tests are not even designed to measure learning. And then when we factor in issues of cultural load (tied directly to vocabulary) many of the items on the tests (the ELA in particular) do not measure much more than cultural capital (tied most directly to family wealth–not income–and maternal levels of schooling). The issues of equity and access to high quality education are critically important Please don’t fall for the spin about state achievement tests scores as some measure of learning–or worse: a measure of teacher or school effectiveness. To say nothing about the sort of outcomes we really need from public schooling: students with the skills to tackle complex issues and find innovative solutions; experience and confidence to engage in democratic deliberations across differences; deep knowledge about and commitment to– the world around them…..None of these, of course, items very amenable to a 3 hour paper and pencil test.

  • miss teacher

    Jack, to extend your example, how about putting that superb teacher in a class of 18-20 instead of 36? Think then about the possibilities. Many have made similar arguments about class size not being important, including the mayor, if I recall correctly. But did you consider the quality of the STUDENTS? Are you talking about 36 gifted kids? Or 36 struggling learners? A good teacher is important, but it’s a rare individual (if one exists as all) who can take an entire, oversize group of kids who are behind and work miracles (And very large classes of kids who are behind do exist- I’ve had them). We’re only human, which is something that gets overlooked.

  • Emily

    I would like to know the high scores for 2009-2010 state tests for all the 5th Grade students of that year.

  • California Gurl

    I am in California where many k-12 charter schools have sprung up that focus almost exclusively in online learning, especially at the secondary level. These schools are not restricted to district boundaries and many have students spread across a wide geographic area. My question is this: Are the schools represented in your report all brick and mortar type schools? I have been trying to find out if online schools are as effective as traditional schools, but have not yet found data on this growing subset of public charter school providers.

  • Pingback: TEP and a failure of leadership - eduskeptic

Tips, questions, feedback?

Contact us at .

Word from Our Sponsor

Follow GothamSchools

RSS
Subscribe to the daily email digest:

Chalk It Up

Recent Comments

1 comment so far today

Events Calendar

Archives

May 2013
M T W T F S S
« Apr  
 12345
6789101112
13141516171819
20212223242526
2728293031