GothamSchools — daily independent reporting on NYC public schools

testing 1-2-3

A list of takeaways we noticed from this year’s state test scores

Despite our ongoing attempt to streamline the mountain of information that came with the state’s release of the 2010-2011 test scores, there are still plenty of takeaways that haven’t been said on a press release or at a press conference.  After taking a slightly deeper look at the data, here are 10 worthwhile bulletins to consider:

  • Some of the neediest students took a step back; others showed progress. Students who are identified as English Language Learners, or ELL, improved slightly in math, but took another step back from statistical gains they made on the english test (ELA) earlier in the decade. While nearly half of the city’s non-ELL students met the state’s ELA standards, just 12 percent ELL students did so. That’s down from 34 percent two years ago, when the standards were easier and 1 percent drop from a year ago. The ELL students improved slightly in math. Special education students improved in both ELA and math.
  • The achievement gap remains vast. Schools in poor neighborhoods still struggle the most. In the South Bronx — one of the nation’s poorest congressional districts — and central Brooklyn, average proficiency rates were below 30 percent in ELA and below 40 percent in math. (Citywide rates were 57 percent in math; 44 percent in ELA). In the city’s more affluent neighborhoods, like Bayside, the Upper West Side and lower Manhattan, scores hovered at significantly higher rates. District 26 in Queens topped out in both subjects, with 74 percent proficiency in reading and 88 percent proficiency in math.
  • New doesn’t always mean better. More than a dozen schools in their first year of testing spanned both extremes of the performance spectrum. Half of them, including The Active Learning Elementary School, whose entire 20-student third grade class was perfectly proficient, significantly outperformed other schools in their districts. But many others struggled just as much as the closed schools that they were supposed to replace. In four such schools, less than a quarter of students did not meet reading standards. Just 5.8 percent of students at one school, Urban Scholars Community School, were proficient in reading.
  • Charter schools outperformed their neighbors, mostly. Citywide, 69 percent of students in charter schools met standards in math, up from 63 percent last year. In ELA, 45 percent were proficient, up from 43 percent last year. Both beat citywide averages. Nearly 75 percent of the charter school classes that took a state exam scored better than their districts, on average.
  • But some charter schools didn’t fit into this trend. A notable exception was Opportunity Charter School, which was the lowest scoring charter school in the city. Just 3 percent of its eighth graders were proficient in reading and just 23 percent met standards in math. By design, the school has a high number of special education students, who typically score much lower on state tests. But this year, as we reported, Opportunity also experienced significant internal turmoil, including a unionization bid by its teachers and the subsequent firing of at least 14 of them. Other charter schools with scores worth noting? The school operated by the United Federation of Teachers posted proficiency rates well below the charter school median score in nearly every grade. And The Equity Project, a charter school in Harlem that pays first-year teachers $125,000, had its second straight year of mediocre marks. TEP’s average scores hovered close to — or fell below — the district average.
  • Unsurprisingly, the city’s highest-scoring schools are also its most selective. The citywide gifted and talented Anderson School, which rarely admits anyone with a score below the 99th percentile on a nationally normed aptitude assessment, had the highest average scores in the city. Many other high-performing schools also contain gifted programs, which limit admission to students scoring in the 90th percentile or higher on the same tests.
  • Few schools experienced big score gains. There were exceptions, such as the Brighter Choice Community School in Brooklyn profiled in the Daily News, where the principal attributed a 55 point gain in its ELA scores to a bad year last year and a smaller class and new resources this year. But most schools saw change within a point or two of the citywide average. One explanation could be that the new test standards, put in place to curb grade inflation, actually worked. A more cynical take would be that principals changed their schools’ testing conditions and scoring policies in response to increased scrutiny by the city. In February, city officials announced that they would begin auditing 60 high schools whose Regents scores and graduation rates showed suspicious patterns, including large score gains in a short time. While the schools that received scores this week weren’t part of these audits, principals might have worried that the department’s auditors would turn to elementary and middle schools next. An even more cynical read on the flatter scores? That students simply didn’t learn more than last year.
  • A handful of schools did see big drops in their scores. Reading scores at P.S. 197 John B. Russwurm in Manhattan dropped 24 points, although it improved slightly in math.
  • The state doesn’t think the tests the scores came from were very good. The state completely discredited exams given before last year, saying their results frequently called students proficient when they weren’t. Now the state has made some incremental changes, such as adding more questions and keeping old questions under wraps to make coaching harder. But it’s still planning to join many other states in adopting completely new tests in three years. Those tests will be based on the new Common Core standards and are likely to prompt a massive dropoff in scores, as testing experts have documented typically happens when accountability measures suddenly change.
  • And yet the scores really matter. The city’s argument that it doesn’t judge schools “solely” according to test scores is a little disingenuous. It’s true that decisions about whether to close schools are based on a number of data points, including their progress reports, school surveys, and quality reviews. But 85 percent of a school’s letter grade on its progress report comes from students’ test scores arrayed in various ways.
  • Paula

    Oh dear. “Despite our ongoing attempt to streamline
    the mountain of information that came with the state’s release of the
    2010-2011 test scores, there are still plenty of takeaways that hasn’t
    been said on a press release or at a press conference.  After taking a slightly deeper look at the data, here’s 10 worthwhile bulletins to consider:”

    Can you find the 2 grammar errors in that opening?
    1) “…there are still plenty…that hasn’t…”  Should be “…there are still plenty…that haven’t…”
    2) “…here’s 10…”   Should be “…here are 10…”

    Geez.

  • Gdecker

    fixed, thanks!

  • enpassant

    Why don’t you take a good hard look at the “attrition” rates at the highest performing charter schools.  Before any charter can trumpet their success, take a peak at the declining number of tested students in any cohort.  Why do the “highest ” performing charter schools seem to lose nearly 1/3 of their testable students?  By shining a spotlight on this issue Gotham, could really do some good  

  • enpassant

    Why don’t you take a good hard look at the “attrition” rates at the highest performing charter schools.  Before any charter can trumpet their success, take a peak at the declining number of tested students in any cohort.  Why do the “highest ” performing charter schools seem to lose nearly 1/3 of their testable students?  By shining a spotlight on this issue Gotham, could really do some good  

  • Gideon

    Is there a way to break down the scores so we can look just at the students who are NOT in special education or ESL in each school.  This would seem a fairer way to compare schools, since the proportion of special needs students varies greatly across schools.  Does the state make this kind of analysis possible?

  • Anonymous

    Gideon is correct.  You need to compare apples to apples.  While I am not trying to take anything away from charter schools many people forget that most charter schools do not cater to the SPED / ELL crowds.

  • Follow the Money

    Up 1 point? 2 points? 3 points? How many does it take to actually be statistically significant? Doesn’t that figure in here???

  • Tim

    And just as importantly, charters usually have a higher percentage of reduced-price-lunch eligible children in their reduced + free mix. 

    The difference between NAEP 4th grade math and reading and 8th grade math scores for reduced-price eligible children and non-eligible children in New York City is statistically insignificant. 

  • Blueriver26

    Tim – you mean reduced-price/free lunch children show statistically significant differences, right?  Not insignificant.  This is a hugely important point, and one that is neglected in commentary and analysis.

  • Blueriver26

    Tim – you mean reduced-price/free lunch children show statistically significant differences, right?  Not insignificant.  This is a hugely important point, and one that is neglected in commentary and analysis.

  • Tim

    Blue River, 

    Yes, that is another way of looking at it: the difference between reduced-price and free-lunch eligible kids is considerable and statistically significant for 2009 NYC NAEP scores in 4th grade reading/math and 8th grade math. 

    I took the opposite approach, which was to say that there’s no statistical difference between kids who AREN’T eligible for free lunch and reduced-price eligible kids. The upshot is that reduced-price and free-lunch kids probably shouldn’t be lumped together, and NYC charters tend to have a considerably higher number of reduced price kids compared to their districts. 

    The income cut-offs for reduced-price eligibility are still very low, so I don’t want to give the impression that I believe reduced-price kids are blessed somehow, but I think it’s safe to assume that a kid from a reduced-price household isn’t homeless, e.g. It’s more likely to be a two-parent home, or have at least one parent who is employed full-time (which likely means that the parent is at least a high-school graduate). Overall the odds are better that the child isn’t being exposed to the sort of extreme out-of-school poverty and related dysfunction that can so greatly compromise in-school performance.

  • Michael M. (parent still)

    One out of two?  ;-)

  • Michael M. (parent still)

    Agreed. 
    Not to mention if you gave the same kids the same test a different day, scores might vary by that much or more.
    Not sure the technical terms, but loosely, range vs. repeatability.

  • http://urbanannapurna.posterous.com/ urban annapurna

    i’ve had a lot of experience with statistics and running numbers, and any statistician worth their salt will tell you the same: just because something is statistically significant doesn’t mean that it is “realistically” significant. numbers are one thing (they can be stripped down and analyzed fairly objectively) while what the numbers are representing is another, in that what the numbers are representing often involved subjective situations. statistical findings always, always, always have to be examined in context – something the DOE (and most ed de/reformers) fail to do. it’s easy to crunch numbers, it’s another thing entirely to know what those numbers really mean.

Tips, questions, feedback?

Contact us at .

Word from Our Sponsor

From Our Jobs Board

Featured Employers
Recent Jobs

Chalk It Up

Recent Comments

0 comments so far today

Archives

June 2013
M T W T F S S
« May  
 12
3456789
10111213141516
17181920212223
24252627282930