GothamSchools — daily independent reporting on NYC public schools

What it really means to score “proficient” on New York tests

A reader recently drew my attention to a deceptively unassuming chart that the city often uses to defend its heavy reliance on state tests.

The chart shows how neatly eighth graders’ scores on the tests predict their future academic success. The higher the score they get, the better their shot at graduating high school with a Regents diploma — the only kind that will count come 2014.

But the reader pointed out that the chart also includes a more frightening statistic: Students who score at a level considered proficient by every measure, a 3 out of possible 4, only have a 55% shot of getting a Regents diploma.

picture-8

That 3 represents the low range of possible 3′s, which are handed out after the state converts raw results known as scale scores into a 1, 2, 3, or 4. A higher scale score equivalent to a 3.5 gives a student an 81% shot of getting a Regents diploma. Students who get a 4 out of 4, meanwhile, graduate 93% of the time..

Nevertheless, a 3 is considered enough to pass. And to move from one grade to the next, a student needs only a 2.

Concerns about the poor rigor of state tests began as cries in the dark by critics of the Bloomberg administration, elevated to the level of academic-but-still-not-official concern, and have now come close to gospel. New tests are being developed as part of the federal government’s push for “Common Core” standards, but they won’t be administered for several years.

UPDATE: The new people in charge of making state tests, State Education Commissioner David Steiner and his deputy John King, have taken the new gospel on the road. Steiner recently took the get-tough message against “grade inflation” to Rochester and Buffalo.

  • Pablo H.

    Great find! Do you have a link to the full presentation?

  • http://www.grand-rounds.blogspot.com Jennifer

    Astute observations and ones that have been echoed by the Commissioner during the recent regional meetings on upcoming changes to the scale score.

    Recognizing that Gotham Schools is a NYC-centric organization, it is important to note that the concept of “passing with a 2″ is unique to NYC. One of the challenges of these types of assessments is that they are designed for a particular purpose and start to lose their strength when they are used for different purposes than their intended ones.

    Yes, the tests have their issues but those issues have been compounded by a local decision to attach individual student success to a test designed to assess school performance.

  • http://www.SpecialEducationMuckraker.com Dee Alpert

    According to the Buffalo article, the Koretz study is finished. Anyone know where we can get a copy of the full report?

  • Jim Devor

    Yet another example of statistical “transparency”.

    For two years, I have been trying to find out what is the data source for the infamous graph. For example, which year is being referred to? Was the same neatly curved correlations replicated in other years? What subject is being measured (i.e. math, ELA or both)? Were ELL and Special Ed students included? Inquiring minds STILL want to know.

  • louis

    YES! Gotham PLEASE FIND OUT THIS INFORMATION!!!

Tips, questions, feedback?

Contact us at .

Follow GothamSchools

RSS

Feb. 10: You’re invited!

Chalk It Up

Recent Comments

46 comments so far today

Our Twitter Updates

  • Frank Thomas, DOE spokesman just told me no arrests have been made tonight at PEP despite confrontation between protesters & police earlier. 21 mins ago
  • RT @leoniehaimson: It's been shown repeatedly that as one schl closes another overwhelmed w/ high needs kids that small schls won't take 26 mins ago
  • Shael: the suggestion that kids are moved around (to large, struggling high schools) just isn't accurate. 28 mins ago
  • @SchoolBook: Manhattan rep @PSulliv and mayoral appointee Lisette Nieves get into an argument she tells him to get off his "soapbox” 30 mins ago
  • Mayoral appointee Lisette nieves chimes in on an increasingly irate @PSulliv she says he's being rude. 31 mins ago
  • More updates...

Archives

February 2012
M T W T F S S
« Jan  
 12345
6789101112
13141516171819
20212223242526
272829  
?>