GothamSchools — daily independent reporting on NYC public schools

curious 2

Brill-ing Down: Adding to Steven Brill’s NYT Magazine Report

Steven Brill’s latest article chronicling the politics of the Race to the Top competition has caused a torrent of commentary. One contentious aspect of the piece is Brill’s comparison of two schools that share the same building: Harlem Success Academy and P.S. 149. After Valerie Strauss picked up the statistics posted on the New York Public School Parents Blog, there has been much speculation about what types of kids are attending each school. Just how different are the populations anyway?

To figure out the answer, I looked at NY State Accountability Report Cards, the Special Education Service Delivery Report for P.S. 149, as well as special education invoices provided to the UFT by the New York State Education Department. I chose these data sets because they seemed to be the most reliable and the most comparable. By “comparable” I mean that both Harlem Success and P.S. 149 have to submit to the state as part of their Accountability Report Cards data on students who receive free or reduced price lunch (an indicator of economic need), whereas, for instance, only P.S. 149 lists something known as the poverty rate (which is slightly different.)

According to this data, Harlem Success Academy does appear to serve fewer needy students, both in terms of economic status, limited English proficiency, and special education needs.  On the other hand, Harlem Success dramatically outperforms P.S. 149 on 3rd grade test results.

For a more comprehensive evaluation, the tables below compare 2008-2009 demographic data and 2008-2009 3rd grade state test scores. (Harlem Success only had this one testable grade.) The second table compares test scores overall and the third table looks at test scores broken down by subgroups like economic need and special education status.

DEMOGRAPHIC DATA:

picture-71

3rd GRADE TEST DATA: ALL STUDENTS

picture-82

3rd GRADE TEST DATA: SUBGROUPS*

picture-9

*There were not enough Limited English Proficient students tested in 3rd grade at P.S. 149 to report a score. There were no Limited English Proficient students tested in 3rd grade at Harlem Success.

  • http://www.edreformer.com Douglas

    This was a good statistical examination, but you remain vague about what it is supposed to convey to us.

  • http://www.edreformer.com Douglas

    If it is supposed to convey that Harlem Success Academy has some kind of unfair advantage. In a way, it could be said that it does. If you look at the scores of the children in Sojourner Truth, they are lower. It would not be because the kids are needy. It may be that http://www.joannejacobs.com/2010/05/education-2010-more-high-poverty-schools/ High poverty schools don’t tend to have highly qualified teachers. And the way I understand it, that’s because unions help better, higher qualified and better paid teachers to avoid these areas.

  • Julie Matz

    The most significant piece of data presented is the fact that Harlem Academy serves K through 3rd grade, While PS/MS 149 serves K through 8th grades. This is a comparison of apples and oranges, even when you just look at 3rd graders (which they both share). K-8th schools are an entity unto themselves, with challenges that a K-3 school would never face.

  • Maestra

    Why did Kim Gittelson not also consult P.S. 149′s Comprehensive Education Plan, or CEP, which is posted on the DOE website? Written in May 2009, the school’s 2009-10 CEP indicates that its ELL population appears to be growing and accounting for a greater percentage of total enrollment. As of May 2009, 62 ELLs with a variety of home languages — mostly Spanish, but also Arabic, Bengali and several African languages — constituted 14% of the enrollment, not 10% as listed on the 2008-09 register, which takes an attendance snapshot on a single census day (usually Oct. 31, months before the administration of the standardized ELA and math tests). The growth is also apparent in the number of students who took the May 2009 NYSESLAT test: 55 (source: P.S. 149 Comprehensive Information Report; NYSESLAT statistics are separate from the NY State Accountability Report Card, which Gittelson cites).

    Significantly, according to the CEP, 18 of P.S. 149′s were enrolled in 2008-09 in the all-important testing grades: third, fourth and fifth. Hence, of the 106 students who took the third-grade, fourth-grade and fifth-grade math exams in 2009-09, 17% were probably ELLs. (I say “probably” because the math test was administered shortly before the CEP was filed.) According to the CEP, 100% of ELLs in those grades scored “proficient” (which I assume means at or above grade level) in math. That is quite an accomplishment.

    Unless one looks at the CEP narrative, and not just statistics, one might ignore the apparently earnest efforts being made at P.S. 149 to improve the performance of their diverse and challenging group of ELLs on literacy exams (the ELA and NYSESLAT). The school should be applauded for having two certified ESL teachers who, the CEP says, provide push-in and pull-out services, as well as afterschool and Saturday programs for ELLs and their parents (funded by federal Title III funds, and well-thought-out, as described in the CEP). Also, I noticed that P.S. 149 was one of very few schools to have no compliance issues listed on a recent audit by the New York State Education Department’s Office of Bilingual Education. (See http://www.emsc.nysed.gov/biling/bilinged/2009-10_NYC_Part154-LAPReports.htm ). Notice also that two ELLs enrolled at the school are in self-contained special education classrooms, and that some of the school’s 17 ELLs in Grades 7 and 8 tested at the beginner level on the NYSESLAT, indicating that they are adolescents who arrived in the U.S. with little English, posing particular challenges for the school.

    I have no relationship with P.S. 149; I never even heard of it before the Times magazine piece mentioned it. I’m just using information available on the school’s statistics page of the DOE website. But I am clicking on more sources than Gittelson did.

    In contrast, what has the Harlem Success Academy done for the Latino, African, and Bengali newcomers in the neighborhood? Brill doesn’t mention a thing in his article.

  • http://curious2.typepad.com Kim Gittleson

    Hi Maestra -
    I did not use the CEP reports because, as I note in my post, I was interested in looking at the two schools by using comparable data. There is no CEP report for Harlem Success, and therefore I thought it would be unfair to pick and choose which data to use to represent the schools if one school (either HSA or P.S. 149) didn’t have numbers. The Accountability Reports, in my mind, are the fairest example of comparable data for the two schools. What you bring up in regards to P.S. 149 is certainly interesting and worthy of analysis and it is indeed data that I’ve looked at, however, I just found it outside of the scope of this particular post. Hope that helps clear up any confusion!
    Kim

  • Maestra

    Kim, I appreciate your response. I did notice you limited your analysis to comparable data to be, you say, fair. But I think it is unfair to write that Harlem Success Academy “dramatically outperforms” P.S. 149 on 3rd grade tests without taking into account that only 39 kids took the third-grade ELA at P.S. 149 last year, of whom probably 10 were ELLs with four different home languages, as stated in the CEP. The high concentration of ELLs in the school’s third grade could explain why P.S. 149 posted better results for Grade 6, which had half the number of ELLs as Grade 3, and in which 86% of students scored at or above grade level. (Again, I realize you couldn’t discuss sixth grade because Harlem Success didn’t have one, but here again, your discussion fails to paint the whole picture.)

    Statistics should inspire inquiring minds to look further. What is preventing Gotham Schools from phoning Harlem Success Academy — or, if need be, filing a Freedom of Information request — to ask if any ELLs took the 3rd grade ELA at that school (unlikely, if only 2% of enrollment in all grades was ELL)? Otherwise, we are left with “data sets,” but not an investigation.

  • Teacher

    Not all poor kids are the same. Some are motivated to leave the public system and apply to charters. At the very least I’d want to look at attendance data – both lateness and absence – before trying to compare these populations.

  • Smith

    Well, Kim. Can you get the attendance figures for the two schools?

  • http://curious2.typepad.com Kim Gittleson

    According to the Accountability reports, HSA had an annual attendance rate of 96% in 2007-2008 and P.S. 149 had a rate of 96%. You can go to http://www.nystart.gov/publicweb/ to view the specific report cards. I don’t have specific data broken down by lateness versus absence.

  • http://curious2.typepad.com Kim Gittleson

    Oops apologies – that published too soon. The rate at P.S. 149 is 89%.

  • http://usaedustat.com Vic Spencer

    One other consideration may be of value.

    With 15 year old student data, the OECD-PISA tests show the USA at 34th internationally.  We used to be very close to the top.  The top two would be Finland and Alberta Canada.

    I am wondering why we are not looking at how the international leaders make their results happen.

    If we are investigating to become better only within the 34th “sandbox”,  there is no way for us to get back to the top, where we should be in order for our children to become employable for life.

Tips, questions, feedback?

Contact us at .

Word from Our Sponsor

Follow GothamSchools

RSS
Subscribe to the daily email digest:

Chalk It Up

Recent Comments

0 comments so far today

Archives

May 2013
M T W T F S S
« Apr  
 12345
6789101112
13141516171819
20212223242526
2728293031