GothamSchools — daily independent reporting on NYC public schools

Closing the Gap: Charter School Special Education Stats

Last week, the New York State Senate passed a bill that would increase the number of charter schools in New York from 200 to 460. Included in the bill was a provision that charter schools increase efforts to enroll students with learning disabilities — an attempt to appease critics who claim that charters significantly under-enroll students with disabilities.

Yet an examination of data provided to me by the city shows that while charters enroll fewer students with disabilities, the gap is not as large as initially reported by the state teachers union, known as NYSUT. According to Department of Education data, 13 percent of charter school students have an Individualized Education Plan, indicating that they have special needs, compared to 15 percent at traditional public schools. NYSUT reported the numbers as being 9.4 percent at charter schools and 16.4 percent at district schools.

The discrepancy stems from problematic data NYSUT received from the state education department. According to the state, the number of students with disabilities that a charter school reports enrolling often does not match up with numbers reported by school districts. As a result, the state does not consider its own data to be reliable.

As an alternative, I used a database known as CAPS, which is compiled by the city’s Committee on Special Education. CAPS includes information about every student in the city who has an IEP, so it provides a more accurate breakdown of the number of special education students at each school.

I found that the percentage of charter schools enrolling as many or more students with disabilities than their traditional public school counterparts increased from a quarter of schools last year to almost a third of schools this year. Meanwhile, charter high schools actually enroll a larger percentage of students with IEPs than traditional public high schools both within their geographical districts and citywide. Of course, there are only a small number of charter high schools.

I also noticed that the 54 charter schools that are authorized by the DOE enroll, on average, 4 percent more students with IEPs than the 37 charters that are authorized by SUNY’s Charter Schools Institute. (City-authorized charters have special education populations of around 14 percent, versus 10 percent for the SUNY schools.) The New York State Education Department authorized just seven charter schools in 2009, which enrolled special education students at about the same level as the city-authorized schools.

A full breakdown of the data is below, followed by some notes on my methodology. To see my calculations as well as special education enrollment by school, you can check out this spreadsheet.


Notes on Methodology:
1. The number of students in need of IEPs can fluctuate as the year progresses. I used numbers from the end of the school year, because the DOE classifies this as the “high-water mark” for special education numbers.

2. To compare charter schools to traditional public schools, I looked at the average IEP rates of traditional public schools in the same district as the charter school, divided by year. So, for example, if a charter school in District 5 enrolled students in kindergarten through fifth grade, I looked at the average IEP rate of kindergartners through fifth-graders in District 5′s traditional public schools. I took an average because IEP rates vary significantly with grade year, with lower rates in the early years (K-2), the highest rates in middle school, and average rates in high school.

3. Since the number of students requiring special education services has increased dramatically over the past five years (see chart below), there has been a significant increase in the percentages of students who need services at both the charter and district schools. Thus, if you look at the data for two consecutive years, you will notice significant increase at both the charter and district level — this is not a data error.

Special Education Students, 2003-2009

4. Unfortunately, my data did not differentiate among the kinds of services required by students with IEPs, so I cannot make any inferences about the level of need among special education students at the two kinds of schools. Because of this, I did not include data from District 75 schools, which enroll only students with special needs and tend to serve the most severely disabled students.

As always, I welcome your feedback and suggestions in the comments section.

  • http://www.classsizematters.org leonie haimson

    one question and one comment: why should we trust city data more than state data? Isnt it self-reported in both cases? Isn’t it the state’s special duty to have accurate figures, especially since they have oversight responsibilities over all charter schools?

    My comment is this: without the self-contained population, this comparison is really not complete, as you note. These students are the most seriously disabled, and I would guess that there are far fewer of them in charters than in district public schools.

  • Kim Gittleson

    Hi Leonie -
    While they are both self-reported, I can tell you that the people at the NYSED admitted to me that their data didn’t match up. The CAPs data, on the other hand, mirrors more closely what is reported on the NYS Accountability Report cards, what the DOE reports as reimbursing, and what charter operators themselves observe. What I have been told is that the Committee on Special Education, a city agency, must approve, or “certify,” students for IEPs. These numbers are then recorded in the CAPs database. There very well may be tampering within that system, but it seems to me that it is more accurate than the State data, which comes from what is known as Student Information Response Systems (SIRS). This SIRS data seems to be unable to track individual students, so there is a lot of doublecounting or students who fall through the cracks. This is because both charters and districts are in charge of reporting the number of students with disabilities that charters serve. This leads to a good deal of confusion – sometimes both districts and charters report on the same students, so the number is inflated, sometimes neither report, so the number is too low, etc. Now, you could very well believe that charter operators are lying, and that the CAPs database isn’t audited thoroughly, which is fair. But the NYSED data doesn’t seem to be supported by anyone–not the state, not the DOE, and not charter operators. This is why I think the CAPs database is a better, but certainly not perfect, resource. And I agree with you – the State’s reporting is shockingly bad and needs improvement.
    And as for your comment, I understand that looking at specific types of special education students being served is the next hurdle. When I get that data, I will be sure to update!

  • JB

    Hey Kim, I love your posts but haven’t commented on one in a while.

    I think the real key here to strengthen your analysis would be the construction of confidence intervals for all of your numbers.  The question is not, “Do charter schools enroll the more, less, or the same percent of students with IEPs as the surrounding district?”, rather, it should be, “If I were to randomly sample X number of students in a charter school from population Y randomly, what’s the probability that I would see Z% of students with IEPs in that charter?”

    The truth is, there’s a fairly wide, statistically “acceptable” range in which we’d expect student compositions to sit that changes based on the size of the charter.  If my school has 100 students and 15 of them have IEPs and I’m drawing from a population of 10,000 students of which 2,000 have IEPs, I may find that although the percentage is different (15% versus 20%), the difference between the two is statistically insignificant.  This would suggest that there was no “foul play” on the part of charters or their lotteries, but instead simple randomness caused the variation.

  • Rhonda Rosenberg

    Thank you Kim I always find your work informative. However, any analysis or Charter School claim on special ed enrollment is meaningless without an explanation of the special education student’s level of need. A special education student that requires speech therapy and a student that requires being in a self contained classroom are both classified as IEP but bring very different challenges to school. If the charter schools believe they enroll the same kind of students that district schools enroll then they should make their numbers public = they have nothing to hide. The truth of the matter is that they enroll students with the lowest level of need and then compare their performance with schools that enroll students with the highest level of need. The charters also do this when they claim their students are economically similar to students at the district schools. This is just not true. Once again the truth is in the details. Research has shown that charters largely enroll students eligible for reduced price lunch who are not as poor as the district school students who are eligible free lunch.
    It’s time that the charters stopped distorting the facts and hiding their numbers. If this were a poker game it would be time for them to show their hand. If charters are as good as they say they are then they should have no problem making their data public. Currently when you go onto a charter’s home page using the nyc.gov/schools website you find that charter’s release almost none of the information that district schools release. What have they got to hide other than the truth?

  • JB

    Rhonda, I have to ask, because I’m unfamiliar with how this works in NYC, but how are charter schools financed?

    If you provide additional funding for students who have additional needs, recognizing the added costs of a service like a speech pathologist, than the expectation that charters enroll those students is fair.  If NYC’s funding formula only provides additional support for special education to it’s TPS or only provides additional cost at a flat rate for all special needs, then the charter funding mechanism should be updated to “fix” this problem.

    Otherwise the expectation is for a charter school to enroll students with significantly more costs without any additional funding.  That’s even before we examine the fact that a TPS can offer a higher level of support with a higher level of stability simply because they’re larger.  Is a charter school going to have to pay, with the same amount of funds it would receive for any kind of student, for a full time speech pathologist to cover two students when the district has a floating person between 50 students in 2 buildings?

    It may all be a moot point, but it’s worth considering.  If charters and TPS could end this nonsense rivalry, we’d see schools of choice funded through a similar mechanism as TPS and we’d also see them share resources– let the TPS charge charters for an SLP’s time so that they have even a shot at offering similar services.  Otherwise, don’t harp on charters having the same problems any small LEA has because its unreasonable to assume they can magically overcome economies of scale.

  • http://www.classsizematters.org leonie haimson

    I am suspicious of any figures that come out of DOE as I’ve seen them skew data or selectively report it too many times. Moreover, they are releasing this data now for clearly political reasons (see the Eva M. letter on another page.) Why don’t they also release the data on how many self-contained kids there are in charter schools? Isn’t that info included in the CAPS data as well? And why not post this data on the charter schools webpages?

  • Ellen

    The graph indicates a growth in numbers of students with special needs in the NYC public school system. The growth starts in 2004 and is just about a 3% growth. That is a worrisome bump to me. Why has there been such a serious growth in kids with special needs in the NYC system? Is it because there are fewer students without needs in the system and the 3% growth is a reflection of that comparison? Are there fewer children in NYC? I thought there was a baby boom!
    No matter…it is still worrisome that there has been such an increase in students with special needs…..inappropriate referrals to special ed services? more students leaving for charter schools? more students leaving for private/parochial/independent schools?
    Isn’t 2004 when the Children First Initiative began? Can this be tied to the increased reading and math scores?
    If there is no data included for the students receiving services through D 75, does that mean there are even higher percentages of students in the NYC public school system with special needs? There are about 23,000 students in D 75. (no one can ever give a real hard number of students with special needs either in district based programs or in D 75 administered programs)
    And, just for clarity, the vast majority of students in D 75 are classified either as learning disabled or emotionally disturbed. Both of those classifications imply that the individual, with appropriate supports and services, could reach average to better scores in tests/assessments. Currently about 5,400 students are classified as on the autistic spectrum, about 800 have some form a of visual impairment and about 1,200 have hearing impairments.
    There are so many more questions than answers!

  • Rhonda Rosenberg

    JB I am not an expert on charter school funding however I do know that the charter schools submit bimonthly invoices on their special education enrollment to the DOE and NYSED. These invoices require the charters to identify the student’s service needs as determined by an IEP. It is my understanding that charters receive additional funding based on these invoices. But you overlook the thrust of my post. Data is a dangerous thing if used inappropriately or incorrectly and charter school advocates play fast and loose with data and stats, It is deceptive to claim special needs enrollment that approximate district school enrollment when charter students have less challenges. It is particularly misleading when charters use data to compare themselves to district schools without acknowledging they enroll less needy students. As long as charters are getting taxpayer dollars then they should be required to engage in full disclosure rather than web pages on nyc.gov/schools with no information.

  • Ellen

    A question: If Opportunity, Lavelle and Wildcat are all schools that are primarily devoted to students with disabilities (Opportunity enrolls 50/50, Lavelle is dedicated to enrolling children with autism and then others) don’t they throw off the curve for the percentage of students with disabilities served in charter schools?

  • JB

    In most states, charters have the same requirements as LEAs (traditional districts), and this includes data requirements.  Is this not the case in NY?  That would seem to be a “complication” in the law that makes everyone lose– parents, taxpayers, students, and charters.

  • JB

    Ellen, that’s a great point– it may be worth examining medians rather than means here.

    However, overall, I think that the best analysis would be the confidence intervals for each individual charter that represents the likelihood of drawing their population based on a random sample of their geographic district.  This would reveal the most about how similar charters are (or aren’t) to their local counterparts and would avoid the broad brush strokes of “all charters” versus “all TPS” since everyone knows there’s tremendous variation within those groups (probably rivaling the variation between them).

  • Gideon

    I don’t believe most charter schools have students in self-contained classrooms. If a student needs that level of support, the Committee on Special Education would place them in a district-run school with self-contained classrooms or a District 75 school for special education students. I suspect the reason that charter schools don’t have self-contained classrooms is that they are too small to support such a program, though you’d think that some of the big ones with 600+ students could do it. That said, there are hundreds of district schools that don’t have self-contained classrooms either.

    The DOE published data for each school on its website on the number of special education students in self-contained classrooms, in collaborative team teaching classes, and other, but charter schools aren’t in it

  • Aaron Pallas

    Kim,

    What’s the date for the 2009-10 CAP data?

  • http://curious2.typepad.com Kim Gittleson

    Aaron -
    2009-2010 data were as of last week, May 5, 2010. The 2008-2009 data was from July 1, 2009.
    Ellen -
    I took out Opportunity and Lavelle when I first did the analysis and it only changed by around .3%. I decided to leave them in once I realized that there were quite a few schools in their respective districts that had extremely high populations of special needs students–which could mean that, like these schools, they try very hard to attract students with learning disabilities. For the overall comparison, this seemed fair.
    JB -
    I agree with you that confidence intervals might add another dimension. I will add, however, that when I looked at individual charter schools I compared those schools to the IEP rates of traditional public schools in the same district, broken down by grade. This seems to me to be the fairest way to look at schools, because these are similar demographics. Obviously the overall picture gets distorted, but if you look at the graph or the spreadsheet you’ll see more nuanced data on individual schools. I will look into doing your methodology, but right now the issue I’m having is with determining the appropriate Population Y, i.e. overall student population.
    Sorry I don’t have answers to the rest of your questions, but I will look into it!

  • An effective Teacher says

    Any student can be given a IEP, but that does not make them a true special education needs student. I’d like them to examine exactly the types of IEP students they have and compare that to those in public schools. I doubt they’d have the seriously disruptive, dangerous, or mentally challenged students being accepted.

  • http://www.SpecialEducationMuckraker.com Dee Alpert

    The NYCDOE’s increase in the number (not just percentage) of students classified as having disabilities is alarming and there is no good explanation for it. A report to the Regents last month stated that NYS’ overall classification rate had risen significantly and that 70% of that rise was due to new NYCDOE classifications. Since NYCDOE typically has about 39% of all public school students in NYS, the increase in The Big Apple is both large and disproportionate.

    Serial audits have shown that the CAP computer system for reporting things re NYCDOE kids with disabilities is wildly inacccurate, and perhaps intentionally so. It was established about 30 years ago to collect and report information relative to the Jose P. consent decree. NYSED’s systems for collecting and reporting student data are similarly wildly unreliable. A Single Audit for NYS reported a few years ago that NYSED neither audited nor verified any of the student data districts reported to it under IDEA (fed. spec. ed. law) and Title 1. NYSED also does not require that districts have their student databases and reports audited and verified by anyone else.

    I have numerous memos in my files from NYSED and NYCDOE officials wihch basically tell school administrators how to game each of the extant reporting systems to their own advantage. District officials are required to certify that the data they submit is correct, but since it is never audited or verified, there is – intentionally – no way that NYSED could discover that a superintendent or principal submitted grossly inaccurate and manipulated data. Even if one got caught, NYSED would do nothing about it, just as it does nothing when its own outside firms find that schools have inappropriately inflated their students’ Regents exam scores.

    I have one NYSED report which indicates that a full 13% of students in any cohort or “Class” are reported as enrolled and actively attending two districts at the same time. NYSED has been aware of this for many years but has done nothing to eliminate these disabled dopplegangers from its data reports and databases. It is entirely possible that NYCDOE schools whose disabled kids are transferred to charters by their parents are then reported as enrolled and attending their old NYCDOE schools and new charters at the same time.

    Because of the way the NYCDOE handles special ed. budgets, it is in charters’ interest to report all their disabled students and it is in the interest of the NYCDOE schools to keep these kids on their enrollment lists as well.

    National research, funded by USDOE, has shown that a child’s actual classification has little to do with the child’s actual, objectively-assessed disability(ies). A child’s actual disablity and level of impairment and a child’s school-given special ed. classification were also reported to have no relation to the amount of money reportedly spent on that child’s special education and related services.

    Then, to make things worse in NYC, the HHS OIG did audits of NYCDOE school Medicaid claims, filed to get reimbursement for related services allegedly provided to Medicaid-eligible students. In both audits, the HHS OIG reported that in at least 50% of all claims submitted and for which reimbursement had been received, there was no documentation whatsoever showing that the service claimed for had actually been provided. US DOJ secured a consent decree re the NYS and NYCDOE school Medicaid fraud last year and according to that decree, about $300 million of the $540 million which was to be repaid to HHS for fraudulent school Medicaid claims was to come from NYC. The decree specifically stated that it was secured on account of unintentional and intentional school Medicaid fraud. No matter how one plays it, the fact is that one can’t rely on NYCDOE data related to special ed. in any way, manner or form.

    The disparities, including those revealed by comparisons of various NYSED databases for disabled kids with figures the NYCDOE puts out are so great that all one can reasonably say is that there should be a federal investigation to find out the source of the irregularities and then whatever federal activities are appropriate after that to clean it up.

    And simply for fun, last time I did a surveillance of a D. 75 school and counted heads going in, the school reported attendance for the day(s) in question exactly double the number of heads I tallied.

    Before anyone puts down charters for enrolling too few kids with disabilities, we really need a good audit, via physical sampling and head counting, of the kids with disabilities who actually attend NYCDOE schools. The only study I ever saw which tried to do something in this area reported that by high school, a full 50% of the disabled kids scheduled to attend resource rooms never showed up in them.

  • JB

    The over identification of special education students is a huge conundrum right now, especially with so many states providing monetary incentives.  One would hope with statewide data warehouse systems that double counting attendance in general has been less of a problem.  It should be pretty easy to see if students with the same identifier are showing up on attendance lists for multiple schools, but I guess that kind of data auditing isn’t widespread yet.

  • Red Hook Teacher

    Since charter schools are by lottery, IEP students, like all general ed students, enter the lottery & if picked are enrolled at the school. Unlike traditional DOE schools, some, not all charter schools do 1 of 3 things:

    1. Counsel an IEP student out (depending on the disability)

    2. Allow the students to stay – even if the disability really does warrant a more restrictive (12-1-1) environment. *Getting extra $ for a student the school KNOWS would thrive in a different setting.

    3. Change the student’s IEP to reflect an environment that would be equal to what the charter school can actually provide (CTT, SETTS, etc).

    All three options are a GROSS negligence and diservice to the child and their unsuspecting family. My DOE school has received many “IEP transfers” from the charter school we co-locate with and the parents all stated that the charter school knew up front what their child’s IEP stated but claimed it could offer the same or better if they “waived their rights to placement” so the child could stay at the charter school without the school being penalized for being “out of compliance.” The parents of course want what they feel is best for their child, and seeing 2 teachers in every classroom, new smart boards and technology, figures that their child is better off in this environment not realizing that their child’s IEP was written with their child’s needs in mind which is why CTT, 12-1-1 or a D75 type setting was put on the IEP in the first place.

    Most charter schools may mean well when it comes to children with special needs, but if they really want to level the playing field in public education, then no matter the school’s philosophy or mission – all new charter schools should have a self-contained, real CTT or bridge class on EVERY grade in addition to their general ed classes. That would partially demonstrate equity with regards to special education students in NYC and transparent accuracy in the data that is reported to the city & state education departments.

    The other thing charter schools can do is hire experienced, qualified social workers & special ed staff and provide adequate SPED training to their entire staff to be better equiped to address the varied needs of our city’s special education population. Charter schools will only be able to cousel out and pass along but so many children with IEP’s.

  • http://perimeterprimate.blogspot.com/ CarolineSF

    I’m chiming in to agree with Rhonda — this is a huge confounding factor:

    “Unfortunately, my data did not differentiate among the kinds of services required by students with IEPs, so I cannot make any inferences about the level of need among special education students at the two kinds of schools.”

    Students with IEPs can range from mildly learning disabled, to brilliant and on the autism spectrum, to high-functioning with a speech impairment, to profoundly affected by Down’s syndrome, to severely emotionally disturbed, and many more similarly varying disabilities. It tells us hardly anything just to have a count that treats them all equally.

  • http://www.SpecialEducationMuckraker.com Dee Alpert

    JB – NYSED reported that its new SIRS student data system (unique student identifier) showed 13% of the first graduating class it covered as enrolled and attending 2 districts at the same time back in 2006. I recently FOIL’d its protocol for resolving such disparities and was told it was still “under development.” Having followed NYSED’s data games for several decades now, I believe it never will come up with a meaningful, verifiable system for resolving the dopplegangers for various political and financial reasons.

    The CT state ed. dept. started doing something with a similar unique student identifier system this past year in regard to kids reported by a district as having transferred to another district (instead of being reported as dropouts). It used the new system to verify the re-enrollments reported. Sure enough, when run through this system with state ed. doing verification, the state’s reported graduation rate plummeted and its dropout rate went sky high.

    The first negative federal audit reporting that NYSED didn’t verify any student (or financial) data districts reported under both IDEA and Title 1 was in 2004. A USDOE OIG audit dated late ’09 which only looked at districts’ financial reports for these federal grand programs showed that NYSED still wasn’t auditing or verifying districts’ financial reports for these grant programs.

    It is unfortunate, but very clear, that unless and until the feds put their collective foot down and tell NYSED “no mas federal money” until it cleans up the NYS district and state reporting act, bigtime, nothing meaningful will be done.

    Not such a big deal. All it means is that for any cognizable, identifiable group of students, the real margin of error when using both NYSED and NYCDOE data is plus or minus 30% … at best. In the current debate re charters and kids with disabilities, it really does mean that it is just as likely that charters enroll a far higher proportion of kids with disabilities than do NYCDOE schools as it does that they enroll a lower percentage.

    Everyone (except the children and taxpayer victims) loves this system because it means both sides (teachers and school district administrators/school boards) can find and spin numbers to prove whatever they want, whenever they want and nobody can really prove they’re wrong. All the opposition can do is come up with a different set of equally unreliable, unverifiable numbers and … . Kids and their parents lose, taxpayers lose, but them winning has little to do with the operation and governance of these large governmental systems.

  • Pingback: What We’re Reading for May 12, 2010 | A Quality Education Blog | Blogs | Loyola University New Orleans

  • Pingback: The Man, The Myth, The Legend « The Education Standard

Tips, questions, feedback?

Contact us at .

Word from Our Sponsor

Chalk It Up

Recent Comments

83 comments so far today

Events Calendar

Archives

June 2013
M T W T F S S
« May  
 12
3456789
10111213141516
17181920212223
24252627282930