GothamSchools — daily independent reporting on NYC public schools

Ken Hirsh

Another Great Charter School: KIPP Infinity

Last week I visited another great New York City charter school: KIPP Infinity in West Harlem.  Infinity serves grades 5 through 8.

In the most recent NYC Department of Education progress report, KIPP Infinity received the highest overall score amongst all 1,043 elementary, middle, and K-8 schools that were graded.  On their 2007-08 “Learning Environment Survey Report”, in which parents, teachers, and students are surveyed, the scores were uniformly excellent and, often, outliers.  For example, on parent engagement, they scored a 125% on a scale from 0 to 100%.

As I talked with principal Joe Negron in his office (a table in the hallway), it was clear that his focus is on further improvement.  He noted, for example, that while most of Infinity’s students pass the state tests, few of them have advanced into the most selective high schools. 

The students at Infinity seem focused and mature for middle schoolers.  Unlike the great elementary charter schools I have mentioned (here and here), Infinity generally has one teacher per classroom with an average class size of 25.  Still, the students seem attentive and engaged.  Many of the teachers have been at the school since day one and turnover has been very low.  Clearly, they are doing a tremendous job.

Interestingly, all KIPP schools plan on using MAP tests to help them to better assess student progress on a national level.  Infinity is happy about this development: they don’t believe that the state assessments are sufficient for them to take their students to the next level.

As part of the larger KIPP NYC network, Infinity staff can focus on educational issues.  A “Shared Services Team” for the network provides support in the core functional areas of finance, HR, operations, technology, and development.

Of course, being a KIPP NYC school has brought the distraction of the KIPP AMP unionization controversy.  Negron confirmed that, contrary to some early media reports, Infinity teachers were not involved in the situation.

  • ceolaf

    Ken,

    Do you ever visit traditional public schools?

  • http://curious2.typepad.com Ken

    Hi ceolaf,

    Good question! I have visited many in the past, but not recently. I am preparing to assemble a list of schools to attempt to visit. I am thinking of randomly selecting 18 peer schools to the 18 charter schools that were on my list. Of course, access might be more of a challenge, but we will see.

  • http://www.sfschools.org Caroline

    Hi Ken — I researched attrition in KIPP schools in my state, California, and blogged the results — which found very high attrition in most KIPP schools. The many journalists, commentators and researchers looking into KIPP schools had somehow neglected to do this research previously (which, yes, does make me wonder if they were avoiding looking into something that would not flatter KIPP). AFTER I did the research it got attention, and a subsequent study of San Francisco Bay Area KIPP schools by the research organization SRI International confirmed that a full 60 percent of students who start fifth grade in the Bay Area KIPP schools don’t make it to the end of eighth grade. SRI also found that the students who leave KIPP schools are overwhelmingly the lower achievers.

    I was talking about this with one person who had just spent a day at KIPP San Francisco Bay Academy — he is a charter school principal and advocate — and he admitted that he had wondered why the eighth grade was so obviously smaller than the fifth grade.

    So I’m curious if you noticed this, or have researched it, about KIPP Infinity. Perhaps you already have and have learned that the attrition is low to normal? Please let us know.

  • eduwonkette

    Hi Caroline,

    Though we cannot tell if they are the same kids from the school report card, KIPP Infinity does not appear to have the striking attrition – at least from grades 5 to 6 – that we have seen in other KIPP schools. See here:
    https://www.nystart.gov/publicweb-rc/2007/fb/AOR-2007-310500860883.pdf

  • http://www.sfschools.org Caroline

    Oh, thanks. Since it’s only in its second year, it’s hard to tell. At least with the Bay Area KIPP schools, some have an enrollment jump at 6th grade, since the feeder elementary schools are K-5s. (I know the notion is that families are so desperate to leave their ravaged public schools that they’ll bail their kid after 4th to move them to KIPPland, but it’s not really like that in general. Kids want to “graduate” from 5th grade with their friends!)

    I don’t think you could tell with Bay Area KIPP schools either if they were only in the second year. It’s over the four years that you see the mass exodus in the figures. And also, whatever is causing that mass exodus — reports vary, frankly — I think KIPP will be a little more wary about it now that the spotlight is on.

    By the way, traditional public schools that serve low-income students also have high mobility, because low incomes tend to correlate with unstable living situations. But the huge difference is that KIPP schools largely don’t replace the kids who leave, and traditional public schools do. So the KIPP schools end up with streamlined classes with (overall) only the high achievers remaining.

  • Socrates

    KIPP Infinity is in its fourth year.

  • http://www.sfschools.org Caroline

    Only two grades showed on the enrollment figures I was steered to — guess they’re from year before last.

    Coincidentally since we’re speaking of the wonderfulness of KIPP, I was just minutes ago talking to a dad here in San Francisco, a PTSA officer at a non-charter public middle school. He told me that they had a bad problem with a serial bully, a new kid who started terrorizing and shaking down kids as soon as he arrived at the school. They learned he had been dumped on the non-charter public school by one of the two KIPP schools here (the ones with the 60% attrition rates). Now he has been expelled from the non-charter school too (and the family moved out of the district), but the parents at the dumpee school are clamoring to get to dump a problem kid back on the KIPP school as a fair exchange. Seems only fair, doesn’t it?

    The non-charter school, by the way, replaced the expelled student with an incoming transfer. KIPP doesn’t do that. It would seem amazing that KIPP can afford not to replace students who leave (given that funding comes with each kid), but I guess those philanthropic multimillions make it possible.

  • http://www.sinksalive.blogspot.com KitchenSink

    Caroline, as a parent aren’t you offended by the district school’s labeling of children as “problem kids”? It’s clear to me that at least some and maybe all KIPPs have a mentality that if you can’t cut it there, you can’t cut it and you need to go elsewhere. But I have visited several KIPPs and know a lot of KIPP people and have NEVER heard them label a child.

    Can we take a look at the adult culture of these district schools that are possibly creating these “problems”?

  • ceolaf

    KitchenSink,

    I’ve heard at least one KIPP person talk about problem kids. And I’ve known countless traditional public schools people who would never use the term or the idea.

    Frankly, if it doesn’t matter to me whether or not KIPP people use that term if their attrition rate is so high.

    The argument for KIPP is that they they help kids to succeed whom others do not, that their scores and success rates are incredibly higher than other schools made of up kids from comparable backgrounds. This attrition problem undermines that entire argument.

    Counseling kids out of your school because they are not a good fit — as opposed to because you affirmatively know that another school is actually a very good fit — is the best way to raise scores, improve results, and maximize outcomes for the ones who stay. That is, if you don’t care about the kids you counsel out. But traditional (i.e. non-charter) public schools are charged with educating every child, without the option of easily counseling them out.

    I am not saying that there are not public school officials who encourage some kids to drop out of high school, but they should be fired. Moreover, I have never heard of a middle school with a 50% dropout rate.

    I cannot even begin to tell out how much that offends me.

  • http://www.sfschools.org Caroline

    Kitchen Sink, you are too much. KIPP dumps the bully on a district school and then you want to blame the district school?

    “Problem kid” is MY label. Sorry not to be all delicate and euphemistic and PC, but to me a kid who bullies and steals from other kids is a problem kid and I’m not going to mince words about it.

    The point is that KIPP dumps its problem kids (whatever it chooses to call them or not to call them) on other schools and doesn’t ever have to accept any other schools’ dumpees.

  • Socrates

    Except that you don’t have any evidence that KIPP does that. You especially don’t have any evidence that it’s widespread, even if you’ve found one school that does it. Out of 60+ KIPP schools, you’re analyzing the ones that are closest to your home, which is natural. Unfortunately for the accuracy of your extrapolations, those are among the lowest-performing schools in KIPP.

    KIPP affords its schools much freedom, and there will therefore be much variation in how they achieve their outcomes. Many of them, like Infinity, achieve miraculous outcomes legitimately and have very low attrition. Some of them, perhaps including the SF schools (which I’m sure are among the lowest-funded KIPP schools – something for the status quo-oriented, funding-is-everything crowd to embrace!), have attrition impacting their results.

    Caroline, you’ve said over and over again that you don’t have time to research adequately the achievement and attrition of KIPP schools around the country. That’s fine, but is belied by your constant posting on this very topic, using the very little (though self-serving, in your case) data you have chosen to accept. What bad luck it will be for you if the KIPP schools in SF turn themselves around, or if one of the more legitimate ones sprouts up in your midst!

  • ceolaf

    Socrates,

    * You challenging the accuracy of Caroline’s data, or its generalizability?

    * I don’t think that the results she found are self-serving. How does she benefit from these findings?

    * KIPP is not not the Coalitions of Essential Schools, in that KIPP decides who gets to call themselves a KIPP school, whereas CES allows anyone to claim affiliation. KIPP has even withdrawn its name from a school. Therefore, there is a large degree to which we can hold KIPP accountable for the actions of schools in its network.

    * Caroline actually does have evidence that that happens. There is the high attrition figure in her area, and the individual story about the one individual. She does not have proof that it is a wide-spread practice, but she has enough evidence to suspect that it is a regular practice there.

    * Counseling out has long been an practice in private schools. This is no secret. There are public discussions about its appropriateness in different situations, and how to do it. There is no reason to think that charter schools never engage in this practice.

    I think you are assuming that KIPP schools should have a presumption of innocence with regard to this charge, and that Caroline’s presentation is not strong enough to convince you that this is a wide-spread practice. Others might have different presumptions or different standards for when they are convinced.

    **********************

    I just looked up the NYC KIPP report cards linked to from schools.NYC.gov. I was able to find three KIPP schools that report enrollments by class for more than one year (KIPP Academy, KIPP Infinity and KIPP Star). Because these report cards only report 3 years of data, I cannot calculate 4 year attrition rates, and there were only 4 classes (i.e. two at Academy and at Star) for which I could even look three year attrition rates. But even that is exaggerated, because they are not actually three year rates. Rather, they are two year rates (i.e. september of year 2005 September of 2007).

    - I found those two year rates to vary from 6% to 22%.
    - I found one year rates (for the other multi-year classes) to vary from 1% to 9%.
    - In no case did any cohort grow or maintain its size.

    I have no idea how to extrapolate these rates into a real four year rate (i.e. fall of 5th grade to completing 8th grade). It’s a tiny set of data. But it’s evidence that KIPP schools in NYC have double digit 2-year attrition rates, at times topping 20%. Moreover, there is no evidence here that KIPP takes in new students after year 1.

    Does this evidence support Caroline’s accusations of serious creaming by attrition? I would say that it does. But I’ll bet that you would say that it does not. This is a pretty easy thing for KIPP national to respond to. They could easily publish enrollments by class and year for each school, or require each school to publish all of this data on their websites.

    2005 2006 2007 2 year 1 year
    KIPP Academy 71 62 55 23%
    KIPP Academy 66 63 61 8%
    KIPP Academy 66 60 9%
    KIPP Academy 63 60 5%
    KIPP Infinity 79 78 1%
    KIPP Star 84 81 79 6%
    KIPP Star 84 81 72 14%
    KIPP Star 83 81 2%

  • http://www.sfschools.org Caroline

    Socrates, are you poorly informed or deliberately giving misinformation? That’s really insulting to the readers of this blog.

    The evidence is clear and indisputable that the majority of California KIPP schools have very high attrition. There were nine at the time I first did the research, and six showed that pattern of very high attrition. We are not talking about “one school,” and several of them are in Los Angeles, 450 miles from my home, just for the record.

    That finding is based on the hard enrollment numbers. A twist on this is the fact that this was “overlooked” by the multitudes of researchers and journalists looking into KIPP until an amateur volunteer unpaid blogger (moi), looked at the year-by-year enrollment figures, available to all on the California Department of Education website. This DOES imply a deliberate unwillingness to check into any information that might reflect poorly on KIPP, on the part of those multitudes of researchers and journalists, but that’s beside the point.

    After those numbers WERE illuminated and got some attention, the research organization SRI International did a major study of the five KIPP schools in the San Francisco Bay Area, which did look into attrition. Their findings more than bore out my conclusion. SRI found that the five Bay Area KIPP schools lose 60% of their students between the start of fifth and the end of eighth grade. SRI also found something that I did not have the access to learn: That the students who leave are consistently the lwoer achievers.

    KIPP folks themselves have by now acknowledged these findings and have begun discussing the problem. So you may discount the findings, but KIPP itself does not.

    In addition, it’s flat-out incorrect that the KIPP schools in this situation are “among the lowest-performing schools in KIPP.” I would challenge you to show the achievement figures for the California KIPP schools. or even show that you know how to research achievement for California schools. To name two, KIPP San Francisco Bay Academy (the one that dumped the bully on Presidio Middle School) is one of the highest-scoring schools in San Francisco, and KIPP Heartwood in San Jose (Alum Rock School District) is similarly high-scoring.

    It’s insulting to the rest of us and degrades the discussion when you just make **** up! Plus it obviously doesn’t work. What is the point?

  • M

    Just because a cohort gets smaller or does not maintain its size does not necessarily mean that there is attrition, as retention is not considered. In the KIPP school where I teach, cohorts get a bit smaller as time goes on, but most of the kids are still in the school; they just join the next cohort. We tend to do this most often in 5th grade, in hopes that it will not have to be done later on.

  • http://www.sfschools.org Caroline

    Yes, M, that could be true, but the fact is that the professional SRI study, whose validity KIPP readily acknowledges, confirms that there IS 60% attrition in KIPP’s San Francisco Bay Area schools.

    KIPP spokespeople say some of the attrition is due to parents who don’t want their kids to repeat a grade and leave when they’re told that’s the only way the child can stay.

    There was a recent brouhaha in Fresno, Calif., where the principal of a KIPP school was accused of abusive behavior to students (as well as significant breaches with standardized testing). Dozens of complaints to the Fresno school district prompted the district to investigate, and KIPP removed the principal. But many parents at the school mounted public protests in DEFENSE of the fired principal. Those parents’ repeated claim was that disgruntled students who had been pushed out of the school, and/or their parents, were making up false charges against the principal. Well, if KIPP never pushes anyone out, how were there dozens of disgruntled students who had been expelled from the school? We seem to be hearing two conflicting stories here.

    I would post links, but this site doesn’t really accept them (requires a very long delay while the post is moderated).

  • ceolaf

    M,

    You raise an interesting point, one that plagues those who have tried to research high school graduation rates. Trying to figure trace what happens to cohorts over time to figure out graduation and attrition rates is notoriously difficult.

    But I agree with Caroline that this can one a way to counsel out lower achieving students, whether it is intentional or not. More importantly, I’d ask what a reasonable retention rate would be? If KIPP has a such a great approach — and this is an honest question here — should there be any grade retention after the 5th grade?

    KIPP and KIPP proponents claims that KIPP produces far better outcomes than traditional public schools with the same kids, right? How should we evaluation those claims in light of the fact that students leave KIPP schools, and SRI found that they tend to be lower performing kids? That another honest question.

    My take on this is that KIPP produces good outcomes, but not with the same kids. There are lots of families and kids who would not agree to what KIPP demands. Even among those who originally agree to go, there are a lot who drop out. So, I still need to be convinced that KIPP produces better outcomes with their kids than the regular public schools would.

    Am I missing something?

  • http://www.sinksalive.blogspot.com KitchenSink

    I’d pay good money to see a Caroline vs. Jay Matthews debate on the subject of how KIPP adds or takes away from the school system in general. I don’t think we’re going to see anyone leave their entrenched positions on this site.

  • Ken Hirsh

    Hey Caroline,

    Thanks for the comments.

    At KIPP Infinity, I didn’t notice or hear anything that would lead me to believe that there has been unusually large attrition. However, I haven’t seen or reviewed any statistics on the matter. I ask most schools I visit about attrition (and I did discuss this with Infinity), but I have never asked for or seen formal statistics. I will try to do some more research on the issue.

  • http://www.sfschools.org Caroline

    I communicate with Jay often by e-mail, KitchenSink, and he quoted me in his new book about KIPP. Actually I have been asked to do that, but I refused for two reasons. First: Live debating is not my strength. If I could do a back-and-forth in writing, maybe. But second: Jay is the nation’s most prominent education journalist, paid to report for the Washington Post and Newsweek. He’s a recognized expert doing this on paid time. I’m an amateur volunteer unpaid mommy.

    For that matter, if there WERE a debate, Jay would have the support of the eduphilanthrobillionaires (the Gates/Broad/Walton/Fisher crowd) and presumably their resources (research, prep, you name it). I’d be on my own.

    Would YOU debate someone under those circumstances? No, I thought not. The fact that I’m even viewed as anywhere in the same league is a testament to how powerful the information I’ve researched is — and, frankly, how badly it weakens the boasts and hype about KIPP. It was low-hanging fruit; anyone could have found the same information.

  • Ken Hirsh

    Hey ceolaf,

    Let me see what I can find out about the KIPP NYC schools (and, in particular, Infinity).

    Separately, with regards to the attrition statistics that you calculated: are these unusually high versus comparable traditional public schools? This is not an issue that I have studied, so I don’t know what normal attrition rates are.

  • http://www.sfschools.org Caroline

    Ken, nobody else noticed previously either, though as I said, one person did allow that he had observed that the 8th grade was much smaller than the 5th at KIPP SF Bay Academy. It didn’t occur to him to make anything of it, though.

    Also, with the spotlight on the attrition now, there’s the question of whether KIPP will make sure it lessens — and whether that will impact achievement. KIPP SF Bay Academy’s attrition did slow in the most recently reported year — and its achievement dropped (though it’s still high). We don’t know if those things are connected or not.

  • http://www.sfschools.org Caroline

    Ken, the CRUCIAL difference between KIPP attrition and that in traditional public schools is that KIPP DOES NOT REPLACE THE STUDENTS WHO LEAVE, while the traditional public school does. We’re talking about middle schools here, so this is not a high school where students are actually dropping out.

    So, when the Bay Area KIPP schools lose 60 percent of their students and those are overwhelmingly the lowest-achieving students, they wind up with ONLY the top 40 percent of their students left in the class. It’s a miracle! The scores of the class went up!

    Since funding comes with the students (I am in California, last of desperately short school funding), traditional public schools are eager to replace students who leave — which is what happens. It’s amazing that KIPP can afford not to, but presumably that’s due to the largesse of the eduphilanthrobillionairepreneurs. (I keep changing the term; guess I should settle on one.)

    The information you would look for regarding traditional public schools is the “mobility rate,” but it’s not parallel, because again, students are transferring in to replace the students who leave. Lower-income students tend to have high mobility and also tend to be lower achievers. So if a high-mobility student leaves a traditional public school, he/she is likely to be replaced by a similarly high-mobility student, statistically likely to be a low achiever.

    The information regarding KIPP attrition comes from just looking at the year-by-year enrollment figures for the same class.

  • Ken Hirsh

    Thanks Caroline.

    I am glad to hear that KIPP SF Bay Academy has slowed attrition while maintaining high achievement.

  • Ken Hirsh

    Caroline, when you write “KIPP DOES NOT REPLACE THE STUDENTS WHO LEAVE” does that apply to all KIPP schools in the nation or are you referring to San Francisco or California?

    I will research this for NYC…

  • http://www.sfschools.org Caroline

    Re KIPP SF Bay Academy, well, you put it in one possible way, Ken. Achievement did drop as attrition slowed, so was there a direct correlation? We don’t know. This is only a one-year change.

    I don’t know about KIPP schools outside California and whether they replace the students who leave, but I also don’t know what they actual policy is — would they LIKE to replace the students who leave but are not doing so? I just know that the numbers show they aren’t replacing the students who leave.

  • Ken Hirsh

    Thanks Caroline.

    Could you refer me to the SRI report (or other report) that you use to support your findings?

  • http://www.sfschools.org Caroline

    Yes, I would have been posting links except that this blog requires moderation for any comments containing links, and that delays them for many hours.

    I’ll do it this way. This is my own blog post about the study, linking to the study itself. So just replace the dots.

    http:// www dot sfschools dot org/2008/09/study-local-kipp-schools-lose-60-of dot html

  • http://www.sfschools.org Caroline

    I tried before and got caught in the “awaiting moderation” trap, so I’m trying again.

    Yes, I would have been posting links except that this blog requires moderation for any comments containing links, and that delays them for many hours.

    I’ll do it this way. This is my own blog post about the study, linking to the study itself. So just replace the dots.

    www dot sfschools dot org/2008/09/study-local-kipp-schools-lose-60-of dot html

  • ceolaf

    Ken,

    The publicly available numbers for the NYC KIPP schools have every cohort being smaller than it was the year before, strongly implying that they do not replace their drop outs.

    Even if they, however, it is not the same as what happens in the public schools. KIPP tries to recruit families who are willing to do the KIPP thing — higher parental involvement and support, valuing school/education. These are not a cross section of the general population.

    A big reason (the main reason?) to drop out of KIPP is unwillingness or lack of ability to follow through on the additional demands that KIPP makes of students and families. Even if it did replace these kids, it would be with families whom the school believes will do so. That makes the replacements different than the dropouts.

    As Caroline points out, when a kids moves away from from a traditional public school, s/he is likely going to be replaced with another kid who has moved in. Both are high mobility, so the reason the first kid left is exactly the reason the second kid comes in. But we know that the goal is for the new KIPP kid to be different than the original KIPP kid.

    *****************

    KIPPs mission is to do the best with the kids it gets. The people work there believe that they can get better results for these kids than the regular public schools, in part because they demand more from them and their families. These greater demand are attractive to some families, but others find that they are too much. And if kids drop out of a KIPP school to return to a traditional public school, it doesn’t feel like the kid is actually dropping out of schools. S/he’s just transferring to another option. Morally, it feels different.

    This is the sort of creaming that Skoolboy wrote about a few weeks ago.

    Traditional public schools had a different mission, and when kids drop out to a less demanding option, it ain’t school. Traditional public schools don’t have the same ability to demand more from families, because there’s no implication of “If you don’t want to live up to your responsibilities, you can go elsewhere.”

  • Ken Hirsh

    Thanks ceolaf.

    I am curious to know how the KIPP Infinity numbers compare to comparable traditional public schools. In traditional public schools that have similar demographics to KIPP Infinity, do the cohort numbers typically show no net attrition over time?

    Separately, do you view the type of “creaming” you refer to (one based on students and parents being willing and able to be held to high standards) as a challenge for analysis, policy, or both?

    Finally, how would you characterize the performance of KIPP Infinity based on the data available to you?

  • Ken Hirsh

    I was able to find some attrition statistics for Infinity in their 2007-08 Annual Report on the DOE site: http://schools.nyc.gov/NR/rdonlyres/224ACC90-6FE5-499B-8E4E-19021E4AF4F9/0/KIPPInfinity.pdf. See page 7.

    * In 2007-08, out of 213 students, 6 left: 2 for geographic reasons, 3 due to parental choice, and 1 for “other reasons (undetermined)”. That’s less than 2% for non-geographic reasons.

    * In 2006-07, out of 149 students, 10 left: 4 for geographic reasons, 5 due to parental choice, and 1 for “other reasons (undetermined)”. That’s about 4% for non-geographic reasons.

  • Ken Hirsh

    The last page of the annual report has unrelated, but very interesting data:

    2007-08 Attendance Rate: 98.3%
    Parent Satisfaction: 99.0%
    Staff Satisfaction: 100.0%

  • http://www.sfschools.org Caroline

    I checked net attrition for ALL the middle schools in my district, when challenged by KIPP defenders (they keep stoutly declaring that this happens at all schools — it’s total bluster). The figures show that there is NO attrition pattern at the traditional public middle schools. It simply doesn’t happen. I mean, the class would be up or down a very few students (<10) — could be either up OR down.

    The thing is, a traditional public school loses funding for every empty seat. If it’s a bunch of empty seats, it hurts! But maybe this is a California thing. Also, our school budgets are created and overseen by each school’s School Site Council, which includes parents, in an open process. The whole school community (or at least the aware parents) is likely to be aware of the funding lost because of open seats. So it’s a big deal to get them filled.

    But under that same funding system, the KIPP schools (rolling in the philanthropy from Gates/Broad et al.) are apparently not too concerned about having the majority of the seats empty by the end of eighth grade. The financial cushion they must have that allows them to be so blithe about it boggles the mind — especially considering they and their advocates are constantly proclaiming that they work these miracles on the same or less money than public schools get.

  • ceolaf

    Ken,

    Mobility is a big issue, but I don’t think that the DOE tracks it. I’m sure people have looked at it, but I don’t know off the top of my head where to look. Moreover, there’s a question as to what you want to compare it to. The city generally? Schools with similar demographics in the? The closest school? The closest 5 schools?

    You mention similar demographics. I doubt that it is possible to look this up anywhere, unfortunately. (Also, as Caroline points out, attrition is not really the issue at other non-charter schools, because those who leave are replaced. Attrition and mobility are not the same thing.)

    As for creaming, it is a problem for analysis, and therefore a problem for policy. There are lots of claims that charters generally or groups of charters or even particular schools have results that better than non-charter schools, and even claims of how much better. But these claims are very hard to substantiate under intense scrutiny, because it is so hard to do actual apples-to-apples comparisons.

    KIPP is a particularly hard one to verify, because they are so demanding. You’ve got such a self-selection bias in the first place, and then the attrition rate on top of that.

    So, what this mean for analysis, in my view, is two-fold. First, we need to do our best to make our analyses are strong as possible. This means, for example that if the charter data only includes kids who stayed there for four years, we’ve got to compare against kids in non-charter schools who stayed in one school for four year.

    Second, we need to be aware of the unavoidable biases in the data and thereby be quite careful about the inferences we make. Small but statistically significant differences should only be credible if they go against the direction the biases would predict. (This counts against claims of charter school achievement gains, but perhaps in favor of charter school cost efficiencies.) Like, if you know that referee is biased in favor player A, and he wins a close game, can you take that seriously? But if player B beats him, well that’s meaningful.

    And then we to policy, which is where i kinda try to be. Unfortunately, policy is rarely based on good analysis. Charter school policy has gotten WAY ahead of the evidence to support them. The policy world’s understand of evidence is analysis is so poor that these important issues aren’t even near the radar.

    But there are even more fundamental policy questions that we rarely really acknowledge. Do charter schools make our system more or less democratic? I think that you’d say “more,” because families can choose where their kids go, even go somewhere that the central district offices cannot control. I would say “less” because I believe that they separate the relative “haves” from the relative “have-not.” Not necessarily fiscal “haves,” but certainly cultural capital “haves.” Unfortunately, the needs cultural capital haves-nots never easy to address in the policy realm, even when its more distant from the policy realm. With mayoral control, it is even harder.

    **********************

    I wish that charter operators and employees understood all this better. I have absolutely no doubt that they (at least the one in NYC) believe in what they are doing, and that they are doing it for the best reasons. They really want to give these kids the best chances they can to be successful.

    In the case of KIPP, they believe that their greater demands are part of what makes their kids successful. And if they let up, so many of their students will suffer. Sure, their approach costs them some drops, but look at how well the others do, I’m sure they think.

    They are true-believers, and better true believers than doubtful cynics. When you are working with kids, you have to believe that each and every one of them can and will succeed. Sure, they have to do their part, but if they DO do their part, success is out there for them. If you are working with kids whom the system has not well served in the past — sometimes from families who have been stuck in that place for generations — you’ve GOT to believe that what you are doing will make the difference.

    It’s really hard to have the that kind of view and maintain that kind of positive energy while also being aware how unfair some of the things you are doing. No one person or school can be fair to everyone, so you do your best to serve the ones in front of you, without thinking so much about those who are not.

    The hope is that the market will eventually serve everyone. And this is where we disagree big-time, Ken. I know that the market will NOT serve everyone. Markets have losers. Sure, they winners, but they have losers, too. Regulation serves to mitigate that, to some degree, even if it costs some winner.

    **************************

    I actually am trying to answer your question, about whether this is a “challenge for analysis, policy, or both”

    I think that the policy challenge is very clear. How do we serve all the kids better? And I think that this kind of problem in the area of analysis misleads people in to thinking that some kids are being served who are actually being served. That is, if KIPP kids are just like the other kids, then current and future KIPP schools can serve everyone, so we just need to expand KIPP.

    But KIPP does NOT serve everyone. KIPP is not THE answer for problems these kids face. However, because people think that it is, we do not continue to look for answers that might serve these other kids, marginalizing them yet again.

    (This is not just about KIPP, and I don’t mean to pick on KIPP. They merely are a prominent and extreme case.)

  • http://www.sfschools.org Caroline

    Or a restatement of Ceolaf’s comment

    (original comment): If KIPP kids are just like the other kids, then current and future KIPP schools can serve everyone, so we just need to expand KIPP.

    KIPP proponents would have us believe that KIPP kids started out as a cross-section and that KIPP can make them all into KIPPsters. If that were true, Ceolaf is correct: Current and future KIPP schools can serve everyone, so we just need to expand KIPP.

    So that’s a big policy question. At some times and in some places, KIPP spokespeople and advocates deny that there’s any creaming or pushing out of students who CAN’T successfully be made into KIPPsters. It seems likely that it’s on that assumption that the press swoons and the multimillion-dollar checks roll in. This isn’t a policy OR an analysis issue — it’s a PR/propaganda issue.

  • ceolaf

    Ken,

    You’re ignoring the fact that kids who leave for geographic reasons tend to be lower achieving kids. One of Caroline’s points is that the kids who move don’t get replaced, either. So, that’s 3% and 7%.

    Use each of those rates twice (.97*.93*.97*.93) and you get a 19% attrition rate over 4 years. They’d lose some kids for reasons of family choice, and some due for geographic reasons. What is left are families supportive of the greater demands, who are more stable. But they’d lose 19% of their original students.

    No, 19% is not 60%. But it’s still a big number, one that biases all achievement data and makes comparisons to other populations highly suspect.

  • Ken Hirsh

    Thanks ceolaf!

    I certainly don’t think that KIPP Infinity is for everyone. I think, though, that they are having a huge, positive impact on the lives of many children. Given the available data, I am surprised when people won’t recognize this.

    I don’t recall anyone involved with KIPP in any way ever suggesting that their schools are for everyone. I agree with you, though, that some people will look at KIPP as a panacea. I also agree with you, that that is a mistake.

  • http://www.sfschools.org Caroline

    I agree that KIPP schools appear to be having a positive impact on the educational attainment, and thus the lives, of the students who manage to enroll and remain in the schools.

    But the huge question to me is: IF the traditional public school down the street also benefited from the same creaming factors, and IF it had the same attrition of the lower performers in the school,(in those cases where this exists), would it do as well as the KIPP school? We have no idea, because the effects haven’t been studied — in fact, the existence of those factors was/is ignored, disputed and denied until irrefutable numbers (at least in the case of the attition) showed up on the Internet.

    Doesn’t it seem like that’s a really important question to answer?

    Why does this matter? Well, first, because obviously it’s important to learn what boosts the educational success of low-income students of color. Which KIPP practices are driving the success? Is it the curriculum? The SLANT techniques (Sit up, Listen to the speaker, Ask and Answer questions, Nod your head to show you’re listening, Track the speaker with your eyes)? The emphasis on being college-bound? The rally-like chants? Learning to walk briskly down the hall? (I really love that one and want to get a job teaching it.) The combination of all the above? How much of it is the creaming and attrition? Don’t we need to know?

    Second, because KIPP schools are constantly compared to the traditional public schools that educate the kids who aren’t KIPPster material — to the detriment of the traditional public schools. Public schools lose support and resources when that happens.

    Third, because money is being poured into KIPP schools by the billionaires, and while it’s their right to do what they want with their money, that has a big impact on social policy.

  • http://ednotesonline.blogspot.com/ Norm

    “Socrates, are you poorly informed or deliberately giving misinformation? That’s really insulting to the readers of this blog.”

    Caroline, as a long time observer of Socrates, who at various times has claimed to be a long-time NYC public school teacher, then disappeared from the teacher bloggers who called him on it, count on the “deliberately giving misinformation” answer. Socrates, who has blogged under quite a few aliases (tracked by ip numbers) hides behind various personnas, clearly has a dog in the race, but refuses to tell anyone if it is a shnauzer or a pit bull. Does anyone think it beyond possibility that the corporate world spending millions on backing charters and privatization schemes wouldn’t hire professionals to troll the blogs offering misleading information?

  • Ken Hirsh

    Thanks Caroline!

    We agree on several points:

    * KIPP schools appear to be having a positive impact on the lives of the students that attend and remain in the schools.

    * KIPP schools have high expectations for and demands of their students.

    * KIPP schools are not for everyone.

    * There are challenges in comparing schools that have higher demands of their students with those that have lesser demands.

    Do you have government policy suggestions that go along with your concerns?

  • http://www.sfschools.org Caroline

    Hi Ken — Hmm, I’m struggling with the question of how to address my concerns via government policy. It’s such an issue of hype and propaganda. You and I (and frankly, anyone with a clue) know that KIPP schools are not for everyone — that they are working with a select group of students predisposed to be higher-functioning and more motivated than many of their demographic counterparts. Yet this is vigorously and constantly disputed by advocates for KIPP. You have seen it on this very blog — KIPP advocates (dishonest or clueless, one or the other) sneering that any parent can fill out a form.

    The general belief about KIPP, I am convinced, is that it can take any low-income child and make him or her a model KIPPster. And KIPP insiders don’t make a point of correcting this mistaken notion — rather, they make a point of NOT correcting it. (The need to hustle for private money, I’m convinced, tends to turn onetime committed idealists into conniving liars.)

    Anyway, I believe that it’s on the basis of that mistaken notion — that KIPP can take any child and make him/her a model KIPPster — that the Gates/Broad billionaire crowd showers KIPP with millions of dollars.

    I guess if I could I would somehow run a model experiment putting a group of KIPP students into a traditional public school without any other students, to see how they functioned with JUST the benefits of self-selection.

    Perhaps one policy might be total transparency about how much the KIPP school was spending per student counting the private philanthropy (as far as I know this is completely murky) — and then give the laboratory traditional public school that much too, so that it had both the selected student population and the same money to spend.

  • Ken Hirsh

    Thanks Caroline.

    I’m a big fan of financial transparency for charter schools and traditional public schools. For now, for charter schools, I think you could look at form 990′s to get a pretty good picture. Also, many (all?) schools have a financial audit that is often (always?) available. I will be doing more work on this. It might be interesting to you to look at the 990′s for the San Francisco schools that you focus on.

    Separately, I think it would be a bad idea to force parents that choose KIPP to send their kids to a traditional public school.

  • http://www.sfschools.org Caroline

    I agree; it wouldn’t be productive to force parents. I just mean it would be enlightening if one could do such an experiment.

    A colleague who is a better numbers researcher than I am is looking at the 990s for the donors to charter schools in Oakland, so that will give some view (she’s also an unpaid volunteer mommy, and the PAID RESEARCHERS AND PRESS SHOULD DO THIS! — why do they leave it to volunteers?). But I’m not sure it would clarify how much money each school was getting, would it?

  • ceolaf

    Caroline,

    1) Those “paid researchers” tend to work off of grants. Even academics are expected to bring in grants to support their research — with their institutions getting a cut for “overhead.” So, you would need people who are interested in the topic, with the right agenda themselves, and sources of funding to pay for the research.

    There’s lots of money out their for research to support research hoping to bolster market/competition-based reforms in education, as you no doubt realize. But where is the money to support research that swim against that tide?

    2) I’m not sure that I trust those 990s. I mean, how accurate are they? This is not to say that schools are intentionally lying on then. Rather, it is the point out that there is not a lot of incentive for them to do good record keeping on this, or to give a lot of thought to filling these forms out. School people are not likely to have the training to understand this stuff, the resources to hire people who do, or fear of any negative consequences if they get it wrong. There wouldn’t be any internal or interpersonal accountability on this, and it’s not clear that there’s any credible threat of external accountability either.

  • Socrates

    CEOlaf,

    Usually the 990s are compiled by CPAs, to my knowledge, and audited as part of a comprehensive annual audit process. So there is some level of oversight, though obviously audits can be imperfect.

    In KIPP’s case, you may remember that NY State’s comptroller did a big additional audit of their books (and some other charters, too) a year or so ago (that’s when there was a big stink about the staff trip to the Bahamas or wherever). I’m sure that audit also analyzed their 990s and fundraised dollars, and is public information.

  • http://www.sfschools.org Caroline

    Ceolaf — Yes, or rather where is the money to support through and scientific research — aimed at actually getting clear information rather than bolstering a position.

    That’s why I keep harping on the fact that all the previous researchers, PLUS the press — which of course is supposed to be unbiased but clearly is too bewitched by KIPP to ask any uncomfortable questions — “forgot” to pay attention to confounding issues like attrition.

  • Pingback: The Pleasanton USD Troll? « sockalicious

  • Pingback: The Pleasanton Unified School District Troll? « sockalicious

  • Pingback: The Vintage Hills Elementary School Troll? « sockalicious

Tips, questions, feedback?

Contact us at .

Follow GothamSchools

RSS

Feb. 10: You’re invited!

Chalk It Up

Recent Comments

40 comments so far today

Our Twitter Updates

  • Update: they're back in now and there is a.considerable police presence near the stage. Crowd has thinned considerably #warofattrition 3 mins ago
  • An activist just drew gasps from his fellow protesters. ”I hope your kids get their asses kicked by all the kids here” he tells the panel. 34 mins ago
  • NYPD has closed auditorium doors. Students protesting in lobby are now locked out of the meeting. 51 mins ago
  • ... & a mom says the city transferred her son from KAPPA VII, which is staying open, to ABCD, which could close, after he was bullied. 1 hr ago
  • We're starting to hear some sad stories: From a mom who wanted to speak at #nycpep but missed chance in all of the confusion ... 1 hr ago
  • More updates...

Archives

February 2012
M T W T F S S
« Jan  
 12345
6789101112
13141516171819
20212223242526
272829  
?>