GothamSchools — daily independent reporting on NYC public schools

Classroom tales: A diary

Teacher Report Cards: The Long Answer

Thursday I received a call from the New York Post, asking me if I was interested in writing about the teacher data reports whose scores looked to be on the verge of release. I’ve written a fair amount about my tormented relationship with my own teacher data report. In light of the battle over the release of the city’s teacher data reports, the Post was looking for a teacher to come out in favor of publishing the scores. In spite of my feelings toward the Post and its parent company, News Corp., in general, I was excited for a chance to share my perspective with a larger audience.

Unfortunately, the Post’s word count constraints meant a large part of my argument was left out in favor of a stronger pro-release column. I understand the newspaper’s need to support its stance as simply as possible, but I want to use the space here to clarify my views and hopefully add some of the nuance that the Post wasn’t interested in.

The truth is, I am in favor of releasing the scores, including my own “average” rating. But not without a serious effort by everyone involved to explain the flaws and shortcomings inherent in them. I believe parents and the public have a right to know how teachers are being rated.

The public should also know that the scores are based on a formula that produces wide variability. The margin of error for some scores was as high as 35 percent! So a teacher who belonged in the top quintile may have ended up in the third quintile, and vice versa. If scores are released, the city or the media have a responsibility to give limitations like this prominent coverage.

Ultimately, the UFT’s decision to fight the release isn’t unreasonable, but it seems like a losing battle, and one that once again puts the union and the teachers it’s seeking to protect in an unfavorable light. I worry that the UFT is going to do more damage than good, and is missing an opportunity to control the conversation over the data reports and teacher effectiveness in general.

The main reason I favor the release of the scores is because of the conversation I hope it will spark. Recently, the discussion surrounding effective teaching has centered on student test scores. I hope (perhaps naively) that by looking at the limits of the teacher data reports, we can also talk honestly about the limits of test scores in general to judge teacher effectiveness and student performance.

The truth is, effective teaching is about much more than helping students score well on state tests. The best teachers I know act as role models and inspirations for their students. They teach their students how to respect one another, take pride in themselves, love learning, constantly question and search for answers. The teacher data reports will never be able to quantify this impact. If we’re going to honestly discuss effective teaching we can start by recognizing this fact.

  • Hubie

    Google:

    “Ruben brosbe shortcomings are a shock to him” for a proper retort

  • http://gothamschools.org/author/arthur-goldstein/ Arthur Goldstein

    I’m shocked, shocked, that the New York Post would do such a thing.  Who could have possibly anticipated this?

  • http://www.classsizematters.org Leonie Haimson

    A parent whose remarks were published as an NY Post oped in support of the teacher data reports has also renounced the accuracy of the resulting piece.

  • http://www.bronxteach.com Ruben Brosbe

    Hubie, that was a pretty intense takedown, filled with a fair amount of ad hominem speculation, but I think the author has some fair grievances. I will say that what A Teacher in the Bronx sees as talking out of both sides of my mouth, I see as an ability to see two sides to an issue. What can be construed as contradictions, I hope others can see as nuance.

  • http://jd2718.wordpress.com Jonathan

    I think you are wrong about the reports (they are meaningless and worthless to us as teachers, but will stir up a storm of stories and propaganda about “low-scoring” teachers – based on meaningless information);

    and I think you showed poor judgment speaking to the Post.

  • Mr. Harris

    How can any good come from the release of these flawed and dangerous reports? If the conversation is already being “controlled” as you speculate, by those who do not represent the teachers, then why should we believe that newscorp or the DOE will be arguing in good faith about what “effective teaching” is? The well has been poisoned with these reports, it’s hard to see what good can come from them in any broader context. It might be instructive to have a conversation about how good reports can be generated by using these flawed ones as a counterpoint, but does anyone really believe that the media and the DOE have any interest in debating these finer statistical points? Think big picture here!

  • confuzzled

    Releasing the scores WILL spark a conversation. But will it be the kind we need to have? I don’t think so. It may bring parents out of the woodwork (FINALLY?!?!) but not for the right reasons, and anything from their end will be short-lived, as they still will continue to be shut out.

    You ended with “The truth is, effective teaching is about much more than helping students score well on state tests. The best teachers I know act as role models and inspirations for their students. They teach their students how to respect one another, take pride in themselves, love learning, constantly question and search for answers. The teacher data reports will never be able to quantify this impact. If we’re going to honestly discuss effective teaching we can start by recognizing this fact.” So how can you say that the TDRs can’t quantify what is the most important part of our job, while supporting the release of these reports? F.Y.I. I work with a few educators who embody all those things you cited, but didn’t do so well on their TDRs. They do not deserve the humiliation that will come with that info plastered all over the papers. My friends are very disheartened and I can’t blame them. And the Post is the biggest teacher-bashing piece of trash around- how could you think they would present your piece in an honest light?

  • http://MoreThoughtful.blogspot.com Alexander Hoffman

    Even if we want to use VAA to judge teachers or inform us about them, we need to make sure that the assumptions upon which the statistical analysis relies are honored.

    With VAA, the big problem is random assignment of students to teachers. It does not take many intentionally assigned students to invalidate this assumption and therefore the who statistical analysis.

    Does anyone believe that releasing these reports will NOT lead to more parental pressure? Isn’t that one of the goals of doing so? If not, what IS the goal? What do those who support their release expect to happen? Parents will move children when then can, and pressure others to move them when they cannot. Parents with more power and leverage will be more successful in doing so. 

    ANYTHING that alters the assignment of students from being random harms the validity of these reports, creating a self-reinforcing cycle that will make some teachers look better and other look worse because of use the use of the statistical methods who assumptions are not honored and thereore produce invalid (i.e. false) results. 

    So, anyone who is thinks that VAA might be useful should be fighting to preserve it, rather than fighting to destroy its validity. Instead, they seem to working to assure that those who doubt VAA are right. 

  • I noticed that…

    Ruben states in the Post that parents should know their child’s grade and academic growth. Well, I agree but this is called a report card. Every term parents are informed of a child academic growth from one report card to the next and the final report card is a culmination. Why should these TDRs be made public when report cards are data driven information for parents and this procedures has been done for many, many years! With this information it’s enough. Having TDRs published is nothing but putting teachers in the stockades so they can be humiliated publicly.

    Where’s your outrage? Why do I feel that Klein’s malicious intent to publish the TDRs is just as bad as cyberbullying; he’s trying to bring shame to the teaching profession.

    I feel that Ruben has another lofty goal and it will definitely be very far from teaching. I would like for Ruben to publish his grades when he was in elementary, middle and high schools. Also publish your college transcript since you believe in going public with TDRs. Let’s see your teachers’ grades.

  • http://www.bronxteach.com Ruben Brosbe

    I noticed, I think there may be some confusion about what the TDRs and what I was advocating. The TDR’s are based on student growth, but they actually are reports for teacher performance, not students. I don’t think they should be released to give parents information about their students. I think they should be released to give parents information about their students’ teachers.

    But while I think the TDRs have flaws I don’t think they’re totally invalid. Therefore another reason I believe they should be released is because they can hopefully start a conversation about how teachers are being evaluated, how they should evaluated, and what role parents should have in terms of access to that information. Clearly Bloomberg and Klein already have their ideas about how to do this. It’s time to for teachers and parents to engage instead of react, and I think the more public this conversation is, the better.

  • Pogue

    It’s a witch hunt. And, worst case scenario is putting the names of all people at their jobs, in the newspapers, in regards to their performances. Foolish data all over the place, driving society’s psyche.

    Many agree that it’s the student’s effort that plays a huge part in their academic success. Do we publish that data? No, it’s cruel, it’s nasty, and it doesn’t help.

    “Conversations” should be calm, humble, and productive processes. Publishing names in newspapers is an aggrandizing witch hunt.

    No teacher should ever be for that.

  • SickofBloomberg

    Just a disgusting and repulsive string of educational hate crimes perpetrated by those two incompetents Bloomberg and Klein, the Hitler and Goering of education. They are engaged in a cleansing of undesirables (unionized teachers and public schools) so they can create their MASTER RACE (CHARTER SCHOOLS AND NON_UNION STAFF). HEIL BLOOMBERG!!!!!!!!

    “But, after all, it is the leaders of the country who determine the policy and it is always a simple matter to drag the people along, whether it is a democracy or a fascist dictatorship or a Parliament or a Communist dictatorship. …voice or no voice, the people can always be brought to the bidding of the leaders. That is easy.” Hermann Wilhelm Göring

  • http://MoreThoughtful.blogspot.com Alexander Hoffman

    We really need to think about this in context.

    What is context?

    Well, part of that is the different goals, objectives and desires of various parties. No question. But part of context is the other programs and procedures in place. 

    So, how useful are these reports, given the other information available to parents? Is there is enough other info for them to make sense of the reports? Is there is so much other info available that they complicate a barely understandable situation?

    More generally, does the value of releasing these reports outweigh the downside(s)? Is anyone willing to actually go through the advantages AND the disadvantages, and try to evaluate that question from their perspective?

  • NYCee

    I guess Ruben never heard the name Rigoberto Ruelas – He is a real life (now dead) casualty of the value added publishing of teachers’ names, a crime committed by the LA Slimes. Or maybe he has and he is just … clueless? Callous? 

    One thing you can say for cannibalism: it never loses its shock value.

  • NYCee

    Ruben is living in gaga land… to think that newspaper readers/media consumers will bother, after seeing teacher data reports, to do their homework and consider all the variables that, in the end, make publishing such reports a total joke. Even if a few well meaning parents or civilians, in this edu-war zone Obama has unleashed, wanted to consider all the variables, it isnt humanly possible to do so. You just cant wrap your head around all the things that come into play.

    To think that folks can and folks would if they could! Unfortunately, he does not think. He has not thought this through.

    Question for Ruben: And how do you think this will impact teaching, as a whole, the whole teaching community, when it comes to fairness in having this (unfair) practice applied, since it cant be fairly applied across the board, to all teachers, of all grades, in all subjects?

    Will you judge pre K teachers by their students progress the previous year, based on a Mommy Report Score?

    Oh lol and give me a soft place to bang my head! It cant be done fairly, Ruben, it just cant! 

    What a mess these fools in power have unleashed upon us, and how unhelpful to have actual members of the teaching profession buy into it, like fish who aim for the frying pan.

  • Mustafa

    You talked to the Post, are you surprised by how they’ll twist your words? Also, do you really think Joel Klein will feel the need to go out of his way to explain the reports to the average person? Come on!

Tips, questions, feedback?

Contact us at .

Follow GothamSchools

RSS

Chalk It Up

Recent Comments

0 comments so far today

Events Calendar

Our Twitter Updates

Archives

February 2012
M T W T F S S
« Jan  
 12345
6789101112
13141516171819
20212223242526
272829