GothamSchools — daily independent reporting on NYC public schools

the scoop

City will spend $1.5M to extend judging of teachers via test scores

The Department of Education created videos to explain the reports.

The Department of Education created videos to explain the reports. View them here.

The Department of Education is moving to extend a program that judges teachers based on their students’ test scores — and it plans to start paying for the project with taxpayer dollars, at a projected cost of $1.5 million over the next three years. A formal request for vendor proposals released today indicates officials are also mulling an expansion of the program to more teachers.

The program, called the Teacher Data Initiative, launched quietly this school year after causing a politically explosive fight between the DOE and the teachers union the year before. The reports allow principals to track the “value” teachers add to students by looking at student test scores from one year to the next. The teachers union here has gone along with programs to judge entire schools based on test scores, but it drew the line at measuring individual teachers’ performance, arguing that so-called “value-added” models risk unfairly misjudging teachers. (Many academic researchers make this claim as well.)

After news of the effort surfaced, the union fought back by ushering a bill into state law that made it illegal for the city to use test scores when making decisions about job security. Both Mayor Bloomberg and Schools Chancellor Joel Klein decried the bill (Bloomberg called it a “special interest protection”), which the legislature passed with no public debate, and the data reports went out as planned.

About 12,000 teachers received the reports this year, all of whom who teach fourth-through-eighth-graders and either English or math (the most-tested subjects in the city). The reports grade teachers based on how much progress their students made on tests last year and give extra credit to those who made progress despite limitations such as students’ race, poverty, and class size.

I’ve spoken to some educators who think the reports are a great first step toward helping teachers think carefully about how to improve their work. The executive director of Teaching Matters, Lynette Guastaferro, called New York “a thought leader” for creating the reports. Others have been wary, including a teacher who wrote about his experience anonymously at the union activist Norm Scott’s blog, reporting that his principal is threatening to use the reports to determine which teachers remain at the school when it phases out. (Asked about the teacher’s allegations, Forte said she hadn’t heard of them but that the city has clarified procedures for teachers to follow if reports are misused.)

The Carnegie Foundation has been financing the reports so far this year, but the grant is about to run out, so the DOE issued a request today seeking a vendor that would keep up the work on the taxpayer dime. The vendor would publish the reports and manage any future expansions. You can see the full Request for Proposals below.

A technology company called the Battelle Memorial Institute has been working on the project until now, Ann Forte, a school spokeswoman, said.

Read the full RFP (which an earlier version of this post said was not available, but now is):

  • http://www.classsizematters.org leonie haimson

    I’d like to point out that despite the DOE’s various excuses for not reducing class size, including the claim that class size doesn’t matter, in the “value added” model used in the teacher data reports to evaluate teacher effectiveness, class size is the ONLY factor under the school system’s control.

    This is an admission on DOE’s part that the larger the class, the less a teacher is expected to raise student achievement. All the other factors in the model pertain to characteristics of the students themselves, such as economic status, prior test scores, absences, etc.

    I discuss this on the parent blog here: http://nycpublicschoolparents.blogspot.com/2009/02/bloomberg-administration-blames-parents.html

    Unfortunately, the class size data is extremely unreliable at the middle shcool and esp. the HS level, so that the class size factor used to help evaluate a teacher’s effectiveness will likely be inaccurate, and thus the information yielded by these reports wrong.

    DOE hasn’t put a penny into improving the accuracy of its class size data, which still counts both CTT classes in HS as two separate classes; also they use HS data as late in the year as possible, in order to take credit for the thousands of kids who drop out between Sept. and January.

  • Jessica

    This is one of the most frightening things I have heard recently in urban education.

  • Loretta

    Maybe, just maybe, common sense and anecdotal reports matter here. We know that schools have turned into test prep factories. We know that this seriously detracts from teaching and learning. We know that schools are not teaching subjects not regularly tested – the arts, social studies, AIDS education, physical education, etc. We know that cheating goes on. Such a policy will bring out the worst in schools and teachers, not the best. We know what kids need to learn and what teachers need to teach – not a mystery. Let’s get down to teaching.

  • http://www.youtube.com/watch?v=OYecfV3ubP8 Michael D. Markowitz, P.E.

    “Education is not the filling of a pail, but the lighting of a fire.”
    – William Butler Yeats

    1) http://www.timeoutfromtesting.org/

    2) Click hyperlink for a related treat.

  • http://chrisschnurr.files.wordpress.com/2006/12/secrecy.gif Michael D. Markowitz, P.E.

    Re “UPDATE: DOE asked me to take down the RFP, which apparently you have to pay a fee to see, unless you’re a reporter. Thoughts?”

    Aren’t we ALL reporters? ;-)

    Click hyperlink for another treat.

  • http://www.classsizematters.org leonie haimson

    Yes, why should reporters get to see things that ordinary taxpayers don’t?

    I say you should post it, Elizabeth; and let them try to sue you.

    Transparency rules!

  • Lynette Guastaferro

    I actually said — that the city was trying to be a thought leader. I am not trying to hedge my bets. We need systems that help us measure the impact of individual teachers because we know that good teachers make all the difference.

    The problem right now is that this test is too narrow and that too many educators are resorting to horrific instruction and drill. However, teaching wholistically is not going to work either. This new system requires a mix of teaching wholistically while targeting specific skills in context. This is hard and not enough people are doing it. The way out of this problem is national standards, radical innovation of the assessments so that they also measure skills in context and wholistically.

    Below I have linked to a fantastic explanation of the past and the possibilities for innovating assessment.

    We need to figure out how to create assessments that we can teach to that will actually push our instruciton to higher levels and not short change our students. http://www.educationsector.org/media/media_show.htm?doc_id=830339

  • http://www.cecd2.net/home.aspxhttp://www.cecd2.net/www/cecd2/site/hosting/Revised%20Resolution%20#18EducationalandRelatedDisparities.doc Michael D. Markowitz, P.E.

    I would be happy to entertain an explanation of how an assessment of students’ progress from one year to the next attributes the value-adding correctly between those children’s teacher… and all the other variables in those particular students’ lives.

    And that’s assuming, of course, that the tests measure all of the value the teacher has added to each student’s educational growth, wholistically (sic) speaking.

    Excuse me, but I’ve already gotten off the bus.

    P.S. What of a teacher who might nominally provide more “added value” to some types of students than others? Will THAT be disaggregated?

  • http://ljohnson562@charter.net Linda Johnson

    If teachers will be evaluated on the basis of test scores, I have advice for them that will guarantee high scores for almost all their students. Teachers need to remember these three words: location, location, location. I taught school for 42 years before retiring in 2007. During this time I taught in affluent, middle-class and very poor areas. In the rich school, most of my students scored above the 85th percentile on standardized tests; in the middle class schools most scored around the 50th percentile and in the impoverished school below the 10th. It was very obvious to me (and heavily supported by research) that these scores correlated closely with socio-economic factors.

    My advice to new teachers: Appy only in districts with high test scores. If you can’t get a job in one of these schools, apply to be a substitute until there is an opening. To veteran teachers: Apply for a transfer to an affluent school in your district. If this is not possible, gather as much evidence of student achievement in the fall (tape recordings, tests, compositions etc.) and get other teachers to observe your students. In the spring, give your own evaluations to show progress. This evidence can be used to counter the results of standardized testing, which may or may not represent growth made by your students during the year. Yes, I want poor children to have the best possible teachers but not until these dedicated professionals are assured of fair evaluations.

  • http://ljohnson562@charter.net Linda Johnson

    Good comment!

  • Michael M.

    Linda,

    Until one studies the “value added” calculation, one cannot simply say, “teach where the scores are high.” The proposed formula puports to measure value added — not just test scores — or I’d agree immediately.

    One of the problems with DOE’s School Progress Report Cards MIGHT be repeated here: misguided notions of how to measure “progress” might be echoed in how to measure “value-added.”

    If Teacher A teaches in Affluent School, where kids score at 85th percentile, year after year, what value has the teacher added? 85 – 85 = net zero.

    If Teacher B teaches at Impovershed School, where kids score at 10th percentile one year, but say 30th percentile next year, for a net increase of 20 percentile points, is Teacher B a better teacher?

    Which teacher kept his or her kids 35 points above the mean? Which teacher didn’t even have 20 points of “headroom” over 85?

    What might the results be if Teachers A and B switched places for year 3? Who knows. So why make a pay differential that falsely rewards for value-added. And I haven’t even looped back on socio-economic or family variable or variables outside the teacher’s control yet.

    P.S. Is the Chancellor’s pay dependent on how his system educates kids? Just a thought. Cheers.

  • http://ljohnson562@charter.net Linda Johnson

    Tests, value added or otherwise, will do nothing to improve education for our children. We already know how to get “highly qualified” teachers. You attract the “best and the brightest” and then lure these people with competitive salaries and promises of professional autonomy and good working conditions. That’s what successful countries do and that’s what we do at the college level where our schools are considered among the world’s best.

    The approach that we are taking now will actually hurt students because of the implied insult to teachers when we talk of giving tests to evaluate them. You can be certain that the “best and the brightest” will not accept these conditions unless the country is in dire economic straits.
    Until recently I pretended that I wanted my Harvard and Stanford educated sons to become teachers, but now I know that I was being dishonest with myself. The truth is that they never would have considered K-12 teaching, nor would any of their classmates. In fact I was told that Stanford discourages their students from classroom teaching because “we educate leaders” or something along those lines. I don’t know if that is true or not but it has the ring of authenticity. “Holding teachers accountable” might impress many citizens but people in education should know that to get and keep quality teachers you have to pay them, provide good working conditions (yes, teachers, like central office people, like air conditioning) and professional autonomy. Teachers do make a huge difference but you aren’t going to attract them with threats, tests or insults.

    One more thing: All (and I mean 100%) of the highly educated women I know are entering the fields of medicine, law, business and university teaching. Once the baby boomers retire, there will no longer be the captive group of talented women to fill our nation’s classrooms. I say GOOD because that might be the best thing to happen to K-12 education. Any district that wants experienced and highly qualified teachers will have to pay them and treat them with respect. At that time, we MIGHT see improved learning in our schools.

Tips, questions, feedback?

Contact us at .

Follow GothamSchools

RSS

Feb. 10: You’re invited!

Chalk It Up

Recent Comments

17 comments so far today

Our Twitter Updates

  • We're headed to Cobble Hill to The Schools for International and Global Studies; parents say they are suing Eva Moskowitz, co-location plan 1 hr ago
  • MT @NYDNBenChapman: Chancellor Dennis Walcott said he spoke with FBI agents at PS 243 this a.m. where aide is accused of molesting students 1 hr ago
  • RT @NYDNBenChapman: Schools chancellor Dennis Walcott just arrived at PS 243 where teacher aide allegedly filmed kiddie porno in school 1 hr ago
  • Says a Robeson senior: “Teachers will let us eat during class, but it’s just chips, not a full meal. You can’t live off chips alone.” 1 hr ago
  • At Paul Robeson High School, which is phasing out, students start at 8:35 a.m. but don't eat lunch until after 2 p.m.: http://t.co/VeMk5hLH 1 hr ago
  • More updates...

Archives

February 2012
M T W T F S S
« Jan  
 12345
6789101112
13141516171819
20212223242526
272829