GothamSchools — daily independent reporting on NYC public schools

experimental education

UFT helping city recruit for Gates-funded teacher quality study

Schools Chancellor Joel Klein wants teachers to sign up to be guinea pigs in a national study on teacher evaluations–and the UFT is backing him up.

In an email sent tonight, Klein and UFT president Michael Mulgrew asked city teachers to volunteer for a new Gates Foundation study that will test methods of evaluating teachers.

The study comes at a time when policymakers are calling for changes in the way teachers are evaluated. The Obama administration is pushing states to judge teachers based on student test scores. But the city teachers’ union last year lobbied the state to ban that practice, at least in teacher tenure decisions.

This study, however, has the union’s wholehearted support because it will begin with measures rooted in classroom practices. Mulgrew told GothamSchools he thought the project was a “fantastic endeavor” that could convince teachers to accept new forms of evaluations.

“It takes the politics out of what’s being measured,” UFT president Michael Mulgrew said. “Teachers are very frustrated with the political debate. They are always saying, ‘why don’t you just come into the classroom?’ That’s what this is doing.”

“I think you’ll have so many teachers volunteer,” he said.

Teachers who volunteer for the two-year study will open their classrooms to videotaped observations, student surveys, and test score scrutiny. Those results will then be analyzed, but they won’t be shared with principals.

“The idea is that at the end of the project we will have a better sense of what kinds of measures are accurate in evaluating what’s actually going on in the classroom,” said Christopher Williams, senior program officer at the Gates Foundation. The project will be led by the Gates Foundation’s Stephen Cantrell and by Tom Kane, a professor of economics and education at Harvard University.

Williams said that the study will be conducted in a variety of school districts across the country and would involve several thousand teachers. He declined to comment on how much funding the Gates Foundation is dedicating to the project. But he emphasized that it was an integral part of the foundation’s larger educational goals.

“This is one part of a broader effort that we’re undertaking to see if we can get more effective teachers in classrooms across the country, especially with the students who need them most,” Williams said.

The full letter that Klein and Mulgrew sent to UFT members is below:

September 1, 2009

Dear Colleagues,

The United Federation of Teachers (UFT) and the Department of Education (DOE) are looking for volunteers to participate in a Bill & Melinda Gates Foundation study to help develop fair, accurate, and useful guides to what really makes effective teaching and learning. This two-year research study is premised on the principle that good teaching is multi-dimensional, and that teachers and their schools need consistent and reliable information in order to identify and support good teaching.

Both the United Federation of Teachers and the Department of Education will be collaborating with independent researchers on this project because we all recognize that the work of teachers must be measured in ways that are fair and valid.  Nationally, current measures of teaching rarely take into account the full range of what teachers do (no single measure really can), or the context in which they teach. The Measures of Effective Teaching project, on the other hand, begins right in the classroom and will explore a broad array of teacher measures: video observations, surveys, and student growth.  It will compare these measures to each other, and to nationally recognized standards, and it will look at their inter-relatedness.  It will be informed by actual teacher practice.

In other words, the real work of real teachers in real classrooms will be central to every aspect of this project.  That’s why both the UFT and the DOE have looked forward to working with the Bill & Melinda Gates Foundation: we want to support student achievement with solid research based on what our teachers do in class.

To that end, together, we are inviting eligible teachers to join us in this project.  Participation is completely voluntary, and those teachers who volunteer will be allowing Gates-funded researchers to collect information about their teaching from a broad variety of sources in order to answer two basic questions: what is our common understanding of the teaching learning process, and how do we measure it consistently?  To answer these questions, researchers will video classrooms; collect surveys from participating teachers and students; assess teacher knowledge of content and pedagogy though a brief test; and collect information on student academic growth through specially administered standardized tests.  Researchers will look at the videos through the lens of several different sets of nationally recognized teaching standards to see which work best. And, teachers will also provide their own reflections on the lessons that have been videotaped.

As you can see, Gates hopes to capture the full range of what teachers do by gathering multiple sources of information, including information on the context in which the teachers teach. The goal is to use this information to create multiple, reliable measures of good teaching.

And that is important to all of us.  We all know that teachers teach best when they know what the standards are for their teaching, have been supported in reaching those standards, and feel assured that no single, snapshot measure will determine the course of their career. If you volunteer, you will be joining us in a project that will help us understand what works when it comes to assessing teachers. We hope this will lead to fairer guides for all of us, and raise the level of achievement in our schools.

To acknowledge their contribution over the course of the two years, teachers will receive a $1500 stipend. And of course, they will also have access to their own videos as well as student test results.

Finally, let us say clearly at the outset: this is a research project, and it assures full confidentiality to the teachers who volunteer. That means that principals and other DOE employees will not receive copies of your videos, surveys, or assessments.  And, teachers will be able to opt out of the program at any time. This project it is not about the evaluation of the 1000 teachers we hope will join us, and it cannot be used by the DOE to evaluate them; rather it is about evaluating the multiple evaluation measures that are used across the country in order to ensure that they are fair, transparent, and consistent. Schools need a better understanding of these measures.  To that end, the researchers do hope to share aggregated data with the central DOE and the union, which could prove helpful in supporting teachers.

Schools and teachers will have opportunities to learn more about this study in the coming weeks through borough meetings and other communications.  More information, including important details about which schools and teachers are eligible and the requirements of the study can be found at: http://schools.nyc.gov/Teachers/Resources/Other/Grants/MET/default.htm

We hope you will join us in this project; it may turn out to be among the most meaningful projects of your career.  And, thank you, as always, for your work on behalf of our students.

Sincerely,

Joel I. Klein                                                                  Michael Mulgrew
Chancellor                                                                    UFT President

UPDATE: This post has been clarified to show that the study will examine multiple measures of teacher evaluation beyond just test scores.

11 Comments

Subscribe to comments with RSS or TrackBack

  1. Fort Tryon Teacher

    This is exciting. Why didn’t I get this e-mail? Who are “eligible teachers”? The hyperlink in the e-mail doesn’t go to anything other than an empty box that says “MET.” How do I sign up?

  2. TeacherMan

    I was at a briefing about this plan at the UFT this afternoon and I think this story misses the mark entirely. This project is designed to get away from using test scores in evaluations and instead look at the broader spectrum of what we do in classrooms. That’s the point. Also, the line about teachers being guinea pigs is offensive. We want more people to realize that you cannot evaluate teachers just on test scores.

  3. Maura Walz

    TeacherMan - You’re right, looking back at the post I don’t think it was explicit enough that the UFT is excited about the study because it goes well beyond test scores and begins by looking into classroom practices. I’ve updated the post. I hope it’s now more clear.

  4. John Hancock

    What about cluster and specialty teachers. How is this going to work for them? What exactly are the student test results for playing the flute in Music or creating a documentary in Technology. What is the standard? Just curious.

  5. Maisie

    What I like about this project is that Gates researchers are really evaluating the evaluation tools that measure teachers, not the teachers alone. For example: They are using state standardized test data but also giving another test. That second test acts as a reality check on how well the standardized tests do in measuring teacher effectiveness. Does the teacher effect come out differently on the second test?

    Judging teacher’s effectiveness based on the state tests can be a problem because those tests are wide and shallow–they measure lots of areas but have only a few questions in each area. So they give a second test with questions that go deeper into a subject area. Do the students’ performances on that test give a different result for their teacher? Then what does that say about measuring teachers using the state tests? This promises to be very interesting.

  6. Hunter65

    Don’t be fooled by this attempt to disguise evaluating teachers (not teaching) by standardized tests and the low level of learning that such tests will be capable of measuring. Unless these tests are aligned with what the teacher is teaching (the goals of the lessons and curriculum) and with survey items, then the test is not a valid measure of anything. Why not use multiple forms of student assessments that are authentic student products rather than just proxies.

    This is a wolf in sheep’s’ clothing. Teachers who participate are fools because they will be contributing to the development of a system in that will dismiss teachers who teach higher level skills and knowledge that the tests can’t measure.

    Everyone should know that Kane believes that no investment should be made in teachers after 3 years of teaching because there is not growth in their students’ test scores.

  7. Maisie

    Hunter65, I don’t think you’re reading this right. The second test is designed to do exactly what you are advocating: test higher-order cognitive skills drawn from the curriculum of that grade and subject. In addition, the study is designed to test multiple measures–including the very ones you say it should–such as student work, student surveys, and videos of teachers in action.

  8. curious

    Until a few years ago, didn’t NYS require a video-taped submission of a lesson as one of the tests for certification similar to the written ATS-W? Yes. So clearly there is already a substantial pre-existing wealth of data about this issue. And certainly what the Gates Foundation is looking for has nothing to do with curriculum mastery or higher-order thinking but rather the more subjective teaching skills like classroom management, student engagement, etc. And these tapes and this study have pre-existing conclusions that the designers are looking to substantiate in a more rigorous and comprehensive way. They are attempting to quantify what is inherently qualititative. I expect the results will lead to the modification of the current surveys used to calculate 15% of a schools progress report grade. And this will then be part of the numerical determination of teacher effectiveness. Notice how one selected teacher and one cherry-picked classroom of students will represent the entire demographic of a particular school.

    If they really want to determine the qualities that make an effective teacher, Gates and Co. would simply dig deep into their own memories. What qualities did your best teachers have? The collective answer to that question will lead them to the data that must be collected to judge a teacher’s true ability. And they must stop claiming that putting numbers on things makes it better, and “more scientifically valid” and unassailably true.

  9. Too bad the DOE website on the subject is blank…for a study they’re trying to recruit teachers to volunteer for, it’s awfully mysterious!

  10. Hunter65

    Maisie, you may not understand that standardized tests do not have the capacity to measure higher order thinking skills.

  11. Maisie

    Hunter65–that’s exactly why the second test is a different one, one that can measure those HOT skills.

Leave a Reply

Tips, questions, feedback?

Contact us at .

Mapping the Budget Cuts

Post a comment about the budget cuts at your school on our interactive comment map. more »

Chalk It Up

Our Twitter Updates

  • Citywide Council on High Schools meeting is set to proceed as scheduled, for now. Same goes for the PEP meeting rescheduled from Jan. 26. 14 hrs ago
  • From the DOE: In anticipation of inclement weather, the Specialized High School open houses scheduled for Weds. have been postponed. 14 hrs ago
  • @datadiva What do you see as the biggest changes? We're having trouble figuring out what to make of the 2010-2011 changes. in reply to datadiva 15 hrs ago
  • NY is near the top RT @alexanderrusso: State by state list of National Merit cut scores shows gaps, equity problems http://bit.ly/dw1Ztv 16 hrs ago
  • RT @HillcrestHigh: The DOE states that ARIS Internet Parent Link is out of service until 2/12. 3 days ago

Events Calendar

Archives

February 2010
M T W T F S S
« Jan  
1234567
891011121314
15161718192021
22232425262728

GothamSchools by Email

Technology in Education

The blogroll is a work-in-progress; to be added or if you've been miscategorized, send us an email at .