GothamSchools — daily independent reporting on NYC public schools

Eye on Education

Biting the Hand that Feeds Me

GothamSchools Editor Elizabeth Green’s cover story in the March 7th edition of the New York Times Sunday magazine tackled the problem of preparing teachers for K-12 classrooms in the United States.  Embellished with the provocative title “Building a Better Teacher,” Elizabeth’s piece profiled two approaches to teacher preparation:  a grassroots approach emerging outside of the academy which focuses on a set of techniques that teachers can use to increase learning time and improve learning environments, and a research-based approach developed in colleges and universities emphasizing the knowledge and skills that enable teachers to teach particular school subjects effectively.  Elizabeth’s story opened with a description of Doug Lemov, who has developed a taxonomy of 49 instructional techniques that he and others believe are critical to effective teaching, and especially to closing the achievement gap between poor, minority children and their more advantaged peers.  If we were to judge the relative merits of the two approaches based on the amount of ink devoted to each in her article, we’d conclude that, in the battle for the minds of education policymakers and practitioners, classroom management (i.e., Lemov’s taxonomy) had won, and pedagogical content knowledge (i.e., the work of Deborah Ball on Mathematical Knowledge for Teaching) had lost.

The disproportionate emphasis on Lemov’s approach in Elizabeth’s article surprised me.  To be sure, he’s a fine human-interest story, and the schools he works with have shown remarkable performance on state achievement tests.  But Elizabeth briefly acknowledged the lack of a research basis for Lemov’s approach, writing:  “And while Lemov has faith in his taxonomy because he chose his champions based on their students’ test scores, this is far from scientific proof.  The best evidence Lemov has now is anecdotal…”  Why would she and the Times choose to feature an approach with so little evidence to back it up?

Lemov’s book, “Teach Like a Champion:  49 Techniques that Put Students on the Path to College,” was published two weeks ago, and currently ranks #30 on Amazon’s bestseller list.  I wanted to see what he had to say about the research evidence underpinning the techniques.  A thin research base does not, of course, mean that the techniques are not valuable—I expect to learn quite a bit from studying them, and seeing if there are opportunities to adapt them for teaching my graduate students (who will tell you that classroom management is not my strong suit.)  And, of course, who wouldn’t want to be a champion teacher?  Because it is, after all, a competition, right? 

But my motivation runs a bit deeper.  Yesterday, the New York State Board of Regents unanimously endorsed a proposal to pilot new programs for preparing teachers that would allow organizations that are not institutions of higher education to offer programs leading to the master’s degrees that New York requires of certified teachers.  Writing in Monday’s New York Times, Lisa Foderaro saw the parallel between this proposal and State Commissioner of Education David Steiner’s approach when he was Dean of the School of Education at Hunter College, where he “sought to elevate the practical aspects of teaching:  when to make eye contact, when to call on a student by name, when to wait for a fuller answer.”  At Hunter, Steiner pioneered an innovative teacher preparation program called Teacher U, partnering with leaders from Uncommon Schools, KIPP, and Achievement First, three networks of charter schools operating in New York State and elsewhere.  Doug Lemov is an instructor for Teacher U.

I’m on record expressing fear that that the Regents’ proposal will decouple the preparation of practitioners from the colleges and universities where research about practice is produced.  Lemov’s book does nothing to assuage that fear.  It provides no research evidence that these 49 techniques produce high levels of student achievement, either singly or in particular combinations.  Lemov’s book does not describe either the incidence or prevalence of the use of these techniques in any population of teachers—there’s no way to tell if more frequent or intense use of a particular technique by a teacher is associated with higher student achievement. 

This doesn’t stop Lemov from writing, “The techniques described here may not be glamorous, but they work.  As a result, they yield an outcome that more than compensates for their occasionally humble appearance” (p. 6).  The book provides no evidence that these techniques work.  What is clear is that there is a set of schools that Lemov works with or is familiar with that demonstrate exemplary performance on state standardized tests, and that, through observation, he has found evidence of these techniques in some of the teachers who teach in these schools.  But that doesn’t mean that it’s the techniques, singly or in combination, that account for the success of the schools.  There may be any number of other explanations for why these networks of schools are demonstrating high levels of success on state assessments. 

If these practical teaching techniques matter, it should be possible to demonstrate their effectiveness using methods that meet conventional scientific standards.  Before we give out master’s degrees based on mastering them.

  • Party’s over!

    Party’s over boys, the gravy train is leaving the station!

    The monopoly the colleges and universities have on teacher certification is being cracked open and practitioners (you know, the ones who actually work with educators every day and know how to teach themselves) like Lemov are on the rise. More are on the way.

    Education schools, like Aaron’s hallowed TC, are high volume, high profit centers for universities. They cost practically nothing to run (compared to a Physics department or a medical school) and they pull in the big bucks with a steady stream of students lining up every year. The demographics of the baby boomers’ retirement and recent NYC birth rates practically guarantee hundreds of millions of dollars a year will be spent on gaining teacher credentials from universities and colleges. Why doesn’t anyone talk about the privatization of public education in the context of these de facto stream of student tuition (aka policy provided, aspiring-teacher funded subsidies) to universities for the school system to function?

    When Aaron talks about certification, he talks about the frightening “lack of research basis” for Lemov’s taxonomy, presumably research conducted and approved by the Academy that directly benefits from the current arrangement. Boo hoo.

    Here’s a research topic that we’d love to see: Go to Bedford Stuyvesant (if you’ve got the guts) and ask parents of kids who are going into kindergarten next year what school they want to get their kids into. When they tell you Excellence Academy, started by Lemov’s network, ask them why.

    Then go visit Excellence and visit the classrooms. Watch and learn. Then, go take a look at their NYS test scores. Then, just for kicks, take a look at their attendance rate. Ask the kids why they go to school 98% of the time. Ask the parents why they pass the Math exams at 100%. Ask the teachers why they like to teach there. Ask the teachers whether their college coursework or their PD in Lemov’s taxonomy is the bigger contributing factor for their success.

    After you’ve done your research, go visit any number of the surrounding elementary schools and see where the hundreds of kids who applied to Excellence, but didn’t get a seat, attend. Take a look at their classes, their scores, their attendance. Interview the parents. Interview the teachers. Ask them how much their college coursework helped them in their success or failure.

    Instead of worrying that you’ll lose your platform on this website, you should be worried that your ivory towers are slowly going to lose their grip on teacher certification and the subsequent funding windfall that your schools so smugly assume is their birthright.

  • Aaron Pallas

    Party’s over, your comment misses the point of my post completely. I am writing about whether there is a research basis for the instructional techniques that Doug Lemov is championing. Not about whether the schools in Lemov’s network are good, not about parents’ preferences, not even about what teachers say about what they find valuable. Do you have anything to say on the topic of whether research has demonstrated that these particular techniques influence student outcomes?

  • Tim

    Party’s over, I don’t believe that a handful of classroom management gimmicks and good scores on state math and ELA exams are a sufficient justification for tearing down and rebuilding public education as we know it. That the system is failing a lot of kids does not warrant pursuing a solution that will leave the same kids in a different system but one that is arguably even more perniciously separate and unequal.

    (In other words, go to some public school parents in New Canaan, Silver Spring, Winnetka, Atherton, Southlake, etc. and see how they respond to the idea of their children’s being controlled by “Dog Whisperer” techniques so they can sit still for their daily nine-hour dose of drill and kill.)

  • miss teacher

    I am about halfway through the book, which I bought after reading the NYT article. It has some solid ideas, and there have already been a few things that I’d been doing that I never labeled. I know little about stats and designing research so I wonder, would it be possible to even effectively study these techniques and separate them from other advantages that charters have over regular public schools like mine? (I’m sure someone will tell me that charters have no edge over regular schools; I disagree.) Hope my question makes sense. I do know that we teachers need to have some “gimmicky” things in our toolbox (like the lightening-fast way kids pass out papers in one of the book’s video clips) and I would like to see if they increase effectiveness.

  • http://stuartbuck.blogspot.com Stuart Buck

    So if there’s no research basis for Lemov’s techniques, he’s still arguably in a better position than masters’ degrees from traditional education schools, because we know for sure that those degrees do nothing for K-12 students.

  • Point Guard in Chief

    huh? I guess it’s a good thing that we don’t “judge the relative merits of approaches based on the ink devoted to each.” that’s just silly.

    having worked in several scientific labs as a graduate student, I can tell you that scientific data isn’t the only grounds for deeming a method worthwhile. Take sports coaching or creative writing programs. There is precious little scientific data for certain approaches, and yet an athlete or writer knows when their performance is elevated by the person teaching him or her. Humans aren’t incapable of evaluating techniques in the absence of hard scientific data. there’s no scientific data that Picasso could paint, but guess what, he could.

  • Ken

    Hey Aaron,

    What is the best research evidence that master’s degrees at ed schools are correlated with better teaching?

  • Michael Fiorillo

    Point Guard in Chief,

    According to the people in charge of the schools today, the only proof or “metric” of Picasso’s ability to paint would be the prices people are willing to pay for his work.

  • http://www.thisweekineducation.com alexander

    good post, aaron — and good for you for taking thison.

    i too have questions about the focus on lemov and the seeming lack of criticality (new word!) in green’s piece. From my blog post, Building A Better Reporter:

    “There are many out there who would say that more PD, or Ball and Lemov’s kind of PD, are not the answers. Many teachers would balk at the notion of more PD, or the hyper-particularity of the PD that Lemov and Ball espouse. But Lemov and Ball don’t really disagree all that much, and the closest we get to a truly opposing view is a former critic, Tom Kane. Access kills, like I always say. Too much access is nearly always fatal.”

    you can read the rest here:

    http://scholasticadministrator.typepad.com/thisweekineducation/2010/03/media-building-a-better-reporter.html

    cheers
    / alexander

  • Smith

    Will this book be the next flavor of the month? I never did finish the backward design book, though it seemed pretty good, and I haven’t gotten around to the differentiation one yet. Maybe I could read this and be ready for Quality Review 2011.

  • Aaron Pallas

    Stuart and Ken,

    I’m not arguing that a master’s degree from an ed school is associated with better teaching. There are, in my view, a great many undergraduate and graduate programs in education that do a rotten job of preparing teachers for the classroom. I’m more interested in the features of programs that can promote successful induction and retention in schools, especially schools serving poor children, where “success” is defined mainly, but not exclusively, in terms of students’ academic achievement. I don’t think it unreasonable to expect ed schools to demonstrate that they are doing a good job at preparing teachers, and many will likely struggle to do so.

    The critical issue for teacher preparation is not the presence or absence of a master’s degree. The vast majority of states allow teachers to be certified with a baccalaureate degree. I think that there’s something special about the way in which graduate education blends the professional and the academic, and I am concerned that the plan approved by the Board of Regents is sacrificing the academic. Why is it necessary to have a graduate degree to be certified to teach in New York State? Why couldn’t the Board of Regents piloted “clinically rich” teacher preparation programs that lead to certification by the state, but without a master’s degree?

  • Elizabeth Green

    Aaron,

    Does every practice need to be put to the academic test before it can be written about journalistically — even written about for a very wide audience? I guess I decided that it doesn’t.

    At the same time, though, I don’t like the idea that my story is viewed as an argument in favor of disconnecting research universities from teacher preparation. I certainly did not come away from my reporting with that conclusion. Rather, I came away with a very strong desire to connect the grassroots R&D work people like Doug Lemov are doing in “the field” with the academic work done by university researchers like Deborah Ball. I sometimes joked that instead of writing a story, I should just hold a conference.

    I think that what Doug Lemov’s taxonomy offers above everything else is not techniques to solve the problem of how to teach well (though certainly it’s not a bad hypothesis that the taxonomy does this), but a common language for talking about the intricacies of teaching work. The success of this common language in allowing teachers to talk about and refine their craft was also more measurable to me than the power of the techniques. The schools in which his taxonomy is used talk in taxonomy language all the time; I saw them do it. Just to be clear: This means that teachers at taxonomy schools talk about their *teaching* all the time. In doing so, they seem to me to be building what many academic researchers have long declared necessary: a more professional approach to teaching work.

    That said, I also came away from my reporting concerned that this language is being created without any input from the academic community. The kind of talk about teaching that Deborah Ball and Magdelene Lampert do, for instance — not to mention the kind of *teaching* that Ball and Lampert do — blows me away. If disconnecting teacher preparation from universities means dealing a blow to this amazing work, which at least in Ball’s case is so obviously enhanced by the mathematics scholars she gets to work with by being at the University of Michigan, it seems obvious to me that we are all worse off.

    One more point though. Do we know for sure what the university’s role will be in teacher preparation if teacher preparation is disconnected from it? I just want to point quickly to Teacher U, the program that is now a partnership with Hunter College but which may very well take advantage of the new state regulations and split off. At Teacher U, according to one of its directors of curriculum, Mayme Hostetter, they use many kinds of teaching curriculum, including the following:

    (1) Doug Lemov

    (2) Deborah Ball

    Now I will return to my work.

    Elizabeth

  • Aaron Pallas

    Elizabeth,

    I know that journalists have to make choices in their writings. But I think you are trying to have it both ways. Virtually all of the evidence on teachers and teaching you cite in the piece comes from studies by academic economists or statisticians — Bill Sanders, Eric Hanushek, Jonah Rockoff, Tom Kane — who define success in teaching solely in terms of raising students’ scores on standardized tests. That’s the evidence you use to frame the debate about good teaching. Is it really that unreasonable to expect you to use the same standard in writing about Lemov? You even give the veneer of science to his method for trying to identify exemplary teachers and their practices: “A self-described data geek, he went about this task methodically, collecting test-score results and demographic information from states around the country. He plotted each school’s poverty level on one axis and its performance on state tests on the other.” But that’s not an approach that can indicate whether the practices Lemov identified are responsible for student learning. It just makes his approach sound scientific.

    We do not, of course, know what the role of universities might be in the pilot programs approved by the Board of Regents. But I am not optimistic about the infusion of academic knowledge about teaching practice, including the work of Deborah Ball. It’s easy for a curriculum developer to say, “Oh, yes, we include the work of X in our curriculum.” But a generation of studies by Ball’s colleagues at the University of Michigan, Michigan State and elsewhere have shown that it’s much easier to internalize buzzwords than to understand complex features of practice. Teacher U says that they do Deborah Ball? That’s nice. But let me remind you that you wrote in the Times article that Doug Lemov and other Uncommon Schools administrators are unfamiliar with her work.

    And if my comments come off as unvarnished criticism of the article, let me say that it’s a fine piece of work, and I’m very glad that you wrote it.

Tips, questions, feedback?

Contact us at .

Follow GothamSchools

RSS

Feb. 10: You’re invited!

Chalk It Up

Recent Comments

36 comments so far today

Our Twitter Updates

  • Tension seen among diff protest grps Says #OWS organizer: "We're letting the UFT do its own thing." Union organizing "People's PEP" #nycpep 16 mins ago
  • We've started our #nycpep liveblog: Stay tuned here: http://t.co/ai26enhL 25 mins ago
  • Edu-Tweeples, is there a hash tag everyone is using for tonights PEP meeting? Suggestions? #0209PEP ? 1 hr ago
  • Conflict of Interest Board "could have lost the power to enforce the City’s ethics law against all unionized employees of the City." 2 hrs ago
  • Tenured teachers and principals can now be fined by the city's ethics board, a judge ruled today. Previously, only DOE could fine violators. 2 hrs ago
  • More updates...

Archives

February 2012
M T W T F S S
« Jan  
 12345
6789101112
13141516171819
20212223242526
272829  
?>