GothamSchools — daily independent reporting on NYC public schools

Classroom tales: A diary

My Disappointing Data, and What To Do With It

I should start by saying that I talked about my teacher data reports with some co-workers today and they had been e-mailed their usernames and passwords for their reports. So apparently not everyone had such a difficult time accessing their reports. I guess I’m just special.

Well, maybe not that special. Not according to my data reports at least. In fact I’m wholly average as an educator when it comes to teaching both math and reading. Not exactly the vote of confidence I was looking for.

I can’t say that I was surprised. I got my students’ test scores at the end of last school year, and I knew how they compared to those of my peers at my school and by extension the city. Test scores jumped up across the city last year, and my students? Well most of their scores went up, but some went down. Meaning, pardon the pun, I didn’t make the grade.

So my teacher data report confirmed what I already knew about my test scores. The only difference is it applied a percentile and a label to my shortcomings. And according to my students’ scores, or more accurately, my value-added score, I am average.

This is disappointing to say the least. I did not join NYC Teaching Fellows to be an average teacher. I became a teacher with the hopes that I would be an above-average educator. I wanted to fulfill every noble cliche — change lives, bring my kids to grade level and do my part to close the achievement gap. Now I knew that my first year was an abject failure in this regard, and my second year fell short too, but falling in the 41st and 38th percentile (side note: How low is the bar for “average”)? That’s a level of failure I never expected and have never experienced before.

Setting aside (for now) the issues with an evaluation tool that is based solely on test scores, the question is: What do I do with this information? What do these numbers really tell me? If they are meant to be a tool for improving my instruction I’m not sure how a few percentiles, even those broken down by gender and performance level, do this. If there were a way to look at data that was broken down by performance indicator and skill, or incorporated attendance and numerous other “x-factors,” I think that could affect my teaching in a much more meaningful way. In the meantime, the data report seems to be more of a general motivator to do better (what that means exactly is a topic for another post) than a tool to fix specific problems with my teaching.

  • Jennifer Jennings

    Hi Ruben – Remember not only to look at the percentile, but the confidence interval. Depending on how many years you’ve been teaching (and as a result, how many students these estimates are based on), your confidence intervals may be very wide, i.e. 41st percentile with a possible range of +/- [insert large number here]. Put differently, your true value-added lies in that range, and most people who do work in this area would caution any teacher or principal against making too much of the percentile itself. Hope this helps! Jennifer

  • ceolaf

    Two important things to understand when looking at such inferences.

    1) These tests have not been shown/proven to have instructional sensitivity. That is, we don’t know the degree to which these particular tests results are reflective of teacher quality, as opposed to the innumerable factors that are outside or beyond a teacher’s control.

    2) These tests — even if they *are* instructionally sensitive — only measure the subset of the standards that we know how to test in this sort of easy to administer/easy to grade format. And the standards are only a subset of all the lessons that teachers really have to teach students. The implicit curriculum is a big deal, a big part of what students need to learn. The life lessons and the moments that we look back on when remembering our own best teachers rarely go back to standards or the explicit curcciulum.

    I’m not saying saying you’re a great teacher. You *could* be a lousy teacher, one even worse than those percentiles. But you could also be a far better teacher. These reports simply are not worth very much.

    Furthermore, research shows that teachers tend to improve for their first five years before more or less plateauing on these sorts of measures. So, this is not the time to measure yourself against all NYC teachers.

  • Ruben

    I appreciate both these comments a lot. It’s important to look at the data critically, even skeptically. At the same time I’m being careful not to be dismissive and to see what lessons I can take away from the report.

  • Jordan

    I’m teaching high school English for my third year and don’t think I have a data report. What does this mean for me?

  • Ruben

    Have you tried the web site? Https://tdi.wcer.wisc.edu
    use your doe username to retrieve your password. I believe every teacher in a testing grade ha a report, but I could be wrong

  • http://themortonschool.blogspot.com Miss Eyre

    Jordan, I believe only teachers who teach ELA and math in grades 3-8 get one of these.  Which means…I got one.  

    And blogged about it at http://www.nyceducator.com.  Goes live at midnight.  Check it out.

  • Aaron Pallas

    Teacher Data Reports are available only for teachers who taught grades four through eight in 2008-09. Ruben, I’d be happy to help you interpret your data report.

  • I noticed that…

    Jordan, Ms. Eyre is correct. Only ELA and math teachers, grade 3-8, get the Teacher Data Reports and their tenure, if probationary, will be based on those scores. It’s unfortunate, but that’s one of the evaluation tools being used by principals to grant tenure.

Tips, questions, feedback?

Contact us at .

Word from Our Sponsor

Follow GothamSchools

RSS
Subscribe to the daily email digest:

Chalk It Up

Recent Comments

10 comments so far today

Events Calendar

Archives

May 2013
M T W T F S S
« Apr  
 12345
6789101112
13141516171819
20212223242526
2728293031