GothamSchools — daily independent reporting on NYC public schools

accountability accountability

State’s test security proposals suggest big changes to come

The first recommendations of the state task force to boost test security are out, and they suggest that big changes could be coming to the way tests are administered and graded.

Next week, the Board of Regents will vote on a measure to start an immediate, independent review of how the state handles allegations of cheating.

No action is set yet on the rest of the recommendations. But they provide a blueprint of what the state might do to prevent cheating scandals like those that have gripped Atlanta, Philadelphia, and other cities.

To improve the current system, the state could prohibit teachers from proctoring their own students’ exams and even exams in the subject they teach; bar teachers from grading their own students’ exams, as many currently do; and keep completed exams on hand for longer than a year so they can be checked if cheating is alleged, the recommendations say. The Regents could turn those recommendations into official policy as soon as next month.

But a more substantive revision of the testing system would be even more secure, the working group concluded. The task force wants permission to sketch out — and cost out — a centralized, statewide scanning system that includes erasure analysis and other measures to check for irregularities in test results.

City officials say they support the changes — as long as the city doesn’t have to foot the bill.

“We applaud the state for proposing to centralize and strengthen security on its exams,” Chief Academic Officer Shael Polakow-Suransky said in a statement. “Their proposals make a lot of sense, provided the costs are not passed on to districts like New York City, where we now spend more than $20 million a year to score state exams.”

  • Tim

    I think the best way to proceed would be to enact the ban on teachers proctoring/grading their own students’ tests (although as I’ve said before, I think it would be best to have teachers not proctor/grade tests even in their own building), but instead of creating a new centralized program to perform erasure analysis on all tests, how about simply randomly auditing tests for a couple of years to see how it goes? 

    A centralized scanning/grading process/department has “Money Pit” written all over it.

  • Philip Nobile

     So the Regents will launch “an independent review of how the state handles allegations of cheating.”  Not good enough for at least two reasons:  First, the state and city must be probed for its longstanding cover-up of Regents cheating that did not originate from allegations.  For example, both SED and the DOE knew about the incriminating “65 bulge” for at least a decade before the Wall Street Journal’s  exposé (February 2, 2010.) When the Journal confronted Klein with its evidence, he must have freaked because he refused to comment or defend the integrity of the city’s Regents scores. The silence of Bloomberg, Walcott, and Suransky on this important story is telling. Further, to date the DOE has refused to reveal whether it controlled for Regents tampering before claiming historic graduation rates for 2010.  Second, any independent review must go beyond prevention and contain a blame and/or punishment component for those officials like Klein and Suransky and the city’s investigative agencies (OSI and SCI) that did next to nothing to stop the crime spree that cheated our most vulnerable minority students. On a personal note, I hope that the independent inquiry will review SCI’s shocking 2007 whitewash of Regents tampering and cover-up at the Cobble Hill School of American Studies in Brooklyn. My whistleblow, backed up by four eyewitnesses, were originally substantiated in 2005 by a brave OSI investigator named Lou Scarcella, whom Klein unfairly forced to resign.  Klein also shamed then OSI Director Theresa Europe, who supported  Scarcella and me under oath, with a demotion.

  • John G

    Any solution that removes teachers from a testing room in a blanket way such that Tim is suggesting is a complete insult to teachers. I don’t know about anyone else, but I’m tired of seeing solutions that include trusting teachers less.
    but it’s also a solution that doesn’t seem to address the real issues about cheating that we have learned from the few actual facts that are out there. As I understand from the Atlanta report (the most factual one ever put out about systemic cheating), cheating starts with a school’s leaders who create a culture that encourages or even pressures cheating. So if you follow Tim’s advice, you’ll still have teachers cheat, because the school leaders are still left to pressure them.
    Really, it’s a solution that seems to grasp just a small fraction of the problem.

  • Tim

    John, that is a ludicrous hypothetical. You seriously think administrators will enter testing classrooms full of children and order teachers they’ve never seen before to cheat? That simply doesn’t pass the laugh test. And while I’m sure you’re right that there will be school leaders who encourage cheating, at least under this plan we’ll know they aren’t forcing their own teachers to meddle with tests on testing day.

    You are looking at this exactly the wrong way: the solution is not only effective, it is effective precisely because of the strong character and professionalism of the overwhelming majority of teachers. “My” solution not only reduces the chances of rogue teachers and admins ever crossing paths, and the element of uncertainty on test day practically makes it fail safe. 

  • John G

    Tim,  

    That’s no hypothetical scenario. To be clear, the report about the Atlanta cheating scandal, and the analysis of it (of which, there is a lot and easy to find), are things I think you should take time to read. 

    If you do, you might see that much of the type of systemic cheating to which you’re proposing a solution  (a ban on all teachers proctoring/grading) comes actually from pressure exerted by school leadership -either directly or through creating a school culture that very much encourages it.What you’re proposing ignores that fact. It also ignores the fact that those leaders will still be there -pressuring teachers- whether you shuffle teachers or not. They will just be pressuring different teachers.

    I wrote to you in another post that undermining the authority of teachers and undermining their autonomy is not worth it -especially since the solution you suggested does nothing about the real problem (according to the most complete factual account that is known about cheating).

    Would you like to recognize the ‘strong character and professionalism of the overwhelming majority’ of us? 1) Stop helicoptering in with more solutions from yet another outsider who, while well intentioned, doesn’t seem to grasp the real problem or the implications of a solution. 2)Suggest a proposal that isn’t insulting to the authority and autonomy of all teachers and one that puts the school leaders on the hook for the comings and goings in their school.

    Ludicrous? Seriously? It is absurd to think that, if an army fails at an invasion, all of the enlisted men should be shuffled around without the officers being punished at all (that’s no solution, Tim and neither is yours).  Ludicrous? is doing all of that and then having the audacity to invoke the ‘strong character’ of most enlisted men as part of your reasoning for making the shuffle.

  • Tim

    John, I may only be an “outsider” who pays NYC and NYS taxes and sends his children to New York City public schools, but that has nothing to do with whether I can call BS on a position that asks me to believe that an administrator would enter multiple testing rooms in the presence of children and pressure a teacher he or she had never seen before into cheating on tests. 

    (Remember, in my ideal scenario, we’re not just shuffling teachers inside their own buildings, we are sending them to completely  schools in neighboring districts.)

    This doesn’t undermine the authority of teachers one iota. What it does is acknowledge that there is a tiny percentage of teachers and administrators who will cheat and provide a near fail-safe and dirt-cheap way of eliminating the temptation and ability to do so. I don’t doubt that there are scads of administrators and educational officials who are applying a lot of wrong-headed pressure upon teachers to improve test scores. That is a different kettle of fish and I’d wish you’d quit leaning on that argument in what ought to be a much narrower discussion. 

  • John G

    Tim, 
    There are several places I’d like to begin responding to your last comment. Whether or not paying taxes and being a parent allows you the opportunity to act as though this is your profession; whether or not this undermines teachers’ autonomy and authority or whether or not there is even a basic relationship between pressure to increase to scores and cheating (it seems you don’t see a relationship between those two things. I think that goes back to the point I’m making about outsiders who don’t understand this profession. 

    But I think I’d like give you the chance to go ahead narrow that discussion. Please do and then let’s take it from there. Also, please lay out your full idea again .. (include what you’re thinking about for administrators and teachers as well). 

    (Just be prepared to explain HOW this doesn’t undermine a teacher’s authority or his/her autonomy. Simply claiming it doesn’t and using the mid-western phrase ‘one iota’ isn’t nearly enough for me.)

  • Tim

    New Testament, midwestern, what’s the difference . . . .

    The upshot: no teacher would be allowed to be with his or her class on testing day. They would be reassigned to proctor / grade exams at a school that isn’t in their district, but a school that would ideally be no farther away than in an adjacent district, and never outside of their school’s home borough. This would minimize the commuting inconveniences for the grown-ups. 

    Yes, new central administration staff would have to be hired or reassigned to oversee the process of determine where the teachers would go, but that would be a pretty trivial expense. Yes, it would be potentially disruptive and chaotic, but my experience has been that testing days are already very chaotic anyway. 

    The main practical objections raised on this board have been A. my kids won’t perform optimally with a strange teacher, B. the travel is too onerous/unfair, and C. your general point, that this will cause some sort of further collapse in public respect for teachers. I guess that you have also said D. cheating will still occur at the same rate that it does now, but I honestly don’t think that passes the common sense test. A corrupt administrator can’t possibly pressure teachers to cheat in front of a whole bunch of other teachers and students.

    That’s it. If you have an alternative plan to provide a powerful disincentive to cheat on the actual administration of tests, and one that would cost hardly anything to implement, I’d love to hear it.

  • el flerpo

    To play Captain Obvious for a moment:  In Atlanta and everywhere else on the planet, cheating is an attempt to game the system and gain some additional benefit while pushing the costs of that action onto the commons.  Because students are graded on tests, students have an incentive to cheat on them.  Because the government taxes income, taxpayers have an incentive to cheat on their taxes.  The urge to cheat may not be as much of an inherent condition of our humanity as sex is, but it’s close.  It’s a universal incentive whenever rules exist.  When there are rules, people will want to cheat.  

    So the cause of cheating by graders is not complex.  They cheat because they have an incentive to cheat.  The only way to eliminate that incentive is to not tie teacher evaluations to student performance.  If you don’t go that route, then you have to enact the best solutions possible to prevent cheating despite the incentive to cheat.  

    The only way to completely end cheating by students is to stop grading them.  Because that solution isn’t acceptable to most people, we opt instead to try to control the problem by surveillance and other measures that come at the cost of “insulting” students (by assuming that they will cheat if they are not monitored).  Most people tend to think that cost is outweighed by the benefits of reducing student cheating.  Similarly, if removing teachers from the testing room would substantially reduce if not eliminate cheating by graders, and the main cost of that policy is that teachers would be insulted, I don’t see how that cost would outweigh the benefit.  Who knows, maybe teachers wouldn’t take it personally, just as their students don’t take it personally that they are required to take tests in the classroom rather than at home without any monitoring.

  • John G

    Ok, my ‘general point’ wasn’t anywhere near the specific point that I actually did make. Listen with the exception of reading (listening to others), you seem like a real smart guy. Please re-read some of the posts I made. Please read the report about the Atlanta cheating scandal and at least some of the analysis that goes with it. 

    Please understand, what you see as going against common sense is actually evidence (sometimes, proof does defy common sense). Please understand, it’s not about how people view teachers (authority) it’s about pride (some things are and you’ll have to deal with it). 

    If you would like a numbered list of reasons why your idea is terrible, please don’t be bothered looking up facts and learning what you’re talking about. Just zip off another snarky, benighted reply and I will re mediate (whenever I get around to it) for you. 

  • John G

    Ok, my ‘general point’ wasn’t anywhere near the specific point that I actually did make. Listen with the exception of reading (listening to others), you seem like a real smart guy. Please re-read some of the posts I made. Please read the report about the Atlanta cheating scandal and at least some of the analysis that goes with it. 

    Please understand, what you see as going against common sense is actually evidence (sometimes, proof does defy common sense). Please understand, it’s not about how people view teachers (authority) it’s about pride (some things are and you’ll have to deal with it). 

    If you would like a numbered list of reasons why your idea is terrible, please don’t be bothered looking up facts and learning what you’re talking about. Just zip off another snarky, benighted reply and I will re mediate (whenever I get around to it) for you. 

  • el flerpo

    One thing Tim asked for, and I have never seen from anyone else who comments here, was a proposed solution to the problem of cheating. The simplest explanation would be that you and others aren’t interested in a solution; that you prefer it to remain a problem, because if it’s not a problem, then a system you disapprove of would function better. Am I wrong?

  • el flerpo

    One thing Tim asked for, and I have never seen from anyone else who comments here, was a proposed solution to the problem of cheating. The simplest explanation would be that you and others aren’t interested in a solution; that you prefer it to remain a problem, because if it’s not a problem, then a system you disapprove of would function better. Am I wrong?

Tips, questions, feedback?

Contact us at .

Follow GothamSchools

RSS

Chalk It Up

Recent Comments

0 comments so far today

Events Calendar

Our Twitter Updates

Archives

May 2012
M T W T F S S
« Apr  
 123456
78910111213
14151617181920
21222324252627
28293031