GothamSchools — daily independent reporting on NYC public schools

Classroom tales: A diary

Reflections on the Test

After months of work and a fair amount of anxiety, test day finally arrived yesterday. As usual I did my best to calm the nerves of my students, and refreshingly, for the first time I didn’t have to calm my own.

I assured the kids that they were completely prepared, and reminded them of all the strategies they had learned to make the state reading test easier. I handed out keychains from my trip to California and told the kids they were good luck charms. I could see the kids loosening up. And finally when I told the kids that the practice test they had taken Friday was actually a fourth-grade exam I knew their confidence was boosted.

Once the test began I knew that I had been telling the kids the truth. They really were prepared, probably better prepared than any class I’ve taught before. I saw the kids highlighting important details, circling the title, writing notes in the margins, and highlighting clues in the questions. These were the types of techniques I avoided teaching, because I hated the idea of teaching to the test. While I still believe in that philosophy, I also believe that these strategies were worthwhile. The kids need coping mechanisms for the stressful, unnatural setting of the test.

What struck me most about today was the not the students, but the test itself. It seemed strangely … easy. After months of worrying that we would get some sort of curve ball because of the new test date (previously the reading test has always been in early January), the test was surprisingly fair. More than fair, it seemed more or else the same as past years.

There was one passage I specifically recognized from a book in our classroom library. I looked it up later and found that the book was a level K. A level K is an early second-grade reading level. By contrast, at this point in the year, my students should be reading at a level N or O, considered mid-to-late third-grade levels. While it’s possible that the questions following the text could be tougher, it didn’t seem that way to me. The questions looked like the usual mix of cause and effect, sequence, drawing conclusions, main idea, and author’s purpose. In any case it seemed strange to me that an exam designed to place students at below, approaching, at, or above grade level, would use a text below grade level.

To be fair to the test makers and the state I decided to do a little extra research. I couldn’t use Fountas and Pinnell, the leveling system in place for classroom libraries, for past tests so instead I used the Flesch-Kincaid readability score. Using Flesch-Kincaid, this year’s test (or rather one passage from this year’s test) stood up much better, scoring 3.1, which indicates that it’s solidly on an early-third-grade reading level. The Flesch-Kincaid readability scores of the three non-poem passages from last year’s exam were 1.8, 1.7 and 1.4. In 2008 the non-poetry passages scored 2.1, 3.9 (!) and 2.6. In 2007 the scores were 3.2, 2.4 and 1.6. Finally, in 2006 the readability scores for the passages I was able to find were 1.4 and 1.2.

With such a sample size it’s difficult to draw any clear conclusions. The Flesch-Kincaid score also isn’t necessarily the best indicator of grade-level difficulty, but it’s a good one. Without knowing the score of the other passages (I also found it odd there was no poem this year) from this year’s test it’s also tough to say how the overall 2010 exam compares to past exams. One thing does seem clear: With a few exceptions, the reading passages are between one and two grades below level in difficulty. Let’s keep that in mind if/when this year’s scores come out and there’s the usual rush to congratulate ourselves on the number of students performing at or above grade level.

  • http://MoreThoughtful.blogspot.com ceolaf wolfhelm

    You know what warms my heart? “With such a sample size it’s difficult to draw any clear conclusions.”

    That’s awesome.

    Now, if only trained journalist and others who opine on education could master this idea.

  • http://themortonschool.blogspot.com Miss Eyre

    My column at NYC Educator today draws pretty much the same conclusions about the 8th grade test.

  • third grade

    I agree that the third grade test passages were quite easy. However, some of the questions were poorly worded and did not have a clear right answer. Specifically, in the passage about the pony express, one of the questions had no clear answer. It was an inferencing questions, but not enough information was given in the story to make a solid inference. Also, the listening passage today was incredibly boring and a few of the questions asked were nit-picky. But you are totally correct, this was a second grade level test. The test makers just added few trick questions to make sure not too many kids got 4s.

  • third grade

    The fifth grade listening passage was a passage that is in a commonly used third grade test prep book. Seriously?

  • Teacher in the Bronx

    The 3rd grade test was amazingly dumbed down. However, in June when scores are announced and the city went up 20% Klein and Bloomberg will take all the credit.

  • Maestra

    Yes, the third-grade passages themselves were easy, but the questions were poorly constructed and could yield some grading surprises. As the poster Third Grade noted, the questions about the listening passages tested kids on remembering extraneous details. I saw that one strong reader couldn’t remember one of these details because it wasn’t at all important to the narrative. I also noted the problem with the Pony Express question that Third Grade mentioned. These tests are very flawed instruments.

    Moreover, though the test administration instructions explicitly stated that students were NOT to look at the questions for the listening section before hearing the passage, I understand that some teachers around the city DO allow students to look at the listening-section questions first. That would make a huge difference in the students’ performance on the listening part. Moreover, this kind of cheating would be difficult to detect. If the students had already been trained to look at the questions before listening, and if the teacher decided not to read aloud the instruction about NOT turning to the questions first, who would catch them? An assistant proctor might not be familiar with the rule. A teacher at my school said she had actually attended a professional development session where she’d been advised to have students read the listening-section questions before hearing the passage. Has anyone else heard of this infraction?

  • http://www.bronxteach.com Ruben Brosbe

    Maestra, no such shenanigans at my school, but there does seem to be a lot of room for variability between testing conditions. There are certainly teachers who take “active proctoring” to a new level and way past the line of appropriate behavior. I’m thankful my school does things by the book, but I have heard stories of teachers allowing extra time or pointing out wrong answers and telling students to “double-check”. Prior to the test there was a lot of time given to the rules and we were warned how serious an infraction would be, and what it would mean if the school was to be audited. There were not any monitors at my school though. Did anyone else have officials checking in on testing conditions? I’m interested to know. I’m also curious (I’ll see if I can track it down) how many schools have actually been audited over the past 5 years of testing.

  • Maestra

    Ruben, no monitors at mine for the past 5 years.

  • http://www.bronxteach.com Ruben Brosbe

    I wasn’t able to find any record of the number of schools that have been cited for cheating, however I did come across an audit report by the NYC Comptroller’s office (http://www.comptroller.nyc.gov/bureaus/audit/07-22-09_MD08_102A.shtm%5C) which states generally that the DOE does a good job educating schools of the regulations and procedures,
    “However, DOE lacks sufficient preventive and detective controls aimed at deterring inappropriate manipulation of test scores, which would help to ensure the overall integrity of the assessment process.”
    According to the report, the DOE disagreed with the tone of their audit as well, but, “After carefully reviewing their comments, however, we found them to be without merit.”
    Doesn’t really surprise me however since it’s not remotely in the DOE’s interest to uncover wrongdoing since it would be a black eye for pretty much every stakeholder involved in the new era of high-stakes testing and “accountability”.

  • bunzi

    Was Moose cheerful or bored ?

Tips, questions, feedback?

Contact us at .

Word from Our Sponsor

Follow GothamSchools

RSS
Subscribe to the daily email digest:

Chalk It Up

Recent Comments

0 comments so far today

Archives

May 2013
M T W T F S S
« Apr  
 12345
6789101112
13141516171819
20212223242526
2728293031