kitchen table math, the sequel: Jeanne Chall on decline at the top

Tuesday, January 27, 2009

Jeanne Chall on decline at the top

The 1970s and 1980s brought additional reasons for discontent. The first was the continuing decline of scores on the Scholastic Achievement Tests (SATs), the decline having begun even as early as the 1960s. Another cause for growing concern was the low achievement particularly among poor and minority children on the National Assessment of Educational Progress [NAEP]. Since 1969, NAEP (also known as "The Nation's Report Card") has conducted periodic assessment of the academic performances of fourth, eighth, and twelfth graders in a range of subjects. At first it was thought that the SAT score decline resulted from growing number of low-income students taking the SAT for the first time. Later, it was found that the absolute decline in scores was even greater among the most able students (Chall, 1989). After years of debate as to whether SAT scores had significantly declined, the College Board changed its standards (permitting a "pass" with lower scores.)

Recommendations to improve educational achievement varied widely. Some championed a stronger focus on open education--calling for greater emphasis on student motivation and interest--while others called for more instruction-centered solutinos--higher educational standards and greater rigor. The most influential of the many proposals at the time was A Nation at Risk, the Report of the National Commission on Excellence in Education (NCEE, 1983). Its proposed solution was largely teacher-cntered: a more rigorous curriculum, reintroduction of traditional courses of study, and more-difficult, challenging textbooks.

Other proposals for teacher-centered solutions appeared during the late 1980s and early 1990s. In a series of studies that compared achievement in public schools with that in private and parocial schools, Coleman and Hoffer (1987) found that students in private and parochial schools tested higher on academic ahievement than those in public schools. The investigators attributed the differences to the heavier focus of the private and parochial schools on teacher-centered practices such as the use of discipline and assigning homework and grades.

The Academic Achievement Challenge: What Really Works in the Classroom
by Jeanne S. Chall
p. 41-42

in a nutshell:
  • Jeanne Chall's 1989 study of the 16-year decline in SAT scores (1964-1980) found the largest decline in scores amongst the top students
  • A Nation at Risk recommended teacher-centered classrooms and the "reintroduction of traditional courses of study"
  • Coleman and Hoffer found that classroom discipline and teacher-centered instruction were the reasons why private & parochial school students did better than students in public schools

Until tonight, I hadn't made the connection between classroom discipline and direct instruction.

Of course, it's obvious that if you're in favor of the latter, you're in favor of the former. You have to be; you can't do direct instruction without classroom discipline.

But it hadn't occurred to me that if you're opposed to "drill and kill" you might also be ambivalent about teachers maintaining law and order inside the classroom.

12 comments:

Anonymous said...

I would like to submit this paper:

Schoolbook simplification and its relation to the decline in SAT-verbal scores,

by Donald Hayes (I'm a big Donald Hayes fan) as a candidate for explaining the drop.

Interesting quote from the paper:
"The third inconsistency between the evidence and the composition explanation [NOTE: the composition explanation claims that the drop in *average* SAT verbal score was caused by more lower scoring students taking the SAT -MJR] stems from its assumption that as more lower scoring students took this test, the fraction scoring over 600 and 700 would necessarily decline (so long as top students continued to take the test). The absolute numbers of students scoring over 600 should have remained about the same.

The evidence is different: The entire distribution of verbal scores from top to bottom, shifted to lower levels. There was not only a proportional decline in top scorers but an absolute decline in the number scoring over 600. There are now 35% fewer scoring over 600. The number scoring over 700 fell from 17,500 in 1972 to just over 10,000 in 1993 — even as the number taking this test grew (Shea, 1993). Highly selective colleges and universities report mean verbal declines on the order of 40 points. The composition hypothesis does not predict this outcome. An acceptable explanation for the SAT-verbal decline must account for this huge decline in the performance of the academic elite.
"

-Mark Roulo

Anonymous said...

Of course, it's obvious that if you're in favor of the latter, you're in favor of the former. You have to be; you can't do direct instruction without classroom discipline.

But it hadn't occurred to me that if you're opposed to "drill and kill" you might also be ambivalent about teachers maintaining law and order inside the classroom.


You might be, but I think it's more typical for a teacher to be more focused on discipline than necessary if they have weak teaching skills because: they are disorganized; they waste their students time talking too much about "text to self/text to world," etc., and they use their time inefficiently. If your students are bored because you're not teaching them anything, and you're taking too long to not teach them, you need to be more rigid about cracking down on any sign of rebellion.

I can see how some teachers who are charismatic might overrely on charisma and fun activities rather than having a straightforward discipline approach, but I don't think this is your typical public school teacher.

And I can see how a teacher who is motivated to teach kids will probably have a very well planned discipline strategy.

But I think those are the outliers--I think the average situation is poor teaching combined w/too much time having to be focused on discipline.


Also, while we are stricter w/my son at home, I'm pretty happy that his teachers consider sensory input as part of their discipline strategy, rather than making him sit in the corner if he's wiggling because he's uncomfortable or bored. I also love that they have a structured play time at the end of the day, where he and his peers have their play somewhat directed--it's wonderful for him, because otherwise he would spend most free-time by himself.

There is plenty about progressive education worth criticizing--I think it's important to recognize the occasional positive aspects (even if they are rarely implemented well--my son's school is the exception, in my opinion, even compared to other schools in the same district).

concerned said...

I've seen "Drill and Kill" appropriately renamed the

"THRILL OF SKILL!" :D

Anonymous said...

are you saying drill and kill is good?

isn't drill and kill the opposite of instruction?

i'm confused, this makes little sense.

concerned said...

Many use the "drill and kill" phrase to imply that skill practice, in general, is bad. I really have a problem with that.

Many students embrace the opportunity to practice their math skills - especially when they have had appropriate instruction.

Don't you think that practicing skills should be thrilling?

Quality instruction and coherent content are paramount. With that said, I believe that there is no reason for a student to experience major frustration when practicing their skill.

It should be enjoyable.

SteveH said...

"isn't drill and kill the opposite of instruction?"

"Drill and Kill" is a pejorative phrase used to support the pedagogical view that mastery of basic skills is only acceptable in a thematic or real world (top-down) context. Unfortunately, a top-down approach rarely, if ever, goes deep enough to achieve an appropriate level of mastery. A conceptual level of understanding (pieces of pie for fractions) might be achieved, but there won't be enough proficiency in basic skills to make the transition to more abstract forms (rational expressions).

A bottom-up, skill-based approach runs the risk of boring some kids to tears, but the skills aren't rote. They are required to advance to a higher level of understanding. In addition, many kids are thrilled, not killed, by mastering these skills.

However, the goal is not some sort of magical "balance" of the two approaches. Mastery of basic skills is absolutly required and the best way to do that is bottom-up, not top-down. In spite of many attempts to unlink mastery and understanding, mastery of basic skills will lead to true understanding, but a top-down, conceptual (pie fraction) understanding with few skills will lead to a dead end in math.

Catherine Johnson said...

oh, lots to read here!

(I HAVE to get sleep - we're all getting sick again.)

Mark - can't wait to read the paper.

Laura - "I think it's more typical for a teacher to be more focused on discipline than necessary if they have weak teaching skills because"

Definitely!

I didn't mean to imply that I was talking about real teachers - or about their intentions - here (though I know it sounds that way).

To the extent I was talking about real teachers I was thinking about the extreme difficulty of maintaining a focused classroom when you're required by administrators to seat children together in collaborative groups, etc.

We've now got 5-year old boys sitting together with peers at little tables "making meaning" while the teacher floats around the classroom differentiating instruction.

Apparently, they are teaching themselves to read.

You're going to get a lot of noise and distraction that way.

Catherine Johnson said...

I didn't find out 'til very late in the day that C. could barely follow what was going on in his middle school math class because it was so noisy....

Catherine Johnson said...

Mark - Chall wrote about the same phenomenon.

THANKS FOR THIS FIND!!

Tracy W said...

Concerned - thrill of skill? I like that, can I steal it?

Anonymous said...

I was thinking about the extreme difficulty of maintaining a focused classroom when you're required by administrators to seat children together in collaborative groups, etc.

ah I see, sorry to misunderstand--that's more or less what I was trying to get out. I can see for some teachers the added strain might lead to chaos and for others it might lead to adopting overly punitive discipline techniques.

I'm finding it so disheartening to be observing elementary school classrooms and seeing the teachers wasting so much time, with little to show at the end, and they are often easily frazzled, sometimes being overly sharp or even yelling at the kids because they can't keep their attention. And they're not awful teachers--they clearly care about the kids and have positive interactions, but it seems like a huge strain for them to hold things together

concerned said...

Hey Tracy,

I didn't come up with that phrase - although I wish I had!

I love it! So I try to give it as much "air play" as possible!

You wouldn't be "stealing" it per se, but supporting "the cause" :D

SteveH explained it beautifully! Thanks!