kitchen table math, the sequel: decline in SAT scores
Showing posts with label decline in SAT scores. Show all posts
Showing posts with label decline in SAT scores. Show all posts

Friday, April 26, 2013

Home stretch! back soon--

Down to the last 100 pages of Debbie's book, which is fantastic.

So still no blogging, but ----- I have bullet points!
  • The tuna cure: Surfer and Abby now eat tuna, lentils, and olive oil (plus, starting in the past week, a few carrots). Basically: a low-rent version of palisadesk's high-protein diet for mast cell cancer in dogs. Surfer--who, it turns out, can't tolerate chemo--appears to be fine. (But we'll see.) The younger vet told me mast cell cancer is the dog equivalent of pancreatic cancer: Surfer, with a Stage 3 diagnosis, was a goner unless the Kinavet worked. Older vet, back now from his own brush with death, says: "It's not a death sentence." (Ed says: Can we always see the older vet?) Funnily enough, we encountered the same division of labor during the two years my mother was sick. The younger doctors would waylay my siblings and me for The Talk (Your mother is dying. Let her die with dignity. If she doesn't want to die with dignity, persuade her.) Then the older docs would say things like "In intensive care we support your mother's organs until her body is strong enough to handle those functions again." The older docs were always right. And they never mentioned death with dignity, which was wise because my mother didn't give two figs for dignity.
  • xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx
  • Common Core illustrative texts v. what 7th graders read in my districtxxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx
  • 4.6% tax increase proposed (I'm voting no, thank you for asking)xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx
  • Borrowing to pay teachers: the tax-cert loopholexxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx
  • SAT score decline (also in bullets)xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx
  • Erica Meltzer's book is out!!!xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx xxxxxxxxxxxxxx
  • New high school principal for Irvington who worked for TFA
One board member told me that when the board met the new principal he must have used the word accountability in every other sentence.

Are we the first affluent district ever to hire a TFA person?

We may be. A TFA alum certainly seems out of place here in Westchester, where affluent districts are snapping up superintendents fleeing New Jersey's salary cap.

Our new super replaces the superintendent against whom a number of us waged a running battle for 5 long years (or was it 6?). He is a man in his late 30s or early 40s, trained in elementary education, whose only previous experience--in New Jersey, where his wife and son continue to live--was heading a tiny K-5 district.

We are paying him $250K per year on a 5-year contract. During a minor depression.* (Did I mention I'm voting no on the budget?)

I think it's possible, perhaps likely, the TFA hire would not have happened without 6 years of citizens' op eds on the Irvington Parents Forum.

Ed told me, when I started the Forum, that revolutions always have writers.

I believe him, and All revolutions have writers has been my essential reason for carrying on. Well, one of the essential reasons, the other essential reason being that both sides of my family came from Ulster.

That said, I don't expect a revolution. The new superintendent has thus far been more of the same, and he was supposed to be The One; all 5 board members said so. The new principal will come into a gatekeeping culture that has been in place for many, many years.

The single best observation anyone ever made to me concerning my district's unshakeable self-regard:
...[W]e're great because 10 kids do spectacular things by senior year. The other 150 will get by and there are no glaring inadequacies.
That's not going to be easy to change.

* Depression at historinhas

Saturday, April 13, 2013

checking in--and decline and fall

I'm doing a very rushed polish of Debbie S's SAT book -- which is wonderful -- and we're around-the-clock, so no blogging!

But I'm amassing beaucoup SAT factoids, so I'll put some up as I go.

For starters, here are the basics on the 16-year decline in SAT scores:
  • SAT scores declined from 1963 to 1980
  • Verbal mean: dropped from 475 to 425
  • Math mean: dropped from 500 to 470
  • By 1990, the Math mean has gone back up to 475, but Verbal mean has not budged
  • By 1980 College Board perceives a “definite need” to “realign the verbal and math scales”
  • SAT V and SAT M averages are 50 points apart
  • “there was a clear need to repopulate the top end of the score scale, especially for SAT V”
The Recentering of SAT® Scales and Its Effects on Score Distributions and Score Interpretations

And get your SAT I Score Equivalents right here:
CONVERT INDIVIDUAL AND MEAN SCORES FROM THE ORIGINAL SCALE TO THE RECENTERED SCALE

Monday, January 16, 2012

math and race in Iowa

Among the possible explanations offered for the decline [in ITBS scores] are increased drug use in the mid-60′s, permissiveness, increase in divorces and single family homes, as well as the progressivist trends in education resulting in student-centered and needs-based courses. (See  Protecting Students from Learning for a more extensive discussion of this last item.) Another explanation offered is that the population of test takers starting around that time began to include more minority students, resulting in a dilution effect. That argument fails to explain, however, why the same pattern of declining test scores for the SATs exists for the ITBS and ITED test scores which were not limited only to college bound students. Also significant is the fact that the population of test takers in Iowa, Minnesota and Indiana remained primarily white which has been noted by Bishop (1989) and Murray (1992). Specifically, the U.S. Census of 1950 shows that the population in Iowa was 99.2 percent white, declining by 0.7 percentage points to 98.5 percent white by 1980. Similarly, the populations of Minnesota and Indiana were 99 and 95.5 percent white in 1950, dropping respectively to 98.2 and 92.8 by 1970. (Hobbes, 2002).
Barry Garelick: The Myth About Traditional Math Education
Education News

Tuesday, November 22, 2011

Wayne Booth and a different way to prepare for critical reading

First of all, the correct answer to yesterday's SAT reading comprehension question, the question we're asked to answer without reading the passage the question is about, is A: The author's attitude toward children appears to be one of concern for the development of their moral integrity.

C. and Ed read the question two minutes ago and both chose A. (Debbie and I chose A, too.) Ed is sitting here now basically running through Glen's entire line of reasoning, all 5 points. I'm cracking up!

Of course, getting this answer right is no great feat: according to the research summary I found, 83% of subjects in the Katz and Lautenschlager et al study got it right, too, with no more than 7% of subjects choosing B, C, D, or E. 

Glen and Ed didn't have to get as fancy schmancy as they did, either. (I say that with love!) According to Katz and Lautenschalger as quoted by Iri-Noda-San, all any of us had to do to answer this question was to note that:
“[t]he item just discussed is flawed because not a single incorrect choice characterizes a socially appropriate attitude toward children, whereas the correct choice does (p. 304)”.
Wayne C. Booth (or: I wish kids could be English majors again)

I have never actually read Wayne Booth, I am sorry to say. I intend to.

Back in graduate school I knew just enough about Wayne Booth's work to have been deeply intrigued by his notion of the implied author, and to have spent quite a bit of time thinking about what exactly an implied author might consist of inside a movie as opposed to a book.

Last night, after Debbie arrived fresh from her tutoring adventures bearing news of the Katz and Lautenschlager study, I had a eureka moment: the SAT has an implied author.

The SAT has an implied author, and you need to read the implied author as well as the passages to get the answers right. That's what good readers do.

I have been naturally reading the implied author in SAT reading sections, and so has C. I say "naturally" because I do it without thinking about it, and if I do think about it, I don't take it seriously. When C. and I joke about the "grammatically correct" minority questions in the writing section, we're joking.  We don't see ourselves as having (correctly) interpreted a text.

In fact, I rely upon my understanding of the implied author to such a degree that the single most useful piece of advice anyone ever gave me about SAT reading was LexAequita's observation that SAT reading questions are "picayune in the sense that you'd better start thinking like a 13-year old with Asperger's syndrome." On one level, Lex's advice is about the logic of SAT reading questions, but on another level Lex's advice is about the implied author. The implied author is picayune!

(There's an implied author in the math sections, too.)

These days, of course, no one has heard of implied authors and the like; the formal analysis of literature seems to have disappeared from English departments across the land. I search high and low for close readings of the folk tales and fairy tales I'm teaching, and all I find are Marxist analyses and multiple references to menstruation. I am not going to discuss menstruation with a class full of 18 year old boys (and girls) taking developmental composition. Nor with a class full of 18 year old boys and girls taking non-developmental composition, for that matter.

If I knew how to do a close reading of texts, if I knew more than just a smidgeon about functional linguistics, I bet I could crack the test, as opposed to consistently get the answers right without knowing why I consistently get the answers right.

And I wish I had been able to take a class with Wayne Booth. His students obviously loved him.

test prep

Who teaches kids to read the implied author in a text?

Does anyone?

If you're lucky, an English teacher will show your child how to locate main and supporting ideas in nonfiction texts. And there is a strong focus in many precincts upon identifying an author's "biases." David Mulroy writes about the contemporary preoccupation with argument in The War Against Grammar.

But I think that's about it.

I know a student in a neighboring town, who I worked with briefly on SAT reading. He put a great deal of time and energy into preparing for the test, and his writing and math scores both were in the mid 700s by October, but he could not get his reading score above the low 600s.

That never made sense to me. He and I had read together. He was a good reader, and he was smart.

You see kids like him time and again, and people remark on it. The reading test is the one that can't be tutored; that's the rule.

Now I'm wondering if kids are failing to read the implied author.

I'm also wondering whether it would be a good idea to have students purposely take some critical reading sections without reading the passages. Offhand, such an exercise seems like a good way to reveal the SAT's implied author.

The researchers who've looked into this issue seem to take the view that if a test-taker can answer the questions on a reading passage without reading the passage, the test is invalid.

That strikes me as the wrong way to look at it, although I haven't read the papers. In the studies, students who did best answering questions without reading the passage also scored highest on the test itself, and I think it's at least possible that this research reveals more about the nature of strong readers than it does about the SAT. I am now wondering how many questions I answer not on the basis of the passages but on the basis of the tone, style, grammar, and content in the question sections per se.

I don't know the answer to that, but I'd like to.

the question:
The author’s attitude toward children appears to be one of:
(A) concern for the development of their moral integrity
(B) idealization of their inexperience and vulnerability
(C) contempt for their inability to accept unpleasant facts
(D) exaggerated sympathy for their problems in daily life
(E) envy of their willingness to learn about morality


Katz, S., Blackburn, A. B., & Lautenschlager, G. (1991). Answering reading comprehension items without passages on the SAT when items are quasirandomized. Educational and Psychological Measurement, 51, 747-754.
Katz, S., Johnson, C, & Pohl, E. (1999). Answering reading comprehension items without the passages on the SAT-I. Psychological Reports, 85, 1157-1163.
Katz, S., & Lautenschlager, G. (1994). Answering reading comprehension questions without passages on the SAT-I, ACT, and GRE. Educational Assessment, 2, 295-308.
Katz, S., Lautenschlager, G., Blackburn, A. B., & Harris, F. (1990). Answering reading comprehension items without passages on the SAT. Psychological Science, 1, 122—127.
Millman, J., Bishop, C. H., & Ebel, R. (1965). An analysis of testwiseness. Educational and Psychological Measurement, 5, 707-727.
Powers, D. E., & Leung, S. W. (1995). Answering the new SAT reading comprehension questions without the passages. Journal of Educational Measurement, 32, 105-129.
Pyrczak, F. (1972). Objective evaluation of the quality of multiple-choice items designed to measure comprehension of reading passages. Reading Research Quarterly, 8, 62-72.
Tuinman, J. (1973-74). Determining the passage dependency of comprehension questions in five major tests. Reading Research Quarterly, 9, 206-223.

Friday, November 11, 2011

anonymous on lefties taking the SAT

Good advice:
Lefties should be particularly vigilant about the chairs/desks. I've heard stories about them having to take long tests on right-handed flip-up deskettes; a true nightmare. I know the registration forms for my grad comps asked lefties to identify themselves, because almost all of the seats in the auditorium had right-hand deskettes. They brought in as many extra lefty ones as they needed. Is there a similar question on SAT registrations?
I have got to find time to write a quick post on working memory.

I believe that the "transmission mechanism" from right-hand desks for left-hand test-takers to reduced performance is working memory blowout.

And see: death by calculator. Death by calculator is a case of working memory blowout.

(The real-world term for working memory blowout problems is cognitive load theory.)

Tuesday, July 26, 2011

SAT equivalent scores

Convert individual and mean scores from the original scale to the recentered scale

In April 1995, the College Board recentered the score scales for all tests in the SAT Program to reflect the contemporary test-taking population. Recentering reestablished the average score for a study group of 1990 seniors at about 500—the midpoint of the 200-to-800 scale—allowing students, schools, and colleges to more easily interpret their scores in relation to those of a similar group of college-bound seniors.
A 700 on critical reading today was a 640 prior to 1995.

A 700 on math today was a 710 prior to 1995, and the math test today covers more material.

Wednesday, March 2, 2011

decline at the top - the best students fared worst

Back in 1977, having watched SAT scores fall for 15 years, the College Board, which developed and administers the SAT, engaged a panel to try to identify the underlying causes of the decline. A first hypothesis to be checked was whether the test had somehow become more demanding. But, no, to the contrary, indications were that scoring had become more lenient. A second prominent hypothesis was that the decline was due to changes in the demographics of the test takers. Analyses shows this hypothesis to be largely correct, but only for a brief while. Over the early 1960s, changes in the composition of the tested population accounted for as much as three-quarters of the test score decline—and, no wonder, for during this period the number of students taking the SAT tripled. Over the 1970s, however, though the test-taking population stabilized, the scores did not. Instead, the decline continued, even steeper than before, while the extent to which it could be ascribed to demographic shifts shrank to 30 percent at most. Furthermore, the scores that dropped most were those of the strongest students, the students in the top 10 percent of their class; the scores of students toward the bottom of the distribution held steady or even increased.

Advancing Our Students' Language and Literacy: The Challenge of Complex Texts
by Marilyn Jager Adams
American Educator | Winter 2010 - 2011

Sunday, February 27, 2011

Marilyn Jager Adams on the 20-year decline in SAT scores

Lynn G left a link to Marilyn Adams' article on reading Advancing Our Students' Language and Literacy, which opens with a reprise of the decline in SAT reading scores:
Few Changes on SAT Posted by Class of 2010.” “Scores on SAT College Entrance Test Hold Steady.” “Class of 2008 Matches ’07 on the SAT.” Year by year, point by point, it is hard to see the real news in these headlines. The real news is not that the SAT scores have held steady. The real news is that the SAT scores haven’t increased. The SAT scores of our college-bound students have been languishing not for one or two years, but for a long time. Several decades ago, scores were much higher.

The SAT score decline began in 1962, nearly 50 years ago. From 1962 to 1980, math scores fell 36 points to 492 while verbal scores fell 54 points to 502. Since 1980, the math scores have been gradually climbing back and are now at 516. Fluctuations aside, the verbal scores remain unchanged, even today study at 502.

If I were writing the headline for the next newspaper story on the SATs, here’s what you’d see: “Seniors and Their SAT scores Sabotaged by Low-Level Textbooks.” And if the copyeditor would let me, I’d add an exclamation point! The literacy level of our secondary students is languishing because the kids are not reading what they need to be reading.

[snip]

To be sure, whether scores on the SAT exams truly reflect relevant or important intellectual or academic proficiencies remains a topic of discussions. Yet, the SATs are not the only indication that the literacy growth of our secondary students has fallen behind.

Between 1994 and 1998, the United States joined 19 other developed countries in an international evaluation of adult literacy levels. As compared with their peers in the other countries, the literacy scores of older U.S. adults (36 years old and up) were quite high, ranking in the top five. In contrast, the scores for younger U.S. adults (35 years old or less) ranked in the bottom half of the distribution by every measure. Among young adults with a high school diploma or less, those from the United states fell at the bottom of the pile, ranking 19th out of 20th. Even among participants who had completed four or more years of postsecondary education, the scores of our young adults were below the average for same-aged and like educated peers in other countries. The young adults in this study would have graduated from high school between 1974 and 1998, during the period when the verbal SAT scores were bottoming out.

Saturday, October 2, 2010

schoolbook simplification

a. Between 1860 and 1991, American publishers produced readers for the same grade at widely divergent LEX levels (e.g., in 1968, first grade readers were available between -68 and -31).

b. The most difficult readers were generally published before 1918. By modern standards, Professor McGuffy’s pre- and post- Civil War readers were very difficult.

c. After World War I, mean reader LEX levels for all grades were generally simplified.

d. After World War II, mean levels of readers for all grades but third became even simpler. These were the books used by the Baby Boomers and successive cohorts.

e. School publishers in Great Britain did not simplify heir first grade readers after World War II, implying that there was no compelling educational reason for American publishers to further simplify their readers.

f. Today’s mean sixth, seventh, and eighth grade readers are simpler than fifth grade readers were before World War II.

g. Sentences were also shortened, from about 20 words before World War II to about 14 words now in Grades 4—8.

h. Texts for grade x + 1 are typically more difficult (lexically) than those for grade x. When the early readers in a series are simplified by a publisher, so too (generally) are the readers for later grades.

American readers were rewritten after World War II for many reasons: to modernize their content and graphics; to incorporate principles from research in education, psychology and linguistics; to emphasize new kinds of social relations; and to respond to television, which was fast becoming an unprecedented rival for students’ attention. Those considerations required that readers be changed but not that they be simplified. Chall (1967) described the justifications given at the time for simplifying schoolbooks; they were to increase their accessibility for students and raise the level of reading success.

The extent of this simplification is notable. Apart from one extraordinarily simple text (LEX = -75), most first graders in the Baby Boom era used readers whose LEX levels were between -53 and -65; that is, on average, first grade readers were 12 LEX units less difficult than the readers used by their parents and grandparents between World Wars I and II and 15 LEX less difficult than the texts used by students in the same grade in Britian — where the students were a year younger in age. Since the empirical range for LEX is about 140 units, a 12 LEX simplification represents 9% of the empirical range. Workbooks are also designed by the same publisher as the readers and are used in conjunction with them. Given the workbooks’ format, we cannot measure their LEX levels. It is unlikely the publishers would make the workbooks harder than their own reader for the same grade level.

In simplifying the readers’ patterns of word choice, the publishers also shortened sentence length (Figure 5). From the fourth grade on, the average sentence length was contracted by about 6 words — this is the equivalent of dropping one to two clauses from every sentence. This reduced the students’ experience in working out the meanings of more complex sentences.

Widespread objections from teachers and parents, and media publicity over the simplified, often dull, Dick, Jane, and Spot-like readers, caused most publishers to acknowledge that they had oversimplified their first and second grade readers. In the 1963 —1991 era, the mean LEX levels for those grades was restored to pre-Worid War II levels — and without ill effects. While they made those early texts harder, the publishers made the fourth, fifth, sixth, seventh, and eighth grade readers even easier — to the point where these are now at their lowest level in American history.

Schoolbook Simplification and Its Relation to the Decline in SAT-Verbal Scores
Donald P. Hayes, Loreen T. Wolfer, Michael F. Wolfe
American Educational Research Journal
Summer 1996, Vol. 33, No. 2, pp. 489-508

schoolbook simplification & the 50-point drop in SAT scores

I'm sure I've posted this before, but it bears repeating:
The 50+ point decline in mean SAT-verbal scores between 1963 and 1979 is widely attributed to changes in the composition of the test-takers. Several inconsistencies in that explanation are identified. That explanation also ignores the pervasive decline In the difficulty of schoolbooks found by analyzing the texts of 800 elementary middle, and high school books published between 1919-1991. When this text simplification series is linked to the SAT verbal series, there is a general fit for the three major periods: before, during, and after the decline. Long-term exposure to simpler texts may induce a cumulating deficit in the breadth and depth of domain-specific knowledge, lowering reading comprehension and verbal achievement. The two time series are so sufficiently linked that the cumulating knowledge deficit hypothesis may be a major explanation for the changes in verbal achievement. Only an experiment can establish whether this is causal, so we describe a simple, low-cost experiment schools can use to test how schoolbook difficulty affects their students’ verbal achievement levels.

Schoolbook Simplification and Its Relation to the Decline in SAT-Verbal Scores
Donald P. Hayes, Loreen T. Wolfer, Michael F. Wolfe
American Educational Research Journal
Summer 1996, Vol. 33, No. 2, pp. 489-508


cumulating knowledge deficit...

Tuesday, February 24, 2009

decline and fall

Table 2: Average SAT Scores of Entering College Classes, 1967–2004*



source:
Kruse Kronicle



* When the SAT was renormed in April 1995, mean scores were set at or near the midpoint of 500 of the 200–800 score scale, a process called recentering. All scores in this table reflect that process. Means after 1996 are recentered, and those for 1996 are based on recentered scores plus scores converted from the original to the new scale. Means for 1987–1995 were recomputed after individual scores were converted from the original to the new scale; means for 1972–1986 were converted to the new scale after a formula was applied to the original mean and standard deviation; and means before 1972 are based on estimates.