kitchen table math, the sequel: how many words can readers predict?

Thursday, August 9, 2012

how many words can readers predict?

re: readers predicting and mis-predicting words, here are Stanovich and Stanovich:
Another problem concerns the assumptions that have been made about the properties of contextual information. It is often incorrectly assumed that predicting upcoming words in sentences is a relatively easy and highly accurate activity. Actually, many different empirical studies have indicated that naturalistic text is not that predictable. Alford (1980) found that for a set of moderately long expository passages of text, subjects needed an average of more than four guesses to correctly anticipate upcoming words in the passage (the method of scoring actually makes this a considerable underestimate). Across a variety of subject populations and texts, a reader’s probability of predicting the next word in a passage is usually between .20 and .35 (Aborn, Rubenstein, and Sterling, 1959; Gough, 1983; Miller and Coleman, 1967; Perfetti, Goldman and Hogaboam, 1979; Rubenstein and Aborn, 1958).

Indeed, as Gough (1983) has shown, this figure is highest for function words, and is often quite low for the very words in the passage that carry the most information content.
How research might inform the debate about early reading acquisition
Keith E. Stanovich, Ontario institute for Studies in Education and Paula J. Stanovich, University of Toronto | Journal of Research in Reading, ISSN 0141-0423
Volume 18, Issue 2, 1995, pp 87-105

Here's the abstract from the NYU study, which is quite fascinating (I need to read it again...):
Research in object recognition has tried to distinguish holistic recognition from recognition by parts. One can also guess an object from its context. Words are objects, and how we recognize them is the core question of reading research. Do fast readers rely most on letter-by-letter decoding (i.e., recognition by parts), whole word shape, or sentence context? We manipulated the text to selectively knock out each source of information while sparing the others. Surprisingly, the effects of the knockouts on reading rate reveal a triple dissociation. Each reading process always contributes the same number of words per minute, regardless of whether the other processes are operating.
and, from the text:
The question is: if parts, wholes, and context all play roles in object recognition, do the mental processes associated with them interact? Does impairing one process impair the others as well? Or, alternatively, if we remove one process, will the others continue working, unaffected? To explore this question, we turn to reading.

We want to know how people quickly and effortlessly recognize an object when there are a vast number of possibilities. Ordinary reading demonstrates this amazing human skill. In studying object recognition, reading is one of the few cases where one knows the composition: letters are parts, words are wholes, and sentences provide context. Using reading, we can attempt to isolate and measure the contributions of parts, wholes, and context to the recognition of words as objects.
Parts, Wholes, and Context in Reading: A Triple Dissociation
Denis G. Pelli*, Katharine A. Tillman
PLOS One | August 2007 | Issue 8 | e680
I'm going to knock off for tonight - will try to get some more up tomorrow.

A couple of quick notes, though:
  • The study looks at decoding -- reading the words accurately out loud -- not comprehension.  
  • "Context" in this study means syntax: the grammatical order of words in the sentence. The authors manipulated context by switching words around. Here's the example they give: contribute others. the of Reading measured - Trying to read this series of words, you have no "context clues" at all, i.e. no syntax to tell you 'a verb has to come next.' 
update 8/9/2012:

from the Eurkalert announcement:
Readers in the study read passages from a Mary Higgins Clark novel. The text was manipulated to selectively knock out each process in turn while retaining the others. Whole word shape was removed by alternating case: “sHe LoOkEd OvEr hEr ShOuLdEr.” To knock out the whole language process, the order of the words was shuffled. To knock out phonics, some of the letters were replaced with others.

Pelli and Tillman’s results show that letter-by-letter decoding, or phonics, is the dominant reading process, accounting for 62 percent of reading speed. However, both holistic word recognition (16 percent) and whole-language processes (22 percent) do contribute substantially to reading speed. Remarkably, the results show that the contributions of these three processes to reading speed are additive. The contribution of each process to reading speed is the same whether the other processes are working or not.

“The contributions made by phonics, holistic word recognition, and whole-language processes are not redundant,” explained Pelli. “These three processes are not working on the same words and, in fact, make contributions to reading speed exclusive of one another.”


TerriW said...

I have wondered a bit on this topic, particularly because I do a WHOLE LOT of reading aloud to the kids and it's always curious to me what my mind can get away with while I'm reading.

I was a bit spooked one day to realize that ... I could be thinking about something else completely and still be chugging along, and the kids didn't notice a thing. Now, I had no idea what I'd been reading, and I obviously couldn't read with much animation or emphasis or expression, but it was going in the eyes, through the brain and out the mouth without disrupting the any of the other thoughts I was having.

This actually is quite handy, though, because it allows me to read ahead while I am reading so I can edit "on the fly" fairly smoothly.

Catherine Johnson said...

I was a bit spooked one day to realize that ... I could be thinking about something else completely and still be chugging along, and the kids didn't notice a thing.


What a fabulous story!

Of course it makes sense, but I would NEVER have nonconscious driving (where you 'wake up' and realize you've been driving without any conscious awareness of having been driving....) to reading!


You might want to take a look at Timothy Wilson's "Strangers to Ourselves." It's pretty good....

Basically, as far as I can tell, we spend most of our day on auto pilot, and we're designed to spend most of our day on auto pilot.

I read one estimate that we have only 45 minutes of willpower available per day.

Not sure how that translates to consciousness per se, but I suspect we have way less conscious time/effort available to us per each 24 hours than we think.

Yet another reason why schools need to TRAIN students to FLUENCY: fluency is the point at which you can read out loud to your kids without having to think about it or even be aware of it!

Catherine Johnson said...

I would like to know whether nonconscious driving is more dangerous than conscious AND nonconscious driving.

Every time I've 'come to' and realized I've been driving without being tuned in to driving, I've thought: THANK GOD I'M STILL ALIVE.

But is that true?

Are we definitely safer when we're paying attention?

In sports, your performance deteriorates when you become too conscious of what you're doing.

otoh, conscious driving isn't about consciously attending to what YOU are doing. It's more about paying attention to what all the other bozos out there are doing.

Note I say 'other'!

gasstationwithoutpumps said...

Unconscious driving mainly leads to death of pedestrians, who don't register as enough of a threat to drivers.

But on the original subject, I have my doubts about the universality of their results. I suspect that some people are primarily decoders and others primarily whole-word readers, and that lumping everyone into one bin muddies their data to the point where it no longer means much. I've not read the paper, though, so perhaps they've addressed this criticism already.

Anonymous said...

How about kids who learn to read, as I did and my kids did, long before they learn phonics in school?

Catherine Johnson said...

Anonymous - I always wonder the same thing. I taught myself to read as a child, before I went to school & before I was taught phonics. (Assuming I was taught phonics, of course....I distinctly remember being taught syllables in 2nd grade, but the readers were all pre-primers.)

I assume, though, that I managed to pick up letter-sound correspondence without being directly taught because later on, when I had trouble reading a word, the problem was with words like 'know' which I sounded out as kuh-now.

TerriW said...

In my personal experience-- and the experience of my daughter -- (we both taught ourselves to read very early) -- it was still phonics, we just figured out the code without being explicitly taught it. It goes hand in hand with the kind of stuff we're both good at: foreign languages, algebra, Wheel of Fortune.