AP calculus scores & stereotype threat

As I understand it, stereotype threat is essentially a self-fulfilling prophecy that takes place below the level of consciousness -- although when I experienced stereotype threat while competing on a television game show my thoughts were conscious, intense, and pretty close to crippling.

I had won a spot on Sale of the Century, and when the big moment arrived I was to play against two men: one white and one black.

I was gripped by stage fright. Sitting in the studio with the group of aspiring contestants who had made the first cut, waiting to see whether I would be called, I felt so terrified I wanted to bolt from the room.

The only thing stopping me bolting from the room was the stage fright I felt at the prospect of people watching me bolt from the room. Which is worse? Having a roomful of strangers watch you play a game show? Or having a roomful of strangers watch you run screaming from the room instead of playing a game show?

I chose door number one and stayed put in my chair; and when I was called to play, two men were called to play, too. I was led to the seat between them.

Suddenly, entirely unbidden, my Betrayer Self began to think: "I can't win against men. I can't win against men. I can't win against men." Over and over again. "I can't win against men."

I was aghast.

I had an Ivy League degree and a Ph.D.; I was a committed feminist; I thought the idea that men were my betters was hooey. Plus I knew boatloads of random factoids and trivia, and Sale of the Century was a random factoids and trivia contest. Yet there I was thinking -- thinking very loudly -- "I can't win against men." Until that moment, I had had no idea I felt that way.

So when it comes to stereotype threat, I'm a believer.

I won that game, but the reason I won was that the black contestant, who was a better player than I, appeared to be suffering an even worse case of stereotype threat than the one threatening to derail me. I won't tell that part of the story here. Suffice it to say that he made an on-camera allusion to what he was feeling just before choosing the wrong square on the board and giving the wrong answer: and losing the game. It was a painful moment. More than painful; it was excruciating. I recall a murmur of what sounded like distress running through the audience.

I managed to defeat the white male contestant mostly because a) he appeared to be just as panicked as I was and b) I knew a lot more random factoids and trivia than he did. And heaven only knows what kind of stereotype threat might have been hammering his brain. Stereotype threat isn't just for for blacks and women; it's for everyone. In fact, you can lower the math performance of white male students attending Stanford University if you remind them, before they take the test, that they aren't Asian.

After I won the game, I calmed down and won two more games, then retired with cash instead of gambling my certain winnings to play on in hopes of making it to much bigger winnings at the top: a classic example of Kahneman and Tversky's concept of loss aversion.

Back to stereotype threat. Sian Beilock discusses stereotype threat at length in Choke. Turns out there is a (disputed) study of stereotype threat and AP calculus scores finding that when test-takers fill out the personal info form, which includes gender, after they've finished the test instead of before, girls score better. (The dispute has to do with statistic methodologies and significance.)

From the 'pro' authors:

Pragmatically speaking, the “trivial” differences carefully dismissed in Stricker and Ward (2004) can translate into very large practical effects, with real theoretical meaning. The inquiry manipulation reduces the gender difference to less than one third its original size. Instead of a ratio of about 6 girls receiving AP credit for every 9 boys who obtain credit, the new manipulation generates a ratio of about 8 girls receiving AP credit for every 9 boys.

How would this manipulation affect females at the population level of all students taking AP Calculus AB? Stricker and Ward (2004) told us that 52,465 boys and 47,275 girls took the test in 1995 (p. 669). ... [C]hanging the way the tests are administered would increase the number of girls receiving AP Calculus credit from 15,081 to 17,870 in a year—an increase of 2,789 young women starting college each year with Calculus credit.

This size number should not be below the radar. The number of people taking the AP Calculus AB test is increasing. In 2004, there were 88,809 boys and 81,521 girls who took the exam (College Board, 2004), which represents an increase of 70.8% since Stricker and Ward collected data in 1995. All other things being equal, we estimate that 4,763 more women would receive AP Calculus AB credit if the timing were changed. We are convinced that stereotype threat in real-world testing situations can have a significant effect on test takers, and Stricker and Ward’s (2004) data support this conclusion.

Stereotype Threat, Inquiring About Test Takers' Ethnicity and Gender, and Standardized Test Performance
Lawrence J. Stricker, William C. Ward
Journal of Applied Social Psychology
Volume 34, Issue 4, pages 665–693, April 2004


Stereotype Threat in Applied Settings Re-Examined
Kelly Danaher and Christian S. Crandall
Journal of Applied Social Psychology
Volume 38, Issue 6, pages 1639–1655, June 2008
[figures drawn from Danaher and Crandall]


Stereotype Threat in Applied Settings Re-Examined: A Reply†
Lawrence J. Stricker, William C. Ward
Journal of Applied Social Psychology
Volume 38, Issue 6, pages 1656–1663, June 2008

stereotype threat redux

If you're interested in the not yet peer reviewed study of Obama's inauguration and its effect on test scores, it's probably worth reading this (long) 2-year old post on stereotype threat.

Stereotype threat is real; I've experienced it myself more than once in my life.

My worst experience, which is mortifying to this day, happened at Dartmouth.

When I was at the college, there were a tiny number of women attending classes as the first group of co-eds.^* Everywhere we went, we were surrounded by a sea of men. This meant that I rarely opened one of the remarkably heavy doors to the big old buildings on campus, because if a Dartmouth boy got to the door first -- and a Dartmouth boy always did get to the door first -- he opened the door for me.
's always
So I was used to having the enormous, heavy, old wood doors opened for me by Dartmouth boys.

One day I found myself walking alone towards the student center, nobody around but me. The student center was a new building, and its entry door was a standard-issue, see-through glass job, weighing what all such doors weigh and easily opened by a 4-year old child.

I clutched. There was no one around me to open the door ---- and I spent a split second thinking that if there was no one to open the door, I wouldn't be able to get in. This was a conscious thought.

It was appalling.

Worse yet, I was a raging feminist at the time. Mary Daly,^** Andrea Dworkin -- you name the angry feminist author & I'd read her, underlined her, & annotated her up the ying-yang. I wanted a career & success, and I wanted a career and success in a world filled with men who had careers and success. I was on a Mission from God.

So there I was, Mary Daly aficionado; I'm walking to the Student Center, and I'm consciously asking myself, "How will I get inside the building if nobody opens the door?"

Ever since that moment, and especially in light of my revelatory experience of stereotype threat on a television game show, I've wondered about this phenomenon.

First of all, how conscious is stereotype threat most of the time? I have no idea. All I know is that there have been 3 occasions in my life during which I have become consciously aware that I (apparently) believed I could not do things men can do. Like open doors, for instance.

But how many times did I unconsciously activate this thought?

And second: does overcoming stereotype threat require a certain personality?

I've thought about that a lot. I was a scrapper, and have always been happy to scrap with myself, if need be. (Not coincidentally, I'm sure, very often I do need be.) The only reason I managed to prevail on the game show was that I was so furious with myself that I was more or less able to get out of panic mode and into battle mode.

But suppose I hadn't been a scrappy person?

Suppose I'd been a meeker sort of person?

I think the outcome of the game tells me the answer. All three contestants appeared to be scared witless, and the contestant who won was the contestant who managed to work up a bit of wrath. (Which reminds me: I've got to get a post up about the research on success and "Agreeableness," one of the five personality factors psychologists seem to have reached consensus on.^*** Turns out super-successful people really aren't as nice as not-super-successful people, just like everyone thinks. Research shows.)

Back on topic: I'm very keen to see the effects of an Obama presidency on young black people ... and in fact I have already seen one such in my own house: C. (the other C.) has cut his dreadlocks! He said it was time for a change. I told him: OK, now you have to go to law school.

Funny thing: I have changed my blonde hair back to its original brown, and I have done this entirely because Michele Obama is a black woman who has black hair. Don't ask me why.

Fortunately, it's working out fine. I say "fortunately," because it doesn't always. Back when Hillary was First Lady & she cut her hair, I cut my hair, too, and I looked like he**.

That's not all. When George Bush was elected president, Ed bought me a pair of cowboy boots; plus I have two Sarah Palin skirts, which I bought on sale and wear to school board meetings.

Point is: people are weirdly social & sociable, and we spend a lot of time copying the folks around us or above us. That's the moral of Alex the parrot, who couldn't learn one-on-one, but learned brilliantly when he had a model to copy & compete with.)

These are interesting times.

That said, I still don't like the stimulus bill.



Obama and the stereotype threat (Frontal Cortex)
D-Ed Reckoning on the nitty gritty
Stimulus Bill Would Provide Flood of Aid to Education

^* aka "co-hogs," which was not a term of affection. You could be sitting in a lecture hall, minding your own business, and suddenly, from behind, you'd hear: "Look at the co-hog taking notes."

^** I wish to heck I'd kept my old copy of Gyn/Ecology. I'd love to read all the stuff I wrote in the margins. otoh, how excruciating would that be? Thank God I never kept a journal.

^*** Personality: What Makes You the Way You Are by Daniel Nettle