Pages

Eureka, part 3: MOOCs and flips and dopamine

Eureka
Eureka, part 2
Eureka, part 3
Eureka, part 4
Eureka, part 5

So, MOOCs. Why don't they work (setting aside, for the moment, Anne D's experience)?

I had just gotten to the point where sitcoms gave me the answer I was looking for when I had to take a train to the city.

So, to reprise:
Ed brought up movies.

When you go to the movies, he said, the screen is huge, the sound is deafening, all the lights are turned off, you can't talk to your friends, and you have to stow your cell phone. Plus a movie lasts only a couple of hours, then you never have to see it again unless there's a sequel that you really want to see, and you don't have to see that for at least a year.

And even at the movies, even with all the ploys and devices filmmakers and theater designers have developed to hold your attention, if the plot sags, your mind wanders.

MOOCs don't have any of those things, so good luck. The wonder of it all is not that the drop-out rate for MOOCs is catastrophic, but that anyone thought they were a good idea in the first place.

Ed continued.

TV, he said, had had to follow in the footsteps of movies. TVs are bigger, the sound is louder, the experience more immersive….

That's not really true, I said. It's definitely not true of sitcoms. Sitcoms are the exact same hokey, flat-lit, 3-camera affair they always were, with the laugh track telling you when to laugh, and they work. They always have.

That's when it hit me.

"Reward prediction error"

In graduate school (I have a Ph.D. in film studies) I was intensely interested in comedy; I wrote my dissertation on 1950s comedies. 1950s comedies are fabulous, but what I really wanted to know was: what is humor?

What makes things funny?

I've wondered about that for my entire adult life, and have probably, finally, found at least a partial answer, which has to do with -- hold your breath -- the basal ganglia. (For passersby, I have been slaving over a basal ganglia writing project for years now.)

Research on the basal ganglia is very new, so take what I'm about to describe as provisional.

The basal ganglia seem to be all about reward prediction error.

"Reward prediction error" means that learning happens when you predict a reward and you are wrong.

Here's how it works. (Or may work).

Dopamine spikes or drops in response to "prediction" errors, that is to mistakes we make predicting rewards.

  • If you expect something good to happen & it doesn't, dopamine drops. That feels bad.
  • If you expect something bad to happen and it doesn't, dopamine spikes. That feels good.
  • If you're not expecting anything good to happen one way or another, and all of a sudden, out of the blue, something good does happen, that feels great. Because dopamine.

(I've learned just this week that "because" has become a preposition.)

So, if you're expecting a check to come in the mail and the check comes in the mail, no dopamine spike. You open the check, you're mildly happy (if that), you deposit the check. Life goes on.

If you're not expecting a check to come in the mail and a check in the exact same amount as the expected check-in-the-mail arrives without warning, that feels great because dopamine.

A surprise check in the mail feels great because dopamine fires in response to good surprises (or to "better-than-expected" rewards.)


Reinforcement learning

Reward prediction error is the basis of reinforcement learning.

It's unfortunate that "reinforcement learning" is called "reinforcement learning," because "reinforcement," to me, sounds as if learning takes place when the same thing happens again.

Instead, reinforcement learning takes place when something new happens, something you didn't expect.

("Something new" includes something old but better -- or worse -- than you expected. I know the whole thing gets incredibly confusing right around this point, but just remember the surprise check in the mail: how different it feels from the fully anticipated check in the mail. The surprise check in the mail produces reinforcement learning; the expected check in the mail does not.)

For the record, I don't know how learning via distributed practice, via repetition, relates to reinforcement learning, so that question will have to remain a mystery for the time being.

Reinforcement learning in the sense of the incidental learning we do naturally throughout the day (what should I do again? what should I not do again?) depends on mistakes. "Reinforcement learning" happens when we are wrong, when we are wrong in a very specific way: reinforcement learning happens when we are wrong about the goodness or badness of what comes next.

Drug addiction is probably a phenomenon of reward prediction error, btw.

Normally we habituate to good things. We get used to them; we no longer feel ecstatic when they occur. But addictive drugs always spike dopamine -- that is their effect inside the brain -- and that is what makes them addictive.

Cocaine spikes dopamine every time you use it, so  your brain is always getting a 'REMEMBER THIS AND DO IT AGAIN' message, and your interest in taking cocaine always increases. Addiction is a form of learning, a form of overlearning, more exactly.

At least, that is the way I understand the reward prediction error theory of drug addition, as a "disease of learning and memory."

(Interesting 2012 research here…dopamine and GABA…)


Surprise is good

The long and the short of it: surprise is good.

Good surprise is good.

Bad surprise is bad.

All surprise, however, appears to be informational. Our brains react strongly, and we learn.

Which brings me to sitcoms.

Why are funny things funny?

Funny things are funny, at least in part, because humor -- humor that works -- is surprising. If it's not surprising, it's not funny.

And that means humor tells your brain you've made a reward prediction error. The punchline of a good joke or gag is unexpected, so dopamine spikes up. Dopamine spikes feel good, so we come back for more.

A good sitcom doesn't need an immersive setting or loud music or arresting imagery to hold our attention.

A good sitcom sets the reward prediction errors coming one on the heels of another, and that is plenty.

Eureka, Part 4 t/k

Flipping the Classroom: Hot, Hot, Hot
MOOCs grow the gap
The New York Times is surprised
In the world of MOOCs, 2+2 is never 4
World's funniest joke: humor depends on surprise
Dick Van Dyke on comedy
Philip Keller on the flipped classroom
If students could talk
Who wants flipped classrooms? (Salman Khan on liberating teachers)
True story
Are math & science lectures boring in a way humanities & social science lectures are not?

Woodrow Wilson on fathers, sons, and universities

I am interested in [this organization - the YMCA] for various reasons. First of all, because it is an association of young men. I have had a good deal to do with young men in my time, and I have formed an impression of them which I believe to be contrary to the general impression. They are generally thought to be arch radicals. As a matter of fact, they are the most conservative people I have ever dealt with. Go to a college community and try to change the least custom of that little world and find how the conservatives will rush at you. Moreover, young men are embarrassed by having inherited their father’s opinions. I have often said that the use of a university is to make young gentlemen as unlike their fathers as possible. I do not say that with the least disrespect for the fathers; but every man who is old enough to have a son in college is old enough to have become very seriously immersed in some particular business and is almost certain to have caught the point of view of that particular business. And it is very useful to his son to be taken out of that narrow circle, conducted to some high place where he may see the general map of the world and of the interests of mankind, and there shown how big the world is and how much of it his father may happen to have forgotten. It would be worth while for men, middle-aged and old, to detach them selves more frequently from the things that command their daily attention and to think of the sweeping tides of humanity.

Woodrow Wilson on the Christian Men’s Association
Needless to say, I personally do not agree that a sentiment such as "the use of a university is to make young gentlemen as unlike their fathers as possible" can be advanced without "the least disrespect for the fathers" even once, let alone often.

Well, at least Woodrow Wilson thought character education happened via instruction in the disciplines, not vendor-produced character-ed "curricula" and the like.

I suppose that's something.

Friday, December 13, 2013

Eureka, part 2: why MOOCs don't work and flipped classrooms never will work

Eureka, part 1

So as I was saying, Ed and I were having lunch in the American Diner, somewhere in the vicinity of Nyack (if I am not mistaken) and we were talking about MOOCs, and I had a eureka moment re: why MOOCs don't work, and why flipped classrooms won't work, either.

The whole MOOC/flipped classroom extravaganza of lo these past 2 years------

Wait.

Has it been 2 years?

Should we date the commencement of MOOC fever to Bill Gates' anointment of Salman Khan as the new new thing?

[pause]

Two seconds on Google brings us to Bill Gates on the “golden era” of learning, thanks to massive open online courses and easy access to information, so I say Yes, blame Bill Gates. Because if it wasn't Bill Gates who launched us on the MOOCs-&-flips merry-go-round, it could have been. Pretty much wherever you see a really bad idea re: public education taking hold, you will find Bill Gates.

So I blame Bill.

Anyway, Ed and I got on the subject of MOOCs, and while I no longer recall our point of departure, we pretty quickly arrived at the simple fact that MOOCs (and flips) are fantastically boring.

The fantastic boringness of MOOCs is no secret, & pretty much everyone concedes the point (though for different reasons) but the question is: Why?

Why are MOOCs fantastically boring?

More to the point, why are MOOCs fantastically boring to me, a person who is perfectly happy, and not remotely bored, listening to a live lecture delivered inside a lecture hall?

I can prove it, too. Morningside's Summer School Institute, which I attended the summer before last, used a heavy-duty lecture format; we students sat for hours of lecture, hours on end. Lecture and Powerpoints.

It was great!

By the end of the two weeks I was exhausted and my brain was fried, but I wasn't bored (just the opposite), and, more importantly, I was still in the class. Everyone was. Which would not have been the case if we'd been taking the class via MOOC.

(For the record, the first week of the Summer School Institute is largely lecture; the second week is divided between lecture and student teaching in Morningside Academy.)

My point being: I have a very high tolerance for lecture; I have no problem showing up for, learning from, and enjoying live lectures delivered in bricks-and-mortar venues. Where MOOCs are concerned, I should be a natural.

So why can't I make it through more than 2 or 3 (usually 2) taped lectures of a MOOC?

Ed brought up movies.

When you go to the movies, he said, the screen is huge, the sound is deafening, all the lights are turned off, you can't talk to your friends, and you aren't allowed to turn your cell phone on. Plus a movie lasts only a couple of hours, then you never have to see it again unless there's a sequel that you really want to see, and you don't have to see that for at least a year.

And even at the movies, even with all the ploys and devices filmmakers and theater designers have developed to hold your attention, if the plot sags, your mind wanders.

MOOCs don't have any of those things, so good luck. The wonder of it all is not that the drop-out rate for MOOCs is catastrophic, but that anyone thought they were a good idea in the first place.

Ed continued.

TV, he said, had had to follow in the footsteps of movies. TVs are bigger, the sound is louder, the experience more immersive….

That's not really true, I said. It's definitely not true of sit coms. Sit coms are the exact same hokey, flat-lit, 3-camera affair they always were, with the laugh track telling you when to laugh, and they work. They always have.

That's when it hit me.

Part 3 t/k

Eureka
Eureka, part 2
Eureka, part 3
Eureka, part 4
Eureka, part 5

Flipping the Classroom: Hot, Hot, Hot
MOOCs grow the gap
The New York Times is surprised
In the world of MOOCs, 2+2 is never 4
World's funniest joke: humor depends on surprise
Dick Van Dyke on comedy
Philip Keller on the flipped classroom
If students could talk
Who wants flipped classrooms? (Salman Khan on liberating teachers)
True story
Are math & science lectures boring in a way humanities & social science lectures are not?

Little Drummer Boy

I spent the first 5 seconds of this video thinking This is ridiculous, and, about 5 seconds after that, This is fabulous!

Little Drummer Boy Pentatonix

You have to watch the video, and the singers' faces.

Thursday, December 12, 2013

Eureka

This afternoon, while Ed and I were having lunch in the American Diner over in …. Nyack?

Hmm.

I have no idea what town the American Diner is in.

Retake.

This afternoon, while Ed and I were having lunch in the American Diner, it came to me.

Why MOOCs don't work, and why flipped classrooms aren't going to work, either.

I've got it.

Optimal arousal levels.

That's the problem.

As usual, the world of athletics is way ahead of the world of everything else.

More anon.

Eureka
Eureka, part 2
Eureka, part 3
Eureka, part 4
Eureka, part 5

Flipping the Classroom: Hot, Hot, Hot
MOOCs grow the gap
The New York Times is surprised
In the world of MOOCs, 2+2 is never 4
World's funniest joke: humor depends on surprise
Dick Van Dyke on comedy
Philip Keller on the flipped classroom
If students could talk
Who wants flipped classrooms? (Salman Khan on liberating teachers)
True story
Are math & science lectures boring in a way humanities & social science lectures are not?

MOOCs grow the gap

This study contributes to a growing body of research on academic achievement of students in online courses. In a recent meta-analysis of studies comparing online to inperson courses (2009), the U.S. Department of Education found that there was no significant difference between student achievement in online and traditional courses, although a small increase was noted for hybrid courses that combined the two methods. However, when these studies were further analyzed by at-risk student population demographics lower achievement was found in online courses (Jaggars & Bailey, 2010). This finding has been recently expanded by Xu and Jaggars (2013) in a study that investigated how different types of students—including groups that share characteristics found, particularly, among students from AOLE’s partner high school—perform in online learning courses. Using course grade and course completion as dependent variables, Xu and Jaggars found that while all students did less well in online courses, some student groups were more negatively affected from taking courses in this mode. These students were males, younger students, students with lower levels academic skills, and African American students. [emphasis added] The study also found that the negative impact of online learning was exacerbated when groups of students comprised of those who adapt least well to online learning study together. It should be noted that the study, based on research conducted across Washington State on 500,000 online and face-to-face course enrollments (and 41,000 students), did not distinguish between different types of online learning environments, faculty preparation, or support services available to students. The Xu and Jaggars study confirms prior findings in previous smaller studies, which also found that students from at-risk demographic groups and introductory courses had lower performance in online courses compared to other students, thereby exacerbating the well-documented achievement gap in higher education (Kaupp, 2012; Xiu & Smith, 2011, Terenzini & Pascarella, 1998).
PRELIMINARY SUMMARY
SJSU+ AUGMENTED ONLINE LEARNING ENVIRONMENT
PILOT PROJECT
September 2013
Prepared for Principal Investigator: Elaine D. Collins, Ph.D

Eureka
Eureka, part 2
Eureka, part 3
Eureka, part 4
Eureka, part 5

Flipping the Classroom: Hot, Hot, Hot
MOOCs grow the gap
The New York Times is surprised
In the world of MOOCs, 2+2 is never 4
World's funniest joke: humor depends on surprise
Dick Van Dyke on comedy
Philip Keller on the flipped classroom
If students could talk
Who wants flipped classrooms? (Salman Khan on liberating teachers)
True story
Are math & science lectures boring in a way humanities & social science lectures are not?

Wednesday, December 11, 2013

In the world of MOOCs, 2 + 2 is never 4

The statistical model found that measures of student effort trump all other variables tested for their relationships to student success, including demographic descriptions of the students, course subject matter and student use of support services. The clearest predictor of passing a course is the number of problem sets a student submitted. The relationship between completion of problem sets and success is not linear; rather the positive effect increases dramatically after a certain baseline of effort has been made. Video Time, another measure of effort, was also found to have a strong positive relationship with passing, particularly for Stat 95 students. The report graphs these and other relationships between variables examined by the logistic-regression models and pass/fail.

While the regression analysis did not find a positive relationship between use of online support and positive outcomes, this should not be interpreted to mean that online support cannot increase student engagement and success. As students, Udacity service providers and faculty members explained, several factors complicated students’ ability to fully use the support services, including their limited online experience, their lack of awareness that these services were available and the difficulties they experienced interacting with some aspects of the online platform. It is thus the advice of the research team that additional investigations be conducted into the role that online and other support can play in the delivery of AOLE courses once the initial technical and other complications have been addressed.

Conclusion: The low pass rates in all courses should be considered in light of the fact that the project specifically targeted at-risk populations, including students who had failed Math 6L before Spring 2013 and groups demonstrated by other research to be less likely to succeed in an online environment. Previous studies (see Section 1) have found that these students do less well in online than in face-to-face courses. Further, student groups in at least one major study (Jaggars and Xu, 2013) who were found to experience the greatest negative effect from taking courses online share many of the characteristics found among the AOLE partner high school students in particular, a group with very low pass rates in Spring 2013.

Overall, much was learned during and from the first iteration of AOLE and improvements are already in progress in the second AOLE iteration. Perhaps most importantly, the faculty members who taught these courses, although they had to contend with major difficulties along the way, believe that the content that has been developed has tremendous potential to advance students’ critical thinking and problem solving abilities. One faculty member summed it up this way: "Udacity has brought to the table ways to make the courses more inquiry-based and added real life context."
PRELIMINARY SUMMARY SJSU+ AUGMENTED ONLINE LEARNING ENVIRONMENT PILOT PROJECT September 2013
Let's reprise.
  • The clearest predictor of success in the course was the number of problem sets students completed. In other words, practice. 
  • The online mentors, aka teachers-slash-tutors, didn't help. But they might have helped if students had a) had lots of internet experience (practice) & thus could figure out how to get to the mentors; b) known the online mentors existed; and c) been able to get the MOOC site to work.
  • "Previous research" had found that weak students do better in face-to-face courses, so….SJSU opted to run a MOOC and fill it with weak students.
  • "Most importantly," the teachers who taught the MOOCs think the "content" has "tremendous potential to advance students’ critical thinking and problem solving abilities."
Practice is what matters, so the instructors are focused on inquiry; weak students do badly in online courses, so the MOOC people put weak students in online courses; educational technology never works.

A person who lives in the world where two plus two equals four would be doing something else.

Eureka
Eureka, part 2
Eureka, part 3
Eureka, part 4
Eureka, part 5

Flipping the Classroom: Hot, Hot, Hot
MOOCs grow the gap
The New York Times is surprised
In the world of MOOCs, 2+2 is never 4
World's funniest joke: humor depends on surprise
Dick Van Dyke on comedy
Philip Keller on the flipped classroom
If students could talk
Who wants flipped classrooms? (Salman Khan on liberating teachers)
True story
Are math & science lectures boring in a way humanities & social science lectures are not?

The New York Times is surprised

Two years after a Stanford professor drew 160,000 students from around the globe to a free online course on artificial intelligence, starting what was widely viewed as a revolution in higher education, early results for such large-scale courses are disappointing, forcing a rethinking of how college instruction can best use the Internet.
After Setbacks, Online Courses Are Rethought by Tamar Lewin December 10, 2013
Who could have predicted the coming of a MOOC rethink? Apart from every single person reading, writing, & commenting on this blog, who?

I ask you.
And perhaps the most publicized MOOC experiment, at San Jose State University, has turned into a flop. It was a partnership announced with great fanfare at a January news conference featuring Gov. Jerry Brown of California, a strong backer of online education. San Jose State and Udacity, a Silicon Valley company co-founded by a Stanford artificial-intelligence professor, Sebastian Thrun, would work together to offer three low-cost online introductory courses for college credit.

Mr. Thrun, who had been unhappy with the low completion rates in free MOOCs, hoped to increase them by hiring online mentors to help students stick with the classes. And the university, in the heart of Silicon Valley, hoped to show its leadership in online learning, and to reach more students.

But the pilot classes, of about 100 people each, failed. Despite access to the Udacity mentors, the online students last spring — including many from a charter high school in Oakland — did worse than those who took the classes on campus. In the algebra class, fewer than a quarter of the students — and only 12 percent of the high school students — earned a passing grade.
Meanwhile I'm pretty sure I heard our curriculum director say, at the last board meeting, that our classrooms have been flipped.

One of the board members said, "What's that?"

Eureka
Eureka, part 2
Eureka, part 3
Eureka, part 4
Eureka, part 5

Flipping the Classroom: Hot, Hot, Hot
MOOCs grow the gap
The New York Times is surprised
In the world of MOOCs, 2+2 is never 4
World's funniest joke: humor depends on surprise
Dick Van Dyke on comedy
Philip Keller on the flipped classroom
If students could talk