Math scores & loss aversion

Enhancing the Efficacy of Teacher Incentives
Loss-aversion incentives increased math test scores between 0.2 and 0.4 standard deviations
In recent years, a number of U.S. states and school districts have implemented teacher financial-incentive plans, also known as merit pay, with the goal of increasing student achievement. Some past studies have shown that such reform attempts, which pay teachers bonuses after their students hit certain goals, have had limited effects on student achievement.

In Enhancing the Efficacy of Teacher Incentives Through Loss Aversion: A Field Experiment (NBER Working Paper No. 18237), co-authors Ronald Fryer, Jr., Steven Levitt, John List, and Sally Sadoff find that using an alternative "loss aversion" incentive -- with teachers being paid bonuses in advance and asked to give money back if students don't achieve specific results -- significantly improves student achievement. Their results also suggest that loss-aversion incentives might be used in the corporate world in the pursuit of profits.

Although earlier studies have confirmed a correlation between teacher quality and student achievement, the challenge to date has been identifying quality teachers and providing proper incentives for all teachers to successfully strive for improved and lasting student achievement. At least ten states and numerous school districts in the United States have adopted programs that reward teachers with extra pay after students achieve certain goals on tests or report cards, but these "traditional" incentive programs generally have not had large effects on long-term student performance.

Fryer and his co-authors conduct a field experiment of teacher incentives using the concept of loss aversion -- that is, by framing incentives as losses rather than gains. They worked with schools in Chicago Heights, Illinois, which is located thirty miles south of Chicago and has nine K-8 schools with a total of about 3,200 students, during the 2010-11 school year. Chicago Heights' schools are made up of primarily low-income minority students who struggle with low achievement rates.'

In cooperation with school administrators and the teachers' union, the authors randomly selected 150 volunteer teachers and divided them into two main categories. The "gain" group was subject to traditional merit-pay incentives distributed after student achievement levels were determined and met; the "loss" group was subject to loss-aversion incentives that gave bonuses in advance, with the stipulation that money would be returned by teachers if students didn't hit stipulated test goals at the end of the school year. With a pool of $632,960 to distribute in incentive payments, the authors further subdivided the "gain" and "loss" groups in order to measure individual-based and team-based teacher incentives.

Using benchmarks from prior student test scores and final end-of-school-year ThinkLink Predictive Assessment test results, the authors find that loss-aversion incentives increased math test scores between 0.2 and 0.4 standard deviations, or the equivalent of increasing teacher quality by more than one standard deviation. The traditional "gain" incentives yielded "smaller and statistically insignificant results." Similar patterns were found in reading test scores -- and in both individual-based and team-based teacher incentive approaches. The authors did not identify any other factors, such as student absenteeism or outright cheating in test scores, which could explain the differences in achievement results.
--Jay Fitzgerald