91制片厂视频

School & District Management

New Center Asks: Does Merit Pay Work?

By Debra Viadero 鈥 March 19, 2007 7 min read
  • Save to favorites
  • Print
Email Copy URL

In the 1980s, school districts dabbled with programs that offered teachers cash inducements, such as bonuses or raises, for doing their jobs well.

But those merit-pay programs were mostly short-lived, hotly debated, and understudied. Even after all this time, no one knows definitively whether children learn more when teachers are paid extra for boosting their students鈥 achievement.

Now 鈥減ay for performance鈥 is in vogue again, with programs operating in Florida, Minnesota, Texas, and Denver, among other places. This time, though, a group of researchers at Vanderbilt University is seizing the chance to put those initiatives under the microscope.

Learn more about the .

With a five-year, $10 million grant from the U.S. Department of 91制片厂视频鈥檚 Institute of 91制片厂视频 Sciences, the newly established National Center on Performance Incentives has put together an ambitious agenda to study such efforts in Nashville, Tenn., across the state of Texas, and in two other locations yet to be named.

Center investigators say their Nashville project is the first randomized experiment in the United States to test the merit-pay idea, although field trials in Chile, Kenya, and Israel have done so, with mixed findings.

In the end, the center鈥檚 researchers hope to shed light on whether teachers behave differently when the prospect of bonuses is dangled before them, whether student achievement improves as a result, and whether the existence of such programs will ultimately attract a different mix of teachers into the field.

James W. Guthrie, left, and Matthew G. Springer direct the National Center on Performance Incentives.

鈥淲e really have no ideology,鈥 said Matthew G. Springer, the center鈥檚 director and a research assistant professor of public policy and education at Vanderbilt, which is in Nashville. 鈥淲e just want to provide an answer and end this two-decade-old debate.鈥

The gem in the center鈥檚 crown of studies is the experiment it has set up in the 74,000-student Nashville public schools. As part of the project, which got under way last fall, mathematics teachers in the city鈥檚 36 middle schools were invited to join a pilot program in which teachers could earn bonuses of up to $15,000 a year, over the next three years, for the gains their students make on state exams.

Gary W. Ritter, a researcher from the University of Arkansas at Little Rock, said his plan to conduct a similar experiment in the Arkansas capital had to be scuttled when the local teachers鈥 union opposed the idea. 鈥淚 can鈥檛 imagine too many places where the idea is not controversial,鈥 he said. 鈥淚鈥檓 quite surprised Vanderbilt was able to do it, and do it as well as it did.鈥

Union on Board

Despite pay-for-performance programs鈥 resurging popularity, some skeptics question whether money can ever be a major motivator for teachers, many of whom see the profession as more of a calling than a job.

Teachers also worry that such rewards will be doled out unfairly, create division in the teachers鈥 lounge, or deflect dollars from across-the-board raises.

鈥淲hen you talk about performance pay in corporate America, people are getting base salaries on top of salaries that are already high,鈥 said Jamye Merritt, the president of the Metropolitan Nashville 91制片厂视频 Association. 鈥淲e鈥檙e not against performance pay, but we would also like teachers鈥 salaries to be higher.鈥 Starting salaries for the district鈥檚 teachers are about $33,000 a year.

For years, the Nashville union also opposed efforts by the district school board and local business leaders to pilot merit-pay programs in the city. Yet 70 percent of the union members voted to back the Vanderbilt plan, which was also endorsed by Nashville Mayor Bill Purcell, the school board, and the business community.

What made the difference for the union this time, Ms. Merritt said, was the strong research component in Vanderbilt鈥檚 plan.

鈥淚 think it will benefit everyone to once and for all know if this will make a difference,鈥 she said. 鈥淚 personally don鈥檛 think it will. Teachers are already working as hard as they can.鈥

Test Scores Key

The experiment also was appealing because it differed from the merit-pay programs that came and went around the country in the 1980s.

For one thing, the bonuses are more substantial. Also, while the earlier programs tended to rely heavily on supervisors鈥 judgments to determine who got bonuses, the Nashville program uses a more objective measure: student test scores.

Do Incentives Pay?

A federally funded research center is studying whether giving educators salary incentives bolsters student gains.

A CLOSER LOOK:
NASHVILLE鈥橲 TEACHER鈥擯AY EXPERIMENT
At the start of the 2006-07 school year, researchers from the National Center on Performance Incentives recruited middle school mathematics teachers from across the city to be part of a three-year pilot program to test whether offering teachers bonuses can lead to student-achievement gains.

HOW BIG ARE THE BONUSES?
$5,000 to $15,000. All teachers who volunteered for the study also get a $750 stipend for participating.

HOW MANY TEACHERS ARE INVOLVED? The study involves 297 teachers from 36 middle schools. About half were randomly assigned to be part of the bonus-eligible group; half are in the control group and will not receive cash awards.

HOW DOES IT WORK? Bonuses are based on the test-score gains that a teacher鈥檚 students make over the course of a school year on state exams. The score changes are then compared against the historical gains, averaged over the last three school years, for the whole district. Teachers qualify for a $5,000 bonus, for example, if their students鈥 gains match those made by the students of the top 20 percent of Nashville teachers between 2004 and 2006. For a teacher to earn a $10,000 bonus, his or her students would have to perform at least as well as those of teachers who ranked in the top 15 percent over that same time.

WHO鈥橲 FUNDING IT? Federal research dollars are underwriting the experiment. A local fund, the Nashville Alliance for Public 91制片厂视频, is providing $1 million to pay for the bonuses.

WHEN WILL THE FINDINGS BE READY? The pilot lasts three years; final results are due out in 2011.

The growth in performance for an individual teacher鈥檚 students will be gauged against a historical average, calculated over three years, for the whole district. Such calculations are possible because Tennessee is among the states with data systems in place that allow researchers to measure the 鈥渧alue added鈥 effect of schools and teachers on individual students鈥 learning growth.

Likewise, the Nashville plan is not what experts call a 鈥渞ank-order tournament鈥濃攊n other words, a system in which teachers compete with one another for rewards. All teachers who meet specified performance targets will get bonuses ranging from $5,000 to $15,000 in the fall.

According to Richard J. Murnane, a Harvard University economist who is a co-author of a widely read critique of the 1980s-era merit-pay programs, such differences suggest the new generation of teacher-incentive programs may be worth a second look.

鈥淚鈥檓 much more agnostic on these new plans,鈥 he said. 鈥淭he only caution I would have is that when you look at the evidence on the stability of these rankings of teacher effectiveness as measured by student gains, you see nontrivial differences across subject areas or from year to year.鈥

That鈥檚 a potential problem for teachers who might wonder why they qualify for a bonus one year but not the next鈥攑articularly if they don鈥檛 think they鈥檝e slacked off.

The investigators at the National Center on Performance Incentives don鈥檛 plan to report any results for at least three years for fear of biasing the outcome of the study. What they will ultimately find is a wide-open question.

A 2001 randomized trial of teacher-incentive programs in Israeli high schools found that individual teacher bonuses can be a cost-effective way to spur student-achievement gains. But researchers studying a similar experiment that took place in Kenya in the late 1990s reported more mixed results.

While student test scores rose in the experimental schools in Kenya, the rewards did not affect teacher-absentee rates, which remained high. Rather than show up more often, teachers taught to the test, spending more time coaching students on the subjects to be tested, according to that study.

Previous studies also did not address whether pay-for-performance systems can change the mix of teachers in the labor pool.

鈥淭here might be people out there who are not in teaching now but may decide to go into it if there were financial incentives,鈥 said James W. Guthrie, a professor of public policy and education at Vanderbilt and the center鈥檚 executive director. 鈥淪o you might be able to draw more talent.鈥

Regardless of the outcome, experts agree that the Nashville study, in and of itself, won鈥檛 be the final word on whether pay incentives work for teachers.

Mr. Guthrie said researchers are negotiating with two other locations in an effort to randomly test two other types of incentive programs鈥攁 rank-order tournament and a program that awards bonuses to groups of educators, such as those in entire schools or at certain grade levels, when students post big learning gains.

Texas Twist

The Texas study, while not randomized, may provide information on an even wider range of incentive programs. Texas has two new pay-incentive programs this school year: the Governor鈥檚 Educator Excellence Grant, which offers a total of $10 million to teachers opting to work in disadvantaged schools, and the Texas Educator Excellence Grant, providing $100 million for performance-based rewards in 1,160 schools.

For both programs, though, the money goes directly to the schools, rather than individual educators. Then the schools set the criteria for deciding who gets the bonuses. The awards also must be based on more than just test scores, according to Mr. Springer.

鈥淭eaching excellence also takes into account such factors as mentoring of other teachers, teaching in subject areas that face a shortage, an individual鈥檚 level of education and experience, and whether the teachers are working in schools that are considered hard to staff,鈥 he added.

The center plans to complete its reports on the Texas plans in 2009 and 2010.

Fortunately for the investigators, though, neither the Texas programs nor the one in Nashville are being financed by the Teacher Incentive Fund, a pot of money the federal government created last year to seed pay-for-performance programs.

A signature initiative of the Bush administration, the fund was opposed by both national teachers鈥 unions. Last month, Congress cut spending for the fund from $99 million in the 2006 fiscal year to $200,00 in fiscal 2007鈥攁 dramatic illustration of how politically precarious such efforts can be. That sort of action worries Mr. Guthrie, who has been interested in the incentive idea for 20 years. 鈥淚鈥檓 still very fearful this will be a fad that will wash across the landscape,鈥 he said, 鈥渁nd go away without being carefully researched and will be thought of as a failure.鈥

Coverage of education research is supported in part by a grant from the Spencer Foundation.
A version of this article appeared in the March 21, 2007 edition of 91制片厂视频 Week as New Center Asks: Does Merit Pay Work?

Events

Recruitment & Retention Webinar Keep Talented Teachers and Improve Student Outcomes
Keep talented teachers and unlock student success with strategic planning based on insights from Apple 91制片厂视频 and educational leaders.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Families & the Community Webinar
Family Engagement: The Foundation for a Strong School Year
Learn how family engagement promotes student success with insights from National PTA, AASA鈥痑nd leading districts and schools.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Special 91制片厂视频 Webinar
How Early Adopters of Remote Therapy are Improving IEPs
Learn how schools are using remote therapy to improve IEP compliance & scalability while delivering outcomes comparable to onsite providers.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

School & District Management Video Tour a School Built to Stay Open in Extreme Weather
River Grove Elementary is built to stay open, with the lights on, as extreme weather strikes.
2 min read
School & District Management Opinion From One Superintendent to Another: Get Political
Strong relationships with political leaders help create a supportive network for your schools, even amid partisan turbulence.
George Philhower
5 min read
Vector of an education leader hand holding a book bridging the gap in education for a group of political people walking on
Feodora Chiosea/iStock
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
School & District Management Whitepaper
Courageous 91制片厂视频 Makes Literacy Change Happen
Get your blueprint for sustainable change and get ready to 鈥渕ake it happen.鈥
Content provided by 95 Percent Group
School & District Management Q&A What Should School Administrators Wear to Work? A Superintendent鈥檚 Style Tips
Melanie Kay-Wyatt describes her wardrobe as professional, comfortable, and colorful.
3 min read
Melanie Kay-Wyatt stands for a portrait inside Alexandria City High School on Sept. 9, 2024 in Alexandria, Va. Kay-Wyatt serves as superintendent for Alexandria City Public Schools.
Melanie Kay-Wyatt, the superintendent for the Alexandria, Va., school district, stands for a portrait inside Alexandria City High School on Sept. 9, 2024. She considers her professional style to be an important part of how she presents herself in her role.
Maansi Srivastava for 91制片厂视频 Week