Winners of the $4 billion jackpot committed to grand goals in using the federal grants to raise student achievement, as measured by higher test scores, narrowed achievement gaps, and increased graduation and college-going rates鈥攁ll in four years.
Now comes the hard part: With the money in hand, the 11 states and the District of Columbia must deliver on those goals, which often involve making leaps in student achievement at a record-setting pace. For most states, that amounts to a long shot.
From the U.S. Department of 91制片厂视频鈥檚 perspective, that may not be a bad thing.
鈥淚nterestingly, when you look at some of those states with the most ambitious goals, these are the same states that are some of the best actors. They are tenacious and aggressive and really trying hard to meet those goals,鈥� said Joanne Weiss, the former director of the Race to the Top and now the chief of staff to Secretary of 91制片厂视频 Arne Duncan.
The winners鈥� success in meeting their goals鈥攚hich earned them a certain number of points in the hard-fought grant competition last year鈥攚ill offer a report card, of sorts, on the aggressive, multistate education improvement initiative launched as part of the American Recovery and Reinvestment Act.
The Many Goals of Race to the Top
The 12 states that won money from President Obama鈥檚 Race to the Top program now have set widely varying goals in which to improve achievement.
Most of the winners aimed high as they sought to woo the competition鈥檚 judges, even though the goals they set to improve student achievement carried limited weight in the scoring system. For example:
鈥� The District of Columbia intends to lift its college-going rate by 20 percentage points, from 39 percent, the most of any Race to the Top winner.
鈥� Rhode Island aspires to increase its proficiency rates in math on the 8th grade National Assessment of 91制片厂视频al Progress, or NAEP, by 27 percentage points over the five-year period, from 28 percent, something no other state has accomplished in so little time.
鈥� And Maryland wants to eliminate achievement gaps among all student subgroups, including minority students and English-language learners, on state tests by 2014.
Those goals may be out of reach, many observers say.
鈥淣othing involving achievement changes fast in a great big country like this. Most of the time, things don鈥檛 change at all. Moving a state is a lot harder than moving an aircraft carrier,鈥� said Chester E. Finn Jr., the president of the Thomas B. Fordham Institute, who led the 91制片厂视频 Department鈥檚 research and improvement branch during the Reagan administration. But at the same time, Mr. Finn said, 鈥渟omething has to happen to the kids for this to be worth doing. We cannot just be rearranging the adult deck chairs.鈥�
If states don鈥檛 meet their goals, nothing happens from the department鈥檚 perspective鈥攕ince those are goals set for the end of the four-year grant period.
That鈥檚 not to say the department won鈥檛 be monitoring the goals, such as by taking note of 2011 NAEP scores among Race to the Top states. The federal agency already is monitoring a slew of performance measures to make sure states live up to their end of the bargain.
What鈥檚 more, said Ann Whalen, a top aide to Secretary Duncan, keeping tabs on states鈥� student-achievement levels is part of the department鈥檚 ongoing process to hold them accountable for their Race to the Top proposals.
鈥淚t really keeps a laser-like focus on improving achievement and closing gaps,鈥� said Ms. Whalen, the director of the 91制片厂视频 Department鈥檚 implementation and support unit.
Judging the Goals
Policy advocates, politicians, and the media have chronicled what Race to the Top applicants did to win the grants, such as changing teacher-evaluation policies and opening the way to an expansion of charter schools. And they鈥檝e examined what the winners plan to do with their money, such as hiring 鈥渄ata coaches鈥� and rebuilding education data systems.
As part of last year鈥檚 $4 billion Race to the Top competition, states had to set goals for how much student achievement would improve if they won a four-year grant. They did so in the areas of: test scores, including on the National Assessment of 91制片厂视频al Progress; achievement gap; graduation rates; and college-going and college-attainment rates. Examples of the goals set by the 12 winners include:
SOURCES: U.S. Department of 91制片厂视频; 91制片厂视频 Week
Down the road, there will be some official assessment by the Institute of 91制片厂视频 Sciences, the research arm of the U.S. Department of 91制片厂视频, which is undertaking two studies.
of the $100 billion in education spending from the ARRA, the 2009 federal economic-stimulus package. That four-year, $10 million study will look at how ARRA-related programs, including the Race to the Top, were implemented, and whether student outcomes improved.
of the Race to the Top and the federal School Improvement Grant program. Researchers will examine how well those two programs were implemented, and whether they improved student outcomes in low-performing schools.
But little attention has been paid in the meantime to the Race to the Top endgame: the student-achievement gains each state is shooting for.
For what would seem to be an important marker, the goals were worth few points in a competition judged on a 500-point grading scale. Indeed, 91制片厂视频 Department officials debated the role goals should play in the competition.
When the Race to the Top was being crafted, they discussed requiring states to meet annual student-achievement goals (rather than four- or five-year ones), but eventually rejected that path because year-to-year ups and downs can occur even as states make steady progress. Also, the department decided against setting minimum goals for the states because the student-achievement picture was so different across the country.
And finally, department officials debated how much weight the goals would receive in the scoring system. By making states鈥� goals worth few points, the department hoped to head off sky-high, unrealistic targets.
When it came time to judge the Race to the Top applications, the outside peer reviewers were told to grade states on whether their goals were 鈥渁mbitious yet achievable.鈥�
As was the case with the other scoring categories, the judges took widely varied approaches in their grading. Several didn鈥檛 even acknowledge the goals, some repeated them and awarded points because they were included, and only a few offered commentary on just how achievable and ambitious the goals actually were.
Delaware was cited by one judge as not being 鈥渁mbitious鈥� enough for aspiring to a 55 percent proficiency rate on NAEP, which, for 8th grade math, would be a 23-percentage-point increase鈥攕till far better than what any other state has accomplished in just a few years. But no judge criticized Tennessee for aiming for a 37 percent proficiency rate on the same test, a 14-percentage-point increase.
Some of New York鈥檚 judges were particularly hard on the state for not aiming for higher gains for minority and high-needs students. The state wants to narrow achievement gaps on NAEP by just a few percentage points for groups such as minority students and English-language learners within four years. Nationally, those same gaps have barely budged in years. Still, one judge saw New York鈥檚 target as too low, calling it 鈥渄isturbing.鈥�
But Maryland鈥檚 far more ambitious goal of completely eliminating achievement gaps earned criticism, too. 鈥淭he extent to which [the goals] are achievable, especially for different subgroups, is questionable, as are the goals themselves,鈥� one judge wrote.
Scattered Targets
An 91制片厂视频 Week examination of the winners鈥� Race to the Top applications shows a wide range of aspirations for what they hope to achieve with their share of the $4 billion.
Hawaii, for example, set of goal of being at the national median on all NAEP tests by 2018.
Ohio wants to boost its 8th grade math proficiency rate on NAEP by 6 percentage points, and its graduation rate by 2 percentage points, to 88 percent.
The District of Columbia wants to increase graduation and college-going rates at a faster pace than any other Race to the Top grantee鈥攇oals that left one judge asking whether that was a 鈥渕oonshot,鈥� referring to the term Mr. Duncan has often used to describe the Race to the Top.
On-Demand Webinar: The Economic Stimulus and American K-12 91制片厂视频
Where did the stimulus hit the mark? Where did it fall short? A representative from the U.S. Department of 91制片厂视频 and a district schools superintendent examine the impact of the law.
鈥� View this free webinar.
Rhode Island is aiming for one of the steepest trajectories, especially on NAEP. In 8th grade math, for example, the state wants to increase its proficiency rate 27 percentage points.
No state has come close to that rate of improvement, including Massachusetts, which has seen some of the biggest growth in NAEP scores in the country. During Massachusetts鈥� best six years, from 2000 to 2005, that state鈥檚 scores in 8th grade math grew 13 percentage points.
鈥淲e do believe it鈥檚 possible to meet these goals,鈥� said Rhode Island Commissioner of 91制片厂视频 Deborah Gist. 鈥淚f you set a goal you know you can meet, you鈥檙e just not stretching yourself as far as you could.鈥�
According to Rhode Island鈥檚 plan, the state set its goal by studying schools that had made rapid student-achievement gains of 10 to 20 percentage points on various metrics鈥攚ith the idea that the state, through the Race to the Top, could replicate that improvement statewide.
One goal which Ms. Gist thinks could be especially challenging: math proficiency in high school. In the 2010-11 school year, only 33 percent of 11th graders were proficient in math on the state test. The state鈥檚 goal? Seventy-five percent proficiency.
鈥淥ur current proficiency level is just so unacceptable. Any other goal just felt unsatisfying,鈥� Ms. Gist said. She noted that the state鈥檚 plan calls for directing more Race to Top resources into high school math.
Achievement Gap Focus
Massachusetts, which often boasts the highest achievement in the country, also has some of the largest achievement gaps between black and white students, and low-income and wealthier students.
鈥淲hat we鈥檙e looking at is continuing improvement but picking up the pace, and at the same time accelerating the improvement for those furthest behind,鈥� said Mitchell D. Chester, the state commissioner of education.
To set the state鈥檚 goals, Mr. Chester said, Massachusetts officials looked at the rate of improvement over the last several years, and bumped it up a notch. One of the state鈥檚 core objectives is reducing achievement gaps by 25 percent on NAEP and 15 percent in high school graduation rates.
鈥淚 do believe in four years鈥� time it is possible and important to demonstrate some tangible, measurable, substantial improvements in student outcomes,鈥� Mr. Chester said. 鈥淭hat鈥檚 the bottom line here. We can鈥檛 wait 10 years.鈥�
Massachusetts officials will watch some midpoint indicators to see if the state is on the right track, including reading in the early elementary grades, middle school math, and overall achievement in the lowest-performing schools.
鈥淚 think there鈥檚 tension about how we judge that success in looking for short-term numbers. There鈥檚 important table-setting going on,鈥� Mr. Chester said. Speaking of other Race to the Top winners, he said that some states may not hit their goals, but may have put landmark policies in place that will pave the way for long-term improvement.
鈥淲e have to be more nuanced in judging this,鈥� he said.
Weighing Success
Experts in education research agree it will take time to judge the ultimate success, or failure, of the Race to the Top, given how long it can take for policy changes to translate into test-score gains. And it will be difficult to figure out whether it was the Race to the Top, and not some other education improvement effort or even a change in demographics, that caused any improvement.
鈥淚t鈥檚 important to differentiate between aspiration and tangible goals to set for a system,鈥� said James W. Kohlmoos, the president and chief executive officer of the Washington-based Knowledge Alliance, which represents such research groups as the federal regional education laboratories.
鈥淲e鈥檙e going to get a lot of anecdotal evidence, and may see correlation over time,鈥� he said. 鈥淏ut maybe the question to ask is, how much has Race to the Top changed actual policy?鈥�
In most winning states, the achievement targets aren鈥檛 just Race to the Top goals, they鈥檙e also state education goals.
Take Tennessee, for example. Its goals, which include halving achievement gaps on NAEP and boosting college-going rates by 9 percentage points by 2014, are embedded in its request to obtain a waiver from certain provisions of the federal No Child Left Behind Act.
The Obama administration last week released details of its plan to provide regulatory relief from many key parts of the NCLB law, including the goal that 100 percent of students be proficient in math and reading by 2014. Several states, including Tennessee, submitted requests before the final rules were even announced.
鈥淎ll of these [Race to the Top] reforms are predicated on a commitment to setting ambitious but realistic goals,鈥� Tennessee Gov. Bill Haslam and Commissioner of 91制片厂视频 Kevin Huffman wrote in a July 29 letter to Mr. Duncan, asking for flexibility under NCLB. 鈥淭o be clear, if we are able to achieve the ... top-line goals, Tennessee鈥檚 public education system will be on a completely different trajectory.鈥�
For education policy advocates, who are watching the progress in Race to the Top states, setting goals鈥攅ven high ones鈥攊s the easy part.
鈥淚f you鈥檙e going to set an ambitious goal, how do you line up the resources to get there,鈥� said Amy Wilkins, the vice president of government affairs and communications at the Washington-based 91制片厂视频 Trust, which advocates educational improvement for disadvantaged students. 鈥淭he hard work comes in implementation.鈥�
