Corrected: An earlier verson of this story misspelled the name of Ryan Reyna, a program director at the National Governors Association in Washington.
States are grappling with a federal requirement that is forcing them to use a new, more uniform method of calculating high school graduation rates鈥攁 method that, in some states, is yielding rates that are 20 percentage points lower than those states have reported in the past.
Under a to federal education rules, the states were required to replace their patchwork of graduation-rate formulas with a four-year 鈥渃ohort鈥� rate, beginning in the 2010-11 school year, and to use that number this school year to determine whether schools are making adequate progress under the No Child Left Behind Act.
鈥淭his is the first year we have true grad-rate accountability,鈥� said Robert W. Balfanz, the co-director of the Everyone Graduates Center at Johns Hopkins University, in Baltimore. Because of a lag in reporting graduation rates, not all the states鈥� rates for 2010-11 have been reported yet. But as they come out, the adjusted cohort rate will be 鈥渆mpowering for communities鈥� wishing to get a picture of what鈥檚 going on in their systems, according to Mr. Balfanz.
SOURCE: 91制片厂视频 Week
At the same time, the gap between states鈥� old and new rates is also presenting communications challenges for some states, which are undertaking intensive efforts to explain to policymakers and the public why the rates differ.
Even as states begin to use the new method, applications for federal waivers of some NCLB mandates show states continuing to tinker with how graduation rates should factor into schools鈥� scores on state accountability measures.
Accurate Measures
The rate at which students graduate from high school has been at the center of the national dialogue on education for years, but how to determine that rate accurately has been anything but clear.
Each state traditionally used its own calculation, but many of those formulas 鈥渉ad some real distortions,鈥� said Russell W. Rumberger, the vice provost for education partnerships for the University of California鈥檚 office of the president and the director of the California Dropout Research Project.
The new rate is part of an effort to improve both the consistency and accuracy of graduation-rate records across the country and to move closer to allowing for state-by-state comparisons.
As the 2008 regulations themselves note, 鈥渆stablishing a uniform and more accurate measure of calculating graduation rate that is comparable across states is a critical and essential step forward in improving high school accountability.鈥�
The four-year adjusted cohort rate set out in the regulations requires states to track individual students and capture how many first-time 9th graders in a given class proceed to graduate with a standard diploma four years later. That method is considered more accurate than previous methods but often yields a graduation rate that is lower than the results of states鈥� old formulas.
By way of comparison, the so-called 鈥渓eaver rate,鈥� which was at one point in use in 32 states, calculates a percentage to represent the number of students who graduate with a standard diploma compared with the sum of those students, students who receive an alternative completion credential, and students who have dropped out over the course of high school. Students who do not fit one of those school-leaving categories can fall through the cracks using this formula.
Another commonly used formula, the 鈥渁veraged freshman graduation rate,鈥� calculates the number of students who graduate with a standard diploma in four years but relies on an estimate rather than an exact number of 9th graders.
The new calculation means that the graduation rate may appear dramatically different even if the number of students who actually graduate hasn鈥檛 changed.
鈥淚t鈥檚 important that it gets out that these drops aren鈥檛 the result of a state doing worse. Now, we have an accurate picture,鈥� said Tara N. Tucci, a senior research and policy associate for the Alliance for Excellent 91制片厂视频, a Washington-based advocacy group.
States are using the new rate to improve their policies, said Ryan Reyna, a program director at the National Governors Association鈥檚 Washington headquarters.
鈥淐ohort rate and calculation has helped in development of early-warning data systems,鈥� he said. 鈥淪tates pushed for the new rate in the hope that with precision would come better interventions and improved outcomes.鈥�
States are staggered along the path to the new rate: Some have been using it for several years, while others are just now beginning to collect the data they need to report it. Kentucky, Idaho, and Puerto Rico received extensions from the U.S. Department 91制片厂视频, as they did not have data systems well-developed enough to report a cohort rate. Reporting a cohort rate requires at least four years of individual student data.
Idaho will report a cohort rate for the first time in 2013-14 and will use it for accountability in 2014-15. Kentucky will also begin using the cohort rate in 2013-14.
Other states, like Florida, made the transition quickly.
鈥淲e have had a student-identification process that allows us to do cohort for many years. We didn鈥檛 have to go through as much of a change as other states,鈥� said Jane A. Fletcher, the Florida department of education鈥檚 director of accountability and policy research.
鈥淎t this point, all states are reporting that they鈥檝e got that basic infrastructure in place to calculate,鈥� said Paige Kowalski, the director of state policy initiatives for the Data Quality Campaign, a Washington-based nonprofit that works to help states collect and use longitudinal education data.
鈥淭his was a policy lever that encouraged them to develop systems more quickly than they would have otherwise,鈥� she said.
Though the 2010-11 adjusted cohort rates had to be reported, the regulations did not specify when, and some states鈥� 2010-11 rates still have not been released. States often release graduation rates up to a year after graduation so they can account for students who may have finished at the end of the summer.
Apples to Apples?
The cohort rate is considered the most accurate way to track graduation rates, but the NGA鈥檚 Mr. Reyna emphasized that states鈥� rates are still not exactly comparable.
States may define when a student enters a cohort differently, for instance, or may track students leaving their systems differently. Some states also report the number of students from a cohort who have graduated in five or six years and use that number in their accountability formulas.
Judi Miller, the assistant director for title programs and services at the Kansas department of education, echoed that concern.
鈥淭here are some nuances in the parameters that each state set, so really you can鈥檛 say they鈥檙e exactly the same in each state,鈥� she said.
Ms. Miller singled out home-schooling as an issue in her state: Kansas students who transfer to unaccredited homeschooling programs are recorded as dropouts, but their counterparts in Indiana, for instance, are not.
As states began reporting the new graduation rates, they undertook efforts to communicate that the apparent drop in graduation rates largely stemmed from a calculation change, not a sudden surge in dropouts.
In Oregon, for instance, 鈥渋n addition to the press releases, we had articles in newsletters directly targeting district staff, and, more broadly, stakeholders,鈥� said Crystal Greene, a senior program and accountability officer in the state department of education.
That was important because 鈥渢he numbers looked quite different,鈥� Ms. Greene said. For example, she said, the 2008-09 graduation rate was 85 percent using the previous calculation, but just 66 percent by the new federal rate.
In Alabama, where the graduation rate using the federal number also looks approximately 20 percentage points lower, 鈥渨e鈥檝e been working on this since 2008 in anticipation ... and have notified the schools and the press,鈥� said Kay Atchison Warfield, an education administrator in that state鈥檚 education department.
The state will report the federal number for the first time this coming August, and Ms. Atchison Warfield says there will be a 鈥渧ery detailed rollout.鈥�
Some states, such as Virginia, still report an older calculation alongside the new federal rate in order to indicate trends.
But the improved data systems needed to calculate the new rate have also led some states to discover a silver lining, said the Data Quality Campaign鈥檚 Ms. Kowalski.
鈥淲hile graduation rates are going down, dropout rates are going down, too,鈥� she said. 鈥� 鈥楧ropout factories鈥� are going away because it turns out kids weren鈥檛 dropping out鈥攚e just lost track of them.鈥�
Ms. Kowalski said the attention to reporting data has led to a focus on 鈥渂asic data-quality issues: How do we support districts and schools on data entry?鈥�
In Alabama, Ms. Atchison Warfield said part of the state鈥檚 efforts to improve its graduation rate includes training school receptionists and secretaries in data entry.
Ensuring that students are tracked properly can be complicated. States use exit codes to track where students go, and those codes, said Mr. Reyna, 鈥渧ary from state to state. States have anywhere from four to near 40" such codes.
Tenuous Step Forward?
Meanwhile, states鈥� attempts to get waivers of the No Child Left Behind law鈥檚 accountability requirements may leave behind the effort to synchronize states鈥� graduation-rate reporting. Many states鈥� applications for such waivers would change how graduation rates are used for accountability purposes.
鈥淚n the year where finally accountability is real, waivers come along and challenge it,鈥� said Johns Hopkins鈥� Mr. Balfanz.
鈥淯nder the regulations, you had to make AYP based on test scores and make AYP based on grad rates,鈥� said Ms. Tucci of the Alliance for Excellent 91制片厂视频. 鈥淏ut we鈥檙e seeing in some states鈥� [waiver applications] that graduation rates are weighted between 15 and 30 percent and test scores are the remainder.
鈥淪chools could see a strong mathematical boost in accountability scores by pushing students out,鈥� she said, whereas before a graduation rate that missed a target could have prevented a school from making AYP.
In Colorado, which received one of the first NCLB waivers, the graduation rate is currently weighted at 12 percent of the overall points for high schools. In Oregon鈥檚 waiver proposal, it鈥檚 closer to 35 percent.
Kentucky had proposed that the graduation rate be weighted at 14 percent, but changed that to 20 percent in its approved plan.
The graduation-rate regulations also require states to break down the figures for student subgroups to highlight the performance of various groups deemed academically at risk. Some states鈥� old rates were already disaggregated; others, like Kansas鈥�, were not.
But many states have used the waiver application to change how their subgroups are defined.
For instance, some waiver applications include the creation of a so-called 鈥渟uper subgroup"鈥攁 group that combines several at-risk groups鈥攖hat allows the state to boost the number of schools with small numbers of minority students that are held accountable for minority-student achievement.
But, Ms. Tucci said, that approach may also mean the graduation rates of certain groups are masked.
For its part, the federal 91制片厂视频 Department said in a March 23 email to 91制片厂视频 Week that it had 鈥渘ot, to date, granted any waivers of the 2008 grad-rate regulations,鈥� and that each state is considered on its own for its waiver application and proposed accountability system.
While the new graduation rates will give educators and policymakers 鈥渁 better idea of what the nature of the problem is,鈥� said the University of California鈥檚 Mr. Rumberger, the real work is yet to come.
鈥淚mproving graduation rates is a huge challenge still,鈥� he said, 鈥渁nd I think it requires effort at federal, state, and local levels.鈥�
