91ƬƵ

Federal

‘Growth Models’ Gaining in Accountability Debate

By David J. Hoff — December 18, 2007 10 min read
  • Save to favorites
  • Print
Email Copy URL

In the debate over the future of the No Child Left Behind Act, policymakers, educators, and researchers seem to agree on one thing: The federal law’s accountability system should be rewritten so it rewards or sanctions schools on the basis of students’ academic growth.

Congress, they say, should scrap the current model, which judges schools on the number of their students who are deemed proficient. That method, its critics say, overlooks schools whose students are showing growth toward proficiency, and sometimes fails to single out high-achieving schools in which a significant proportion of students aren’t making progress.

The U.S. Department of 91ƬƵ recently reaffirmed the Bush administration’s commitment to so-called growth models. Earlier this month, it would approve all states’ growth models that meet its criteria for participating in a 2-year-old pilot project.

See Also

“Everything I’ve done says growth model, growth model, growth model,” said David N. Figlio, a professor of economics at the University of Florida, in Gainesville, who has studied several states’ accountability systems. “A growth model will encourage schools to make genuine improvements, as opposed to cosmetic improvements.”

Compared with the NCLB law’s current “status model”—which makes accountability decisions by tracking the test scores of one year’s group of students against the previous year’s—growth models, by tracking individual students’ progress, can provide a more accurate picture of whether a school is succeeding in helping its students.

Pilot States

In November 2005, the U.S. Department of 91ƬƵ announced a pilot program for up to 10 states to use growth-based accountability models. All states are now eligible to apply for the program.

BRIC ARCHIVE

(Requires ).

SOURCE: EPE Research Center, 2007

“The growth model shows you exactly what’s happening in that school,” said Robin R. Taylor, the associate secretary for assessment and accountability in the Delaware Department of 91ƬƵ.

But despite widespread support for the concept, the path to implementing growth models under a revised No Child Left Behind law won’t be easy, researchers and policymakers say.

Not all states have the data systems they would need to analyze test scores for evaluating schools using the proposed accountability model. Experts question whether growth models that required student gains large enough to reach the law’s goal of universal proficiency would deliver results much different from those of the current accountability system. They also disagree on how to design growth models to determine the success of schools with already-high achievement levels and thus low rates of academic growth.

“I don’t think you can do growth without recognizing status,” said Margaret Goertz, a co-director of the Consortium for Policy Research in 91ƬƵ, based at the University of Pennsylvania, in Philadelphia. “There’s got to be some sort of mix.”

The No Child Left Behind law, which marks its sixth anniversary next month, is the first federal effort to hold all public K-12 schools accountable for the performance of their students. The law was due for reauthorization in 2007, but Congress has not advanced beyond holding hearings and discussing draft plans for revising it. The effort is slated to resume in 2008, although some observers predict Congress won’t complete its work until after the next president takes office.

A revision of the Elementary and Secondary 91ƬƵ Act, first passed in 1965, the NCLB law requires states to test their students annually in grades 3-8 and at least once in high school in reading and mathematics. It also mandates that states determine whether schools and districts are increasing the number of students who are proficient in those subjects.

To avoid getting caught in the law’s web of sanctions, schools must be on pace to meet the goal of universal proficiency by the end of the 2013-14 school year. Schools must meet their annual goals for all students and those same goals for specified student subgroups, including members of racial and ethnic minorities, economically disadvantaged students, English-language learners, and children with disabilities.

Online-Only Content

Review state-by-state data on the percentage of schools and districts making adequate yearly progress in the 2006-07 school year, and those “in need of improvement.”

Public Schools-- Adequate Yearly Progress and Improvement Status Under NCLB

Schools and Districts-- Stages of Improvement Under NCLB

School Districts--Adequate Yearly Progress and Improvement Status Under NCLB

(All tables require )

All 3 tables are also available in this Microsoft Excel file.

SOURCE: EPE Research Center

If schools receiving federal Title I aid for disadvantaged students don’t meet their goals for two years in a row, they must offer their students the chance to transfer to other public schools. After a school falls short of its goals for five years, authorities must completely restructure it.

The law requires schools and districts to compare the test scores of each grade from one school year to the next. For example, the proficiency levels of last year’s 3rd graders will be compared with this year’s to determine a school’s accountability status for the 2008-09 school year. The accountability method is commonly called a status model because it tracks the state of each grade from year to year and doesn’t measure individual students’ growth in achievement.

The weakness of the model is that it doesn’t reward schools that start at low levels of performance. They can show significant growth in student achievement but still be declared “in need of improvement” under the NCLB law. Conversely, schools that start with high student achievement can backslide and not be targeted for interventions, so long as the total number of students scoring as proficient doesn’t drop below the schools’ goals.

Unlike the current accountability system, growth models recognize schools’ success in improving student achievement at all performance levels, Mr. Figlio said. that the status models reward schools for focusing on students near the proficiency level and slighting those either way above or below that level. (“Acceleration Under Review,” Aug. 1, 2007)

“The big value of growth models is that educators focus on what their goal is: that is, to grow kids [academically],” said Chrys Dougherty, the research director of the National Center on 91ƬƵal Accountability, an Austin, Texas-based nonprofit group that supports data-based efforts to improve schools.

Congress had little choice but to rely on the status model when it wrote the NCLB legislation in 2001, NCLB legislation in 2001, the law’s supporters say. At the time, few states tested students every year—something necessary for tracking student growth. And even fewer had the sophisticated databases needed to calculate accountability scores based on such growth.

See Also

What changes would you make to the No Child Left Behind Act’s accountability demands? Join the discussion.

Perhaps six states could have used a growth model under the bipartisan measure at the time President Bush signed it into law in January 2002, Mr. Dougherty estimates.

Today, all states test annually under the NCLB law. But have the three pieces of data that can track every student’s score from one year to the next, according to the Data Quality Campaign, a coalition of education groups led by the National Center on 91ƬƵal Accountability. Those ingredients are: a unique number to identify each student, the assurance that proficiency levels are consistent across grade levels, and information about why specific students aren’t assessed.

When the Data Quality Campaign first conducted the survey in 2005, 21 states had the data they needed for growth models.

“States are moving very quickly toward” being ready to use growth models, said Brian Gong, the executive director of the National Center for the Improvement of 91ƬƵal Assessment, a Dover, N.H.-based group that consults with states on testing and accountability policies. “It will take many states several years to work that out.”

Although policymakers, researchers, and interest groups are rallying around growth models, they don’t necessarily agree on how to design them.

The most significant question to be settled: How much growth is enough?

91ƬƵ Department's Criteria for Growth Models

To use a growth model, the 91ƬƵ Department requires states to meet a number of conditions:

  • The model must demonstrate that it will meet the No Child Left Behind Act’s goal that all students will be proficient in reading and mathematics by the end of the 2013-14 school year. It also must set a goal of closing achievement gaps, such as between minority and white students, every year.
  • States’ achievement goals need to be set based on expectations for students’ grade levels.
  • Accountability systems must require schools and districts to meet annual goals for student achievement in both reading and mathematics.
  • States must meet the NCLB law’s requirements that students be assessed in grades 3-8 and once in high school and must hold schools and districts accountable for the achievement of students in subgroups by race, ethnicity, socioeconomic status, English-language learners, and students with disabilities.
  • States’ testing systems must report results that can compare one grade with the next year’s, and the U.S. Department of 91ƬƵ must approve the testing system.
  • States must track all students’ achievement in a statewide data system.
  • States must report test-participation rates of students and hold schools and districts accountable for an academic indicator other than test scores.
  • SOURCE: U.S. Department of 91ƬƵ

    “When most people think about growth models, they think about a year’s growth in a year’s time or a little more than a year’s growth in a year’s time,” said Ms. Goertz, who was on a panel of researchers and advocates who reviewed applications in the 91ƬƵ Department’s pilot project.

    While such learning growth may constitute progress, it’s not fast enough to meet the NCLB law’s goal of proficiency for all U.S. students.

    In designing the pilot project, Secretary of 91ƬƵ Margaret Spellings required that students post achievement gains that suggest they would be proficient by the end of the 2013-14 school year.

    “That’s a very steep trajectory,” said Mr. Gong. “It’s very hard for schools to reach.”

    The number of schools meeting their goals hasn’t increased significantly in the nine states that are currently using growth models.

    The criteria that the 91ƬƵ Department requires states to meet may make it difficult to dramatically expand the number of states using the growth models. And the steep increases in student achievement required under the growth models may mean that schools’ results may not differ from the current accountability system.

    But states are anxious to try growth models to inform Congress’ debate over the future of the law, said one official who works closely with states.

    “We have a large number of states trying to improve their approaches” to accountability, said Scott R. Palmer, the director of the education practice of Washington office of the Holland & Knight law firm.

    “It’s good that the department would … encourage states to move to these models,” said Mr. Palmer, who advises the Council of Chief State School Officers and several states.

    By changing the way states report whether schools have made adequate yearly progress, or AYP—the gauge of success under the law—states could give a better picture of schools’ progress toward the law’s goals. One alternative would be to give schools letter grades based on their progress toward meeting the proficiency goal.

    That would eliminate the stigma of failing to achieve AYP and give schools an incentive to improve or maintain their grades.

    In his research on Florida’s accountability system, Mr. Figlio found that schools that received an F and were far from moving up a grade rarely made significant progress. Those close to improving their grades had a reachable goal and were more likely to produce student significant achievement gains, he added.

    “If schools think there’s no chance, why should they work toward it?” Mr. Figlio said.

    Another benefit of a grading system, Mr. Gong said, is that it would recognize all schools that are making progress, not just those that are on track to meet an ambitious standard.

    “It would … recognize that some growth levels would be admirable and hard to do even if they don’t get [all] students to proficiency,” he said.

    For all the focus on growth models, some scholars suggest that No Child Left Behind also should recognize the overall achievement of a school. Just as the status model overlooks schools with significant achievement gains, a growth model could conceivably determine that a school with 100 percent proficiency is in “need of improvement.”

    Trying to balance the grades for status and growth is often difficult, Mr. Gong of the National Center for the Improvement of 91ƬƵal Assessment said. Last month, the New York City school system released grades based on a combination of schools’ overall achievement and growth of achievement for all its 1,466 schools. The city’s elite schools complained about getting grades of B or C, while some low-performing schools received higher grades.

    “That’s always been the case when growth and status are combined,” Mr. Gong said. The best solution is to give separate grades, he added.

    But the public isn’t savvy enough to see through such a nuanced system, said Mr. Figlio. In England, the education department gives each school a grade for growth and status, but people overlook the scores for growth, he said.

    “What happens is people pay attention to the status score,” said Mr. Figlio, who recently lived in England while on sabbatical from the University of Florida.

    Under Florida’s accountability system, schools are rated on the growth of three separate groupings of students: the total enrollment; students starting below proficiency; and those who score at the state’s lowest performance levels.

    “The kids who are historically left behind are counted three times,” Mr. Figlio said. “The kids who are historically advantaged are counted once.”

    A version of this article appeared in the December 19, 2007 edition of 91ƬƵ Week as ‘Growth Models’ Gaining In Accountability Debate

    Events

    Recruitment & Retention Webinar Keep Talented Teachers and Improve Student Outcomes
    Keep talented teachers and unlock student success with strategic planning based on insights from Apple 91ƬƵ and educational leaders. 
    This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91ƬƵ Week's editorial staff.
    Sponsor
    Families & the Community Webinar
    Family Engagement: The Foundation for a Strong School Year
    Learn how family engagement promotes student success with insights from National PTA, AASA and leading districts and schools.  
    This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91ƬƵ Week's editorial staff.
    Sponsor
    Special 91ƬƵ Webinar
    How Early Adopters of Remote Therapy are Improving IEPs
    Learn how schools are using remote therapy to improve IEP compliance & scalability while delivering outcomes comparable to onsite providers.
    Content provided by 

    EdWeek Top School Jobs

    Teacher Jobs
    Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
    Principal Jobs
    Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
    Administrator Jobs
    Over a thousand district-level jobs: superintendents, directors, more.
    Support Staff Jobs
    Search thousands of jobs, from paraprofessionals to counselors and more.

    Read Next

    Federal Days After Georgia Shooting, No Mention of Safety or Schools in Trump-Harris Debate
    The debate came less than a week after two students and two teachers were killed at Apalachee High School in Winder, Ga.
    3 min read
    Ball State University students watch a presidential debate between Republican presidential nominee former President Donald Trump, left, and Democratic presidential nominee Vice President Kamala Harris, Tuesday, Sept. 10, 2024, in Muncie, Ind.
    Ball State University students watch a presidential debate between Republican presidential nominee former President Donald Trump, left, and Democratic presidential nominee Vice President Kamala Harris, Tuesday, Sept. 10, 2024, in Muncie, Ind.
    Darron Cummings/AP
    Federal Photos PHOTOS: Behind the Scenes at the Moms for Liberty National Summit
    Former President Trump was a keynote the final night—and said little about schools.
    1 min read
    Moms for Liberty member Aura Moody dances with others at the annual Moms For Liberty Summit in Washington, D.C., on Aug. 30, 2024.
    Moms for Liberty member Aura Moody dances with others at the conservative parents' rights organization's annual summit in Washington, on Friday, August 30, 2024.
    Lawren Simmons for 91ƬƵ Week
    Federal At Moms for Liberty National Summit, Trump Hardly Mentions 91ƬƵ
    In a "fireside chat" with a co-founder of the parents' rights group, the former president didn't discuss his education policy priorities.
    5 min read
    Republican presidential nominee former President Donald Trump speaks with Moms for Liberty co-founder Tiffany Justice during an event at the group's annual convention in Washington, Friday, Aug. 30, 2024.
    Former President Donald Trump, the Republican presidential nominee, speaks with Tiffany Justice, a Moms for Liberty co-founder, during the group's national summit on Friday Aug. 30, 2024, in Washington. The former president spoke only briefly about issues directly related to education.
    Mark Schiefelbein/AP
    Federal Then & Now Why It's So Hard to Kill the 91ƬƵ Department—and Why Some Keep Trying
    Project 2025 popularized plans to end the U.S. Department of 91ƬƵ, but the idea has been around since the agency's inception.
    9 min read
    President Ronald Reagan is flanked by 91ƬƵ Secretary Terrel Bell, left, during a meeting Feb. 23, 1984 meeting  in the Cabinet Room at the White House.
    President Ronald Reagan is flanked by 91ƬƵ Secretary Terrel Bell, left, during a meeting Feb. 23, 1984 meeting in the Cabinet Room at the White House. Bell, who once testified in favor of creating the U.S. Department of 91ƬƵ, wrote the first plan to dismantle the agency.
    91ƬƵ Week with AP