The goal of the No Child Left Behind Act is simply stated: All children should be proficient in reading and mathematics by the end of the 2013-14 school year. But more than five years after the law was enacted, it remains unclear what 鈥減roficient鈥� means.
Because the federal law gives the states the power to define proficiency, there are 50 different definitions of the term. And policymakers are sending mixed messages about how to judge the rigor of each state鈥檚 standards.
Some experts criticize the states for not matching the proficiency levels in the National Assessment of 91制片厂视频al Progress, or NAEP. U.S. Secretary of 91制片厂视频 Margaret Spellings and others suggest the goal should reflect grade-level expectations.
鈥淚t sounds good, and we think we know what it means,鈥� Laura S. Hamilton, a senior behavioral scientist for the RAND Corp., said of the proficiency goal. 鈥淚n reality, it鈥檚 almost meaningless.鈥�
Still, Secretary Spellings, Rep. George Miller, D-Calif., and other leading federal policymakers say that universal academic proficiency is one of the most important principles in the law and should be retained as Congress works to reauthorize the NCLB legislation this year. Many endorse adding science to the list of subjects students should be expected to master by the 2013-14 deadline.
鈥淭he goal of all children being able to read, do math, and do science at grade level is the right goal to keep our eye on even as we make adjustments in how we get there,鈥� said Aaron K. Albright, the press secretary for Democrats on for the House 91制片厂视频 and Labor Committee, of which Rep. Miller is the chairman. 鈥淣othing is more important to our country than providing each and every child with a first-rate, world-class education.鈥�
As Congress considers changes to the law, it will have to address the question of what it means to be proficient and who will write that definition.
State or National?
When Congress passed the No Child Left Behind measure in late 2001, it relied on a long-standing policy of not directing states or school districts on what to teach or how to teach it. The law gives states the authority to set their own subject-matter standards and to define what it means for students to demonstrate they are proficient, using assessments linked to those standards.
The Bush administration says it remains committed to honoring states鈥� authority to set their own standards and define proficiency as they see fit.
鈥淚t鈥檚 important for there to be a sense of buy-in and commitment鈥� from states, said Kerri L. Briggs, the Department of 91制片厂视频鈥檚 acting assistant secretary for elementary and secondary education and President Bush鈥檚 nominee for that post.
But many researchers and other critical observers of the proficiency provisions suggest that states haven鈥檛 set challenging standards under the law, especially compared with NAEP. The national assessment tests a representative sample of 4th, 8th, and 12th graders in every state, and it reports the percentage of students who score at the basic, proficient, and advanced levels.
Last week, a research group released a study suggesting that states may have lowered their definitions of proficiency since NCLB was enacted in 2002.
In a study comparing state test scores with NAEP results, the research group Policy Analysis for California 91制片厂视频 found a widening gap between students rated as proficient on the national assessment and those at the same level on state tests. Of the 12 states studied, that gap grew larger over the past five years in 10 states, according to the study released last week by PACE, which is based at the University of California, Berkeley.
In 2005, most states reported higher percentages of students at proficiency on their tests than on the National Assessment of 91制片厂视频al Progress in 4th grade reading.
Notes: If state test results were not available for grade 4, the EPE Research Center used test results from grade 3 or grade 5.
No results are reported for New Hampshire, Rhode Island, and Vermont because these states did not test reading in grades 3-5.
SOURCE: EPE Research Center
The gap between NAEP and state-test proficiency levels averaged 41 percentage points in the 47 states that gave 4th grade reading tests in 2005, according to an analysis by the 91制片厂视频 Research Center. The difference was 71 percentage points in Mississippi, and 61 points in both Georgia and Alabama.
Advocates of national academic standards argue that because of such disparities, Congress should set up a process that would establish national standards and tests that states would be able to adopt, knowing that they met a national definition of proficiency.
鈥淭he time has come to think beyond this tradition of state dominion 鈥� and come up with some national standards and a national assessment,鈥� said Lindsay Clare Matsumura, an assistant professor of education at the University of Pittsburgh.
The Thomas B. Fordham Foundation, a Washington think tank, and the Aspen Institute鈥檚 Commission on No Child Left Behind propose using NAEP test questions and definitions of proficiency as the basis for any national standards and tests.
鈥淎lmost everyone recognizes that NAEP captures what children should be proficient in or at least have a basic understanding of,鈥� said Roy E. Barnes, a Democratic former governor of Georgia and a co-chairman of the bipartisan Aspen Institute commission, which issued extensive recommendations for reauthorizing the federal education law in February.
NAEP鈥檚 Flaws
The Aspen Institute panel suggests that national standards and tests be designed around NAEP鈥檚 achievement levels. Those standards and tests would be models that states could adopt for accountability purposes under the NCLB law. If states chose to keep their own standards and tests, they would have to submit them to an independent national panel that would compare their rigor with that of NAEP.
In Congress, Sen. Christopher J. Dodd, D-Conn., has introduced a bill that would establish national standards in mathematics and science based on NAEP. Sen. Edward M. Kennedy, D-Mass., has a separate proposal that would require states to compare their own standards against the NAEP鈥檚 standards. Sen. Kennedy is the chairman of the Senate Health, 91制片厂视频, Labor, and Pensions Committee, and Sen. Dodd is a senior member of the panel.
Most testing experts and researchers say that NAEP shouldn鈥檛 be used to create a universal definition of proficiency.
NAEP 鈥渨asn鈥檛 designed for the purpose we want now, which is accountability,鈥� said James W. Pellegrino, a professor of cognitive psychology and education at the University of Illinois at Chicago. 鈥淲hat we want to do is establish what we consider proficiency to be.鈥�
Overall, NAEP standards appear to be ambitious. In the 2005 exam given to 4th graders, for example, 31 percent ranked as proficient or above in reading, and 36 percent scored at that level in mathematics.
Given how students perform on NAEP, other researchers say that the national assessment would produce an overly ambitious definition of proficiency if it were used as the basis for national standards or tests.
In a paper last fall, Richard Rothstein, a research associate at the Economic Policy Institute, a Washington-based research organization, estimated that students in countries that score highest on international assessments don鈥檛 ensure all their students meet NAEP鈥檚 proficiency levels.
In Singapore, 25 percent of 8th graders would not have ranked as proficient under NAEP鈥檚 standards, according to Mr. Rothstein鈥檚 analysis of the 2003 Trends in International Mathematics and Science Study. Singapore was the highest-scoring country on the TIMMS test.
NAEP scores also contradict other assessments鈥� results, Mr. Rothstein said.
In 2000, NAEP reported that 1.5 percent of high school seniors scored at its advanced level in math. By comparison, 2.7 percent of the members of that year鈥檚 high school graduating classes earned college credit for calculus based on their performance on Advanced Placement exams.
But supporters of NAEP say that its proficiency levels are an appropriate goal for all students.
鈥淭hat sounds like an excuse for low expectations,鈥� said Mr. Barnes, the former Georgia governor. 鈥淚t may be unpleasant [to set a high standard], but it鈥檚 necessary.鈥�
Real-World Standards
Other advocates of a different conception of proficiency have called for defining proficiency based on whether students are prepared for either college or the workforce.
Under such proposals, states would define what it means for a student to be ready for college or a career by the end of high school. From there, the states would work to set definitions for proficiency for each grade level leading up to high school to make sure students were on track to meet the high school standards. State officials would set their own goals, working with business leaders and higher education officials.
鈥淭he goal ought to be that young people should graduate high school ready for college or the workplace,鈥� said Sandy Kress, a former White House adviser to President Bush on the NCLB law and a lobbyist based in Austin, Texas. Mr. Kress represents the Business Coalition for Student Achievement, a group made up of national business groups and corporate executives that is calling for standards linked to college and workplace readiness.
Read the related story,
The 91制片厂视频 Trust, meanwhile, in a series of recommendations for the reauthorization of the NCLB law it made last week, proposed amending the law鈥檚 goal for student achievement by linking it to new, more challenging standards based on skills needed to succeed after high school.
Under the plan, states would set a goal that at least 95 percent of students meet their states鈥� definition of 鈥渂asic鈥� under the 11th grade standards, and that at least 80 percent of students rate as 鈥減roficient鈥� at that grade level.
Although the terminology would change, the requirement that the standards be linked to college and the workplace would make such standards more rigorous than they are now, said Kati Haycock, the president of the 91制片厂视频 Trust, a Washington-based research and advocacy group that is a staunch supporter of the federal law鈥檚 efforts to raise the achievement of disadvantaged students.
鈥淲e鈥檙e asking most states to set higher standards for basic than they have now for proficient,鈥� Ms. Haycock said in a conference call with reporters last week.
Whether or not states鈥� standards are modeled after NAEP鈥檚 standards, many researchers argue that the federal government should abandon the goal of universal proficiency.
The current goal of getting all students to the same place has some 鈥減erverse incentives,鈥� Ms. Hamilton of the RAND Corp. said. Schools are focusing on students who are close to meeting the proficiency goals, she said, and slighting those who are achieving well above or well below the standard.
Instead, accountability systems should track the overall growth in achievement and whether that growth exceeds what can reasonably be expected over the course of a year, Ms. Hamilton said.
鈥淚t鈥檚 not something that鈥檚 easy to explain to the public,鈥� she said. 鈥淏ut it鈥檚 a way to look at test scores along the whole distribution of performance rather than whether or not everyone is proficient.鈥�
