Over the objection of officials at the statistical wing of the U.S. Department of 91制片厂视频, the independent body that sets policy for the National Assessment of 91制片厂视频al Progress has approved a policy that significantly narrows the grounds for excluding students with disabilities and English-language learners from the exams.
Beginning as early as next year, the National Assessment Governing Board will also highlight states and districts that don鈥檛 meet testing-participation targets for those populations.
Adopted March 6, the new policy caps a decadelong effort to increase participation of students with disabilities and ELLs in the federally sponsored assessment and to bring uniformity to exclusion and accommodations decisions on NAEP for those students.
Until now, those decisions have essentially been directed by a patchwork of state and local policies, resulting in wide variations in exclusion rates. Guidance established by NAGB in 2004 tried to standardize decisionmaking, but still allowed local officials to determine whether, for instance, a student would still take NAEP if the national exam did not permit the same accommodations as state tests.
The disparities have long been worrisome for testing experts, who say they could jeopardize NAEP鈥檚 role as a uniform measuring stick of student achievement across states and cities.
The 24 members of the National Assessment Governing Board had an unusually busy agenda during its most recent meeting. In addition to the new policy governing NAEP inclusion and accommodations policies, the board approved:
鈥� An alteration to the schedule of assessments. The board will add a science assessment at grade 8 in 2011 at the state and national level. The addition will allow the National Center for 91制片厂视频 Statistics to conduct a 鈥渓inking study鈥� between the exam results and those on the Trends in International Mathematics and Science Study, better known as TIMSS, to be assessed that year.
鈥� A plan to cancel the administration of the national and state writing assessment in grade 4 for 2011, to free up funding for the science exam. Moreover, the writing assessment was to have been given in a pencil-and-paper format in 2011 and subsequently changed to a computer-based format, which raised concerns about an interruption in the trend line.
鈥� New achievement-level descriptors for the 2009 reading exam, to reflect its updated framework.
鈥� A framework for the naep Assessment in Technology and Engineering Literacy, which will guide the development of the test, to be given at one or more grades in 2014.
SOURCE: 91制片厂视频 Week
Though supportive of the goal of greater inclusion on NAEP, the acting commissioner of the National Center for 91制片厂视频 Statistics indicated that his agency couldn鈥檛 support the policy. In a letter drafted days before the board vote, Stuart Kerachsky said that NCES harbors concerns about 鈥渇lagging鈥� individual states鈥� exclusion rates.
鈥淭here is no statistical basis for such standards,鈥� he wrote. 鈥淔or that reason alone, NCES is unable to support this recommendation: We would be implicitly impugning jurisdiction results ... without cause.鈥�
Additionally, he warned that the policy could be viewed as an attempt by the board to sway state instructional decisionmaking, in contravention of federal law.
But those arguments didn鈥檛 convince NAGB Chairman David P. Driscoll or the other board members, who approved the policy unanimously.
鈥淲e have been at this for almost two years,鈥� said Mr. Driscoll, a former Massachusetts state education chief, referencing the work of the ad hoc committee set up by the board to craft recommendations for the policy. 鈥淭o do nothing would be totally wrong, and the targets here are very reasonable.鈥�
Fewer Exclusions
The policy narrows the grounds for school officials to disallow student participation on NAEP, sometimes called 鈥渢he nation鈥檚 report card.鈥� The exam uses a methodology involving representative samples of students to arrive at its scores.
Under the new policy, states and districts would aim to test at least 95 percent of all students in the sample, and to test 85 percent of the students with disabilities and ELLs. States that didn鈥檛 reach the overall participation goal would be 鈥減rominently designated鈥� in NAEP reports, the policy states, while those not meeting the participation rates for special education students or ELLs would be 鈥渋dentfied鈥� in the reports.
For students with disabilities, the guidelines state that only those students who have been identified as having the most significant cognitive disabilities should be considered for exclusion.
All other students would participate, using accommodations specified on their Individualized 91制片厂视频 Plan or Section 504 plan. If a specified accommodation is not permitted on NAEP for reasons of test validity鈥攕uch as read-aloud assistance on the reading exam, or the use of a calculator on math鈥攖hen the student would be encouraged to take the exam without that accommodation. Students could still refuse to participate.
For ELLs, the guidelines state that students who have been in the United States for a year or more should be included. A student in the country for less than that could take an exam if it is available in his or her native language. School staff members would select among ELL accommodations using 鈥渙bjective indicators鈥� of English proficiency, the guidelines state. The board also directed the NCES to create assessments in Spanish for all subjects other than reading and writing.
Sticky Issues
Several hard-to-pin down issues are at the center of the debate. One concerns uncertainty over just how much exclusion rates affect overall scores on NAEP.
鈥淲e know that there is a nonsignificant relationship between exclusion rates and student scores,鈥� said Peggy G. Carr, the associate commissioner for NCES鈥� assessment division. 鈥淲e do know, however, that there is a moderate, mostly significant relationship between changes in exclusion rates and changes in scores.鈥�
States are required to take part in NAEP math and reading at both grades 4 and 8.
But according to Mr. Kerachsky, although exclusion rates have fallen, few states have managed to reach the targets specified in the policy. Based on 2009 participation data on reading, math, and science tests, only three states would have met the targets, he pointed out.
In his letter, Mr. Kerachsky stated that the policy could be seen as an effort by the board to influence state and local policies around exclusion. Language in the federal No Child Left Behind Act, he noted, prohibits the federal government from using NAEP to influence states鈥� 鈥渋nstructional practices.鈥�
Already, state and district exclusion rates are published in tables at the back of the NAEP reports, he noted. 鈥淚 think we all agree exclsion is an important issue,鈥� Mr. Kerachsky told the board. 鈥淚t鈥檚 a question of the importance of a flag or a designation. You are implying then that there is something wrong with the [test] results.鈥�
Though his arguments made little headway with the board, Mr. Kerachsky鈥檚 position has been supported by other stakeholders. A policy task force made up primarily of state education department officials, convened by NAGB and the Council of Chief State School Officers, urged the govern
ing board to report the 95 percent inclusion goal as a target, but to hold off on flagging individual states鈥� rates for the time being.
A handful of members who supported the new policy urged careful oversight as it is implemented, especially with regard to encouraging students with nonallowable accommodations to test without them.
鈥� 鈥楨ncouragement鈥� is an endeavor that can be pursued with varying degrees of yield,鈥� said W. James Popham, a member of the governing board. Some degree of training for local test administrators and oversight to ensure that they don鈥檛 go 鈥渙verboard鈥� with the policy should be instituted, he said.
Yet another fine line involves concerns around the IEP, a legal document that specifies the services and accommodations to which students with disabilities are entitled.
The original draft would have directed some students to take exams without their IEP-specified accommodations, but that language was softened because of legal concerns, said Oscar Troncoso, the chairman of the ad hoc committee.
Mr. Kerachsky鈥檚 letter warns that the legal status of the IEP could still be a potential problem, but some attorneys dispute that assertion.
鈥淏y allowing only accommodations that maintain NAEP鈥檚 validity, regardless of what accommodations a student鈥檚 IEP may include, NAGB鈥檚 new policy is consistent with well-written IEPs and with legal requirements in special education and the NCLB,鈥� said Miriam K. Freedman of the Boston-based law firm Stoneman, Chandler & Miller llp, who specializes in special education law and served as a member of the task force on students with disabilities.
And several members of the governing board indicated that they were influenced by widespread support for the guidelines among parents and advocacy groups at public hearings.
Those stakeholders 鈥渟poke very, very strongly in favor of the guidelines,鈥� said NAGB member Susan Pimentel, an educational consultant. 鈥淚 think there is a sense and a perception of basic fairness here, and that perception is so important to the credibility of NAEP.鈥�
The policy got an additional boost from Alexa E. Posny, the deputy assistant secretary for the Department of 91制片厂视频鈥檚 office of special education and rehabilitation services, who called it an 鈥渋mportant step forward.鈥�
鈥淚nclusion does not happen on its own,鈥� Ms. Posny said. 鈥淚t is hard work.鈥�
Ms. Posny chaired the task force on students with disabilities that helped draft the initial policy. At that time, she was Kansas鈥� schools chief and had only been nominated for the federal post.
Uncertainty Ahead?
Before being implemented, the proposal must first pass legal muster by the Department of 91制片厂视频鈥檚 office of the general counsel.
鈥淲e really get the legal issue nailed down, and then we explore whether there鈥檚 a way to accomplish NAGB鈥檚 goals within the boundaries of our charter,鈥� said John Q. Easton, the director of the Institute of 91制片厂视频 Sciences, of which the NCES belongs. 鈥淚 don鈥檛 know what that [way] is, and we won鈥檛 know until we get down to trying different approaches.鈥�
He sought to underscore that that work will be done in partnership with NAGB. Nevertheless, the meeting highlighted the delicate鈥攁nd at times uneasy鈥攔elationship between NAGB and the NCES. Ambiguities in how the two bodies are structured make it difficult to determine which of them is supposed to follow the other鈥檚 lead.
Of the two, the NCES is generally viewed as more cautious about statistical reporting, to ensure that information is not misinterpreted or accused of being partisan. NAGB, on the other hand, has pushed to make the reports accompanying NAEP releases more user-friendly. It successfully introduced descriptors of achievement at three levels鈥斺�渂asic,鈥� 鈥減roficient,鈥� and 鈥渁dvanced鈥濃�攊n NAEP releases, but those descriptors are printed with a disclaimer from the NCES urging caution in interpretation.
鈥淢y view is that NCES has to stand behind its reports,鈥� Mr. Kerachsky said, when asked which agency ultimately would get the last say over implementation of the policy. 鈥淲e take advice from NAGB, but these are government reports that have to meet guidelines from [the Office of Management and Budget], for example, for statistical reporting.鈥�
But in an interview, Mr. Driscoll, made it clear that NAGB expects the NCES鈥� cooperation in carrying out the policy, including the identification of states whose exclusion rates remain high. 鈥淚t doesn鈥檛 mean we鈥檙e going to give states a scarlet letter,鈥� Mr. Driscoll said, 鈥渂ut it certainly doesn鈥檛 mean putting these rates in the back of the report where no one will see them.鈥�
