Spurred by the promise of $350 million in Race to the Top money for improved tests鈥攁s well as an opportunity to strengthen bids for part of the federal fund鈥檚 larger $4 billion pot鈥攕tates are scrambling to join consortia to develop common assessments.
Six state consortia are now engaged in discussions about common tests, and the multiple partnerships may put to rest for now speculation that federal support inevitably will lead to a single national set of exams.
Since it isn鈥檛 yet clear what the U.S. Department of 91制片厂视频 expects to see from the consortia, most states have hedged their bets by signing up for more than one partnership. For the most part, their signatures on the 鈥渕emorandums of understanding鈥� listing the principles of each consortium are nonbinding.
The situation remains fluid, with the number of states involved in each consortium changing almost daily.
At this point, signing a memo 鈥渋s not a meaningful gesture. ... Many states did it to get extra points in their Race to the Top applications,鈥� said Stanley N. Rabinowitz, a senior program director of assessment and accountability services at WestEd, a San Francisco-based technical-assistance provider.
Nearly all states have joined multiple consortia that are crafting common assessments to qualify for Race to the Top money.
Source: 91制片厂视频 Week; Center for Assessment
鈥淭hat shouldn鈥檛 be interpreted to mean that states aren鈥檛 serious,鈥� he said. 鈥淚t鈥檚 a courting process, a development process, and states are feeling each other out.鈥�
In fact, there are signs that several of the consortia might try to merge even before March, when the 91制片厂视频 Department is expected to release its application notice for the $350 million in assessment funding, which is being provided under the American Recovery and Reinvestment Act.
To that end, the Maine commissioner of education, Susan Gendron, who is also the board president of the Council of Chief State School Officers, last week sent a letter to state chiefs to arrange a meeting of all the state consortia. The nation鈥檚 governors also were scheduled to discuss common assessments last week, she said in an interview.
Still, observers warn that even if more clarity on the format of such consortia is reached, many obstacles stand in the way of their making headway. They include potentially conflicting goals, delicate political questions about curricula, and widely divergent procurement laws.
There鈥檚 even a more basic calculus at work: whether the largest consortia will be able to work effectively, or prove unwieldy and inefficient.
Connecting the Dots
Four states have yet to join any of the consortia. Two of them, Alaska and Texas, are also the lone holdouts from a state-led project to devise common English/language arts and mathematics standards. A third state, Virginia, 鈥渞emains committed鈥� to its own Standards of Learning testing program, according to Charles Pyle, a spokesman for the Virginia education department. Nevada also has not joined a consortium.
Observers agreed that, with few details available yet on the format of the competition, it鈥檚 reasonable for states to try to shape matters by joining several collaboratives, although most of the consortia are being led by states that already have some experience with the principles laid out in their respective memorandums of understanding.
Balanced Assessment Consortium
NO. OF STATES* 36
Achieve Consortium
NO. OF STATES* 27
Multiple Options for Student Assessment and Instruction Consortium (MOSAIC)
NO. OF STATES* 27
Summative Multi-State Assessment Resources for Teachers and 91制片厂视频al Researchers (SMARTER)
NO. OF STATES* 24
Florida Assessment Consortium
NO. OF STATES* 17
National Center on 91制片厂视频 and the Economy Consortium
NO. OF STATES* 7
*As of Jan. 19, 2010
Source: 91制片厂视频 Week; Center for Assessment
One consortium, called SMARTER, will focus on adaptive-testing technology. Computer-adaptive tests adjust their difficulty depending on whether a student has correctly answered previous questions. Proponents say that such tests home in more precisely on a student鈥檚 mastery of standards, though the technology has its detractors, too.
The consortium is being led by three states, including Oregon, the only one using an adaptive-test model to meet the annual assessment requirements of the federal No Child Left Behind Act.
Another consortium, nicknamed MOSAIC, will focus on professional development for classroom-based formative-assessment techniques, which help teachers adjust instruction in real time, said Pat Roschewski, the director of statewide assessment for Nebraska.
The state, which is leading the endeavor, has trained teachers on such assessments for a decade, though for NCLB accountability purposes it is phasing out the local tests in favor of statewide ones.
The Balanced Assessment Consortium, which Ms. Gendron leads with Steven L. Paine, the West Virginia superintendent of education, seeks a system that would include curriculum-embedded, performance-based tasks scored by teachers throughout the year. Such tasks would help guide instruction and would be coupled with year-end exams.
鈥淥ne of the things that鈥檚 critically important is how we change practice in the classroom that enhances teacher effectiveness,鈥� Ms. Gendron said. 鈥淲e know from experience that assessments by themselves do not change practice.鈥�
A Florida-led consortium has as one of its goals common year-end assessments with a shared proficiency definition and grade-by-grade benchmarks toward college- and career readiness.
The National Center on 91制片厂视频 and the Economy, a nonprofit that works to improve linkages between education and the workforce, will focus on high school exams. The idea, said the group鈥檚 president, Marc S. Tucker, is to align curriculum, instruction, and testing in the early high school grades with comprehensive, syllabus-based 鈥渂oard examinations,鈥� such as those used in Britain.
Rounding out the consortia is one organized by Achieve, one of the groups leading the Common Core State Standards Initiative. Its organizers said it will work to keep the other consortia focused on crafting exams that produce comparable results across states.
Procurement Headaches
Experts and policymakers express their views on how the consortia will shake out over the coming months.
LARRY BERGER
Chief Executive Officer, Wireless Generation
鈥淭he fact that [the federal assessment competition] is going to be a secret, with only tea leaves for us to read until it hits the street, is creating confusion, but it is productive confusion. 鈥� States are joining multiple partnerships in part because it鈥檚 a good principle when we don鈥檛 know what we鈥檙e buying.鈥�
SUSAN GENDRON
Board President, Council of Chief State School Officers
鈥淲e absolutely think that [merging the consortia] is the right thing to do. I鈥檒l be honest, there might be one or two that say, 鈥榃e still want to go alone.鈥� And then the states will have to decide how they want to proceed.鈥�
STANLEY N. RABINOWITZ
Senior Program Director, WestEd
鈥淎ll of [the consortia] are still nowhere near to being a final product or a final understanding. Over the next month or so, some will survive and some won鈥檛, based on how well they evolve to meet the states鈥� broad interests.鈥�
ERIC J. SMITH
91制片厂视频 Comissioner, Florida
鈥淚 think you鈥檙e going to see in coming weeks and months a lot of modifications. ... My sense is there鈥檚 probably more commonality between the consortia than differences.鈥�
Eric J.Smith photo by Ray Stanyard
Ms. Gendron hopes that convening state officials will provide an avenue for some of the consortia to merge or strike a governance arrangement to share their work.
For the most part, leaders of the consortia say they have found much commonality among the six.
鈥淥ur greatest need now is continued conversation around the various options on the table,鈥� said Eric J. Smith, Florida鈥檚 education commissioner. 鈥淚t鈥檚 healthy and smart. We鈥檙e going to find that most states have a common interest in how this gets fleshed out.鈥�
Even so, many tensions are still lurking below the surface.
One is the fundamental difference between traditional year-end accountability tests, which tend to be curriculum-neutral, and those that would depend on projects aligned closely with curricular units.
To draw comparisons across states using the latter type, discrete curricular units would probably need to be taught across multiple districts or states, said Larry Berger, the chief executive officer of Wireless Generation, a New York City educational technology company.
鈥淣o one is advocating a national curriculum or even one across a state, but ... that鈥檚 still politically complicated territory,鈥� he said.
Experts also have questions about the procurement processes for developing and executing testing specifications. Generally, procurement laws prevent a technical expert advising the design process from bidding on actual test development.
Laws and legal precedents differ in their stringency, but a consortium might be bound by the most restrictive state鈥檚 policy unless some other model was reached, warned Mr. Berger, who testified on the issue at one of the 91制片厂视频 Department鈥檚 public hearings on the competition.
Mr. Berger, a board member for 91制片厂视频, the publisher of 91制片厂视频 Week, believes that the consortia should begin bidding competitively on technical partners now, or risk preclusion from using such experts later.
Too Many Cooks?
Other state experts say they are aware of such challenges and are considering new avenues for dealing with procurement, but the details, for now, are sketchy at best.
And in what comes as a caution against merging the consortia, some observers suggest that smaller partnerships would be able to operate more nimbly and effectively than those with dozens of members.
The New England Common Assessment Program consortium, which crafted common NCLB tests, worked, observers say, because the states involved鈥擬aine, New Hampshire, Rhode Island, and Vermont鈥攈ad similar testing issues, and each had an equal say in decisionmaking.
鈥淭hat was four states. With 36 states, it鈥檚 a different order of magnitude keeping everyone on the same page,鈥� said Lauress Wise, a scientist at the Human Resources Research Organization, an Alexandria, Va.-based analysis group.
The World-Class Instructional Design and Assessment consortium, which created a common English-language-proficiency test to meet NCLB requirements, worked despite its many players, because the participating states sought a fixed product, not a flexible model, added WestEd鈥檚 Mr. Rabinowitz. But given that federal officials have indicated that they want both innovation and commonality, consensus on a common assessment system could prove more challenging to reach, he said.
He hopes the federal competition will reserve money for smaller consortia鈥攐r subsets of the larger ones鈥攖o work on 鈥渘iche鈥� issues.
On at least one area, participants generally agreed: If the government chooses to finance more than one consortium, it should allow for movement between them.
鈥淢y personal hope would be that they fund a couple of different approaches and then do some formal evaluation of the effectiveness of these approaches for meeting the objectives, and let states add on to the consortia that prove to be effective,鈥� said Mr. Wise.
鈥淚 think the [competition notice] will give more specifics on the broad questions,鈥� added Mr. Rabinowitz, 鈥渂ut I鈥檓 not sure it鈥檚 going to solve fully the real implementation issues, which will drive a lot of the consortia discussions and the ability to be successful.鈥�
Assistant Editor Catherine Gewertz contributed to this report.
