91制片厂视频

91制片厂视频 Funding

Scoring Race to the Top: A Look Behind the Curtain

By Steven Brill 鈥 May 18, 2010 7 min read
  • Save to favorites
  • Print
Email Copy URL

In an article I wrote for The New York Times Magazine about Race to the Top that is being published this Sunday and which has , I only touch briefly on issues related to administering the contest. But readers of 91制片厂视频 Week might be interested in more detail of what I discovered in finding, as the article puts it, that 鈥済ood intentions can鈥檛 guarantee perfect execution in a federal bureaucracy.鈥

When the federal government gives out billions of dollars in grants, it can鈥檛 be done based on the gut feel of some policy wonks, however honest and well-meaning, that this state deserves it and that one doesn鈥檛. So before he left the government last fall, U.S. Department of 91制片厂视频 adviser and Race to the Top architect Jon Schnur recruited Joanne Weiss, who has an impressive r茅sum茅 in both the nonprofit and business sectors running education-related ventures, to create a rigorous process for giving out the money by using vetters who would be screened rigorously for conflicts of interest. Like jurors, they were also instructed, Ms. Weiss told me, 鈥渘ot to consider anything outside the actual four corners of what was submitted in the applications.鈥

A review of the vetters鈥 score sheets and written comments juxtaposed against the applications they judged suggests that their standards were inconsistent, that some were naive about the difference between promises and the capacity to deliver, and that others fell victim to the propensity of many states to misstate the status of their programs and overstate the buy-in they had from key stakeholders, especially the teachers鈥 unions.

See Also

In an exclusive 91制片厂视频 Week chat, Steven Brill provided a behind-the-scenes look at the judging process in the $4 billion federal stimulus-grant program. Read the transcript from this online chat.

For example, the vetter who gave Louisiana the low score I cite in the Times article arguably confirmed the fears that state Superintendent Paul G. Pastorek expressed to me of being graded by people with little experience trying to reform American public school systems. He was probably referring to Alan Ruby, who asked Mr. Pastorek the most skeptical questions during the Louisiana team鈥檚 presentation in Washington. Mr. Ruby is a senior fellow for international education at the University of Pennsylvania Graduate School of 91制片厂视频. The key items on his r茅sum茅 prior to his arrival at Penn are his years working at the World Bank and as Australia鈥檚 deputy secretary of employment, education, training, and youth affairs. Mr. Ruby acknowledged in an interview that he vetted Louisiana, but he rejected the notion 鈥渢hat my questions were hostile or skeptical,鈥 and declined to comment on whether his was the 349 score, a score 38 points lower than what California got from one of its vetters, despite the fact that California鈥檚 widely panned application committed to do nothing to link teacher pay to performance until 2012 and even then promised only to do it for 10 percent of the state鈥檚 teachers鈥攊f the union agreed.

鈥淲e made the attorney general of each state sign an assurance that everything in the application was accurate,鈥 Ms. Weiss told me when I asked about all the boxes that, the Times article reports, were checked inaccurately to indicate school district and union commitments to implement the plans in the proposals. Actually, the 146 pages of regulations that Ms. Weiss and her team drafted only require that the attorneys general certify that any statements made in the application about existing state law were accurate, a point emphasized by a spokesman for New York State Attorney General Andrew M. Cuomo when I asked him about New York鈥檚 inaccurately checked boxes.

Ms. Weiss told me that no one in her office checked the accuracy of the assurances, as conveyed by the checked boxes, before the awards were announced. Instead, she said, the vetters, who were paid $5,000 each to read and score the applications, were supposed to examine everything in the applications, including the appendices that contained the memoranda of understanding (MOUs) that the stakeholders had actually agreed to鈥攚hich, as I report, often turned out to be conditioned on the unions鈥 making collective bargaining concessions. Some did: A reviewer who gave New York a relatively low score wrote in his or her comments that 鈥渄espite checking the box that the applicant鈥檚 MOU uses the standard terms and conditions, the state did not in fact use the standard MOU. 鈥 These terms do not reflect the strongest level of commitment. ...鈥 But one of the other four New York vetters鈥攚ho gave the state a surprising 454 out of 500, which was higher than winner Tennessee鈥檚 average score鈥攑raised the breadth of commitments by local school systems that the state鈥檚 application listed.

In fact, even the first-round winner, Delaware, broke the rules, without anyone seeming to notice. Delaware checked all the boxes for its 38 school districts and for union support in each, even though its appendixed MOU, like New York鈥檚, made its commitments conditional on union collective bargaining agreements鈥 being negotiated 鈥渋n good faith.鈥 However, in Delaware, the core of its commitments鈥攕uch as how teachers will be evaluated鈥攚ill be defined with the union鈥檚 input, but under state regulations, they can ultimately be imposed by the state without union sign-off. The collective bargaining caveat in the MOU, Delaware state teachers鈥 union President Diane Donohue told me, 鈥渉as to do with other, smaller aspects of the plan, like extending school days at turnaround schools, which I am sure we will agree on.鈥 Besides, Ms. Donohue went to Washington with Delaware officials to assure the vetters of her union鈥檚 commitment to the entire proposal.

On May 5, the department, noting 鈥渋nconsistencies in some instances between the tables and narratives,鈥 amended its rules to require that any state in which a school district鈥檚 commitment to implement any part of the state鈥檚 plan is conditional on future collective bargaining agreements should mark a C in the relevant box on the grid, rather than a Y or an N. Secretary of 91制片厂视频 Arne Duncan has released a list of the 49 vetters with their biographies, but he has refused to disclose which ones vetted which states or awarded which scores and wrote which comments. (Thus, my having to make suppositions about Mr. Ruby.) He also required them all to sign expansive nondisclosure agreements prohibiting them from talking to the press. Asked how he could explain shielding publicly paid officials from publicly explaining their individual decisions to spend taxpayer money, Mr. Duncan cited the 鈥渢ransparency鈥 of having made all the applications, scores, and comments public and said 鈥渋t鈥檚 a set of folks together making the decisions.鈥 Ms. Weiss interrupted to add that 鈥渋t鈥檚 also to prevent these guys from having all kinds of undue pressure brought to bear on them.鈥

My Times article also refers to the reformers鈥 concern about Mr. Duncan鈥檚 鈥渓anguage of collaboration鈥濃攖hat he might have inadvertently signaled to the states that getting union buy-in was more important than submitting a strong plan. Mr. Duncan has since taken steps to counter that impression, publicly stating that plans that are watered down to win union support won鈥檛 win the Race. But some of that collaboration perspective may have seeped into how the vetters scored the states, at least according to one reviewer who was willing to discuss it. The 500-point score sheet had a discrete place where stakeholder buy-in was to be taken into account for up to 45 points, with most states getting 25 to 45 points, which means that about 20 points were typically in play. But one vetter who was willing to be interviewed about this issue鈥擬ichael C. Johanek, who also teaches at the University of Pennsylvania Graduate School of 91制片厂视频鈥攖old me he thought 鈥渢here were plenty of places throughout the application, probably hundreds of points鈥 worth, where if you believe you can鈥檛 do successful reform without teacher enthusiasm you could take that into account.鈥 Mr. Johanek would not reveal which states he vetted, but his perception of the scoring rules (in addition to his equating a union leader鈥檚 signature with 鈥渢eacher enthusiasm鈥) might be telling.

Although a reporter can鈥檛 know it by asking them how they arrived at their decisions, Mr. Duncan maintained 鈥渢he peer reviewers did a phenomenal job.鈥 He shrugged off their seemingly limited backgrounds, saying 鈥淚 really value a diversity of opinion; what you don鈥檛 want here is group think.鈥

As has been reported by 91制片厂视频 Week, last month the New Teacher Project recommended that monitoring of the reviewers鈥 work in the upcoming second round should be made 鈥渕ore robust鈥 and that the highest and lowest scores out of the five should be eliminated in the next round, a change that would have put Louisiana in sixth place. (Delaware and Tennessee would still have scored first and second.) Mr. Duncan told me he thought that was a bad idea. 鈥淢y biggest fear,鈥 he said, 鈥渋s that you throw out the outliers. You need people who are willing to say the emperor has no clothes, or this is a brilliant idea.鈥

A version of this article appeared in the May 19, 2010 edition of 91制片厂视频 Week as Scoring Race to the Top: A Look Behind the CurtainScoring Race to the Top: A Look Behind the Curtain

Events

Recruitment & Retention Webinar Keep Talented Teachers and Improve Student Outcomes
Keep talented teachers and unlock student success with strategic planning based on insights from Apple 91制片厂视频 and educational leaders.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Families & the Community Webinar
Family Engagement: The Foundation for a Strong School Year
Learn how family engagement promotes student success with insights from National PTA, AASA鈥痑nd leading districts and schools.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Special 91制片厂视频 Webinar
How Early Adopters of Remote Therapy are Improving IEPs
Learn how schools are using remote therapy to improve IEP compliance & scalability while delivering outcomes comparable to onsite providers.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

91制片厂视频 Funding A Funding Lifeline for Rural Schools Is at Risk, and Not for the First Time
Rural schools near national forests rely on dedicated federal funds. But so far, lawmakers haven't renewed them.
7 min read
School bus on rural route, Owens Valley, CA.
iStock/Getty
91制片厂视频 Funding Project 2025 Would Dramatically Cut Federal Funds for Schools. Then What?
A key federal funding source for schools would disappear under the conservative policy agenda.
9 min read
Kristen Eichamer holds a Project 2025 fan in the group's tent at the Iowa State Fair, Aug. 14, 2023, in Des Moines, Iowa. A constellation of conservative organizations is preparing for a possible second White House term for Donald Trump. The Project 2025 effort is being led by the Heritage Foundation think tank.
Kristen Eichamer holds a Project 2025 fan in the group's tent at the Iowa State Fair on Aug. 14, 2023, in Des Moines, Iowa. Conservative organizations preparing for a possible second White House term for Donald Trump have assembled a policy agenda that would eliminate the U.S. Department of 91制片厂视频 and phase out Title I funds for public schools.
Charlie Neibergall/AP
91制片厂视频 Funding A State Considers a Future in Which Schools Can't Rely on Property Taxes
How would school districts fill the gap if a governor gets his wishes?
10 min read
A school building rests on vanishing columns of rolled hundred dollar bills. Vanishing property tax support for schools.
Vanessa Solis/91制片厂视频 Week + Getty Images
91制片厂视频 Funding Inside a Summer Learning Camp With an Uncertain Future After ESSER
A high-poverty district offers an enriching, free summer learning program. But the end of ESSER means tough choices.
5 min read
Alaysia Kimble, 9, laughs with fellow students while trying on a firefighter鈥檚 hat and jacket at Estabrook Elementary during the Grizzle Learning Camp on June, 26, 2024 in Ypsilanti, Mich.
Alaysia Kimble, 9, laughs with fellow students while trying on a firefighter鈥檚 hat and jacket at Estabrook Elementary during the Grizzly Learning Camp on June, 26, 2024 in Ypsilanti, Mich. The district, with 70 percent of its students coming from low-income backgrounds, is struggling with how to continue funding the popular summer program after ESSER funds dry up.
Sylvia Jarrus for 91制片厂视频 Week