Responding to a potential cheating scandal uncovered by a recent newspaper investigation, Texas officials last week announced a sweeping review of test security and plans for a new monitoring scheme for the state accountability system, which has served as a model for other states as well as the federal No Child Left Behind Act.
鈥淲e take cheating very seriously in our state, and we will be taking whatever actions are necessary to maintain the integrity of our testing program,鈥� Commissioner of 91制片厂视频 Shirley Neeley said at a Jan. 10 press conference called to outline the state鈥檚 response. 鈥淭his whole situation is embarrassing, 鈥� but we鈥檙e not putting our heads in the sand over this.鈥�
The move came after an analysis of test scores by The Dallas Morning News found that results at as many as 400 schools out of 7,700 statewide鈥攊ncluding one celebrated Houston elementary school鈥攚ere suspect. The newspaper, which used a regression analysis of all school-level results on the Texas Assessment of Knowledge and Skills for 2003 and 2004, outlined unlikely leaps in TAKS scale scores from one year to the next or students鈥� inability to maintain high levels of achievement as they advanced in school. The analysis compares relationships between variables to gauge or predict consistencies, such as a school鈥檚 performance in reading over several grades.
Ms. Neeley said the newspaper鈥檚 use of scale scores鈥攖he average score a school achieves on a given test, as opposed to passing rates, may not provide the most accurate measure of how a school is performing. The commissioner acknowledged, however, that the state must devise a common formula for identifying questionable results.
Although reports of cheating on standardized tests are not uncommon across the country, the extent of the allegations in Texas appear to be unprecedented, observers say. The latest claims have renewed appeals from experts for states to institute better oversight of testing systems.
鈥淭his is an ethical failure on the part of the U.S. education system, not just on Texas,鈥� said Daniel Koretz, a testing researcher at Harvard University. 鈥淭here isn鈥檛 an expectation in this country that we will carefully evaluate the impact of holding people accountable for scores.鈥�
Texas has long used test scores to determine whether schools are making enough progress in raising student achievement, and for issuing penalties to those that fail to do so adequately. Under the federal law, state test scores are a central factor in whether schools meet 鈥渁dequately yearly progress.鈥�
Monitoring Criticized
Texas does not regularly monitor or review school or district results on the statewide assessment, according to Debbie Graves Ratcliffe, a spokeswoman for the Texas 91制片厂视频 Agency. Since it began testing more than two decades ago, the state agency has conducted limited reviews of school data, primarily to find instances in which large numbers of students were exempted from taking the test or absent on test day. It has also investigated specific allegations of cheating or cases of significant statistical anomalies.
Districts are primarily responsible for monitoring their results and investigating any irregularities or allegations of impropriety. They can then refer cases to the state agency for further review or action. The state probes only a handful each year.
Texas鈥� limited monitoring is standard practice throughout the nation, according to George Madaus, a senior fellow with the National Board on 91制片厂视频al Testing and Public Policy, a private body based at Boston College.
鈥淭he whole testing situation is almost totally unregulated,鈥� said Mr. Madaus, who, along with other researchers, has pushed for better monitoring for years. 鈥淲e鈥檙e dealing with a very useful, but a very fallible, technology.鈥�
Officials in Pittsburgh and Indiana, however, recently announced the hiring of independent contractors to monitor their testing programs and make recommendations for detecting potential cheating.
Commissioner Neeley said Texas, too, would hire an outside expert to review its testing policies and procedures and would craft measures for analyzing test results for the nearly 3 million students in grades 3-11 who participate in TAKS each year.
Educators found to have cheated, or those who failed to report cheating, could face disciplinary measures, ranging from a formal reprimand to suspension of their professional certificates to jail time, she said.
National Model Tainted
The state鈥檚 plan followed similar announcements by superintendents in Houston and Dallas, Texas鈥� largest school districts. The Dallas Morning News analysis found irregularities in dozens of schools in those districts.
In Houston, Wesley Elementary, which gained national acclaim under then-Superintendent Rod Paige for getting nearly all students from the poor neighborhood it serves to grade level in reading, was among those accused, along with two other affiliated schools that form a charter school district known as Acres Homes. Mr. Paige is wrapping up four years as the U.S. secretary of education.
According to the newspaper鈥檚 analysis of 2003 reading scores, Wesley鈥檚 5th graders were among the top performers in the state, scoring in the top 10 percent for the grade level. The following year, as 6th graders at Houston鈥檚 M.C. Williams Middle School, they fell to the bottom 10 percent in that subject and on the mathematics test, a trend that was not repeated elsewhere in the state.
鈥淎 Dallas Morning News investigation has found strong evidence that at least some of the success at Wesley and two affiliated schools comes from cheating,鈥� the newspaper said in an article dated Dec. 31.
A former Wesley Elementary teacher, Donna Garner, had reported to the Houston school board 19 months earlier that teachers at the school were encouraged over several years to cheat, according to state and district documents.
In November, the district appointed an independent counsel to investigate Ms. Garner鈥檚 claims.
The school attracted considerable attention throughout the 1990s, particularly for its adherence to Direct Instruction, a scripted commercial reading program. Its principal at the time, Thaddeus Lott, was hailed in news stories for helping his students beat the odds.
As governor of Texas, George W. Bush drew on the district鈥檚 purported success to support his educational accountability program, which became a national model and the basis for the No Child Left Behind Act instituted after he became president.
Wesley Elementary鈥檚 success prompted accusations of cheating then as well, but the claims were dismissed after a state investigation. In a 1998 interview with 91制片厂视频 Week, Mr. Lott chalked up those challenges to 鈥渋gnorance,鈥� saying 鈥渋t is racist鈥� to assume that poor minority children can鈥檛 learn.
Mr. Lott was not available for comment last week.
鈥楬ighly Questionable鈥�
After the latest charges, Abelardo Saavedra, who recently took over as the superintendent of the 212,000-student Houston district, said in a statement to The Dallas Morning News that the district agrees that the performance of Wesley and two other schools that form the school system鈥檚 Acres Home charter district was 鈥渉ighly questionable.鈥�
Mr. Saavedra announced Jan. 6 that the district would establish an inspector general鈥檚 office to institute new controls over test procedures and to investigate any suspected wrongdoing. The district鈥檚 internal auditor, Robert Moore, a certified fraud examiner, will head the office.
The Houston district is also planning to hire outside monitors to visit schools on test days, some assigned to specific schools and others randomly throughout the district. Commissioner Neeley said the state was considering a similar strategy.
District superintendents in Dallas and Fort Worth, where the newspaper found a number of cases of questionable test-score trends, have also unveiled plans for stricter monitoring.
But some critics say the measures may be inadequate, given the state鈥檚 and districts鈥� interest in showing that student achievement is improving.
鈥淭o think the TEA is going to monitor the quality of data from districts is like asking the fox to guard the chicken coop,鈥� charged Walter M. Haney, a professor of education at Boston College who has worked to debunk what he calls 鈥淭he Texas Miracle鈥� in raising student achievement. 鈥淓ven if there鈥檚 not outright fraud, where people become so obsessed with raising test scores on one relatively narrow test,鈥� cheating and other improprieties are likely to occur.
