Jump to content

Atlanta schools' test score gains were real

From bullshitopedia
Atlanta schools' test score gains were real
FALSE
"Dramatic improvements in standardized test scores in Atlanta Public Schools in the 2000s showed that the district's reforms were transforming student achievement."
Domain Education & Learning
Tactic Fraud or Scam
Statistical & Evidentiary Distortion
Era Current
First seen 2000s
Origin Test results reported by Atlanta Public Schools under Superintendent Beverly Hall, celebrated nationally until investigative reporting raised questions in 2008 and 2009
Last reviewed 2026-10-27
Further reading: books on Education & Learning

The claim that Atlanta schools' test score gains were real was widely accepted in the 2000s, when Atlanta Public Schools reported rapid improvements on Georgia's standardized tests and its superintendent, Beverly Hall, was named National Superintendent of the Year in 2009. A state investigation in 2011 found that teachers and administrators at dozens of schools had changed students' answers, given students answers during tests and falsified results, under intense pressure to meet targets. It was one of the largest cheating scandals in American public education. In 2015 eleven educators were convicted of racketeering.

The claim

Atlanta's scores on the Criterion-Referenced Competency Tests rose sharply at many schools, including those serving low-income students. District leaders presented the gains as evidence of successful reform, and they brought national praise, philanthropic support and bonuses for staff tied to performance targets.

What the evidence shows

  • Investigative reporting. Beginning in 2008, The Atlanta Journal-Constitution published analyses showing that some schools' gains were statistically improbable, with scores jumping far more than would be expected and then falling when students moved to other schools.
  • Erasure analysis. A state analysis of answer sheets found unusually high numbers of erasures from wrong answers to right answers at many Atlanta schools.
  • State investigation. Governor Sonny Perdue appointed special investigators. Their 2011 report found cheating at 44 of the 56 schools they examined and named 178 educators, including 38 principals, as involved. It described "cheating parties" where staff changed answers, and a culture in which teachers who raised concerns faced retaliation while those who met targets were rewarded.
  • Prosecutions. In 2013 a grand jury indicted 35 educators, including Hall, on charges including racketeering. Hall, who denied wrongdoing, died of cancer in 2015 before trial. Many defendants pleaded guilty. In April 2015 a jury convicted eleven educators of racketeering, and several received prison sentences, some later reduced.
  • Harm to students. Inflated scores meant that some students who needed help were not identified, and later analyses suggested affected students suffered lasting academic consequences.

Why it persists

The Atlanta case is a frequently cited example of what social scientists call Campbell's law: the more a quantitative indicator is used for social decision-making, the more it is subject to corruption pressures and the more it distorts the processes it is meant to monitor. High-stakes testing, tied to jobs, bonuses and school survival, created strong incentives to cheat. Similar, smaller scandals occurred in other districts.

Lessons for readers

  • Improvements that seem too good to be true deserve statistical scrutiny.
  • High stakes attached to a single measure create incentives to manipulate it.
  • Look for consistency across different measures, such as national tests and later performance.
  • Retaliation against whistleblowers is a warning sign of institutional fraud.
  • Investigative journalism can detect problems that institutions overlook.

See also

Sources

  • Special Investigators appointed by the Governor of Georgia, Report of the Special Investigation into the Atlanta Public Schools (2011).
  • Heather Vogell and others, investigative reporting on test scores, The Atlanta Journal-Constitution, 2008–2011.
  • Reporting on the 2015 racketeering trial and convictions (Associated Press and others).
  • Donald T. Campbell, "Assessing the Impact of Planned Social Change," Evaluation and Program Planning 2, no. 1 (1979).