Retired

The graveyard

Tests every current model now aces. They were good tests once; then the models caught up, or trained on them. Either way they stopped measuring anything. This is where Goodhart's law ends up.

Nothing has retired yet

A test retires when nearly every blind judgement says both answers nailed it.

Retired tests keep their pages, answers and history. They stop counting as fresh. The retirement rule

Tell us what broke, or what is missing