SO-Arena tests System One decision models on 2,919 tasks in 11 domains. Who leads, why the top scorer is only seventh on reliability, and how to read it.
ARC-AGI vs Humanity's Last Exam: one tests how fast a model learns a new puzzle, the other tests expert knowledge. Scores, grading, cost and which to trust.
How to use MMLU benchmark runs: pick the right variant, run it with lm-evaluation-harness or Inspect, smoke test the format, and read the score honestly.
MMLU vs GPQA explained: broad exam recall versus expert written science questions, why GPQA scores run lower, and which benchmark still means anything in 2026.
MMLU vs SWE-bench explained: what each measures, why the scores are not comparable, and which benchmark to trust for knowledge vs coding agents in 2026.
MMLU vs MMLU Pro explained: how the 4 option and 10 option benchmarks differ, why their scores aren't comparable, and which one to trust for LLMs in 2026.