How to use MMLU benchmark runs: pick the right variant, run it with lm-evaluation-harness or Inspect, smoke test the format, and read the score honestly.
MMLU vs GPQA explained: broad exam recall versus expert written science questions, why GPQA scores run lower, and which benchmark still means anything in 2026.
GDPval is OpenAI's AI test of 1,320 real work tasks from 44 occupations. How grading works, how to read the GDPval-AA board, and what it misses.
MMLU vs SWE-bench explained: what each measures, why the scores are not comparable, and which benchmark to trust for knowledge vs coding agents in 2026.
MMLU vs MMLU Pro explained: how the 4 option and 10 option benchmarks differ, why their scores aren't comparable, and which one to trust for LLMs in 2026.
SWE-Bench Pro explained: how Scale AI's coding benchmark differs from Verified, what V2 changed, and the November 2026 full, HARD-51 and private scores.