SWE-bench
swebench.com · Benchmarks
Benchmark of real GitHub issues from popular Python repositories where a fix counts only if the repo's tests pass; includes the Verified, Lite and other subsets.
About the Benchmarks category
The standard tests used to compare models on knowledge, reasoning, coding and abstraction. Check what each one measures, how it is scored and whether results may be contaminated.
SWE-bench is one of 5 benchmarks tools indexed on TrueIQ. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.