huggingface.co · Benchmarks
Open dataset from the Artificial Hivemind paper: 26,070 real open ended chatbot questions plus 31,250 human ratings, used to measure how alike model answers are.
Infinity-Chat is one of 13 benchmark tools on TrueIQ. See all benchmark tools or how we check facts.
// guides
The Artificial Hivemind paper explained: why AI models give the same answers, what Infinity-Chat and NoveltyBench measure, and how to test output diversity yourself.
// related
NoveltyBenchnovelty-bench.github.ioCarnegie Mellon benchmark for output diversity: 1,100 prompts, each answered 10 times, scored on how many answers are meaningfully different and how useful the new ones are.BenchmarksFree★ 35
SWE-benchswebench.comOriginal Princeton SWE-bench of real GitHub issues where a fix counts only if the repo's tests pass; includes Lite, Verified and related subsets. For Scale AI's harder Pro benchmark, see SWE-Bench Pro.BenchmarksFree★ 6.1k
Humanity's Last Exam (HLE)lastexam.ai2,500 expert written questions from CAIS and Scale AI, plus HLE Diamond, a cleaned 1,000 question subset (500 reasoning, 500 knowledge) released September 2026.BenchmarksFree★ 1.7k
ARC-AGIarcprize.orgAbstraction and Reasoning Corpus series from Francois Chollet and the ARC Prize Foundation that tests skill acquisition on novel tasks; ARC-AGI-3 adds interactive games.BenchmarksFree★ 4.9k
BIG-benchgithub.comBeyond the Imitation Game: a collaborative benchmark of 200+ diverse tasks from 450 authors at 132 institutions, built to probe and extrapolate language model capabilities.BenchmarksFree★ 3.2kMMLUgithub.comMassive Multitask Language Understanding: a multiple choice benchmark spanning 57 subjects from math to law, introduced in 2020 and now largely saturated by frontier models.BenchmarksFree★ 1.6k