
lighteval
github.com · LLM Evals
Hugging Face toolkit for evaluating LLMs across many backends with reusable tasks and detailed sample level results.
lighteval is one of 21 LLM eval tools on TrueIQ. See all LLM eval tools or how we check facts.

github.com · LLM Evals
Hugging Face toolkit for evaluating LLMs across many backends with reusable tasks and detailed sample level results.
lighteval is one of 21 LLM eval tools on TrueIQ. See all LLM eval tools or how we check facts.
// guides
Open LLM Leaderboard v2 explained: its six benchmarks, how normalized scores work, why Hugging Face retired it, and how to query or rerun it today.
The best LLM evaluation frameworks in 2026: Promptfoo, DeepEval, Ragas, Inspect and TruLens for apps, plus lm-evaluation-harness and HELM for model benchmarks.
// related