TrueIQ.si
Submit a tool

OpenCompass

opencompass.org.cn · LLM Evals

Open source

Comprehensive evaluation platform from Shanghai AI Lab supporting many models, datasets and a public leaderboard.

#platform#leaderboard#benchmarks#shanghai-ai-lab
Visit OpenCompass ↗GitHub ↗

About the LLM Evals category

Frameworks and platforms for testing language models and LLM applications — from academic benchmark harnesses to CI-friendly unit tests and LLM-as-judge scoring.

OpenCompass is one of 15 llm evals tools indexed on TrueIQ. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All LLM Evals →
OpenAI Evalsgithub.comFramework and open registry of evaluations for testing language models and the systems built on them.LLM EvalsOpen source★ 19.6klm-evaluation-harnessgithub.comEleutherAI's unified harness for running hundreds of academic benchmarks against any model with consistent prompts.LLM EvalsOpen source★ 14.1klightevalgithub.comHugging Face toolkit for evaluating LLMs across many backends with reusable tasks and detailed sample-level results.LLM EvalsOpen source★ 2.6ksimple-evalsgithub.comLightweight reference implementations OpenAI uses to report zero-shot benchmark results transparently.LLM EvalsOpen source★ 4.7kHELMcrfm.stanford.eduStanford's Holistic Evaluation of Language Models, measuring accuracy, robustness, bias and efficiency across many scenarios.LLM EvalsOpen source★ 2.9kDeepEvaldeepeval.comPytest-style framework for unit-testing LLM apps with metrics for hallucination, relevance, RAG quality and more.LLM EvalsOpen source★ 18.6k