TrueIQ.si
Submit a tool

DeepEval

deepeval.com · LLM Evals

Open source

Pytest-style framework for unit-testing LLM apps with metrics for hallucination, relevance, RAG quality and more.

#pytest#metrics#rag#llm-as-judge
Visit DeepEval ↗GitHub ↗

About the LLM Evals category

Frameworks and platforms for testing language models and LLM applications — from academic benchmark harnesses to CI-friendly unit tests and LLM-as-judge scoring.

DeepEval is one of 15 llm evals tools indexed on TrueIQ. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All LLM Evals →
Ragasragas.ioLibrary of metrics and synthetic test-set generation for evaluating retrieval-augmented generation pipelines.LLM EvalsOpen source★ 15.9kGiskardgiskard.aiTesting library and platform that scans AI agents and models for hallucinations, bias and security issues.LLM EvalsOpen source★ 5.9kPromptfoopromptfoo.devDeveloper CLI for testing prompts and models with assertions, side-by-side comparisons and automated red-teaming in CI.LLM EvalsOpen source★ 25.7kEvidentlyevidentlyai.comOpen-source library for evaluating, testing and monitoring ML and LLM systems, from data drift to response quality.LLM EvalsOpen source★ 8kOpenCompassopencompass.org.cnComprehensive evaluation platform from Shanghai AI Lab supporting many models, datasets and a public leaderboard.LLM EvalsOpen source★ 7.5kOpenAI Evalsgithub.comFramework and open registry of evaluations for testing language models and the systems built on them.LLM EvalsOpen source★ 19.6k