The week in brief

Behind it, Langfuse (+311) and Opik (+164) followed.

10 new tools joined the directory this week: SO-Arena, QuillBot, ZeroGPT, Vals AI and MKA (Multimodal Knowledge Agent) and 5 more.

On Hacker News, “Perplexity Decider v1.3: Training, eval, and use cases” drew the most attention in this space (147 points, 26 comments). Among listed tools, Artificial Analysis's site was linked from 90 Hacker News stories over the past 90 days, more than any other tool here.

In research, “SO-Arena: Benchmarking the Capability Spectrum and Reliability of System One Models” collected the most upvotes on Hugging Face Daily Papers this week (85). Among new GitHub repositories created in the past 7 days, jackson-cmd/risk-aware-trading-agents leads with 201 stars.

Biggest GitHub star gainers

GitHub star counts for the 42 open source tools we track, compared between Nov 9, 2026 and Nov 16, 2026 (175 hours apart).

Star gains, Nov 9, 2026 to Nov 16, 2026
ToolStars beforeStars afterGainChange
Promptfoo26,98127,322+3411.26%
Langfuse37,18537,496+3110.84%
Opik23,27823,442+1640.70%
DeepEval19,38119,512+1310.68%
Aider Leaderboards50,03050,143+1130.23%
PyRIT4,7734,880+1072.24%
Arize Phoenix12,21112,317+1060.87%
garak9,96210,051+890.89%

New listings this week

Tools added to the directory this week
ToolCategoryListed
SO-ArenaBenchmarksNov 14, 2026
QuillBotIntegrity & DetectionNov 14, 2026
ZeroGPTIntegrity & DetectionNov 13, 2026
Vals AILeaderboardsNov 13, 2026
MKA (Multimodal Knowledge Agent)BenchmarksNov 13, 2026
Jev Decision IndexLeaderboardsNov 11, 2026
Harness LeaderboardLeaderboardsNov 10, 2026
CopyleaksIntegrity & DetectionNov 10, 2026
Winston AIIntegrity & DetectionNov 09, 2026
Jev (TypeSafe AI)LLM EvalsNov 09, 2026

Most discussed on Hacker News

The highest scoring Hacker News stories in this space during the week.

Listed tools with the most Hacker News links

Hacker News stories linking to each tool's own website over the past 90 days.

Notable new papers

The most upvoted papers on Hugging Face Daily Papers and the newest relevant arXiv preprints from this week.

  1. SO-Arena: Benchmarking the Capability Spectrum and Reliability of System One ModelsHF Daily Papers · Nov 10, 2026 · 85 upvotes
  2. VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in BlenderHF Daily Papers · Nov 10, 2026 · 83 upvotes
  3. Actor, Judge, or Teacher? Understanding Decision Models in Long Horizon AgentsHF Daily Papers · Nov 11, 2026 · 36 upvotes
  4. TTB: Test time Baking for Efficient Rendering of Decoder only View Synthesis ModelsHF Daily Papers · Nov 11, 2026 · 26 upvotes
  5. Do Underwater Image Quality Metrics Agree with Human Perception? A Benchmark with Human Choices, Simple Edits and Generative DriftHF Daily Papers · Nov 12, 2026 · 11 upvotes
  6. WeightBench: Evaluating Language Models as Weight-Space ProgrammersarXiv · Nov 13, 2026 · Aayush Marasini, Barsat Khadka, Nick Rahimi · cs.LG
  7. MeReader: An Offline, Privacy Preserving, Progress-Aware AI Assistant for Narrative eBook ReadingarXiv · Nov 13, 2026 · Mohammed Efaz, Udo Bub, Itilekha Podder · cs.IR
  8. TradeGauntlet: Evaluating Compliance Controls for Autonomous Trading AgentsarXiv · Nov 13, 2026 · Sandip Nandi, Aishwarya Bose, Apurba Bose et al. · cs.MA
  9. Evaluating Feedback-Driven Black Box Processes via Stochastic Modeling and SimulationarXiv · Nov 13, 2026 · Mengfan Xu, Zirui Liu, Juan Zhai et al. · cs.SE
  10. Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent EvaluationarXiv · Nov 13, 2026 · Disha Sheshanarayana, Sai Linisha Reddy Goli · cs.CL

New GitHub repos in LLM evaluation

Repositories created in the 7 days before Nov 16, 2026, ranked by stars.

New repositories ranked by GitHub stars
RepositoryStarsLanguageDescription
jackson-cmd/risk-aware-trading-agents201PythonAI trading agents for US stocks with news backtesting that can't see the future: a public LLM trading agent leaderboard (rta-bench-1), frozen point in time 2020/2022/2026 markets (prices, VIX, news),
Sid00011/Flagwake6PythonA free, offline, recheckable test of how an AI defender behaves during a security incident, scored with business cost.
chessifyme/gmbench4PythonBenchmark of how well AI and LLM agents explain chess: positions, moves and plans, graded against expert answer keys
ranajahanzaib/finetuning-regression-tester4PythonEvaluate fine tuned language models for task gains and behavioral regressions with paired tests.
DawitLemmaBalcha/code-review-bench4PythonReview benchmark for model generated code patches: six tasks across Python, JavaScript, Go and Java with hidden tests, a fixed rubric and a Docker runner.
anoopcodehack/MedThread4TypeScriptMedThread , A clinical grade data synthesis platform that transforms heterogeneous, unstructured medical documents into a verifiable, dated longitudinal health timeline, with zero hallucinations, str
xzx34/RewardAudit3PythonAutomated testing of rule based verifiers (checkers, reward functions) for LLM evaluation and RLVR. No model, no GPU.
aliraza2025/receipts3PythonEvidence first PM skills for Claude Code, Codex, and Cursor: make PRDs, metrics, experiments, AI evals, and launch copy show their receipts.

How we compile this report

Every figure comes from a public source: star counts from the GitHub API, story scores and links from Hacker News (via Algolia), papers from arXiv and Hugging Face Daily Papers, and new repositories from GitHub search. Hacker News link counts include stories whose link points to the tool's own domain. Listing dates are the day a tool joined TrueIQ. Numbers are shown as recorded; if a figure is unavailable, it is left out rather than estimated.