rag-evaluation repositories
Trending repositories tagged rag-evaluation, ranked by trending score. Updated daily.
-
1
JEen-wang/Adaptive-rag
按问题复杂度自动分流的电商客服 RAG:简单问题直接回答;复杂问题经过多跳检索并自我纠错;查单、退改通过工具调用完成,且高风险写操作必须先经人工确认。基于 FastAPI 和 LangGraph,混合检索并附带引用,内置离线评测与 Prometheus 指标。涵盖简历写法和项目面试拷打
GitHub · Python · 285 stars · 36 forks · +95 stars in 24 hours · Trending score 3.38
-
2
skygazer42/MimirQ
中文优先的企业 RAG 知识库:可控解析、治理、切块、混合检索、重排、引用、图谱、评测与 Dify 接入。
GitHub · Python · 614 stars · 105 forks · +22 stars in 24 hours · Trending score 2.29
-
3
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
GitHub · Python · 5,969 stars · 575 forks · +17 stars in 24 hours · Trending score 2.26
-
4
future-agi/future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
GitHub · Python · 2,286 stars · 724 forks · +1 stars in 24 hours · Trending score 1.21
-
5
dolev31/lasagna
Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.
GitHub · Python · 37 stars · 14 forks · 0 stars in 24 hours · Trending score 0.32
-
6
OpenAgentHQ/openagent-eval
Local-first evaluation framework for RAG systems and AI Agents. 18+ metrics, CLI + SDK, framework-agnostic. The pytest of AI evaluation.
GitHub · Python · 16 stars · 32 forks · 0 stars in 24 hours · Trending score 0.31
-
7
ggozad/haiku.rag
Agentic RAG for local and self-hosted document search: hybrid retrieval, reranking and multimodal RAG on embedded LanceDB, with Docling parsing and an MCP server
GitHub · Python · 667 stars · 62 forks · 0 stars in 24 hours · Trending score 0.19
-
8
HosseinHeydari2004/RAG-Tutorial-From-Zero-to-Advanced
A repository that teaches Rag concepts from scratch with coding.
GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
9
tonydzi/verbatim-citation-gate
Catch fabricated RAG citations before they reach the user: a zero-token verbatim gate + a burden-of-proof judge, framework-agnostic.
GitHub · Python · 6 stars · 4 forks · 0 stars in 24 hours · Trending score 0.09
-
10
lizhiyao/oh-my-knowledge
OMK helps people and agents build, maintain, and reuse valuable knowledge from real work and collaboration, with readable content, traceable sources, and revision history for future tasks.
GitHub · TypeScript · 25 stars · 5 forks · 0 stars in 24 hours · Trending score 0.07
-
11
techtheist/knowledgedrift
KnowledgeDrift - Second Generation AI Memory benchmark
GitHub · Rust · 17 stars · 1 forks · 0 stars in 24 hours · Trending score 0.06
-
12
dokimos-dev/dokimos
LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.
GitHub · Java · 64 stars · 6 forks · 0 stars in 24 hours · Trending score 0.03
-
13
vectara/open-rag-eval
RAG evaluation without the need for "golden answers"
GitHub · Python · 427 stars · 34 forks · 0 stars in 24 hours · Trending score 0.00
-
14
SasanLabs/LLMForge
LLMForge is probably the most modern AI vulnerability lab for OWASP VulnerableApp — real-LLM-backed labs for prompt injection, LLM-orchestrated BOLA, and RAG attacks.
GitHub · Python · 16 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00
-
15
neskuchny/Tessbrain
The company brain: it remembers, thinks, and does the work. Meetings become a typed graph with sources — it answers with citations, spots divergence on its own, and returns reports, automations and specs for AI executors.
GitHub · Python · 8 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
16
w93139/rag-eval-workflow
A framework-neutral RAG evaluation skill with golden sets, regression gates, and script-domain checks.
GitHub · Python · 10 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
17
TrustifAI/typed_evals
Fast, typed Python framework for Jev-as-a-Judge/Decision-model evaluation for LLMs, RAG, and AI agents along with human-label calibration.
GitHub · Python · 19 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
18
sgyaqing/RAG-BenchLab
Build RAG evaluation testsets from documents and benchmark RAG systems.
GitHub · Python · 16 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00