ai-evals repositories
Trending repositories tagged ai-evals, ranked by trending score. Updated daily.
-
1
microsoft/PyRIT
Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.
GitHub · Python · 5,011 stars · 1,104 forks · +51 stars in 24 hours · Trending score 3.46
-
2
future-agi/future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
GitHub · Python · 2,285 stars · 725 forks · +1 stars in 24 hours · Trending score 1.21
-
3
coval-ai/benchmarks
Reproducible voice-AI benchmarking — TTS / STT / S2S latency and accuracy.
GitHub · Python · 106 stars · 16 forks · +1 stars in 24 hours · Trending score 0.64
-
4
ARTPARK-SAHAI-ORG/calibrate
Core engine behind Calibrate, a framework for evaluating AI agents: speech-to-text, text-to-speech, LLM evaluation, end-to-end simulations
GitHub · JavaScript · 24 stars · 7 forks · 0 stars in 24 hours · Trending score 0.04