ai-evals repositories

Trending repositories tagged ai-evals, ranked by trending score. Updated daily.

  1. 1
    microsoft/PyRIT

    Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.

    GitHub · Python · 5,011 stars · 1,104 forks · +51 stars in 24 hours · Trending score 3.46

  2. 2
    future-agi/future-agi

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    GitHub · Python · 2,285 stars · 725 forks · +1 stars in 24 hours · Trending score 1.21

  3. 3
    coval-ai/benchmarks

    Reproducible voice-AI benchmarking — TTS / STT / S2S latency and accuracy.

    GitHub · Python · 106 stars · 16 forks · +1 stars in 24 hours · Trending score 0.64

  4. 4
    ARTPARK-SAHAI-ORG/calibrate

    Core engine behind Calibrate, a framework for evaluating AI agents: speech-to-text, text-to-speech, LLM evaluation, end-to-end simulations

    GitHub · JavaScript · 24 stars · 7 forks · 0 stars in 24 hours · Trending score 0.04