agent-testing repositories

Trending repositories tagged agent-testing, ranked by trending score. Updated daily.

  1. 1
    reticlehq/reticle

    AI agents can generate code, but still struggle to understand what they build. Reticle brings Jev-style machine-native runtime perception to web & desktop applications.

    GitHub · TypeScript · 1,320 stars · 267 forks · +41 stars in 24 hours · Trending score 2.99

  2. 2
    langwatch/langwatch

    Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

    GitHub · TypeScript · 5,050 stars · 434 forks · +4 stars in 24 hours · Trending score 1.64

  3. 3
    najeed/ai-agent-eval-harness

    The open-source MultiAgentOps evaluation and verification harness for any industry business workflow.

    GitHub · Python · 48 stars · 9 forks · +3 stars in 24 hours · Trending score 1.00

  4. 4
    langwatch/scenario

    Agentic testing for agentic codebases

    GitHub · TypeScript · 1,030 stars · 93 forks · 0 stars in 24 hours · Trending score 0.63

  5. 5
    LeonEvo1103/surfaceloom

    Open-source AI agent testing framework for browser and native desktop apps, with explicit tool effects, evidence, lifecycle, and trace contracts.

    GitHub · TypeScript · 23 stars · 2 forks · +1 stars in 24 hours · Trending score 0.45

  6. 6
    TaimoorKhan10/replayd

    Turn failed AI agent runs into replayable regression tests. Catch regressions before you ship.

    GitHub · Python · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.28

  7. 7
    ProofAgent-ai/proofagent-harness

    Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI

    GitHub · Python · 40 stars · 10 forks · 0 stars in 24 hours · Trending score 0.18

  8. 8
    samikuikka/apo

    Capability testing for agent harnesses: turn expert knowledge into executable specifications, run the real agent, get a binary pass/fail verdict with tests, traces, and deliverables.

    GitHub · TypeScript · 5 stars · 3 forks · 0 stars in 24 hours · Trending score 0.10

  9. 9
    LambdaTest/rook

    rook by TestMu AI: Agent Assurance from the terminal. Test how your AI agents actually behave across workflows, tools, and actions, and catch failures and vulnerabilities before they ship.

    GitHub · Shell · 80 stars · 15 forks · 0 stars in 24 hours · Trending score 0.10

  10. 10
    LambdaTest/homebrew-rook

    Official Homebrew tap for rook by TestMu AI: agent assurance from the terminal. brew install lambdatest/rook/rook

    GitHub · Shell · 23 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  11. 11
    vonavikon/qa-agent-evals

    Acceptance testing for LLM systems via role subagents (Claude Code plugin)

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  12. 12
    DefuzeX-AI/AgentBehaviorBench

    AgentBehaviorBench (ABB): A benchmark for evaluating AI agents’ ability to test other agents and detect behavioral defects.

    GitHub · Python · 22 stars · 30 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    nano-step/eval-harness

    Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance, and CI reports.

    GitHub · Shell · 15 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    UiPath/coder_eval

    Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.

    GitHub · Python · 160 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    automators-com/flowproof

    Open-source E2E testing an AI agent records for you. Plain-language tests, recorded once on your real app (web, desktop, SAP, Citrix, AI agents), replayed on every commit with zero LLM calls.

    GitHub · Rust · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    theagentplane/chronicle

    Record-and-replay for agent decision graphs: reproduce a prod agent failure as a committed regression test, and re-run your fix without live LLM calls.

    GitHub · Python · 27 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    arthi-arumugam-git/whatbroke

    Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.

    GitHub · TypeScript · 21 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    zariffromlatif/life-forge

    Autonomous flight simulator for AI agents: co-evolutionary adversarial red-teaming with 3D MAP-Elites quality-diversity. Discovers zero-days in LLM agents before production. MCP-native.

    GitHub · Python · 5 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    Alpha-Park/genpark-agent-chaos-injection-and-resilience-evaluator-skill

    Injects synthetic latency, truncated responses, and HTTP error faults to evaluate autonomous agent self-healing resilience | GenPark: https://www.genpark.ai | LinkedIn: https://www.llinkedin.com/company/92955550

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    alphaparkinc/genpark-agent-chaos-injection-and-resilience-evaluator-skill

    Injects synthetic latency, truncated responses, and HTTP error faults to evaluate autonomous agent self-healing resilience | GenPark: https://www.genpark.ai | LinkedIn: https://www.llinkedin.com/company/92955550

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00