agent-testing repositories
Trending repositories tagged agent-testing, ranked by trending score. Updated daily.
-
1
reticlehq/reticle
AI agents can generate code, but still struggle to understand what they build. Reticle brings Jev-style machine-native runtime perception to web & desktop applications.
GitHub · TypeScript · 1,320 stars · 267 forks · +41 stars in 24 hours · Trending score 2.99
-
2
langwatch/langwatch
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
GitHub · TypeScript · 5,050 stars · 434 forks · +4 stars in 24 hours · Trending score 1.64
-
3
najeed/ai-agent-eval-harness
The open-source MultiAgentOps evaluation and verification harness for any industry business workflow.
GitHub · Python · 48 stars · 9 forks · +3 stars in 24 hours · Trending score 1.00
-
4
langwatch/scenario
Agentic testing for agentic codebases
GitHub · TypeScript · 1,030 stars · 93 forks · 0 stars in 24 hours · Trending score 0.63
-
5
LeonEvo1103/surfaceloom
Open-source AI agent testing framework for browser and native desktop apps, with explicit tool effects, evidence, lifecycle, and trace contracts.
GitHub · TypeScript · 23 stars · 2 forks · +1 stars in 24 hours · Trending score 0.45
-
6
TaimoorKhan10/replayd
Turn failed AI agent runs into replayable regression tests. Catch regressions before you ship.
GitHub · Python · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.28
-
7
ProofAgent-ai/proofagent-harness
Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI
GitHub · Python · 40 stars · 10 forks · 0 stars in 24 hours · Trending score 0.18
-
8
samikuikka/apo
Capability testing for agent harnesses: turn expert knowledge into executable specifications, run the real agent, get a binary pass/fail verdict with tests, traces, and deliverables.
GitHub · TypeScript · 5 stars · 3 forks · 0 stars in 24 hours · Trending score 0.10
-
9
LambdaTest/rook
rook by TestMu AI: Agent Assurance from the terminal. Test how your AI agents actually behave across workflows, tools, and actions, and catch failures and vulnerabilities before they ship.
GitHub · Shell · 80 stars · 15 forks · 0 stars in 24 hours · Trending score 0.10
-
10
LambdaTest/homebrew-rook
Official Homebrew tap for rook by TestMu AI: agent assurance from the terminal. brew install lambdatest/rook/rook
GitHub · Shell · 23 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
11
vonavikon/qa-agent-evals
Acceptance testing for LLM systems via role subagents (Claude Code plugin)
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
12
DefuzeX-AI/AgentBehaviorBench
AgentBehaviorBench (ABB): A benchmark for evaluating AI agents’ ability to test other agents and detect behavioral defects.
GitHub · Python · 22 stars · 30 forks · 0 stars in 24 hours · Trending score 0.00
-
13
nano-step/eval-harness
Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance, and CI reports.
GitHub · Shell · 15 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
14
UiPath/coder_eval
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
GitHub · Python · 160 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00
-
15
automators-com/flowproof
Open-source E2E testing an AI agent records for you. Plain-language tests, recorded once on your real app (web, desktop, SAP, Citrix, AI agents), replayed on every commit with zero LLM calls.
GitHub · Rust · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
16
theagentplane/chronicle
Record-and-replay for agent decision graphs: reproduce a prod agent failure as a committed regression test, and re-run your fix without live LLM calls.
GitHub · Python · 27 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
17
arthi-arumugam-git/whatbroke
Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.
GitHub · TypeScript · 21 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
18
zariffromlatif/life-forge
Autonomous flight simulator for AI agents: co-evolutionary adversarial red-teaming with 3D MAP-Elites quality-diversity. Discovers zero-days in LLM agents before production. MCP-native.
GitHub · Python · 5 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
19
Alpha-Park/genpark-agent-chaos-injection-and-resilience-evaluator-skill
Injects synthetic latency, truncated responses, and HTTP error faults to evaluate autonomous agent self-healing resilience | GenPark: https://www.genpark.ai | LinkedIn: https://www.llinkedin.com/company/92955550
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
alphaparkinc/genpark-agent-chaos-injection-and-resilience-evaluator-skill
Injects synthetic latency, truncated responses, and HTTP error faults to evaluate autonomous agent self-healing resilience | GenPark: https://www.genpark.ai | LinkedIn: https://www.llinkedin.com/company/92955550
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00