model-evaluation repositories

Trending repositories tagged model-evaluation, ranked by trending score. Updated daily.

  1. 1
    future-agi/future-agi

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    GitHub · Python · 2,288 stars · 725 forks · +2 stars in 24 hours · Trending score 1.55

  2. 2
    Blackwellboy/model-serving-minefield

    Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each.

    GitHub · Python · 177 stars · 19 forks · 0 stars in 24 hours · Trending score 1.02

  3. 3
    ml4t/diagnostic

    Signal diagnostics, statistical validation, and backtest evaluation for quantitative trading workflows.

    GitHub · Python · 50 stars · 25 forks · +2 stars in 24 hours · Trending score 0.81

  4. 4
    Andreas698/glm-5.3-uncensored

    GLM 5.3 Uncensored — 35 jailbreak prompt files, model guide and API access. One RouterHub key also covers GPT, Claude, DeepSeek, Qwen and Grok.

    GitHub · Python · 51 stars · 13 forks · +1 stars in 24 hours · Trending score 0.53

  5. 5
    ruvnet/ruv-FANN

    Neural networks and weight-space programming in Rust, JavaScript and WebAssembly. Inspect activations, edit weights, evaluate candidates, train small models, and explicitly promote or roll back revisions.

    GitHub · Rust · 394 stars · 109 forks · 0 stars in 24 hours · Trending score 0.50

  6. 6
    kevinoshaughnessy/subversionbench

    Agentic evaluation of misalignment, scheming and evaluation awareness in LLM agents. Scenario text encoded at rest to resist training-data contamination.

    GitHub · Python · 6 stars · 0 forks · +1 stars in 24 hours · Trending score 0.42

  7. 7
    ulyssestenn/omt

    Ollama Model Test - Figure out the best model for the task

    GitHub · Python · 50 stars · 1 forks · 0 stars in 24 hours · Trending score 0.30

  8. 8
    Folkbench/folkbench

    AI API 中转站推荐与评测:中转站排行榜、中转站检测、Claude / GPT / Gemini 中转站对比 · AI API relay rankings · Folkbench Switch for Claude Code, Codex & Gemini CLI

    GitHub · TypeScript · 3,131 stars · 20 forks · −745 stars in 24 hours · Trending score 0.18

  9. 9
    Anil-matcha/awesome-abliterated-llms

    Developer guide to deployed abliterated LLM endpoints on Muapi, with model comparisons and API examples.

    GitHub · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.17

  10. 10
    Burakkylmz/ml-labs

    A hands-on Machine Learning laboratory built with Python, Scikit-learn, Pandas, NumPy, JupyterLab, Docker, and uv. Features reproducible, step-by-step labs covering data analysis, statistics, EDA, preprocessing, model training, evaluation, and forecasting.

    GitHub · Jupyter Notebook · 14 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09

  11. 11
    Claire1217/benchmark-radar

    Track newly released AI benchmarks and their real-world adoption momentum.

    GitHub · HTML · 11 stars · 0 forks · −1 stars in 24 hours · Trending score 0.09

  12. 12
    npstorey/civic-ai-tools

    Open-source platform connecting AI assistants to government open data — MCP server, curated civic MCP directory, and anti-hallucination framework for all 559 Socrata portals

    GitHub · TypeScript · 48 stars · 18 forks · 0 stars in 24 hours · Trending score 0.09

  13. 13
    fstandhartinger/model-market-comparison

    Benchmark Heaven: AI model benchmarks with sources and modeled costs, plus the JevBench and ImageJevBench decision model leaderboards.

    GitHub · HTML · 23 stars · 6 forks · 0 stars in 24 hours · Trending score 0.08

  14. 14
    saccofrancesco/deepshot

    AI-powered NBA game outcome predictor that uses advanced team stats and trend-based features to forecast winners and track model performance

    GitHub · Jupyter Notebook · 175 stars · 22 forks · 0 stars in 24 hours · Trending score 0.08

  15. 15
    samsarone/samsar

    Full-stack Generative Video Cloud

    GitHub · JavaScript · 58 stars · 10 forks · 0 stars in 24 hours · Trending score 0.08

  16. 16
    routerhubSI/glm-5.3-abliterated

    GLM 5.3 abliterated or uncensored API access with RouterHub. Browse 35 jailbreak prompt links, compare GLM models, and find SDK examples, coding-tool setup, pricing, and evaluation guides.

    GitHub · Python · 181 stars · 38 forks · −168 stars in 24 hours · Trending score 0.06

  17. 17
    umstek/zero-shot-ie-bench

    60 zero-shot information-extraction & classification systems (57 benchmarked) across 32 families — extractor encoders, zero-shot classifiers, cross-encoder rerankers, typed-decision engines — local, Ollaya-served & hosted (OpenRouter, Cloudflare, TypeSafe); measured accuracy/latency/cost benchmarks, 9-language suite, web UI

    GitHub · Python · 8 stars · 2 forks · 0 stars in 24 hours · Trending score 0.04

  18. 18
    Guillain-RDCDE/FLAC_Detective

    Catches fake hi-fi: music sold as lossless that was secretly compressed. It only says so when the proof is overwhelming.

    GitHub · Python · 25 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    billyrdavis1985-bot/hf-critic

    Fine-tuning open-source LLMs into reasoning-process critics — QLoRA, held-out eval, controlled cross-model comparison. Part of the IRMB program.

    GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    suncityldp/zx-bench

    A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.

    GitHub · TypeScript · 158 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    AdArya125/Primer-to-Machine-Learning

    'Primer to Machine Learning' is a comprehensive guide covering essential topics in machine learning, including statistics, data preprocessing, supervised and unsupervised learning, neural networks, deep learning, NLP, time series analysis, and reinforcement learning. Perfect for beginners and intermediates.

    GitHub · Jupyter Notebook · 42 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    To3akaRin/VLMForge

    Evaluate visual models on your own images, JSON Schema, and production constraints with LangGraph, Pareto analysis, and a no-key Replay demo.

    GitHub · Python · 101 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    Brainchip-Inc/brainchip_devhub

    Code and tutorials for training and deploying models on Akida

    GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    LalaGa-1119/jiazuo-atelier

    甲作 Atelier:手机端 AI 美甲推荐与虚拟试戴;仓库公开其中的轻量评测工作台。

    GitHub · TypeScript · 22 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00