llm-runtime repositories

Trending repositories tagged llm-runtime, ranked by trending score. Updated daily.

  1. 1
    zhangshuibai/molten

    Run a coding model at 300+ tok/s on your Mac. Native Rust + Metal inference engine for LiquidAI LFM2.5-24B-A2B (MLX 4-bit) on Apple Silicon.

    GitHub · Metal · 29 stars · 2 forks · +1 stars in 24 hours · Trending score 0.59

  2. 2
    initializ/forge

    Forge is the open-source runtime for Anthropic's Agent Skills standard — built for the agent that runs next to a service, in your environment, on infrastructure you already operate. Write a SKILL.md. Compile to a portable, hardened agent. Deploy it anywhere containers run: Kubernetes, on-prem, air-gapped, embedded in CI, or as an A2A endpoint.

    GitHub · Go · 230 stars · 17 forks · 0 stars in 24 hours · Trending score 0.23

  3. 3
    xarillian/chorus-llm

    A local LLM runtime for many-agent applications, built on llama.cpp. One model, shared inference, many agents, embedded. C++/C, Vulkan, Metal, Godot.

    GitHub · C++ · 20 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00