cache-compression repositories

Trending repositories tagged cache-compression, ranked by trending score. Updated daily.

  1. 1
    cryptopoly/ChaosEngineAI

    Local AI workstation: chat by voice or text, transcribe, generate images and video (with sound on Apple Silicon), benchmark and serve open-weight models. MLX, llama.cpp, vLLM and MTPLX backends, DFlash/DDTree speculative decoding, TurboQuant and TriAttention cache compression.

    GitHub · Python · 26 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09