npu repositories

Trending repositories tagged npu, ranked by trending score. Updated daily.

  1. 1
    AbrahamPaulJ/nightmare-mobile

    On-device, ComfyUI-style node graph for image/video diffusion on Android. Run MiniMax H3 and WAN 2.2 14B on the Qualcomm Hexagon NPU. SD1.5, SDXL, Flux, Z-Image, Anima, Qwen Image 2.1, Krea 2 & MOSS Image. Inpainting, outpainting, ControlNet, LoRA, IP-Adapter & LivePortrait. Fully offline, no server, no account.

    GitHub · Kotlin · 282 stars · 23 forks · +33 stars in 24 hours · Trending score 2.64

  2. 2
    lemonade-sdk/lemonade

    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

    GitHub · C++ · 6,259 stars · 571 forks · +8 stars in 24 hours · Trending score 2.23

  3. 3
    ROCm/FastFlowLM

    Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    GitHub · C++ · 2,072 stars · 181 forks · +10 stars in 24 hours · Trending score 2.04

  4. 4
    MicroPerceptron/virtio-accel

    Transport-neutral, vendor-agnostic virtual accelerator devices. First class cross-platform NPU backend support for Apple, Intel, AMD, Qualcomm devices, as well as Vulkan for cross-platform GPU support.

    GitHub · Rust · 24 stars · 3 forks · +6 stars in 24 hours · Trending score 1.58

  5. 5
    ayanoby/hexanima

    Offline anime image generation on the Snapdragon 8 Gen 1 NPU (Hexagon V69), no root. Android app.

    GitHub · C++ · 29 stars · 6 forks · +4 stars in 24 hours · Trending score 1.45

  6. 6
    jia1217/vigenflow

    VigenFlow runs generative diffusion models fully on-device using the AMD Ryzen AI NPU.

    GitHub · C++ · 29 stars · 4 forks · +4 stars in 24 hours · Trending score 1.25

  7. 7
    jwkim04/tesseract-npu

    A full-stack, open-source NPU for LLM inference.

    GitHub · C++ · 25 stars · 3 forks · +2 stars in 24 hours · Trending score 1.24

  8. 8
    Xilinx/mlir-aie

    A close-to-metal Python API for programming AMD Ryzen™ AI NPUs (AI Engines), built on an open-source MLIR-based compiler toolchain.

    GitHub · C · 719 stars · 207 forks · +3 stars in 24 hours · Trending score 1.21

  9. 9
    microsoft/ai-dev-gallery

    An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

    GitHub · C# · 1,519 stars · 229 forks · +1 stars in 24 hours · Trending score 1.21

  10. 10
    ModelEngine-Group/unified-cache-management

    Persist and reuse KV Cache to speedup your LLM.

    GitHub · C++ · 361 stars · 138 forks · +2 stars in 24 hours · Trending score 1.18

  11. 11
    justADeni/intel-npu-llm

    A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)

    GitHub · Python · 52 stars · 5 forks · +4 stars in 24 hours · Trending score 1.15

  12. 12
    ModelCloud/GPTQModel

    LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

    GitHub · Python · 1,294 stars · 221 forks · +2 stars in 24 hours · Trending score 1.11

  13. 13
    DEEPX-AI/dx-all-suite

    DEEPX NPU SDK (DXNN) for edge AI: compile, quantize and deploy ONNX models on DEEPX NPUs

    GitHub · Python · 79 stars · 23 forks · 0 stars in 24 hours · Trending score 0.95

  14. 14
    zmxhot/InstantCaption

    Free offline AI translator for Android: low-latency speech translation, live captions and floating subtitles powered by local LLMs. 免费离线 AI 同声传译 · 本地大模型 · 低延迟字幕。NPU integration in source; public APK uses CPU models.

    GitHub · Java · 28 stars · 1 forks · +1 stars in 24 hours · Trending score 0.86

  15. 15
    1bit-MONSTER/engine

    One binary to rule them all: model-agnostic local LLM inference for AMD Strix Halo (Ryzen AI MAX+ 395) on Linux. Radeon 8060S iGPU (gfx1151) via HRX + our HIP kernels, XDNA 2 NPU via our NPU runtime, inside Lemonade Server with an OpenAI-compatible API. Qwen3.8, ZAYA1, BitNet b1.58, any GGUF. Apache-2.0.

    GitHub · C++ · 10 stars · 2 forks · +1 stars in 24 hours · Trending score 0.69

  16. 16
    shen-shanshan/cs-self-learning

    This repo is used for archiving my notes, codes and materials of cs learning.

    GitHub · Jupyter Notebook · 103 stars · 6 forks · 0 stars in 24 hours · Trending score 0.67

  17. 17
    pccxai/pccx-FPGA-NPU-LLM-kv260

    PCCX v002 KV260 board/model integration and verification, consuming a pinned reusable core. Operated by Altifigence.

    GitHub · Python · 21 stars · 7 forks · 0 stars in 24 hours · Trending score 0.63

  18. 18
    istitov/stuff

    Useful Gentoo overlay: curated ebuilds, AI, tools & science

    GitHub · Shell · 48 stars · 22 forks · +1 stars in 24 hours · Trending score 0.55

  19. 19
    oneclickvirt/oneclickvirt

    Universal Virtualization Management Platform 可扩展的通用虚拟化管理平台,支持 Proxmox VE / LXD (GPU) / Incus (GPU) / Docker / Podman / Containerd / Qemu / Kubevirt

    GitHub · Go · 384 stars · 61 forks · 0 stars in 24 hours · Trending score 0.40

  20. 20
    Xilinx/XRT

    Run Time for AIE and FPGA based platforms

    GitHub · C++ · 695 stars · 553 forks · 0 stars in 24 hours · Trending score 0.33

  21. 21
    Hal0ai/hal0

    Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

    GitHub · Python · 87 stars · 12 forks · 0 stars in 24 hours · Trending score 0.32

  22. 22
    datawhalechina/torch-rechub

    A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

    GitHub · Jupyter Notebook · 1,243 stars · 162 forks · 0 stars in 24 hours · Trending score 0.30

  23. 23
    gregordinary/ggml-rocket

    Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU

    GitHub · C++ · 28 stars · 4 forks · 0 stars in 24 hours · Trending score 0.28

  24. 24
    Kreuzhofen/hk-npu-studio

    HK NPU STUDIO — Local AI for Snapdragon® PCs. NPU-accelerated image generation for Windows 11 ARM64. Featuring Phoenix Boost.

    GitHub · Python · 19 stars · 1 forks · 0 stars in 24 hours · Trending score 0.24