mobile-inference repositories

Trending repositories tagged mobile-inference, ranked by trending score. Updated daily.

  1. 1
    cactus-compute/engine

    2bit quants, kernels and runtime for consumer devices.

    GitHub · C++ · 6,199 stars · 515 forks · +19 stars in 24 hours · Trending score 1.95

  2. 2
    google/XNNPACK

    High-efficiency floating-point neural network inference operators for mobile, server, and Web

    GitHub · C · 2,507 stars · 595 forks · +4 stars in 24 hours · Trending score 1.67

  3. 3
    software-mansion/react-native-executorch

    High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime

    GitHub · TypeScript · 1,794 stars · 102 forks · +1 stars in 24 hours · Trending score 0.86

  4. 4
    software-mansion-labs/react-native-executorch-gallery

    On-device AI examples for React Native ExecuTorch - computer vision, LLMs, speech transcription & more.

    GitHub · TypeScript · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  5. 5
    Abhinivesh2729/Thinai

    Thinai is a privacy-focused Android app that runs small language models locally on your device, with a local API for integrating and accessing on-device AI inference.

    GitHub · Dart · 25 stars · 17 forks · 0 stars in 24 hours · Trending score 0.04

  6. 6
    AndreiiArhire/LightMIS

    LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decoder

    GitHub · Python · 34 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00