multimodal-llm repositories

Trending repositories tagged multimodal-llm, ranked by trending score. Updated daily.

  1. 1
    Tencent/WeMM-Video

    WeMM-Video is a family of omni-modal foundation models by WeChat Vision at Tencent, excelling in omni-modal video understanding and reasoning while maintaining top-tier capabilities across general audio, image, and text.

    GitHub · Python · 88 stars · 4 forks · +30 stars in 24 hours · Trending score 1.67

  2. 2
    NVIDIA/sports-intelligence-playbooks

    This repository provides a starter kit for sports intelligence built on NVIDIA AI stack: playbooks, training recipes, and inference for Multimodal Language Models.

    GitHub · Python · 95 stars · 12 forks · +2 stars in 24 hours · Trending score 1.43

  3. 3
    Tencent/WeMM-Embedding

    WeMM-Embedding is a family of universal multimodal embedding models by the WeChat Vision Team at Tencent, supporting multimodal understanding and retrieval.

    GitHub · Python · 1,824 stars · 125 forks · +2 stars in 24 hours · Trending score 1.01

  4. 4
    monurcan/simit_paper

    SIMIT: Self-Improving Vision-Language Models via Imagination at Test-Time, official implementation of the paper

    GitHub · Python · 10 stars · 0 forks · +2 stars in 24 hours · Trending score 0.80

  5. 5
    hec-ovi/vllm-awq4-qwen

    vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-stream, vision, tool calling, 256K context, OpenAI-compatible, Docker. Matches DGX Spark FP8+DFlash+MTP at a third of the cost. No CUDA.

    GitHub · Python · 53 stars · 5 forks · 0 stars in 24 hours · Trending score 0.59

  6. 6
    sirkosophia/Where-OPD

    Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes. Official implementation.

    GitHub · Python · 18 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46

  7. 7
    yxwang1215/Glance-ETD

    Glance, then Select: Evidence-Tempered Visual Token Selection for Extremely Compressed Multimodal LLMs

    GitHub · Python · 9 stars · 0 forks · +1 stars in 24 hours · Trending score 0.41

  8. 8
    HarryHsing/OmniAgent

    OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewer frames on LVBench.

    GitHub · Python · 90 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    HVision-NKU/OraRL

    🎬 OraRL — Annotations as Rollouts for efficient, scalable reinforcement learning of unified video MLLMs.

    GitHub · Python · 159 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    v-modal/vmodal_sdk_robotics

    Robotics vision SDK

    GitHub · Python · 253 stars · 5 forks · −195 stars in 24 hours · Trending score -0.03