multimodal-llm repositories
Trending repositories tagged multimodal-llm, ranked by trending score. Updated daily.
-
1
Tencent/WeMM-Video
WeMM-Video is a family of omni-modal foundation models by WeChat Vision at Tencent, excelling in omni-modal video understanding and reasoning while maintaining top-tier capabilities across general audio, image, and text.
GitHub · Python · 88 stars · 4 forks · +30 stars in 24 hours · Trending score 1.67
-
2
NVIDIA/sports-intelligence-playbooks
This repository provides a starter kit for sports intelligence built on NVIDIA AI stack: playbooks, training recipes, and inference for Multimodal Language Models.
GitHub · Python · 95 stars · 12 forks · +2 stars in 24 hours · Trending score 1.43
-
3
Tencent/WeMM-Embedding
WeMM-Embedding is a family of universal multimodal embedding models by the WeChat Vision Team at Tencent, supporting multimodal understanding and retrieval.
GitHub · Python · 1,824 stars · 125 forks · +2 stars in 24 hours · Trending score 1.01
-
4
monurcan/simit_paper
SIMIT: Self-Improving Vision-Language Models via Imagination at Test-Time, official implementation of the paper
GitHub · Python · 10 stars · 0 forks · +2 stars in 24 hours · Trending score 0.80
-
5
hec-ovi/vllm-awq4-qwen
vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-stream, vision, tool calling, 256K context, OpenAI-compatible, Docker. Matches DGX Spark FP8+DFlash+MTP at a third of the cost. No CUDA.
GitHub · Python · 53 stars · 5 forks · 0 stars in 24 hours · Trending score 0.59
-
6
sirkosophia/Where-OPD
Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes. Official implementation.
GitHub · Python · 18 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46
-
7
yxwang1215/Glance-ETD
Glance, then Select: Evidence-Tempered Visual Token Selection for Extremely Compressed Multimodal LLMs
GitHub · Python · 9 stars · 0 forks · +1 stars in 24 hours · Trending score 0.41
-
8
HarryHsing/OmniAgent
OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewer frames on LVBench.
GitHub · Python · 90 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
9
HVision-NKU/OraRL
🎬 OraRL — Annotations as Rollouts for efficient, scalable reinforcement learning of unified video MLLMs.
GitHub · Python · 159 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
10
v-modal/vmodal_sdk_robotics
Robotics vision SDK
GitHub · Python · 253 stars · 5 forks · −195 stars in 24 hours · Trending score -0.03