vlm repositories
Trending repositories tagged vlm, ranked by trending score. Updated daily.
-
1
JuneYaooo/rea-video
Reverse-engineer any video, shot by shot: filmed, AI-generated or coded, and how to remake it. Breakdowns in the open VIDEO.md format. 逆向一切视频,逐个镜头看是拍的、AI 生成的还是代码做的,再告诉你怎么复刻;拆解结果按 VIDEO.md 格式输出。
GitHub · Python · 11,470 stars · 1,698 forks · +737 stars in 24 hours · Trending score 5.62
-
2
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
GitHub · Python · 169,335 stars · 35,251 forks · +114 stars in 24 hours · Trending score 3.91
-
3
RainBowLuoCS/Gamer
Official Implementation of Gamer: A Generalist Vision-Language-Action Foundation Model for Long-Horizon Real-Time Game Agents
GitHub · 1,144 stars · 22 forks · +345 stars in 24 hours · Trending score 2.73
-
4
baidu-baige/LoongForge
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
GitHub · Python · 873 stars · 70 forks · +34 stars in 24 hours · Trending score 2.56
-
5
zenstory-ai/video-recap-skills
AI 视频解说 Agent 技能包:自动切镜、看画面写解说词、配音混音合成成片,可导出剪映/CapCut 草稿,无需 GPU | Agent skills for narrated video recaps & CapCut drafts
GitHub · Python · 642 stars · 116 forks · +23 stars in 24 hours · Trending score 2.31
-
6
Tencent/AngelSlim
Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
GitHub · Python · 1,809 stars · 200 forks · +15 stars in 24 hours · Trending score 2.27
-
7
lightseekorg/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
GitHub · Python · 2,944 stars · 424 forks · +8 stars in 24 hours · Trending score 2.11
-
8
modelscope/evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
GitHub · Python · 3,716 stars · 586 forks · +6 stars in 24 hours · Trending score 2.08
-
9
qualcomm/GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
GitHub · Go · 8,541 stars · 1,091 forks · +7 stars in 24 hours · Trending score 2.05
-
10
NVIDIA-NeMo/Automodel
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
GitHub · Python · 1,096 stars · 390 forks · +9 stars in 24 hours · Trending score 2.03
-
11
StarTrail-org/PixelRAG
https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
GitHub · Python · 10,972 stars · 988 forks · +5 stars in 24 hours · Trending score 1.96
-
12
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
GitHub · Python · 38,891 stars · 10,668 forks · −155 stars in 24 hours · Trending score 1.77
-
13
camUrban/PteraSoftware
Ptera Software is a fast, easy-to-use, and open-source software package for analyzing flapping-wing flight.
GitHub · Python · 276 stars · 71 forks · +7 stars in 24 hours · Trending score 1.60
-
14
MigoXLab/LMeterX
A general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结
GitHub · Python · 218 stars · 20 forks · +7 stars in 24 hours · Trending score 1.45
-
15
video-db/skills
Server-side video workflows for agents: ingest, understand, search, edit, stream.
GitHub · 151 stars · 13 forks · +3 stars in 24 hours · Trending score 1.43
-
16
OmniJev/OneJev
🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.
GitHub · Python · 274 stars · 28 forks · 0 stars in 24 hours · Trending score 1.26
-
17
Fabric-Project/Fabric
Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer
GitHub · Swift · 613 stars · 34 forks · +5 stars in 24 hours · Trending score 1.25
-
18
WayneChou-bot/WareTwin
Real-time 3D digital twin of an autonomous warehouse — 20 AMRs, deterministic simulation, explainable fleet scheduling, failure injection, VLM camera perception, AI Ops Copilot and what-if scenarios. React Three Fiber + FastAPI.
GitHub · TypeScript · 165 stars · 74 forks · 0 stars in 24 hours · Trending score 1.13
-
19
SoMarkAI/OXR
An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.
GitHub · Python · 3,544 stars · 262 forks · −68 stars in 24 hours · Trending score 0.91
-
20
NVIDIA-AI-Blueprints/video-search-and-summarization
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
GitHub · Python · 1,997 stars · 421 forks · 0 stars in 24 hours · Trending score 0.85
-
21
telekinesis-ai/telekinesis-examples
Telekinesis Agentic Skill Library: build AI-powered Computer Vision, Robotics and Physical AI applications.
GitHub · 88 stars · 6 forks · +2 stars in 24 hours · Trending score 0.81
-
22
NVIDIA-AI-Blueprints/Retail-Catalog-Enrichment
A GenAI-powered catalog enrichment system that transforms basic product images into comprehensive, rich catalog
GitHub · Python · 47 stars · 25 forks · +2 stars in 24 hours · Trending score 0.80
-
23
EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
GitHub · Python · 4,497 stars · 699 forks · 0 stars in 24 hours · Trending score 0.80
-
24
shapsider/OmniJev
OmniJev — multimodal finite-choice decision interface and MuJoCo embodied workbench: trajectory replays, decision probes, benchmark panels, 60s walkthrough.
GitHub · Python · 22 stars · 0 forks · +2 stars in 24 hours · Trending score 0.72