vlm repositories

Trending repositories tagged vlm, ranked by trending score. Updated daily.

  1. 1
    JuneYaooo/rea-video

    Reverse-engineer any video, shot by shot: filmed, AI-generated or coded, and how to remake it. Breakdowns in the open VIDEO.md format. 逆向一切视频,逐个镜头看是拍的、AI 生成的还是代码做的,再告诉你怎么复刻;拆解结果按 VIDEO.md 格式输出。

    GitHub · Python · 11,470 stars · 1,698 forks · +737 stars in 24 hours · Trending score 5.62

  2. 2
    huggingface/transformers

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    GitHub · Python · 169,335 stars · 35,251 forks · +114 stars in 24 hours · Trending score 3.91

  3. 3
    RainBowLuoCS/Gamer

    Official Implementation of Gamer: A Generalist Vision-Language-Action Foundation Model for Long-Horizon Real-Time Game Agents

    GitHub · 1,144 stars · 22 forks · +345 stars in 24 hours · Trending score 2.73

  4. 4
    baidu-baige/LoongForge

    A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.

    GitHub · Python · 873 stars · 70 forks · +34 stars in 24 hours · Trending score 2.56

  5. 5
    zenstory-ai/video-recap-skills

    AI 视频解说 Agent 技能包:自动切镜、看画面写解说词、配音混音合成成片,可导出剪映/CapCut 草稿,无需 GPU | Agent skills for narrated video recaps & CapCut drafts

    GitHub · Python · 642 stars · 116 forks · +23 stars in 24 hours · Trending score 2.31

  6. 6
    Tencent/AngelSlim

    Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

    GitHub · Python · 1,809 stars · 200 forks · +15 stars in 24 hours · Trending score 2.27

  7. 7
    lightseekorg/tokenspeed

    TokenSpeed is a speed-of-light LLM inference engine.

    GitHub · Python · 2,944 stars · 424 forks · +8 stars in 24 hours · Trending score 2.11

  8. 8
    modelscope/evalscope

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    GitHub · Python · 3,716 stars · 586 forks · +6 stars in 24 hours · Trending score 2.08

  9. 9
    qualcomm/GenieX

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    GitHub · Go · 8,541 stars · 1,091 forks · +7 stars in 24 hours · Trending score 2.05

  10. 10
    NVIDIA-NeMo/Automodel

    🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

    GitHub · Python · 1,096 stars · 390 forks · +9 stars in 24 hours · Trending score 2.03

  11. 11
    StarTrail-org/PixelRAG

    https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

    GitHub · Python · 10,972 stars · 988 forks · +5 stars in 24 hours · Trending score 1.96

  12. 12
    sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    GitHub · Python · 38,891 stars · 10,668 forks · −155 stars in 24 hours · Trending score 1.77

  13. 13
    camUrban/PteraSoftware

    Ptera Software is a fast, easy-to-use, and open-source software package for analyzing flapping-wing flight.

    GitHub · Python · 276 stars · 71 forks · +7 stars in 24 hours · Trending score 1.60

  14. 14
    MigoXLab/LMeterX

    A general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结

    GitHub · Python · 218 stars · 20 forks · +7 stars in 24 hours · Trending score 1.45

  15. 15
    video-db/skills

    Server-side video workflows for agents: ingest, understand, search, edit, stream.

    GitHub · 151 stars · 13 forks · +3 stars in 24 hours · Trending score 1.43

  16. 16
    OmniJev/OneJev

    🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.

    GitHub · Python · 274 stars · 28 forks · 0 stars in 24 hours · Trending score 1.26

  17. 17
    Fabric-Project/Fabric

    Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer

    GitHub · Swift · 613 stars · 34 forks · +5 stars in 24 hours · Trending score 1.25

  18. 18
    WayneChou-bot/WareTwin

    Real-time 3D digital twin of an autonomous warehouse — 20 AMRs, deterministic simulation, explainable fleet scheduling, failure injection, VLM camera perception, AI Ops Copilot and what-if scenarios. React Three Fiber + FastAPI.

    GitHub · TypeScript · 165 stars · 74 forks · 0 stars in 24 hours · Trending score 1.13

  19. 19
    SoMarkAI/OXR

    An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.

    GitHub · Python · 3,544 stars · 262 forks · −68 stars in 24 hours · Trending score 0.91

  20. 20
    NVIDIA-AI-Blueprints/video-search-and-summarization

    NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

    GitHub · Python · 1,997 stars · 421 forks · 0 stars in 24 hours · Trending score 0.85

  21. 21
    telekinesis-ai/telekinesis-examples

    Telekinesis Agentic Skill Library: build AI-powered Computer Vision, Robotics and Physical AI applications.

    GitHub · 88 stars · 6 forks · +2 stars in 24 hours · Trending score 0.81

  22. 22
    NVIDIA-AI-Blueprints/Retail-Catalog-Enrichment

    A GenAI-powered catalog enrichment system that transforms basic product images into comprehensive, rich catalog

    GitHub · Python · 47 stars · 25 forks · +2 stars in 24 hours · Trending score 0.80

  23. 23
    EvolvingLMMs-Lab/lmms-eval

    One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

    GitHub · Python · 4,497 stars · 699 forks · 0 stars in 24 hours · Trending score 0.80

  24. 24
    shapsider/OmniJev

    OmniJev — multimodal finite-choice decision interface and MuJoCo embodied workbench: trajectory replays, decision probes, benchmark panels, 60s walkthrough.

    GitHub · Python · 22 stars · 0 forks · +2 stars in 24 hours · Trending score 0.72