multimodal repositories

Trending repositories tagged multimodal, ranked by trending score. Updated daily.

  1. 1
    bojieli/ai-agent-book

    《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

    GitHub · Python · 58,941 stars · 6,920 forks · +229 stars in 24 hours · Trending score 4.59

  2. 2
    microsoft/AesCode

    Aesthetic code generation with decoupled cross-modal rewards: turning prompts into editable, verifiable HTML/CSS infographics, with image generators as aesthetic guidance.

    GitHub · Python · 284 stars · 10 forks · +201 stars in 24 hours · Trending score 3.92

  3. 3
    Mintplex-Labs/anything-llm

    Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

    GitHub · JavaScript · 68,473 stars · 7,726 forks · +67 stars in 24 hours · Trending score 3.61

  4. 4
    HUANGCHIHHUNGLeo/claude-real-video

    Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.

    GitHub · Python · 2,328 stars · 208 forks · +120 stars in 24 hours · Trending score 3.57

  5. 5
    vllm-project/vllm-omni

    A framework for efficient model inference with omni-modality models

    GitHub · Python · 7,876 stars · 2,167 forks · +38 stars in 24 hours · Trending score 3.35

  6. 6
    sgl-project/sglang-omni

    High Performance Serving Runtime For Interactive Super Intelligence System

    GitHub · Python · 1,876 stars · 778 forks · +43 stars in 24 hours · Trending score 3.29

  7. 7
    screenpipe/screenpipe

    YC (S26) | Screenpipe finds the work worth automating | Continuously record computer work locally, discover recurring workflows, and hand the result to any agent you already use.

    GitHub · Rust · 22,488 stars · 2,311 forks · +46 stars in 24 hours · Trending score 3.20

  8. 8
    Neywa-Labs/mlx-audio

    A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

    GitHub · Python · 8,306 stars · 800 forks · +37 stars in 24 hours · Trending score 2.83

  9. 9
    verl-project/verl-omni

    Multimodal RL training framework for diffusion & omni models

    GitHub · Python · 1,556 stars · 337 forks · +17 stars in 24 hours · Trending score 2.66

  10. 10
    ARahim3/DigUp

    Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

    GitHub · Swift · 6,484 stars · 518 forks · +19 stars in 24 hours · Trending score 2.58

  11. 11
    Zen4-bit/Proxima

    Multi-AI MCP Server - Connect ChatGPT, Claude, Gemini & Perplexity to your coding tools without any API

    GitHub · JavaScript · 1,219 stars · 171 forks · +22 stars in 24 hours · Trending score 2.44

  12. 12
    modelscope/ms-swift

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

    GitHub · Python · 16,136 stars · 1,820 forks · +11 stars in 24 hours · Trending score 2.41

  13. 13
    rerun-io/rerun

    Visualize, query, and stream to train on multimodal robotics data.

    GitHub · Rust · 11,845 stars · 909 forks · +12 stars in 24 hours · Trending score 2.36

  14. 14
    chaw1/datakeel

    Local-first dataset workbench for visual QA, human-approved releases, and traceable metrics.

    GitHub · Python · 230 stars · 0 forks · +14 stars in 24 hours · Trending score 2.31

  15. 15
    LynnReal-AI/LynnReal-Omni

    LynnReal-Omni brings text-to-video, image-to-video, human- and hand-pose guided generation, structural control, omni-reference generation, style transfer, video editing, degraded-video restoration and streaming long-video generation into a single framework, all at four-step fast generation.

    GitHub · Python · 284 stars · 12 forks · +26 stars in 24 hours · Trending score 2.25

  16. 16
    OmniJev/Flide

    🔥🔥 The extremely fast inference engine for decision model

    GitHub · Python · 550 stars · 38 forks · +7 stars in 24 hours · Trending score 2.17

  17. 17
    antflydb/antfly

    GitHub · Zig · 517 stars · 36 forks · +15 stars in 24 hours · Trending score 2.16

  18. 18
    SAOS-3624/dsh-video-storyboard

    Scene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.

    GitHub · JavaScript · 583 stars · 40 forks · +9 stars in 24 hours · Trending score 2.13

  19. 19
    StarTrail-org/PixelRAG

    https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

    GitHub · Python · 10,972 stars · 988 forks · +5 stars in 24 hours · Trending score 1.96

  20. 20
    TanStack/ai

    🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.

    GitHub · TypeScript · 3,375 stars · 410 forks · +5 stars in 24 hours · Trending score 1.90

  21. 21
    vortex-data/vortex

    An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

    GitHub · Rust · 3,334 stars · 267 forks · +6 stars in 24 hours · Trending score 1.87

  22. 22
    NVIDIA-NeMo/DataDesigner

    🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.

    GitHub · Python · 2,418 stars · 251 forks · +8 stars in 24 hours · Trending score 1.82

  23. 23
    genkit-ai/genkit

    Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

    GitHub · TypeScript · 6,607 stars · 891 forks · +4 stars in 24 hours · Trending score 1.82

  24. 24
    apache/seatunnel

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    GitHub · Java · 9,821 stars · 2,474 forks · +4 stars in 24 hours · Trending score 1.76