multimodal repositories
Trending repositories tagged multimodal, ranked by trending score. Updated daily.
-
1
bojieli/ai-agent-book
《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
GitHub · Python · 58,941 stars · 6,920 forks · +229 stars in 24 hours · Trending score 4.59
-
2
microsoft/AesCode
Aesthetic code generation with decoupled cross-modal rewards: turning prompts into editable, verifiable HTML/CSS infographics, with image generators as aesthetic guidance.
GitHub · Python · 284 stars · 10 forks · +201 stars in 24 hours · Trending score 3.92
-
3
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
GitHub · JavaScript · 68,473 stars · 7,726 forks · +67 stars in 24 hours · Trending score 3.61
-
4
HUANGCHIHHUNGLeo/claude-real-video
Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.
GitHub · Python · 2,328 stars · 208 forks · +120 stars in 24 hours · Trending score 3.57
-
5
vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
GitHub · Python · 7,876 stars · 2,167 forks · +38 stars in 24 hours · Trending score 3.35
-
6
sgl-project/sglang-omni
High Performance Serving Runtime For Interactive Super Intelligence System
GitHub · Python · 1,876 stars · 778 forks · +43 stars in 24 hours · Trending score 3.29
-
7
screenpipe/screenpipe
YC (S26) | Screenpipe finds the work worth automating | Continuously record computer work locally, discover recurring workflows, and hand the result to any agent you already use.
GitHub · Rust · 22,488 stars · 2,311 forks · +46 stars in 24 hours · Trending score 3.20
-
8
Neywa-Labs/mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
GitHub · Python · 8,306 stars · 800 forks · +37 stars in 24 hours · Trending score 2.83
-
9
verl-project/verl-omni
Multimodal RL training framework for diffusion & omni models
GitHub · Python · 1,556 stars · 337 forks · +17 stars in 24 hours · Trending score 2.66
-
10
ARahim3/DigUp
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
GitHub · Swift · 6,484 stars · 518 forks · +19 stars in 24 hours · Trending score 2.58
-
11
Zen4-bit/Proxima
Multi-AI MCP Server - Connect ChatGPT, Claude, Gemini & Perplexity to your coding tools without any API
GitHub · JavaScript · 1,219 stars · 171 forks · +22 stars in 24 hours · Trending score 2.44
-
12
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
GitHub · Python · 16,136 stars · 1,820 forks · +11 stars in 24 hours · Trending score 2.41
-
13
rerun-io/rerun
Visualize, query, and stream to train on multimodal robotics data.
GitHub · Rust · 11,845 stars · 909 forks · +12 stars in 24 hours · Trending score 2.36
-
14
chaw1/datakeel
Local-first dataset workbench for visual QA, human-approved releases, and traceable metrics.
GitHub · Python · 230 stars · 0 forks · +14 stars in 24 hours · Trending score 2.31
-
15
LynnReal-AI/LynnReal-Omni
LynnReal-Omni brings text-to-video, image-to-video, human- and hand-pose guided generation, structural control, omni-reference generation, style transfer, video editing, degraded-video restoration and streaming long-video generation into a single framework, all at four-step fast generation.
GitHub · Python · 284 stars · 12 forks · +26 stars in 24 hours · Trending score 2.25
-
16
OmniJev/Flide
🔥🔥 The extremely fast inference engine for decision model
GitHub · Python · 550 stars · 38 forks · +7 stars in 24 hours · Trending score 2.17
-
17
antflydb/antfly
GitHub · Zig · 517 stars · 36 forks · +15 stars in 24 hours · Trending score 2.16
-
18
SAOS-3624/dsh-video-storyboard
Scene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.
GitHub · JavaScript · 583 stars · 40 forks · +9 stars in 24 hours · Trending score 2.13
-
19
StarTrail-org/PixelRAG
https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
GitHub · Python · 10,972 stars · 988 forks · +5 stars in 24 hours · Trending score 1.96
-
20
TanStack/ai
🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.
GitHub · TypeScript · 3,375 stars · 410 forks · +5 stars in 24 hours · Trending score 1.90
-
21
vortex-data/vortex
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
GitHub · Rust · 3,334 stars · 267 forks · +6 stars in 24 hours · Trending score 1.87
-
22
NVIDIA-NeMo/DataDesigner
🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.
GitHub · Python · 2,418 stars · 251 forks · +8 stars in 24 hours · Trending score 1.82
-
23
genkit-ai/genkit
Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
GitHub · TypeScript · 6,607 stars · 891 forks · +4 stars in 24 hours · Trending score 1.82
-
24
apache/seatunnel
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
GitHub · Java · 9,821 stars · 2,474 forks · +4 stars in 24 hours · Trending score 1.76