multimodal-learning repositories
Trending repositories tagged multimodal-learning, ranked by trending score. Updated daily.
-
1
HenryNdubuaku/maths-cs-ai-compendium
Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with intuition.
GitHub · TypeScript · 7,727 stars · 951 forks · +4 stars in 24 hours · Trending score 1.55
-
2
TingdeLiu/tingdeliu.github.io
Research notes on embodied AI, vision-language navigation, and robot learning — paper surveys, in-depth readings, and engineering practice.
GitHub · JavaScript · 153 stars · 3 forks · +1 stars in 24 hours · Trending score 0.54
-
3
PreferredAI/cornac
A Comparative Framework for Multimodal Recommender Systems
GitHub · Python · 1,065 stars · 177 forks · 0 stars in 24 hours · Trending score 0.46
-
4
The-Martyr/Awesome-Multimodal-Reasoning
Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal LLMs
GitHub · 108 stars · 13 forks · 0 stars in 24 hours · Trending score 0.29
-
5
Hoar012/Awesome-Multimodal-Embodied-AI
A list of papers at the intersection of multimodal learning, embodied AI, and robotics.
GitHub · 38 stars · 6 forks · 0 stars in 24 hours · Trending score 0.28
-
6
galilai-group/stable-pretraining
Reliable, minimal and scalable library for pretraining foundation and world models
GitHub · Python · 348 stars · 122 forks · 0 stars in 24 hours · Trending score 0.14
-
7
lzmd-arch/BioSNN-Plug
脉冲神经网络认知原型:纯局部学习规则(无代理梯度)+ SNN 自主调度 LLM。Spiking neural network cognitive prototype — purely local learning rules (no surrogate gradients), SNN autonomously schedules an LLM, modality-plugin architecture. 研究原型,非生产框架 / research prototype, not a production framework.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
8
Jian-Lang/AOEPT
This repo is the official implementation of "AOEPT: Breaking the Implicit Modality-Reduction Bottleneck in Modality-Missing Prompt Tuning" accepted by ICML 2026.
GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
9
Jian-Lang/awesome-modality-missing-learning
A collection of research studies centered on Modality Missing Learning (MML) (also referred to as Incomplete Multimodal Learning).
GitHub · HTML · 142 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00
-
10
richard-peng-xia/awesome-multimodal-in-medical-imaging
A collection of resources on applications of multi-modal learning in medical imaging.
GitHub · 985 stars · 85 forks · 0 stars in 24 hours · Trending score 0.00
-
11
zay002/SplAttN
[ICML 2026 Spotlight] Official PyTorch implementation of “SplAttN: Bridging 2D and 3D with Gaussian Soft Splatting and Attention for Point Cloud Completion”.
GitHub · Python · 16 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
12
Boom5426/Awesome-Virtual-Cell
Awesome-AI-Virtual-Cell: papers, datasets, benchmarks, talks, and community resources for AIVC
GitHub · HTML · 338 stars · 28 forks · 0 stars in 24 hours · Trending score 0.00
-
13
uni-medical/retina-text2cfp
[MICCAI 2025] Official implementation of RetinaLogos, a caption-guided framework for high-resolution retinal image synthesis. Enables fine-grained control over retinal anatomy, disease stages, and pathological features using a 1.4M-scale captioned fundus dataset.
GitHub · Python · 24 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
14
pykale/pykale
Knowledge-Aware machine LEarning (KALE): accessible machine learning from multiple sources for interdisciplinary research, part of the 🔥PyTorch ecosystem. ⭐ Star to support our work!
GitHub · Python · 490 stars · 73 forks · 0 stars in 24 hours · Trending score 0.00
-
15
OliverDOU776/Few-step-probabilistic-glucose-forecasting-from-continuous-glucose-monitoring-and-meal-images
Official research code for GlucoFlow: few-step multimodal probabilistic glucose forecasting.
GitHub · Python · 396 stars · 13 forks · 0 stars in 24 hours · Trending score 0.00
-
16
Yuchen-zh/Multimodal-Fake-News-Datasets
A collection and analysis of multimodal fake news datasets across languages, domains, platforms, and modalities.
GitHub · Python · 71 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
17
just-a-go/SOVA
Official implementation of SOVA: Strict Outcome-Conditioned Virtual Advantages for Video Reasoning. Correctness-oriented calibration for TW-GRPO without extra rollouts.
GitHub · Python · 24 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00