multimodal-learning repositories

Trending repositories tagged multimodal-learning, ranked by trending score. Updated daily.

  1. 1
    HenryNdubuaku/maths-cs-ai-compendium

    Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with intuition.

    GitHub · TypeScript · 7,727 stars · 951 forks · +4 stars in 24 hours · Trending score 1.55

  2. 2
    TingdeLiu/tingdeliu.github.io

    Research notes on embodied AI, vision-language navigation, and robot learning — paper surveys, in-depth readings, and engineering practice.

    GitHub · JavaScript · 153 stars · 3 forks · +1 stars in 24 hours · Trending score 0.54

  3. 3
    PreferredAI/cornac

    A Comparative Framework for Multimodal Recommender Systems

    GitHub · Python · 1,065 stars · 177 forks · 0 stars in 24 hours · Trending score 0.46

  4. 4
    The-Martyr/Awesome-Multimodal-Reasoning

    Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal LLMs

    GitHub · 108 stars · 13 forks · 0 stars in 24 hours · Trending score 0.29

  5. 5
    Hoar012/Awesome-Multimodal-Embodied-AI

    A list of papers at the intersection of multimodal learning, embodied AI, and robotics.

    GitHub · 38 stars · 6 forks · 0 stars in 24 hours · Trending score 0.28

  6. 6
    galilai-group/stable-pretraining

    Reliable, minimal and scalable library for pretraining foundation and world models

    GitHub · Python · 348 stars · 122 forks · 0 stars in 24 hours · Trending score 0.14

  7. 7
    lzmd-arch/BioSNN-Plug

    脉冲神经网络认知原型:纯局部学习规则(无代理梯度)+ SNN 自主调度 LLM。Spiking neural network cognitive prototype — purely local learning rules (no surrogate gradients), SNN autonomously schedules an LLM, modality-plugin architecture. 研究原型,非生产框架 / research prototype, not a production framework.

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  8. 8
    Jian-Lang/AOEPT

    This repo is the official implementation of "AOEPT: Breaking the Implicit Modality-Reduction Bottleneck in Modality-Missing Prompt Tuning" accepted by ICML 2026.

    GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    Jian-Lang/awesome-modality-missing-learning

    A collection of research studies centered on Modality Missing Learning (MML) (also referred to as Incomplete Multimodal Learning).

    GitHub · HTML · 142 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    richard-peng-xia/awesome-multimodal-in-medical-imaging

    A collection of resources on applications of multi-modal learning in medical imaging.

    GitHub · 985 stars · 85 forks · 0 stars in 24 hours · Trending score 0.00

  11. 11
    zay002/SplAttN

    [ICML 2026 Spotlight] Official PyTorch implementation of “SplAttN: Bridging 2D and 3D with Gaussian Soft Splatting and Attention for Point Cloud Completion”.

    GitHub · Python · 16 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    Boom5426/Awesome-Virtual-Cell

    Awesome-AI-Virtual-Cell: papers, datasets, benchmarks, talks, and community resources for AIVC

    GitHub · HTML · 338 stars · 28 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    uni-medical/retina-text2cfp

    [MICCAI 2025] Official implementation of RetinaLogos, a caption-guided framework for high-resolution retinal image synthesis. Enables fine-grained control over retinal anatomy, disease stages, and pathological features using a 1.4M-scale captioned fundus dataset.

    GitHub · Python · 24 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    pykale/pykale

    Knowledge-Aware machine LEarning (KALE): accessible machine learning from multiple sources for interdisciplinary research, part of the 🔥PyTorch ecosystem. ⭐ Star to support our work!

    GitHub · Python · 490 stars · 73 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    OliverDOU776/Few-step-probabilistic-glucose-forecasting-from-continuous-glucose-monitoring-and-meal-images

    Official research code for GlucoFlow: few-step multimodal probabilistic glucose forecasting.

    GitHub · Python · 396 stars · 13 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    Yuchen-zh/Multimodal-Fake-News-Datasets

    A collection and analysis of multimodal fake news datasets across languages, domains, platforms, and modalities.

    GitHub · Python · 71 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    just-a-go/SOVA

    Official implementation of SOVA: Strict Outcome-Conditioned Virtual Advantages for Video Reasoning. Correctness-oriented calibration for TW-GRPO without extra rollouts.

    GitHub · Python · 24 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00