megatron repositories

Trending repositories tagged megatron, ranked by trending score. Updated daily.

  1. 1
    modelscope/ms-swift

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

    GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42

  2. 2
    modal-labs/spindle

    Own your Tinker-compatible training stack

    GitHub · Python · 46 stars · 3 forks · +1 stars in 24 hours · Trending score 0.77

  3. 3
    baidu-baige/LoongForge

    A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.

    GitHub · Python · 869 stars · 70 forks · 0 stars in 24 hours · Trending score 0.46

  4. 4
    modelscope/mcore-bridge

    MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models (Qwen3-Next, GLM-5.3, Deepseek-V4, MiniMax-2.7, ...) and 200+ multimodal large models (Qwen3.8, Qwen3-Omni, Gemma4, ...).

    GitHub · Python · 107 stars · 56 forks · 0 stars in 24 hours · Trending score 0.43

  5. 5
    plugyawn/Megaprop

    Newton-Muon + Preconditioned Optimizers for MoE Training at scale, with out-of-the-box support for MuP and FSDP support for Muon, built on top of Megatron-LM and TransformerEngine.

    GitHub · 35 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14

  6. 6
    Orchestra-Research/AI-Research-SKILLs

    Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.

    GitHub · TeX · 14,252 stars · 992 forks · 0 stars in 24 hours · Trending score 0.00