megatron repositories
Trending repositories tagged megatron, ranked by trending score. Updated daily.
-
1
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42
-
2
modal-labs/spindle
Own your Tinker-compatible training stack
GitHub · Python · 46 stars · 3 forks · +1 stars in 24 hours · Trending score 0.77
-
3
baidu-baige/LoongForge
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
GitHub · Python · 869 stars · 70 forks · 0 stars in 24 hours · Trending score 0.46
-
4
modelscope/mcore-bridge
MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models (Qwen3-Next, GLM-5.3, Deepseek-V4, MiniMax-2.7, ...) and 200+ multimodal large models (Qwen3.8, Qwen3-Omni, Gemma4, ...).
GitHub · Python · 107 stars · 56 forks · 0 stars in 24 hours · Trending score 0.43
-
5
plugyawn/Megaprop
Newton-Muon + Preconditioned Optimizers for MoE Training at scale, with out-of-the-box support for MuP and FSDP support for Muon, built on top of Megatron-LM and TransformerEngine.
GitHub · 35 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14
-
6
Orchestra-Research/AI-Research-SKILLs
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.
GitHub · TeX · 14,252 stars · 992 forks · 0 stars in 24 hours · Trending score 0.00