NVIDIA-NeMo/Automodel: 🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support ·
github.com · 3,177 words · saved by 1 readers
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
📣 News and Discussions [09/11/2026]DeepSeek-V4.1-Flash We now support SFT and LoRA for DeepSeek's causal encoder/decoder backbone with CSA2, single-pass mHC, and Engram, many thanks to @Khazic. Check out the HellaSwag EP64 16-node recipe and model coverage page. [08/29/2026]GLM-5.3 We now support full-parameter fine-tuning of Z.ai's GLM-5.3 with cuDNN DSA and HybridEP. Check out the EP64/PP4 recipe and model coverage page. [08/28/2026]Ox Alpha / GLM-5.3-Flash We now support fine-tuning Z.ai's 320B-A18B hybrid-attention MoE VLM with packed CP and EP. Check out the MedPix EP72/CP2 recipe…
saved by
related reading
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- Llama 2 · Hugging Facehuggingface.co
- Trending Papers - Hugging Facepaperswithcode.com
- GitHub - NVIDIA-NeMo/Speech: A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech) · GitHubgithub.com
- GitHub - huggingface/nanotron: Minimalistic large language model 3D-parallelism training · GitHubgithub.com
- GitHub - Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Modelgithub.com
- Neuronpedianeuronpedia.org
- GitHub - linkedin/Liger-Kernel: Efficient Triton Kernels for LLM Traininggithub.com
- ⭐️ Fast LLM Inference From Scratchandrewkchan.dev
- LLM Resourcesforrestbicker.com
- GitHub - rasbt/LLMs-from-scratch: Implement a ChatGPT-like LLM in PyTorch from scratch, step by stepgithub.com
- GitHub - eugeneyan/open-llms: 📋 A list of open LLMs available for commercial use.github.com