✳flâneur — a map of the web's best reading
LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism
arxiv.org · saved by 1 readers
N/A
Explore this link on the map →related reading
- GitHub - jacobhilton/deep_learning_curriculum: Language model alignment-focused deep learning curriculum · GitHubgithub.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4. · GitHubgithub.com
- GitHub - openai/parameter-golf: Train the smallest LM you can that fits in 16MB. Best model wins! · GitHubgithub.com
- GitHub - karpathy/nanochat: The best ChatGPT that $100 can buy. · GitHubgithub.com
- GitHub - linkedin/Liger-Kernel: Efficient Triton Kernels for LLM Training · GitHubgithub.com
- Star Attention: Efficient LLM Inference over Long Sequencesarxiv.org
- Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inferencearxiv.org
- GitHub - karpathy/autoresearch: AI agents running research on single-GPU nanochat training automatically · GitHubgithub.com
- Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingarxiv.org
- Accelerating Diffusion LLMs via Adaptive Parallel Decodingarxiv.org
- GitHub - guidance-ai/guidance: A guidance language for controlling large language models. · GitHubgithub.com
- Trainloop AItrainloop.ai