✳flâneur — a map of the web's best reading

Unsloth update: Mistral support + more

unsloth.ai · 3,399 words · saved by 1 readers

unsloth About Pricing Blog Contact Get started Blog Finetune Mistral 14x faster Dec 14, 2023 • By Daniel Han Unsloth open source: Mistral 7B 1xA100 2.2x faster Code Llama 34B 1xA100 1.9x faster Llama 7B 1xA100 2.2x faster Llama 7B 1xT4 2x faster We’re excited to release QLoRA support for Mistral 7B, CodeLlama 34B, and all other models based on the Llama architecture! We added sliding window attention, preliminary Windows and DPO support, and will share all 59 notebooks for reproducing our numbers. You can now QLoRA finetune Mistral 7B 2.2x on 1x A100 faster with 62% less memory or 12.4GB peak VRAM. CodeLlama 34B is 1.9x faster on 1x A100, using 32% less memory or 27GB peak VRAM. It finally doesn’t OOM! Unsloth Pro version: Mistral 7B 1xA100 14x faster Code Llama 34B 1xA100 13x faster Llama 7B 1xA100 21x faster Llama 7B 2xT4 28x faster Our PRO version can finetune Mistral 7B a whopping 14x faster on 1x A100, using 70% less peak VRAM, and CodeLlama 34B is 13x faster on 1x A100 using 50%

Unsloth update: Mistral support + more unsloth Models Blog Unsloth Studio✨ Docs Blog Finetune Mistral 14x faster Dec 14, 2023 • By Daniel Han Dec 14, 2023 • By Daniel Han Unsloth open source: Mistral 7B 1xA100 2.2x faster Code Llama 34B 1xA100 1.9x faster Llama 7B 1xA100 2.2x faster Llama 7B 1xT4 2x faster We’re excited to release QLoRA support for Mistral 7B, CodeLlama 34B, and all other models based on the Llama architecture! We added sliding window attention, preliminary Windows and DPO support, and will share all 59 notebooks for reproducing our numbers. You can now QLoRA finetune Mistral

Explore this link on the map →

related reading