AdapterHub - 715 adapters for 78 text tasks and 97 languages
"Adapter" refers to a set of newly introduced weights, typically within the layers of a transformer model. Adapters provide an alternative to fully fine-tuning the model for each downstream task, while maintaining performance. They also have the added benefit of requiring as little as 1MB of storage space per task! Learn More!
AdapterHub - Home of Adapters, the library for parameter-efficient and module fine-tuning New Release: Introducing Adapters , the new unified adapter package Home of Adapters , the library for parameter-efficient and modular fine-tuning central repository for pre-trained adapter modules --> 406 adapters 58 text tasks 97 languages --> pip install adapters Blog Explore Docs GitHub Paper Adapters are Lightweight 🤖 "Adapter" refers to a set of newly introduced weights, typically within the layers of a transformer model. Adapters provide an alternative to fully fine-tuning the model for each downs
Explore this link on the map →related reading
- [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
- PEFT Method Overview [implementing Adapters in PyTorch] | Eva Korolevaxmarva.github.io
- Anatomy of a Modern Finetuning APIbenanderson.work
- Recent Advances in Language Model Fine-tuningruder.io
- Transformer²: Self-Adaptive LLMssakana.ai
- Hugging Face · GitHubgithub.com
- The Annotated Transformernlp.seas.harvard.edu
- Orbit - Ultra-efficient RL Pipelinespherelab.ai
- Annotated Research Paper Implementations: Transformers, StyleGAN, Stable Diffusion, DDPM/DDIM, LayerNorm, Nucleus Sampling and morenn.labml.ai
- Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
- Parameter-Efficient LLM Finetuning With Low-Rank Adaptation (LoRA) - Lightning AIlightning.ai
- GitHub - SoyGema/pulling_ace · GitHubgithub.com