How to generate text: using different decoding methods for language generation with Transformers
huggingface.co · 4,158 words · saved by 1 readers
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
How to generate text: using different decoding methods for language generation with Transformers Back to Articles a]:hidden"> How to generate text: using different decoding methods for language generation with Transformers Published March 1, 2020 Update on GitHub Upvote 301 +295 Patrick von Platen patrickvonplaten Follow Note : Edited on July 2023 with up-to-date references and examples. Introduction In recent years, there has been an increasing interest in open-ended language generation thanks to the rise of large transformer-based language models trained on millions of webpages, including Op
related reading
- A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
- Transformers from Scratche2eml.school
- transformer_attention.pdfarxiv.org
- Transformers Laid Outgoyalpramod.github.io
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- How to make LLMs go fastvgel.me
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Language Modelinglena-voita.github.io
- The Annotated Transformernlp.seas.harvard.edu
- How do Transformers work? · Hugging Facehuggingface.co