bigscience/T0pp · Hugging Face
huggingface.co · 1,825 words · saved by 1 readers
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
How do I pronounce the name of the model? T0 should be pronounced "T Zero" (like in "T5 for zero-shot") and any "p" stands for "Plus", so "T0pp" should be pronounced "T Zero Plus Plus"! Official repository: bigscience-workshop/t-zero Model Description T0* shows zero-shot task generalization on English natural language prompts, outperforming GPT-3 on many tasks, while being 16x smaller. It is a series of encoder-decoder models trained on a large set of different tasks specified in natural language prompts. We convert numerous English supervised datasets into prompts, each with multiple…
related reading
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Llama 2 · Hugging Facehuggingface.co
- microgptkarpathy.github.io
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- The Annotated Transformernlp.seas.harvard.edu
- TOD-Bertarxiv.org
- Hugging Face – The AI community building the future.huggingface.co
- bigscience/bloom · Hugging Facehuggingface.co
- Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformerai.googleblog.com
- GRPO Trainer · Hugging Facehuggingface.co
- BIG-bench/bigbench/benchmark_tasks/keywords_to_tasks.md at main · google/BIG-benchgithub.com
- Generalized Language Models | Lil'Loglilianweng.github.io