bigscience/bloom · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

BigScience Large Open-science Open-access Multilingual Language Model Version 1.3 / 6 July 2022 Current Checkpoint: Training Iteration 95000 Link to paper: here Total seen tokens: 366B Model Details BLOOM is an autoregressive Large Language Model (LLM), trained to continue text from a prompt on vast amounts of text data using industrial-scale computational resources. As such, it is able to output coherent text in 46 languages and 13 programming languages that is hardly distinguishable from text written by humans. BLOOM can also be instructed to perform text tasks it hasn't been…

related reading

• On the Biology of a Large Language Modeltransformer-circuits.pub
• Llama 2 · Hugging Facehuggingface.co
• Hugging Face – The AI community building the future.huggingface.co
• bigscience/T0pp · Hugging Facehuggingface.co
• frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
• Incredibly Fast BLOOM Inference with DeepSpeed and Acceleratehuggingface.co
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• Introducing Bloom: an open source tool for automated behavioral evaluations \ Anthropicanthropic.com
• GitHub - openlm-research/open_llama: OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama datasetgithub.com
• GitHub - eugeneyan/open-llms: 📋 A list of open LLMs available for commercial use.github.com
• google/diffusiongemma-26B-A4B-it · Hugging Facehuggingface.co
• Report: Hugging Face Business Breakdown & Founding Story | Contrary Researchresearch.contrary.com