Google AI Blog: Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance

Posted by Sharan Narang and Aakanksha Chowdhery, Software Engineers, Google Research In recent years, large neural networks trained for l...

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrou Skip to main content Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance April 4, 2022 Posted by Sharan Narang and Aakanksha Chowdhery, Software Engineers, Google Research Quick links Share Copy link × In recent years, large neural networks trained for language understanding and generation have achieved impressive results across a wide range of tasks. GPT-3 first showed that large language models (LLMs) can be used for few-shot learning and can achieve impressive results

saved by

• Jacky Zhao
• Amir
• Belinda Mo
• Asma Lamgh

related reading

• Scaling Instruction-Finetuned Language Modelsarxiv.org
• Google AI: New giant voice AI can explain jokesmixed-news.com
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• [2210.11416] Scaling Instruction-Finetuned Language Modelsarxiv.org
• More Efficient In-Context Learning with GLaMblog.research.google
• Language Model Compositionarxiv.org
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• Language Models Perform Reasoning via Chain of Thoughtai.googleblog.com
• Scalable MatMul-free Language Modelingarxiv.org
• AI Revolution - Transformers and Large Language Models (LLMs)blog.eladgil.com