ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools
We introduce ChatGLM, an evolving family of large language models that we have been developing over time. This report primarily focuses on the GLM-4 language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent our most capable models that are trained with all the insights and lessons gained from the preceding three generations of ChatGLM. To date, the GLM-4 models are pre-trained on ten trillions of tokens mostly in Chinese and English, along with a small set of corpus from 24 languages, and aligned primarily for Chinese and English usage. The high-quality alignment is achieved via a multi-stage post-training process, which involves supervised fine-tuning and learning from human feedback. Evaluations show that GLM-4 1) closely rivals or outperforms GPT-4 in terms of general metrics such as MMLU, GSM8K, MATH, BBH, GPQA, and HumanEval, 2) gets close to GPT-4-Turbo in instruction following as measured by IFEval, 3) matches GPT-4 Turbo (128K) and Claude 3 for long context
Abstract We introduce ChatGLM, an evolving family of large language models that we have been developing over time. This report primarily focuses on the GLM-4 language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent our most capable models that are trained with all the insights and lessons gained from the preceding three generations of ChatGLM. To date, the GLM-4 models are pre-trained on ten trillions of tokens mostly in Chinese and English, along with a small set of corpus from 24 languages, and aligned primarily for Chinese and English usage. The high-quality…
saved by
related reading
- GitHub - eugeneyan/open-llms: 📋 A list of open LLMs available for commercial use.github.com
- gpt-4.pdfcdn.openai.com
- GPT-4openai.com
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrouai.googleblog.com
- AI Timeline — Complete History of 194+ Large Language Modelsllm-timeline.com
- [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
- Vanilla GPT-3 quality from an open source model on a single machine: GLM-130B - The Full Stackfullstackdeeplearning.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- GitHub - Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Modelgithub.com
- Things we learned about LLMs in 2024simonwillison.net
- Training language models to follow instructions with human feedback.pdfproceedings.neurips.cc