flâneur

Import AI 372: Gibberish jailbreak; DeepSeek's great new model; Google's soccer-playing robots

importai.substack.com · 3,036 words · saved by 1 readers

Welcome to Import AI, a newsletter about AI research. Import AI runs on lattes, ramen, and feedback from readers. If you’d like to support this (and comment on posts!) please subscribe. DeepSeek makes the best coding model in its class - and releases it as open source: …Made in China will be a thing for AI models, same as electric cars, drones, and other technologies… Chinese startup DeepSeek has built and released DeepSeek-V2, a surprisingly powerful language model. DeepSeek-V2 is a large-scale model and competes with other frontier systems like LLaMA 3, Mixtral, DBRX, and Chinese models like Qwen-1.5 and DeepSeek V1. The model beats Facebook's 70B LLaMA3 model on a few hard tasks including Math (43.6% vs 42.2 for LLaMA3), a Chinese version of MMLU called CMML What they built: DeepSeek-V2 is a Transformer-based mixture-of-experts model, comprising 236B total parameters, of which 21B are activated for each token. The model was pretrained on "a diverse and high-quality corpus comprisin

Import AI 372: Gibberish jailbreak; DeepSeek's great new model; Google's soccer-playing robots If neural nets didn't work, what would we be using instead? Jack Clark May 13, 2024 25 1 Share Welcome to Import AI, a newsletter about AI research. Import AI runs on lattes, ramen, and feedback from readers. If you’d like to support this (and comment on posts!) please subscribe. Subscribe DeepSeek makes the best coding model in its class - and releases it as open source: …Made in China will be a thing for AI models, same as electric cars, drones, and other technologies… Chinese startup DeepSeek has

related reading