LLM Engineer's Almanac - Executive Summary | Modal

modal.com · 3,562 words · saved by 1 readers

Nearly every serious application of computer systems includes relational database management software, from local SQLite on phones to planet-scale Spanner in cloud data centers. These systems all trace their lineage back through IBM System R to the Information Management System built to send humans to the Moon — or at least track all the bills of material for the rockets that carried them. In place of behemoth proprietary software built for specific systems at great expense, there is now a legion of open source software. Language models are still closer in their lifecycle to the Peterlee Relational Test Vehicle than to Postgres, but they hold the same promise: to be a part of nearly every application of computer systems. When these applications need to store and retrieve structured data, they currently deduce following the relational algebra of Ted Codd; when they need to produce or process unstructured data, they will infer with neural probabilistic models. The weights for capable lan

LLM Engineer's Almanac - Executive Summary | Modal Advisor Executive Summary Benchmarking Workloads Quant Formats Block Quants Token Timing Simulator Spec Dec Roofline More Powered by Modal Advisor Executive Summary Benchmarking Workloads Quant Formats Block Quants Token Timing Simulator Spec Dec Roofline Powered by Modal LLM Engines: An Executive Summary Nearly every serious application of computer systems includes relational database management software, from local SQLite on phones to planet-scale Spanner in cloud data centers. These systems all trace their lineage back through IBM System R

LLM Engineer's Almanac - Executive Summary | Modal

related reading