LLMs shouldn’t write SQL - by Benn Stancil - benn.substack
[ People can ] work like journalists, collating existing metrics and drawing conclusions by considering them in their totality. Rather than looking for new ways to assess a question, they start by asking, “how do we currently measure that?” [ Or they can ] work like scientists, creating new datasets and aggregating them in novel ways to draw conclusions about specific, nuanced hypotheses. In business contexts, the first type of analysis typically consists of asking a series of Mad Lib-style questions about known metrics, like revenue retention or daily active users or ad spend, and aggregating and filtering those metrics by different dimensions. “Show me total orders in Massachusetts by month compared to the same number from a year ago,” someone might ask. This question will reveal something, like a spike in new orders in February. And that will prompt more questions of the same style—“now show me total orders in Massachusetts by month and by product category”—until people find whateve
LLMs shouldn’t write SQL There's no direct path from a business question to a useful query. Feb 23, 2024 52 23 5 Share There are, very roughly, two ways to analyze data : 1 [ People can ] work like journalists, collating existing metrics and drawing conclusions by considering them in their totality. Rather than looking for new ways to assess a question, they start by asking, “how do we currently measure that?” [ Or they can ] work like scientists, creating new datasets and aggregating them in novel ways to draw conclusions about specific, nuanced hypotheses. In business contexts, the first typ
saved by
related reading
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- Learning Tracks — Technicallytechnically.dev
- Putting Task Expertise into RL Achieves State-of-the-Art Performance on Text-to-SQLthinkingmachines.ai
- Malleable software in the age of LLMsgeoffreylitt.com
- Against SQLscattered-thoughts.net
- Andrej Karpathy on X: "LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating" / Xx.com
- crawshaw - 2025-01-06crawshaw.io
- Tableau and Power BI Shouldn’t Be Your Go-to Data Analysis Tool | by Brandon @ AnalyticsMentor.io | Mediummedium.com
- Lessons from Human Data Analysts to Improve the AI Varietydatafordoers.substack.com
- Thoughts on AI in academiatheinfinitesimal.substack.com
- Inside OpenAI’s in-house data agent | OpenAIopenai.com
- How to Use LLMs Better - Learn How To Learnlearnhowtolearn.org