ChatGPT is a bullshit generator. But it can still be amazingly useful

The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce

The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce plausible text, not true statements. ChatGPT is shockingly good at sounding convincing on any conceivable topic. But OpenAI is clear that there is no source of truth during training. That means that using ChatGPT in its current form would be a bad idea for applications like education or answering health questions. Even though the bot often gives…

related reading

• ChatGPT Is Dumber Than You Think - The Atlantictheatlantic.com
• ChatGPT Is a Blurry JPEG of the Web | The New Yorkernewyorker.com
• GPT-4openai.com
• [2302.03494] A Categorical Archive of ChatGPT Failuresarxiv.org
• Collections: On ChatGPT – A Collection of Unmitigated Pedantryacoup.blog
• Think of language models like ChatGPT as a “calculator for words”simonwillison.net
• truthfulQA_lin_evans.pdfowainevans.github.io
• I cannot believe the shit that morons are getting up to with ChatGPTmaxread.substack.com
• What should you use ChatGPT for? | ✰Vicki Boykis✰vickiboykis.com
• Comparing Google and ChatGPT | Hacker Newsnews.ycombinator.com
• 2405.01470arxiv.org
• Making Large Language Models work for yousimonwillison.net