[2302.03494] A Categorical Archive of ChatGPT Failures
Large language models have been demonstrated to be valuable in different fields. ChatGPT, developed by OpenAI, has been trained using massive amounts of data and simulates human conversation by comprehending context and generating appropriate responses. It has garnered significant attention due to its ability to effectively answer a broad range of human inquiries, with fluent and comprehensive answers surpassing prior public chatbots in both security and usefulness. However, a comprehensive analysis of ChatGPT's failures is lacking, which is the focus of this study. Ten categories of failures, including reasoning, factual errors, math, coding, and bias, are presented and discussed. The risks, limitations, and societal implications of ChatGPT are also highlighted. The goal of this study is to assist researchers and developers in enhancing future language models and chatbots.
A Categorical Archive of ChatGPT Failures Ali Borji Quintic AI aliborji@gmail.com April 5, 2023 arXiv:2302.03494v8 [cs.CL] 3 Apr 2023…
saved by
related reading
- GPT-4openai.com
- gpt-4.pdfcdn.openai.com
- ChatGPT Is a Blurry JPEG of the Web | The New Yorkernewyorker.com
- ChatGPT Is Dumber Than You Think - The Atlantictheatlantic.com
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- Collections: On ChatGPT – A Collection of Unmitigated Pedantryacoup.blog
- Think of language models like ChatGPT as a “calculator for words”simonwillison.net
- ChatGPT is a bullshit generator. But it can still be amazingly usefulnormaltech.ai
- The Yale Review | Melanie Mitchell: The Dangerous Unknowns at the…yalereview.org
- gpt-4-system-card.pdfcdn.openai.com
- 2405.01470arxiv.org
- Making Large Language Models work for yousimonwillison.net