Why RAG won't solve generative AI's hallucination problem | TechCrunch

techcrunch.com · 1,158 words · saved by 1 readers

Hallucinations — the lies generative AI models tell, basically — are a big problem for businesses looking to integrate the technology into their operations. Because models have no real intelligence and are simply predicting words, images, speech, music and other data according to a private schema, they sometimes get it wrong. Very wrong. In a recent piece in The Wall Street Journal, a source recounts an instance where Microsoft’s generative AI invented meeting attendees and implied that conference calls were about subjects that weren’t actually discussed on the call. As I wrote a while ago, hallucinations may be an unsolvable problem with today’s transformer-based model architectures. But a number of generative AI vendors suggest that they can be done away with, more or less, through a technical approach called retrieval augmented generation, or RAG. Here’s how one vendor, Squirro, pitches it: At the core of the offering is the concept of Retrieval Augmented LLMs or Retrieval Augmented

Why RAG won't solve generative AI's hallucination problem | TechCrunch Image Credits: D3Damon / Getty Images AI Why RAG won’t solve generative AI’s hallucination problem Kyle Wiggers 7:00 AM PDT · May 4, 2024 Hallucinations — the lies generative AI models tell, basically — are a big problem for businesses looking to integrate the technology into their operations. Because models have no real intelligence and are simply predicting words, images, speech, music and other data according to a private schema , they sometimes get it wrong. Very wrong. In a recent piec

Why RAG won't solve generative AI's hallucination problem | TechCrunch

related reading