✳flâneur — a map of the web's best reading

Is Grok Basically Just an OpenAI Wrapper? | Hacker News

news.ycombinator.com · 4,405 words · saved by 1 readers

> The issue here is that the web is full of ChatGPT outputs, so we accidentally picked up some of them when we trained Grok on a large amount of web data. This was a huge surprise to us when we first noticed it. For what it’s worth, the issue is very rare and now that we’re aware of it we’ll make sure that future versions of Grok don’t have this problem. Don’t worry, no OpenAI code was used to make Grok. https://twitter.com/ibab_ml/status/1733558576982155274 Grok is extremely consistent in both referring to OpenAI in refusals, and also using the full repertoire of GPT-ism in its other responses, such as ending every message with an "Overall, ..." or "In conclusion, ..." section. They RLHF-ed Grok on GPT output, specifically and in volume. Maybe sourced via the API or other means, I don't know. But Igor's explanation that "this is very rare" makes no sense after you play with Grok for even 5 minutes. Edit: I'm not 100% sure, but I think my comment is being interpreted uncharitably. I wo

Is Grok Basically Just an OpenAI Wrapper? | Hacker News Hacker News new | past | comments | ask | show | jobs | submit login Is Grok Basically Just an OpenAI Wrapper? ( twitter.com/jaxwinterbourne ) 82 points by bundie on Dec 9, 2023 | hide | past | favorite | 87 comments minimaxir on Dec 9, 2023 | next [–] An xAI engineer replied: > The issue here is that the web is full of ChatGPT outputs, so we accidentally picked up some of them when we trained Grok on a large amount of web data. This was a huge surprise to us when we first noticed it. For what it’s worth, the issue is very rare and now th

Explore this link on the map →

related reading