flâneur

Comparing Google and ChatGPT | Hacker News

news.ycombinator.com · 19,238 words · saved by 1 readers

Large language models like GPT are one of the biggest areas of active ML research at Google, and there's a ton of pretty obvious applications for how they can be used to answer queries, index information, etc. There is a huge budget at Google related to staffing people to work on these kinds of models and do the actual training, which is very expensive because it takes a ton of compute capacity to train these super huge language models. However what I gathered from the talk is the economics of actually using these kinds of language models in the biggest Google products (e.g. search, gmail) isn't quite there yet. It's one thing to put up a demo that interested nerds can play with, but it's quite another thing to try to integrate it deeply in a system that serves billions of requests a day when you take into account serving costs, added latency, and the fact that the average revenue on something like a Google search is close to infinitesimal already. I think I remember the presenter sayi

Comparing Google and ChatGPT | Hacker News Hacker News new | past | comments | ask | show | jobs | submit login Comparing Google and ChatGPT ( twitter.com/jdjkelly ) 260 points by xezzed on Dec 1, 2022 | hide | past | favorite | 267 comments hncel on Dec 1, 2022 | next [–] I work at Alphabet and I recently went to an internal tech talk about deploying large language models like this at Google. As a disclaimer I'll first note that this is not my area of expertise, I just attended the tech talk because it sounded interesting. Large language models like GPT are one of the biggest areas of active

related reading