Feedback loops, and Google’s home-field advantage with LLMs | by Sarah Tavel | Feb, 2023 | Medium

When I was at Pinterest leading product for the Discovery team, we started to leverage deep learning for our recommendations. It was always…

Feedback loops, and Google’s home-field advantage with LLMs Sarah Tavel 3 min read · Feb 11, 2023 -- 2 Listen Share When I was at Pinterest leading product for the Discovery team, we started to leverage deep learning for our recommendations. It was always the case that while deep learning enabled a step-function change in the results (as measured by user engagement), the results got dramatically better once we took that user engagement data and fed it back into the model to further tune the results. We’d go from a place of discontinuous change with each step-function upgrade of the model, to a

related reading

• RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
• Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• Delip Rao e/σ on X: "Despite the amazing results I’ve experienced with ChatGPT, this is not a correct way to look at LLM vs. Google search. Since several other tweets have made this equivalence and have been eager to spell doom for Google, twitter.com
• Why Chatbots Are Not the Future of Interfaceswattenberger.com
• Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
• Comparing Google and ChatGPT | Hacker Newsnews.ycombinator.com
• Andrej Karpathy — AGI is still a decade awaydwarkesh.com
• GenAI Handbookgenai-handbook.github.io
• Naturally Occurring Feedback is Common, Extractable and Usefularxiv.org
• Feedback Loops With Language Models Drive In-Context Reward Hackingarxiv.org
• "Oh Bing, Please Don't Be Evil" - by Rohit Krishnanstrangeloopcanon.com