Is this the ChatGPT moment for recommendation systems? | Shaped Blog
Researchers at Meta recently published a ground-breaking paper that combines the technology behind ChatGPT with Recommender Systems. They show they can scale these models up to 1.5 trillion parameters and demonstrate a 12.4% increase in topline metrics in production A/B tests. We dive into the details below. A write-up on the ICML'24 paper by Zhai et al.: Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations. Acknowledgements: This post was written by Tullie Murrell, with review and edits from Jiaqi Zhai. All figures are from the paper. From music streaming services to e-commerce giants, recommendation systems are the invisible hand guiding our online experiences. For almost a decade, Deep Learning Recommendation Models (DLRMs) have been state-of-the-art for analyzing our every click and purchase to predict our next desires. But unlike the Transformer architectures used to power large language models (e.g. ChatGPT), DLRMs scale poorly
Is this the ChatGPT moment for recommendation systems? Researchers at Meta recently published a ground-breaking paper that combines the technology behind ChatGPT with Recommender Systems. They show they can scale these models up to 1.5 trillion parameters and demonstrate a 12.4% increase in topline metrics in production A/B tests. We dive into the details below. Jun 5, 2024 | 10 min read by Tullie Murrell A write-up on the ICML’24 paper by Zhai et al.: Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations . Acknowledgements: This post was wri
Explore this link on the map →related reading
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- GenAI Handbookgenai-handbook.github.io
- Recommendation System Series Part 3: The 6 Research Directions of Deep Recommendation Systems That... | Towards Data Sciencetowardsdatascience.com
- Wide & Deep Learning for Recommender Systems | by Atul Anand | Analytics Vidhya | Mediummedium.com
- Beyond “People Also Liked”: Building Intelligent Food Recommenders with LLMs | by Faisal Hussain Sabir | Mediummedium.com
- Composer2.pdfcursor.com
- Recommendation System Series Part 2: The 10 Categories of Deep Recommendation Systems That... | Towards Data Sciencetowardsdatascience.com
- Just Ask for Generalization | Eric Jangevjang.com
- [2505.10831] Creating General User Models from Computer Usearxiv.org
- How to build production-ready Recommender Systemstheneuralmaze.substack.com
- Graph Convolutional Neural Networks for Web-Scale Recommender Systemsarxiv.org
- Generative AI's Act o1: The Reasoning Era Begins | Sequoia Capitalsequoiacap.com