System Design for Recommendations and Search

Breaking it into offline vs. online environments, and candidate retrieval vs. ranking steps.

System Design for Recommendations and Search eugeneyan Start Here Writing Speaking Prototyping About System Design for Recommendations and Search [ teardown production engineering recsys 🔥 ] · 13 min read Also translated to Korean thanks to Zimin Park. How do the system designs for industrial recommendations and search look like? It’s uncommon to see system design discussed in machine learning papers or blogs; most focus on model design, training data, and/or loss functions. Nonetheless, the handful of papers that discuss implementation details elucidate design patterns and best practices tha

related reading

• How to build production-ready Recommender Systemstheneuralmaze.substack.com
• Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
• The Anatomy of a Search Engineinfolab.stanford.edu
• Tensorflow deep retrieval using Two Towers architecture | Google Cloud Blogcloud.google.com
• Personalized recommendations - IV (two tower models for retrieval)linkedin.com
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• [1904.06813] Personalized Re-ranking for Recommendationarxiv.org
• Our AI Research: How We Evaluate Semantic Search Technology | Exa Blogexa.ai
• Read in smrysmry.ai
• GitHub - donnemartin/system-design-primer: Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.github.com
• Navigate, don't search | thesephist.comthesephist.com
• Rerankers and Two-Stage Retrieval | Pineconepinecone.io