Slide 1
static.googleusercontent.com · 3,823 words · saved by 1 readers
N/A
Challenges in Building Large-Scale Information Retrieval Systems Jeff Dean Google Fellow jeff@google.com Why Work on Retrieval Systems? • Challenging blend of science and engineering – Many interesting, unsolved problems – Spans many areas of CS: • architecture, distributed systems, algorithms, compression, information retrieval, machine learning, UI, etc. – Scale far larger than most other systems • Small teams can create systems used by hundreds of millions Retrieval System Dimensions •…
related reading
- Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
- The Anatomy of a Search Engineinfolab.stanford.edu
- Everything I know about good system designseangoedecke.com
- Searchjzhao.xyz
- abseil / Performance Hintsabseil.io
- Building and operating a pretty big storage system called S3 | All Things Distributedallthingsdistributed.com
- How to design resilient and large scale data systemsblog.dataengineer.io
- Spending Inference Time - Kevin Lukevinlu.ai
- I could do that in a weekend!danluu.com
- On the Theoretical Limitations of Embedding-Based Retrievalarxiv.org
- CRDTs go brrrjosephg.com
- Hermes: Algorithm-System Co-design for Efficient Retrieval-Augmented Generation At-Scalemichaeltshen.github.io