[2401.09350] Foundations of Vector Retrieval
Abstract:Vectors are universal mathematical objects that can represent text, images, speech, or a mix of these data modalities. That happens regardless of whether data is represented by hand-crafted features or learnt embeddings. Collect a large enough quantity of such vectors and the question of retrieval becomes urgently relevant: Finding vectors that are more similar to a query vector. This monograph is concerned with the question above and covers fundamental concepts along with advanced data structures and algorithms for vector retrieval. In doing so, it recaps this fascinating topic and lowers barriers of entry into this rich area of research.
View PDF HTML (experimental) Abstract:Vectors are universal mathematical objects that can represent text, images, speech, or a mix of these data modalities. That happens regardless of whether data is represented by hand-crafted features or learnt embeddings. Collect a large enough quantity of such vectors and the question of retrieval becomes urgently relevant: Finding vectors that are more similar to a query vector. This monograph is concerned with the question above and covers fundamental concepts along with advanced data structures and algorithms for vector retrieval. In doing so, it…
saved by
related reading
- Machine Learning for Inverse Problems and Data Assimilationarxiv.org
- [2508.21038] On the Theoretical Limitations of Embedding-Based Retrievalarxiv.org
- On the Theoretical Limitations of Embedding-Based Retrievalarxiv.org
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- Foundations of Computer Visionvisionbook.mit.edu
- [2603.07146] Fine-Grained Table Retrieval Through the Lens of Complex Queriesarxiv.org
- On the Theoretical Limitations of Embedding-Based Retrievalarxiv.org
- Not All Vector Databases Are Made Equal | Towards Data Sciencetowardsdatascience.com
- 1301.3781arxiv.org
- Announcing ScaNN: Efficient Vector Similarity Searchai.googleblog.com
- Harnessing the Universal Geometry of Embeddingsarxiv.org
- [2205.13147] Matryoshka Representation Learningarxiv.org